Jun 11 23:07:51.086199 np0000002687 systemd[1]: Started devstack@n-cpu.service - Devstack devstack@n-cpu.service. Jun 11 23:07:52.834613 np0000002687 nova-compute[98431]: DEBUG os_vif [-] Loaded VIF plugin class '' with name 'noop' {{(pid=98431) initialize /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:54}} Jun 11 23:07:52.835465 np0000002687 nova-compute[98431]: DEBUG os_vif [-] Loaded VIF plugin class '' with name 'ovs' {{(pid=98431) initialize /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:54}} Jun 11 23:07:52.835465 np0000002687 nova-compute[98431]: INFO os_vif [-] Loaded VIF plugins: noop, ovs Jun 11 23:07:52.964777 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:07:52.975170 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.010s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:07:53.023891 np0000002687 nova-compute[98431]: INFO oslo_service.periodic_task [-] Skipping periodic task _heal_instance_info_cache because its interval is negative Jun 11 23:07:53.765773 np0000002687 nova-compute[98431]: WARNING nova.compute.manager [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] In native threading mode the number of concurrent builds, and snapshots should be limited to the same number. The current configuration has differing limits: max_concurrent_builds: 10, max_concurrent_snapshots: 5. Nova will use a single, overall limit of 10 for these tasks. Jun 11 23:07:53.765965 np0000002687 nova-compute[98431]: INFO nova.utils [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] The long task thread pool MainProcess.long_task is initialized Jun 11 23:07:53.766229 np0000002687 nova-compute[98431]: INFO nova.virt.driver [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] Loading compute driver 'libvirt.LibvirtDriver' Jun 11 23:07:53.963908 np0000002687 nova-compute[98431]: INFO nova.compute.provider_config [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access. Jun 11 23:07:54.466338 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] Acquiring lock "singleton_lock" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 11 23:07:54.466338 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] Acquired lock "singleton_lock" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 11 23:07:54.466338 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] Releasing lock "singleton_lock" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 11 23:07:54.466555 np0000002687 nova-compute[98431]: WARNING oslo_service.backend._threading.service [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] no_fork=True: running service in main process Jun 11 23:07:54.466906 np0000002687 nova-compute[98431]: INFO nova.service [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] Starting compute node (version 33.1.0) Jun 11 23:07:54.969834 np0000002687 nova-compute[98431]: INFO nova.utils [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] The default thread pool MainProcess.default is initialized Jun 11 23:07:54.970388 np0000002687 nova-compute[98431]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:07:54.970643 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] Starting event thread {{(pid=98431) start /opt/stack/nova/nova/virt/libvirt/host.py:251}} Jun 11 23:07:54.971051 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] Starting connection event dispatch thread {{(pid=98431) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:552}} Jun 11 23:07:54.971810 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] Connecting to libvirt: qemu:///system {{(pid=98431) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:557}} Jun 11 23:07:55.573452 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] Registering for lifecycle events {{(pid=98431) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:563}} Jun 11 23:07:55.574490 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] Registering for connection events: {{(pid=98431) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:584}} Jun 11 23:07:55.575110 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] Connection event '1' reason 'None' Jun 11 23:07:56.078734 np0000002687 nova-compute[98431]: WARNING nova.virt.libvirt.driver [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] Cannot update service status on host "np0000002687" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host np0000002687 could not be found. Jun 11 23:07:56.079123 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.volume.mount [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] Initialising _HostMountState generation 0 {{(pid=98431) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}} Jun 11 23:08:05.698125 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.host [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] Libvirt host capabilities Jun 11 23:08:05.698125 np0000002687 nova-compute[98431]: Jun 11 23:08:05.698125 np0000002687 nova-compute[98431]: ad465dfe-0ed1-4637-98c3-ddaebebd61a4 Jun 11 23:08:05.698125 np0000002687 nova-compute[98431]: Jun 11 23:08:05.698125 np0000002687 nova-compute[98431]: x86_64 Jun 11 23:08:05.698125 np0000002687 nova-compute[98431]: EPYC-Milan Jun 11 23:08:05.698125 np0000002687 nova-compute[98431]: AMD Jun 11 23:08:05.698125 np0000002687 nova-compute[98431]: Jun 11 23:08:05.698125 np0000002687 nova-compute[98431]: Jun 11 23:08:05.698125 np0000002687 nova-compute[98431]: Jun 11 23:08:05.698125 np0000002687 nova-compute[98431]: Jun 11 23:08:05.698125 np0000002687 nova-compute[98431]: Jun 11 23:08:05.698125 np0000002687 nova-compute[98431]: Jun 11 23:08:05.698125 np0000002687 nova-compute[98431]: Jun 11 23:08:05.698125 np0000002687 nova-compute[98431]: Jun 11 23:08:05.698125 np0000002687 nova-compute[98431]: Jun 11 23:08:05.698125 np0000002687 nova-compute[98431]: Jun 11 23:08:05.698125 np0000002687 nova-compute[98431]: Jun 11 23:08:05.698125 np0000002687 nova-compute[98431]: Jun 11 23:08:05.698125 np0000002687 nova-compute[98431]: Jun 11 23:08:05.698125 np0000002687 nova-compute[98431]: Jun 11 23:08:05.698125 np0000002687 nova-compute[98431]: Jun 11 23:08:05.698125 np0000002687 nova-compute[98431]: Jun 11 23:08:05.698125 np0000002687 nova-compute[98431]: Jun 11 23:08:05.698125 np0000002687 nova-compute[98431]: Jun 11 23:08:05.698125 np0000002687 nova-compute[98431]: Jun 11 23:08:05.698125 np0000002687 nova-compute[98431]: Jun 11 23:08:05.698125 np0000002687 nova-compute[98431]: Jun 11 23:08:05.698125 np0000002687 nova-compute[98431]: Jun 11 23:08:05.698125 np0000002687 nova-compute[98431]: Jun 11 23:08:05.698125 np0000002687 nova-compute[98431]: Jun 11 23:08:05.698125 np0000002687 nova-compute[98431]: Jun 11 23:08:05.698125 np0000002687 nova-compute[98431]: Jun 11 23:08:05.698125 np0000002687 nova-compute[98431]: Jun 11 23:08:05.698125 np0000002687 nova-compute[98431]: Jun 11 23:08:05.698125 np0000002687 nova-compute[98431]: Jun 11 23:08:05.698125 np0000002687 nova-compute[98431]: Jun 11 23:08:05.698125 np0000002687 nova-compute[98431]: Jun 11 23:08:05.698125 np0000002687 nova-compute[98431]: Jun 11 23:08:05.698125 np0000002687 nova-compute[98431]: Jun 11 23:08:05.698125 np0000002687 nova-compute[98431]: Jun 11 23:08:05.698125 np0000002687 nova-compute[98431]: Jun 11 23:08:05.698125 np0000002687 nova-compute[98431]: Jun 11 23:08:05.698125 np0000002687 nova-compute[98431]: Jun 11 23:08:05.698125 np0000002687 nova-compute[98431]: Jun 11 23:08:05.698125 np0000002687 nova-compute[98431]: Jun 11 23:08:05.698125 np0000002687 nova-compute[98431]: Jun 11 23:08:05.698125 np0000002687 nova-compute[98431]: Jun 11 23:08:05.698125 np0000002687 nova-compute[98431]: Jun 11 23:08:05.698125 np0000002687 nova-compute[98431]: Jun 11 23:08:05.698125 np0000002687 nova-compute[98431]: Jun 11 23:08:05.698125 np0000002687 nova-compute[98431]: Jun 11 23:08:05.698125 np0000002687 nova-compute[98431]: Jun 11 23:08:05.698125 np0000002687 nova-compute[98431]: tcp Jun 11 23:08:05.698125 np0000002687 nova-compute[98431]: rdma Jun 11 23:08:05.698125 np0000002687 nova-compute[98431]: Jun 11 23:08:05.698125 np0000002687 nova-compute[98431]: Jun 11 23:08:05.699720 np0000002687 nova-compute[98431]: Jun 11 23:08:05.699720 np0000002687 nova-compute[98431]: Jun 11 23:08:05.699720 np0000002687 nova-compute[98431]: Jun 11 23:08:05.699720 np0000002687 nova-compute[98431]: 24607188 Jun 11 23:08:05.699720 np0000002687 nova-compute[98431]: 6151797 Jun 11 23:08:05.699720 np0000002687 nova-compute[98431]: 0 Jun 11 23:08:05.699720 np0000002687 nova-compute[98431]: 0 Jun 11 23:08:05.699720 np0000002687 nova-compute[98431]: Jun 11 23:08:05.699720 np0000002687 nova-compute[98431]: Jun 11 23:08:05.699720 np0000002687 nova-compute[98431]: Jun 11 23:08:05.699720 np0000002687 nova-compute[98431]: Jun 11 23:08:05.699720 np0000002687 nova-compute[98431]: Jun 11 23:08:05.699720 np0000002687 nova-compute[98431]: Jun 11 23:08:05.699720 np0000002687 nova-compute[98431]: Jun 11 23:08:05.699720 np0000002687 nova-compute[98431]: Jun 11 23:08:05.699720 np0000002687 nova-compute[98431]: Jun 11 23:08:05.699720 np0000002687 nova-compute[98431]: Jun 11 23:08:05.699720 np0000002687 nova-compute[98431]: Jun 11 23:08:05.699720 np0000002687 nova-compute[98431]: Jun 11 23:08:05.699720 np0000002687 nova-compute[98431]: Jun 11 23:08:05.699720 np0000002687 nova-compute[98431]: Jun 11 23:08:05.699720 np0000002687 nova-compute[98431]: Jun 11 23:08:05.699720 np0000002687 nova-compute[98431]: Jun 11 23:08:05.699720 np0000002687 nova-compute[98431]: Jun 11 23:08:05.699720 np0000002687 nova-compute[98431]: Jun 11 23:08:05.699720 np0000002687 nova-compute[98431]: Jun 11 23:08:05.699720 np0000002687 nova-compute[98431]: Jun 11 23:08:05.699720 np0000002687 nova-compute[98431]: Jun 11 23:08:05.699720 np0000002687 nova-compute[98431]: Jun 11 23:08:05.699720 np0000002687 nova-compute[98431]: Jun 11 23:08:05.699720 np0000002687 nova-compute[98431]: Jun 11 23:08:05.699720 np0000002687 nova-compute[98431]: Jun 11 23:08:05.699720 np0000002687 nova-compute[98431]: Jun 11 23:08:05.699720 np0000002687 nova-compute[98431]: Jun 11 23:08:05.699720 np0000002687 nova-compute[98431]: Jun 11 23:08:05.699720 np0000002687 nova-compute[98431]: Jun 11 23:08:05.699720 np0000002687 nova-compute[98431]: Jun 11 23:08:05.700568 np0000002687 nova-compute[98431]: Jun 11 23:08:05.700568 np0000002687 nova-compute[98431]: Jun 11 23:08:05.700568 np0000002687 nova-compute[98431]: Jun 11 23:08:05.700568 np0000002687 nova-compute[98431]: Jun 11 23:08:05.700568 np0000002687 nova-compute[98431]: Jun 11 23:08:05.700568 np0000002687 nova-compute[98431]: apparmor Jun 11 23:08:05.700568 np0000002687 nova-compute[98431]: 0 Jun 11 23:08:05.700568 np0000002687 nova-compute[98431]: Jun 11 23:08:05.700568 np0000002687 nova-compute[98431]: Jun 11 23:08:05.700568 np0000002687 nova-compute[98431]: dac Jun 11 23:08:05.700568 np0000002687 nova-compute[98431]: 0 Jun 11 23:08:05.700568 np0000002687 nova-compute[98431]: +64055:+993 Jun 11 23:08:05.700568 np0000002687 nova-compute[98431]: +64055:+993 Jun 11 23:08:05.700568 np0000002687 nova-compute[98431]: Jun 11 23:08:05.700568 np0000002687 nova-compute[98431]: Jun 11 23:08:05.700568 np0000002687 nova-compute[98431]: Jun 11 23:08:05.700568 np0000002687 nova-compute[98431]: hvm Jun 11 23:08:05.700568 np0000002687 nova-compute[98431]: Jun 11 23:08:05.700568 np0000002687 nova-compute[98431]: 64 Jun 11 23:08:05.700568 np0000002687 nova-compute[98431]: /usr/bin/qemu-system-alpha Jun 11 23:08:05.700568 np0000002687 nova-compute[98431]: clipper Jun 11 23:08:05.700568 np0000002687 nova-compute[98431]: Jun 11 23:08:05.700568 np0000002687 nova-compute[98431]: Jun 11 23:08:05.700568 np0000002687 nova-compute[98431]: Jun 11 23:08:05.700568 np0000002687 nova-compute[98431]: Jun 11 23:08:05.700568 np0000002687 nova-compute[98431]: Jun 11 23:08:05.700568 np0000002687 nova-compute[98431]: Jun 11 23:08:05.700568 np0000002687 nova-compute[98431]: Jun 11 23:08:05.700568 np0000002687 nova-compute[98431]: Jun 11 23:08:05.700568 np0000002687 nova-compute[98431]: Jun 11 23:08:05.700568 np0000002687 nova-compute[98431]: Jun 11 23:08:05.700568 np0000002687 nova-compute[98431]: hvm Jun 11 23:08:05.700568 np0000002687 nova-compute[98431]: Jun 11 23:08:05.700568 np0000002687 nova-compute[98431]: 32 Jun 11 23:08:05.700568 np0000002687 nova-compute[98431]: /usr/bin/qemu-system-arm Jun 11 23:08:05.700568 np0000002687 nova-compute[98431]: virt-8.2 Jun 11 23:08:05.700568 np0000002687 nova-compute[98431]: virt Jun 11 23:08:05.700568 np0000002687 nova-compute[98431]: qcom-dc-scm-v1-bmc Jun 11 23:08:05.700568 np0000002687 nova-compute[98431]: mori-bmc Jun 11 23:08:05.700568 np0000002687 nova-compute[98431]: ast2600-evb Jun 11 23:08:05.700568 np0000002687 nova-compute[98431]: borzoi Jun 11 23:08:05.700568 np0000002687 nova-compute[98431]: tiogapass-bmc Jun 11 23:08:05.700568 np0000002687 nova-compute[98431]: spitz Jun 11 23:08:05.700568 np0000002687 nova-compute[98431]: virt-2.7 Jun 11 23:08:05.700568 np0000002687 nova-compute[98431]: nuri Jun 11 23:08:05.700568 np0000002687 nova-compute[98431]: mcimx7d-sabre Jun 11 23:08:05.700568 np0000002687 nova-compute[98431]: romulus-bmc Jun 11 23:08:05.700568 np0000002687 nova-compute[98431]: virt-3.0 Jun 11 23:08:05.700568 np0000002687 nova-compute[98431]: virt-5.0 Jun 11 23:08:05.700568 np0000002687 nova-compute[98431]: npcm750-evb Jun 11 23:08:05.700568 np0000002687 nova-compute[98431]: virt-2.10 Jun 11 23:08:05.700568 np0000002687 nova-compute[98431]: rainier-bmc Jun 11 23:08:05.700568 np0000002687 nova-compute[98431]: mps3-an547 Jun 11 23:08:05.700568 np0000002687 nova-compute[98431]: musca-b1 Jun 11 23:08:05.700568 np0000002687 nova-compute[98431]: realview-pbx-a9 Jun 11 23:08:05.701761 np0000002687 nova-compute[98431]: versatileab Jun 11 23:08:05.701761 np0000002687 nova-compute[98431]: kzm Jun 11 23:08:05.701761 np0000002687 nova-compute[98431]: virt-2.8 Jun 11 23:08:05.701761 np0000002687 nova-compute[98431]: fby35-bmc Jun 11 23:08:05.701761 np0000002687 nova-compute[98431]: musca-a Jun 11 23:08:05.701761 np0000002687 nova-compute[98431]: virt-3.1 Jun 11 23:08:05.701761 np0000002687 nova-compute[98431]: mcimx6ul-evk Jun 11 23:08:05.701761 np0000002687 nova-compute[98431]: virt-5.1 Jun 11 23:08:05.701761 np0000002687 nova-compute[98431]: smdkc210 Jun 11 23:08:05.701761 np0000002687 nova-compute[98431]: sx1 Jun 11 23:08:05.701761 np0000002687 nova-compute[98431]: virt-2.11 Jun 11 23:08:05.701761 np0000002687 nova-compute[98431]: imx25-pdk Jun 11 23:08:05.701761 np0000002687 nova-compute[98431]: stm32vldiscovery Jun 11 23:08:05.701761 np0000002687 nova-compute[98431]: virt-2.9 Jun 11 23:08:05.701761 np0000002687 nova-compute[98431]: orangepi-pc Jun 11 23:08:05.701761 np0000002687 nova-compute[98431]: quanta-q71l-bmc Jun 11 23:08:05.701761 np0000002687 nova-compute[98431]: z2 Jun 11 23:08:05.701761 np0000002687 nova-compute[98431]: virt-5.2 Jun 11 23:08:05.701761 np0000002687 nova-compute[98431]: xilinx-zynq-a9 Jun 11 23:08:05.701761 np0000002687 nova-compute[98431]: tosa Jun 11 23:08:05.701761 np0000002687 nova-compute[98431]: mps2-an500 Jun 11 23:08:05.701761 np0000002687 nova-compute[98431]: virt-2.12 Jun 11 23:08:05.701761 np0000002687 nova-compute[98431]: mps2-an521 Jun 11 23:08:05.701761 np0000002687 nova-compute[98431]: sabrelite Jun 11 23:08:05.701761 np0000002687 nova-compute[98431]: mps2-an511 Jun 11 23:08:05.701761 np0000002687 nova-compute[98431]: canon-a1100 Jun 11 23:08:05.701761 np0000002687 nova-compute[98431]: realview-eb Jun 11 23:08:05.701761 np0000002687 nova-compute[98431]: quanta-gbs-bmc Jun 11 23:08:05.701761 np0000002687 nova-compute[98431]: emcraft-sf2 Jun 11 23:08:05.701761 np0000002687 nova-compute[98431]: realview-pb-a8 Jun 11 23:08:05.701761 np0000002687 nova-compute[98431]: yosemitev2-bmc Jun 11 23:08:05.701761 np0000002687 nova-compute[98431]: virt-7.0 Jun 11 23:08:05.701761 np0000002687 nova-compute[98431]: virt-4.0 Jun 11 23:08:05.701761 np0000002687 nova-compute[98431]: raspi1ap Jun 11 23:08:05.701761 np0000002687 nova-compute[98431]: palmetto-bmc Jun 11 23:08:05.701761 np0000002687 nova-compute[98431]: sx1-v1 Jun 11 23:08:05.701761 np0000002687 nova-compute[98431]: n810 Jun 11 23:08:05.701761 np0000002687 nova-compute[98431]: g220a-bmc Jun 11 23:08:05.701761 np0000002687 nova-compute[98431]: n800 Jun 11 23:08:05.701761 np0000002687 nova-compute[98431]: bletchley-bmc Jun 11 23:08:05.701761 np0000002687 nova-compute[98431]: virt-7.1 Jun 11 23:08:05.701761 np0000002687 nova-compute[98431]: tacoma-bmc Jun 11 23:08:05.701761 np0000002687 nova-compute[98431]: virt-4.1 Jun 11 23:08:05.702577 np0000002687 nova-compute[98431]: quanta-gsj Jun 11 23:08:05.702577 np0000002687 nova-compute[98431]: versatilepb Jun 11 23:08:05.702577 np0000002687 nova-compute[98431]: terrier Jun 11 23:08:05.702577 np0000002687 nova-compute[98431]: mainstone Jun 11 23:08:05.702577 np0000002687 nova-compute[98431]: realview-eb-mpcore Jun 11 23:08:05.702577 np0000002687 nova-compute[98431]: integratorcp Jun 11 23:08:05.702577 np0000002687 nova-compute[98431]: virt-7.2 Jun 11 23:08:05.702577 np0000002687 nova-compute[98431]: supermicrox11-bmc Jun 11 23:08:05.702577 np0000002687 nova-compute[98431]: virt-4.2 Jun 11 23:08:05.702577 np0000002687 nova-compute[98431]: witherspoon-bmc Jun 11 23:08:05.702577 np0000002687 nova-compute[98431]: qcom-firework-bmc Jun 11 23:08:05.702577 np0000002687 nova-compute[98431]: mps3-an524 Jun 11 23:08:05.702577 np0000002687 nova-compute[98431]: kudo-bmc Jun 11 23:08:05.702577 np0000002687 nova-compute[98431]: vexpress-a9 Jun 11 23:08:05.702577 np0000002687 nova-compute[98431]: midway Jun 11 23:08:05.702577 np0000002687 nova-compute[98431]: musicpal Jun 11 23:08:05.702577 np0000002687 nova-compute[98431]: lm3s811evb Jun 11 23:08:05.702577 np0000002687 nova-compute[98431]: lm3s6965evb Jun 11 23:08:05.702577 np0000002687 nova-compute[98431]: supermicro-x11spi-bmc Jun 11 23:08:05.702577 np0000002687 nova-compute[98431]: microbit Jun 11 23:08:05.702577 np0000002687 nova-compute[98431]: fby35 Jun 11 23:08:05.702577 np0000002687 nova-compute[98431]: mps2-an505 Jun 11 23:08:05.702577 np0000002687 nova-compute[98431]: mps2-an385 Jun 11 23:08:05.702577 np0000002687 nova-compute[98431]: virt-6.0 Jun 11 23:08:05.702577 np0000002687 nova-compute[98431]: virt-8.0 Jun 11 23:08:05.702577 np0000002687 nova-compute[98431]: cubieboard Jun 11 23:08:05.702577 np0000002687 nova-compute[98431]: ast1030-evb Jun 11 23:08:05.702577 np0000002687 nova-compute[98431]: verdex Jun 11 23:08:05.702577 np0000002687 nova-compute[98431]: bpim2u Jun 11 23:08:05.702577 np0000002687 nova-compute[98431]: netduino2 Jun 11 23:08:05.702577 np0000002687 nova-compute[98431]: mps2-an386 Jun 11 23:08:05.702577 np0000002687 nova-compute[98431]: olimex-stm32-h405 Jun 11 23:08:05.702577 np0000002687 nova-compute[98431]: virt-6.1 Jun 11 23:08:05.702577 np0000002687 nova-compute[98431]: virt-8.1 Jun 11 23:08:05.702577 np0000002687 nova-compute[98431]: raspi2b Jun 11 23:08:05.702577 np0000002687 nova-compute[98431]: vexpress-a15 Jun 11 23:08:05.702577 np0000002687 nova-compute[98431]: fuji-bmc Jun 11 23:08:05.702577 np0000002687 nova-compute[98431]: virt-6.2 Jun 11 23:08:05.702577 np0000002687 nova-compute[98431]: sonorapass-bmc Jun 11 23:08:05.702577 np0000002687 nova-compute[98431]: cheetah Jun 11 23:08:05.702577 np0000002687 nova-compute[98431]: virt-2.6 Jun 11 23:08:05.702577 np0000002687 nova-compute[98431]: ast2500-evb Jun 11 23:08:05.703326 np0000002687 nova-compute[98431]: highbank Jun 11 23:08:05.703326 np0000002687 nova-compute[98431]: akita Jun 11 23:08:05.703326 np0000002687 nova-compute[98431]: connex Jun 11 23:08:05.703326 np0000002687 nova-compute[98431]: netduinoplus2 Jun 11 23:08:05.703326 np0000002687 nova-compute[98431]: collie Jun 11 23:08:05.703326 np0000002687 nova-compute[98431]: raspi0 Jun 11 23:08:05.703326 np0000002687 nova-compute[98431]: fp5280g2-bmc Jun 11 23:08:05.703326 np0000002687 nova-compute[98431]: Jun 11 23:08:05.703326 np0000002687 nova-compute[98431]: Jun 11 23:08:05.703326 np0000002687 nova-compute[98431]: Jun 11 23:08:05.703326 np0000002687 nova-compute[98431]: Jun 11 23:08:05.703326 np0000002687 nova-compute[98431]: Jun 11 23:08:05.703326 np0000002687 nova-compute[98431]: Jun 11 23:08:05.703326 np0000002687 nova-compute[98431]: Jun 11 23:08:05.703326 np0000002687 nova-compute[98431]: Jun 11 23:08:05.703326 np0000002687 nova-compute[98431]: Jun 11 23:08:05.703326 np0000002687 nova-compute[98431]: Jun 11 23:08:05.703326 np0000002687 nova-compute[98431]: hvm Jun 11 23:08:05.703326 np0000002687 nova-compute[98431]: Jun 11 23:08:05.703326 np0000002687 nova-compute[98431]: 32 Jun 11 23:08:05.703326 np0000002687 nova-compute[98431]: /usr/bin/qemu-system-arm Jun 11 23:08:05.703326 np0000002687 nova-compute[98431]: virt-8.2 Jun 11 23:08:05.703326 np0000002687 nova-compute[98431]: virt Jun 11 23:08:05.703326 np0000002687 nova-compute[98431]: qcom-dc-scm-v1-bmc Jun 11 23:08:05.703326 np0000002687 nova-compute[98431]: mori-bmc Jun 11 23:08:05.703326 np0000002687 nova-compute[98431]: ast2600-evb Jun 11 23:08:05.703326 np0000002687 nova-compute[98431]: borzoi Jun 11 23:08:05.703326 np0000002687 nova-compute[98431]: tiogapass-bmc Jun 11 23:08:05.703326 np0000002687 nova-compute[98431]: spitz Jun 11 23:08:05.703326 np0000002687 nova-compute[98431]: virt-2.7 Jun 11 23:08:05.703326 np0000002687 nova-compute[98431]: nuri Jun 11 23:08:05.703326 np0000002687 nova-compute[98431]: mcimx7d-sabre Jun 11 23:08:05.703326 np0000002687 nova-compute[98431]: romulus-bmc Jun 11 23:08:05.703326 np0000002687 nova-compute[98431]: virt-3.0 Jun 11 23:08:05.703326 np0000002687 nova-compute[98431]: virt-5.0 Jun 11 23:08:05.703326 np0000002687 nova-compute[98431]: npcm750-evb Jun 11 23:08:05.703326 np0000002687 nova-compute[98431]: virt-2.10 Jun 11 23:08:05.703326 np0000002687 nova-compute[98431]: rainier-bmc Jun 11 23:08:05.703326 np0000002687 nova-compute[98431]: mps3-an547 Jun 11 23:08:05.703326 np0000002687 nova-compute[98431]: musca-b1 Jun 11 23:08:05.703326 np0000002687 nova-compute[98431]: realview-pbx-a9 Jun 11 23:08:05.703326 np0000002687 nova-compute[98431]: versatileab Jun 11 23:08:05.703326 np0000002687 nova-compute[98431]: kzm Jun 11 23:08:05.703326 np0000002687 nova-compute[98431]: virt-2.8 Jun 11 23:08:05.703326 np0000002687 nova-compute[98431]: fby35-bmc Jun 11 23:08:05.703326 np0000002687 nova-compute[98431]: musca-a Jun 11 23:08:05.703326 np0000002687 nova-compute[98431]: virt-3.1 Jun 11 23:08:05.703326 np0000002687 nova-compute[98431]: mcimx6ul-evk Jun 11 23:08:05.703326 np0000002687 nova-compute[98431]: virt-5.1 Jun 11 23:08:05.704174 np0000002687 nova-compute[98431]: smdkc210 Jun 11 23:08:05.704174 np0000002687 nova-compute[98431]: sx1 Jun 11 23:08:05.704174 np0000002687 nova-compute[98431]: virt-2.11 Jun 11 23:08:05.704174 np0000002687 nova-compute[98431]: imx25-pdk Jun 11 23:08:05.704174 np0000002687 nova-compute[98431]: stm32vldiscovery Jun 11 23:08:05.704174 np0000002687 nova-compute[98431]: virt-2.9 Jun 11 23:08:05.704174 np0000002687 nova-compute[98431]: orangepi-pc Jun 11 23:08:05.704174 np0000002687 nova-compute[98431]: quanta-q71l-bmc Jun 11 23:08:05.704174 np0000002687 nova-compute[98431]: z2 Jun 11 23:08:05.704174 np0000002687 nova-compute[98431]: virt-5.2 Jun 11 23:08:05.704174 np0000002687 nova-compute[98431]: xilinx-zynq-a9 Jun 11 23:08:05.704174 np0000002687 nova-compute[98431]: tosa Jun 11 23:08:05.704174 np0000002687 nova-compute[98431]: mps2-an500 Jun 11 23:08:05.704174 np0000002687 nova-compute[98431]: virt-2.12 Jun 11 23:08:05.704174 np0000002687 nova-compute[98431]: mps2-an521 Jun 11 23:08:05.704174 np0000002687 nova-compute[98431]: sabrelite Jun 11 23:08:05.704174 np0000002687 nova-compute[98431]: mps2-an511 Jun 11 23:08:05.704174 np0000002687 nova-compute[98431]: canon-a1100 Jun 11 23:08:05.704174 np0000002687 nova-compute[98431]: realview-eb Jun 11 23:08:05.704174 np0000002687 nova-compute[98431]: quanta-gbs-bmc Jun 11 23:08:05.704174 np0000002687 nova-compute[98431]: emcraft-sf2 Jun 11 23:08:05.704174 np0000002687 nova-compute[98431]: realview-pb-a8 Jun 11 23:08:05.704174 np0000002687 nova-compute[98431]: yosemitev2-bmc Jun 11 23:08:05.704174 np0000002687 nova-compute[98431]: virt-7.0 Jun 11 23:08:05.704174 np0000002687 nova-compute[98431]: virt-4.0 Jun 11 23:08:05.704174 np0000002687 nova-compute[98431]: raspi1ap Jun 11 23:08:05.704174 np0000002687 nova-compute[98431]: palmetto-bmc Jun 11 23:08:05.704174 np0000002687 nova-compute[98431]: sx1-v1 Jun 11 23:08:05.704174 np0000002687 nova-compute[98431]: n810 Jun 11 23:08:05.704174 np0000002687 nova-compute[98431]: g220a-bmc Jun 11 23:08:05.704174 np0000002687 nova-compute[98431]: n800 Jun 11 23:08:05.704174 np0000002687 nova-compute[98431]: bletchley-bmc Jun 11 23:08:05.704174 np0000002687 nova-compute[98431]: virt-7.1 Jun 11 23:08:05.704174 np0000002687 nova-compute[98431]: tacoma-bmc Jun 11 23:08:05.704174 np0000002687 nova-compute[98431]: virt-4.1 Jun 11 23:08:05.704174 np0000002687 nova-compute[98431]: quanta-gsj Jun 11 23:08:05.704174 np0000002687 nova-compute[98431]: versatilepb Jun 11 23:08:05.704174 np0000002687 nova-compute[98431]: terrier Jun 11 23:08:05.704174 np0000002687 nova-compute[98431]: mainstone Jun 11 23:08:05.704174 np0000002687 nova-compute[98431]: realview-eb-mpcore Jun 11 23:08:05.704174 np0000002687 nova-compute[98431]: integratorcp Jun 11 23:08:05.704174 np0000002687 nova-compute[98431]: virt-7.2 Jun 11 23:08:05.705957 np0000002687 nova-compute[98431]: supermicrox11-bmc Jun 11 23:08:05.705957 np0000002687 nova-compute[98431]: virt-4.2 Jun 11 23:08:05.705957 np0000002687 nova-compute[98431]: witherspoon-bmc Jun 11 23:08:05.705957 np0000002687 nova-compute[98431]: qcom-firework-bmc Jun 11 23:08:05.705957 np0000002687 nova-compute[98431]: mps3-an524 Jun 11 23:08:05.705957 np0000002687 nova-compute[98431]: kudo-bmc Jun 11 23:08:05.705957 np0000002687 nova-compute[98431]: vexpress-a9 Jun 11 23:08:05.705957 np0000002687 nova-compute[98431]: midway Jun 11 23:08:05.705957 np0000002687 nova-compute[98431]: musicpal Jun 11 23:08:05.705957 np0000002687 nova-compute[98431]: lm3s811evb Jun 11 23:08:05.705957 np0000002687 nova-compute[98431]: lm3s6965evb Jun 11 23:08:05.705957 np0000002687 nova-compute[98431]: supermicro-x11spi-bmc Jun 11 23:08:05.705957 np0000002687 nova-compute[98431]: microbit Jun 11 23:08:05.705957 np0000002687 nova-compute[98431]: fby35 Jun 11 23:08:05.705957 np0000002687 nova-compute[98431]: mps2-an505 Jun 11 23:08:05.705957 np0000002687 nova-compute[98431]: mps2-an385 Jun 11 23:08:05.705957 np0000002687 nova-compute[98431]: virt-6.0 Jun 11 23:08:05.705957 np0000002687 nova-compute[98431]: virt-8.0 Jun 11 23:08:05.705957 np0000002687 nova-compute[98431]: cubieboard Jun 11 23:08:05.705957 np0000002687 nova-compute[98431]: ast1030-evb Jun 11 23:08:05.705957 np0000002687 nova-compute[98431]: verdex Jun 11 23:08:05.705957 np0000002687 nova-compute[98431]: bpim2u Jun 11 23:08:05.705957 np0000002687 nova-compute[98431]: netduino2 Jun 11 23:08:05.705957 np0000002687 nova-compute[98431]: mps2-an386 Jun 11 23:08:05.705957 np0000002687 nova-compute[98431]: olimex-stm32-h405 Jun 11 23:08:05.705957 np0000002687 nova-compute[98431]: virt-6.1 Jun 11 23:08:05.705957 np0000002687 nova-compute[98431]: virt-8.1 Jun 11 23:08:05.705957 np0000002687 nova-compute[98431]: raspi2b Jun 11 23:08:05.705957 np0000002687 nova-compute[98431]: vexpress-a15 Jun 11 23:08:05.705957 np0000002687 nova-compute[98431]: fuji-bmc Jun 11 23:08:05.705957 np0000002687 nova-compute[98431]: virt-6.2 Jun 11 23:08:05.705957 np0000002687 nova-compute[98431]: sonorapass-bmc Jun 11 23:08:05.705957 np0000002687 nova-compute[98431]: cheetah Jun 11 23:08:05.705957 np0000002687 nova-compute[98431]: virt-2.6 Jun 11 23:08:05.705957 np0000002687 nova-compute[98431]: ast2500-evb Jun 11 23:08:05.705957 np0000002687 nova-compute[98431]: highbank Jun 11 23:08:05.705957 np0000002687 nova-compute[98431]: akita Jun 11 23:08:05.705957 np0000002687 nova-compute[98431]: connex Jun 11 23:08:05.705957 np0000002687 nova-compute[98431]: netduinoplus2 Jun 11 23:08:05.705957 np0000002687 nova-compute[98431]: collie Jun 11 23:08:05.705957 np0000002687 nova-compute[98431]: raspi0 Jun 11 23:08:05.705957 np0000002687 nova-compute[98431]: fp5280g2-bmc Jun 11 23:08:05.705957 np0000002687 nova-compute[98431]: Jun 11 23:08:05.706684 np0000002687 nova-compute[98431]: Jun 11 23:08:05.706684 np0000002687 nova-compute[98431]: Jun 11 23:08:05.706684 np0000002687 nova-compute[98431]: Jun 11 23:08:05.706684 np0000002687 nova-compute[98431]: Jun 11 23:08:05.706684 np0000002687 nova-compute[98431]: Jun 11 23:08:05.706684 np0000002687 nova-compute[98431]: Jun 11 23:08:05.706684 np0000002687 nova-compute[98431]: Jun 11 23:08:05.706684 np0000002687 nova-compute[98431]: Jun 11 23:08:05.706684 np0000002687 nova-compute[98431]: Jun 11 23:08:05.706684 np0000002687 nova-compute[98431]: hvm Jun 11 23:08:05.706684 np0000002687 nova-compute[98431]: Jun 11 23:08:05.706684 np0000002687 nova-compute[98431]: 64 Jun 11 23:08:05.706684 np0000002687 nova-compute[98431]: /usr/bin/qemu-system-aarch64 Jun 11 23:08:05.706684 np0000002687 nova-compute[98431]: virt-8.2 Jun 11 23:08:05.706684 np0000002687 nova-compute[98431]: virt Jun 11 23:08:05.706684 np0000002687 nova-compute[98431]: qcom-dc-scm-v1-bmc Jun 11 23:08:05.706684 np0000002687 nova-compute[98431]: mori-bmc Jun 11 23:08:05.706684 np0000002687 nova-compute[98431]: ast2600-evb Jun 11 23:08:05.706684 np0000002687 nova-compute[98431]: borzoi Jun 11 23:08:05.706684 np0000002687 nova-compute[98431]: tiogapass-bmc Jun 11 23:08:05.706684 np0000002687 nova-compute[98431]: spitz Jun 11 23:08:05.706684 np0000002687 nova-compute[98431]: virt-2.7 Jun 11 23:08:05.706684 np0000002687 nova-compute[98431]: nuri Jun 11 23:08:05.706684 np0000002687 nova-compute[98431]: mcimx7d-sabre Jun 11 23:08:05.706684 np0000002687 nova-compute[98431]: romulus-bmc Jun 11 23:08:05.706684 np0000002687 nova-compute[98431]: virt-3.0 Jun 11 23:08:05.706684 np0000002687 nova-compute[98431]: virt-5.0 Jun 11 23:08:05.706684 np0000002687 nova-compute[98431]: npcm750-evb Jun 11 23:08:05.706684 np0000002687 nova-compute[98431]: virt-2.10 Jun 11 23:08:05.706684 np0000002687 nova-compute[98431]: rainier-bmc Jun 11 23:08:05.706684 np0000002687 nova-compute[98431]: mps3-an547 Jun 11 23:08:05.706684 np0000002687 nova-compute[98431]: virt-2.8 Jun 11 23:08:05.706684 np0000002687 nova-compute[98431]: musca-b1 Jun 11 23:08:05.706684 np0000002687 nova-compute[98431]: realview-pbx-a9 Jun 11 23:08:05.706684 np0000002687 nova-compute[98431]: versatileab Jun 11 23:08:05.706684 np0000002687 nova-compute[98431]: kzm Jun 11 23:08:05.706684 np0000002687 nova-compute[98431]: fby35-bmc Jun 11 23:08:05.706684 np0000002687 nova-compute[98431]: musca-a Jun 11 23:08:05.706684 np0000002687 nova-compute[98431]: virt-3.1 Jun 11 23:08:05.706684 np0000002687 nova-compute[98431]: mcimx6ul-evk Jun 11 23:08:05.706684 np0000002687 nova-compute[98431]: virt-5.1 Jun 11 23:08:05.706684 np0000002687 nova-compute[98431]: smdkc210 Jun 11 23:08:05.706684 np0000002687 nova-compute[98431]: sx1 Jun 11 23:08:05.706684 np0000002687 nova-compute[98431]: virt-2.11 Jun 11 23:08:05.706684 np0000002687 nova-compute[98431]: imx25-pdk Jun 11 23:08:05.706684 np0000002687 nova-compute[98431]: stm32vldiscovery Jun 11 23:08:05.706684 np0000002687 nova-compute[98431]: virt-2.9 Jun 11 23:08:05.706684 np0000002687 nova-compute[98431]: orangepi-pc Jun 11 23:08:05.707582 np0000002687 nova-compute[98431]: quanta-q71l-bmc Jun 11 23:08:05.707582 np0000002687 nova-compute[98431]: z2 Jun 11 23:08:05.707582 np0000002687 nova-compute[98431]: virt-5.2 Jun 11 23:08:05.707582 np0000002687 nova-compute[98431]: xilinx-zynq-a9 Jun 11 23:08:05.707582 np0000002687 nova-compute[98431]: xlnx-zcu102 Jun 11 23:08:05.707582 np0000002687 nova-compute[98431]: tosa Jun 11 23:08:05.707582 np0000002687 nova-compute[98431]: mps2-an500 Jun 11 23:08:05.707582 np0000002687 nova-compute[98431]: virt-2.12 Jun 11 23:08:05.707582 np0000002687 nova-compute[98431]: mps2-an521 Jun 11 23:08:05.707582 np0000002687 nova-compute[98431]: sabrelite Jun 11 23:08:05.707582 np0000002687 nova-compute[98431]: mps2-an511 Jun 11 23:08:05.707582 np0000002687 nova-compute[98431]: canon-a1100 Jun 11 23:08:05.707582 np0000002687 nova-compute[98431]: realview-eb Jun 11 23:08:05.707582 np0000002687 nova-compute[98431]: quanta-gbs-bmc Jun 11 23:08:05.707582 np0000002687 nova-compute[98431]: emcraft-sf2 Jun 11 23:08:05.707582 np0000002687 nova-compute[98431]: realview-pb-a8 Jun 11 23:08:05.707582 np0000002687 nova-compute[98431]: sbsa-ref Jun 11 23:08:05.707582 np0000002687 nova-compute[98431]: yosemitev2-bmc Jun 11 23:08:05.707582 np0000002687 nova-compute[98431]: virt-7.0 Jun 11 23:08:05.707582 np0000002687 nova-compute[98431]: virt-4.0 Jun 11 23:08:05.707582 np0000002687 nova-compute[98431]: raspi1ap Jun 11 23:08:05.707582 np0000002687 nova-compute[98431]: palmetto-bmc Jun 11 23:08:05.707582 np0000002687 nova-compute[98431]: sx1-v1 Jun 11 23:08:05.707582 np0000002687 nova-compute[98431]: n810 Jun 11 23:08:05.707582 np0000002687 nova-compute[98431]: g220a-bmc Jun 11 23:08:05.707582 np0000002687 nova-compute[98431]: n800 Jun 11 23:08:05.707582 np0000002687 nova-compute[98431]: bletchley-bmc Jun 11 23:08:05.707582 np0000002687 nova-compute[98431]: virt-7.1 Jun 11 23:08:05.707582 np0000002687 nova-compute[98431]: tacoma-bmc Jun 11 23:08:05.707582 np0000002687 nova-compute[98431]: virt-4.1 Jun 11 23:08:05.707582 np0000002687 nova-compute[98431]: quanta-gsj Jun 11 23:08:05.707582 np0000002687 nova-compute[98431]: versatilepb Jun 11 23:08:05.707582 np0000002687 nova-compute[98431]: terrier Jun 11 23:08:05.707582 np0000002687 nova-compute[98431]: mainstone Jun 11 23:08:05.707582 np0000002687 nova-compute[98431]: realview-eb-mpcore Jun 11 23:08:05.707582 np0000002687 nova-compute[98431]: integratorcp Jun 11 23:08:05.707582 np0000002687 nova-compute[98431]: virt-7.2 Jun 11 23:08:05.707582 np0000002687 nova-compute[98431]: supermicrox11-bmc Jun 11 23:08:05.707582 np0000002687 nova-compute[98431]: virt-4.2 Jun 11 23:08:05.707582 np0000002687 nova-compute[98431]: witherspoon-bmc Jun 11 23:08:05.707582 np0000002687 nova-compute[98431]: qcom-firework-bmc Jun 11 23:08:05.707582 np0000002687 nova-compute[98431]: mps3-an524 Jun 11 23:08:05.708284 np0000002687 nova-compute[98431]: kudo-bmc Jun 11 23:08:05.708284 np0000002687 nova-compute[98431]: vexpress-a9 Jun 11 23:08:05.708284 np0000002687 nova-compute[98431]: midway Jun 11 23:08:05.708284 np0000002687 nova-compute[98431]: musicpal Jun 11 23:08:05.708284 np0000002687 nova-compute[98431]: lm3s811evb Jun 11 23:08:05.708284 np0000002687 nova-compute[98431]: lm3s6965evb Jun 11 23:08:05.708284 np0000002687 nova-compute[98431]: supermicro-x11spi-bmc Jun 11 23:08:05.708284 np0000002687 nova-compute[98431]: microbit Jun 11 23:08:05.708284 np0000002687 nova-compute[98431]: fby35 Jun 11 23:08:05.708284 np0000002687 nova-compute[98431]: mps2-an505 Jun 11 23:08:05.708284 np0000002687 nova-compute[98431]: mps2-an385 Jun 11 23:08:05.708284 np0000002687 nova-compute[98431]: virt-6.0 Jun 11 23:08:05.708284 np0000002687 nova-compute[98431]: virt-8.0 Jun 11 23:08:05.708284 np0000002687 nova-compute[98431]: raspi3ap Jun 11 23:08:05.708284 np0000002687 nova-compute[98431]: cubieboard Jun 11 23:08:05.708284 np0000002687 nova-compute[98431]: ast1030-evb Jun 11 23:08:05.708284 np0000002687 nova-compute[98431]: verdex Jun 11 23:08:05.708284 np0000002687 nova-compute[98431]: bpim2u Jun 11 23:08:05.708284 np0000002687 nova-compute[98431]: netduino2 Jun 11 23:08:05.708284 np0000002687 nova-compute[98431]: xlnx-versal-virt Jun 11 23:08:05.708284 np0000002687 nova-compute[98431]: mps2-an386 Jun 11 23:08:05.708284 np0000002687 nova-compute[98431]: olimex-stm32-h405 Jun 11 23:08:05.708284 np0000002687 nova-compute[98431]: virt-6.1 Jun 11 23:08:05.708284 np0000002687 nova-compute[98431]: virt-8.1 Jun 11 23:08:05.708284 np0000002687 nova-compute[98431]: raspi3b Jun 11 23:08:05.708284 np0000002687 nova-compute[98431]: raspi2b Jun 11 23:08:05.708284 np0000002687 nova-compute[98431]: vexpress-a15 Jun 11 23:08:05.708284 np0000002687 nova-compute[98431]: fuji-bmc Jun 11 23:08:05.708284 np0000002687 nova-compute[98431]: virt-6.2 Jun 11 23:08:05.708284 np0000002687 nova-compute[98431]: sonorapass-bmc Jun 11 23:08:05.708284 np0000002687 nova-compute[98431]: cheetah Jun 11 23:08:05.708284 np0000002687 nova-compute[98431]: virt-2.6 Jun 11 23:08:05.708284 np0000002687 nova-compute[98431]: ast2500-evb Jun 11 23:08:05.708284 np0000002687 nova-compute[98431]: highbank Jun 11 23:08:05.708284 np0000002687 nova-compute[98431]: akita Jun 11 23:08:05.708284 np0000002687 nova-compute[98431]: connex Jun 11 23:08:05.708284 np0000002687 nova-compute[98431]: netduinoplus2 Jun 11 23:08:05.708284 np0000002687 nova-compute[98431]: collie Jun 11 23:08:05.708284 np0000002687 nova-compute[98431]: raspi0 Jun 11 23:08:05.708284 np0000002687 nova-compute[98431]: fp5280g2-bmc Jun 11 23:08:05.708284 np0000002687 nova-compute[98431]: Jun 11 23:08:05.708284 np0000002687 nova-compute[98431]: Jun 11 23:08:05.708284 np0000002687 nova-compute[98431]: Jun 11 23:08:05.708284 np0000002687 nova-compute[98431]: Jun 11 23:08:05.708284 np0000002687 nova-compute[98431]: Jun 11 23:08:05.708284 np0000002687 nova-compute[98431]: Jun 11 23:08:05.709127 np0000002687 nova-compute[98431]: Jun 11 23:08:05.709127 np0000002687 nova-compute[98431]: Jun 11 23:08:05.709127 np0000002687 nova-compute[98431]: Jun 11 23:08:05.709127 np0000002687 nova-compute[98431]: Jun 11 23:08:05.709127 np0000002687 nova-compute[98431]: Jun 11 23:08:05.709127 np0000002687 nova-compute[98431]: hvm Jun 11 23:08:05.709127 np0000002687 nova-compute[98431]: Jun 11 23:08:05.709127 np0000002687 nova-compute[98431]: 32 Jun 11 23:08:05.709127 np0000002687 nova-compute[98431]: /usr/bin/qemu-system-cris Jun 11 23:08:05.709127 np0000002687 nova-compute[98431]: axis-dev88 Jun 11 23:08:05.709127 np0000002687 nova-compute[98431]: Jun 11 23:08:05.709127 np0000002687 nova-compute[98431]: Jun 11 23:08:05.709127 np0000002687 nova-compute[98431]: Jun 11 23:08:05.709127 np0000002687 nova-compute[98431]: Jun 11 23:08:05.709127 np0000002687 nova-compute[98431]: Jun 11 23:08:05.709127 np0000002687 nova-compute[98431]: Jun 11 23:08:05.709127 np0000002687 nova-compute[98431]: Jun 11 23:08:05.709127 np0000002687 nova-compute[98431]: Jun 11 23:08:05.709127 np0000002687 nova-compute[98431]: Jun 11 23:08:05.709127 np0000002687 nova-compute[98431]: Jun 11 23:08:05.709127 np0000002687 nova-compute[98431]: hvm Jun 11 23:08:05.709127 np0000002687 nova-compute[98431]: Jun 11 23:08:05.709127 np0000002687 nova-compute[98431]: 32 Jun 11 23:08:05.709127 np0000002687 nova-compute[98431]: /usr/bin/qemu-system-i386 Jun 11 23:08:05.709127 np0000002687 nova-compute[98431]: pc-i440fx-noble-v2 Jun 11 23:08:05.709127 np0000002687 nova-compute[98431]: ubuntu Jun 11 23:08:05.709127 np0000002687 nova-compute[98431]: pc-q35-mantic Jun 11 23:08:05.709127 np0000002687 nova-compute[98431]: pc-i440fx-impish-hpb Jun 11 23:08:05.709127 np0000002687 nova-compute[98431]: pc-q35-5.2 Jun 11 23:08:05.709127 np0000002687 nova-compute[98431]: pc-q35-lunar-hpb Jun 11 23:08:05.709127 np0000002687 nova-compute[98431]: pc-i440fx-mantic Jun 11 23:08:05.709127 np0000002687 nova-compute[98431]: pc-i440fx-2.12 Jun 11 23:08:05.709127 np0000002687 nova-compute[98431]: pc-i440fx-2.0 Jun 11 23:08:05.709127 np0000002687 nova-compute[98431]: pc-i440fx-xenial Jun 11 23:08:05.709127 np0000002687 nova-compute[98431]: pc-q35-kinetic Jun 11 23:08:05.709127 np0000002687 nova-compute[98431]: pc-i440fx-6.2 Jun 11 23:08:05.709127 np0000002687 nova-compute[98431]: pc-q35-4.2 Jun 11 23:08:05.709127 np0000002687 nova-compute[98431]: pc-i440fx-mantic-maxcpus Jun 11 23:08:05.709127 np0000002687 nova-compute[98431]: pc-i440fx-2.5 Jun 11 23:08:05.709127 np0000002687 nova-compute[98431]: pc-i440fx-4.2 Jun 11 23:08:05.709127 np0000002687 nova-compute[98431]: pc-i440fx-focal Jun 11 23:08:05.709127 np0000002687 nova-compute[98431]: pc-i440fx-hirsute Jun 11 23:08:05.709127 np0000002687 nova-compute[98431]: pc-q35-xenial Jun 11 23:08:05.709127 np0000002687 nova-compute[98431]: pc-i440fx-jammy-hpb Jun 11 23:08:05.709127 np0000002687 nova-compute[98431]: pc-i440fx-5.2 Jun 11 23:08:05.709127 np0000002687 nova-compute[98431]: pc-q35-2.7 Jun 11 23:08:05.709127 np0000002687 nova-compute[98431]: pc-q35-eoan-hpb Jun 11 23:08:05.709127 np0000002687 nova-compute[98431]: pc-i440fx-disco-hpb Jun 11 23:08:05.709127 np0000002687 nova-compute[98431]: pc-q35-groovy Jun 11 23:08:05.710041 np0000002687 nova-compute[98431]: pc-i440fx-zesty Jun 11 23:08:05.710041 np0000002687 nova-compute[98431]: pc-q35-lunar Jun 11 23:08:05.710041 np0000002687 nova-compute[98431]: pc-q35-mantic-hpb-maxcpus Jun 11 23:08:05.710041 np0000002687 nova-compute[98431]: pc-i440fx-groovy Jun 11 23:08:05.710041 np0000002687 nova-compute[98431]: pc-q35-7.1 Jun 11 23:08:05.710041 np0000002687 nova-compute[98431]: pc-q35-artful Jun 11 23:08:05.710041 np0000002687 nova-compute[98431]: pc-i440fx-trusty Jun 11 23:08:05.710041 np0000002687 nova-compute[98431]: pc-i440fx-2.2 Jun 11 23:08:05.710041 np0000002687 nova-compute[98431]: pc-i440fx-eoan-hpb Jun 11 23:08:05.710041 np0000002687 nova-compute[98431]: pc-q35-focal-hpb Jun 11 23:08:05.710041 np0000002687 nova-compute[98431]: pc-q35-8.1 Jun 11 23:08:05.710041 np0000002687 nova-compute[98431]: pc-q35-jammy-maxcpus Jun 11 23:08:05.710041 np0000002687 nova-compute[98431]: pc-q35-bionic-hpb Jun 11 23:08:05.710041 np0000002687 nova-compute[98431]: pc-q35-mantic-hpb Jun 11 23:08:05.710041 np0000002687 nova-compute[98431]: pc-i440fx-artful Jun 11 23:08:05.710041 np0000002687 nova-compute[98431]: pc-i440fx-8.1 Jun 11 23:08:05.710041 np0000002687 nova-compute[98431]: pc-i440fx-2.7 Jun 11 23:08:05.710041 np0000002687 nova-compute[98431]: pc-q35-6.1 Jun 11 23:08:05.710041 np0000002687 nova-compute[98431]: pc-i440fx-kinetic Jun 11 23:08:05.710041 np0000002687 nova-compute[98431]: pc-i440fx-jammy-maxcpus Jun 11 23:08:05.710041 np0000002687 nova-compute[98431]: pc-i440fx-yakkety Jun 11 23:08:05.710041 np0000002687 nova-compute[98431]: pc-q35-2.4 Jun 11 23:08:05.710041 np0000002687 nova-compute[98431]: pc-q35-cosmic-hpb Jun 11 23:08:05.710041 np0000002687 nova-compute[98431]: pc-i440fx-7.1 Jun 11 23:08:05.710041 np0000002687 nova-compute[98431]: pc-q35-2.10 Jun 11 23:08:05.710041 np0000002687 nova-compute[98431]: x-remote Jun 11 23:08:05.710041 np0000002687 nova-compute[98431]: pc-q35-5.1 Jun 11 23:08:05.710041 np0000002687 nova-compute[98431]: pc-q35-2.9 Jun 11 23:08:05.710041 np0000002687 nova-compute[98431]: pc-i440fx-2.11 Jun 11 23:08:05.710041 np0000002687 nova-compute[98431]: pc-i440fx-jammy-hpb-maxcpus Jun 11 23:08:05.710041 np0000002687 nova-compute[98431]: pc-q35-3.1 Jun 11 23:08:05.710041 np0000002687 nova-compute[98431]: pc-i440fx-6.1 Jun 11 23:08:05.710041 np0000002687 nova-compute[98431]: pc-q35-4.1 Jun 11 23:08:05.710041 np0000002687 nova-compute[98431]: pc-q35-jammy Jun 11 23:08:05.710041 np0000002687 nova-compute[98431]: pc-i440fx-2.4 Jun 11 23:08:05.710041 np0000002687 nova-compute[98431]: pc-i440fx-4.1 Jun 11 23:08:05.710041 np0000002687 nova-compute[98431]: pc-q35-eoan Jun 11 23:08:05.710959 np0000002687 nova-compute[98431]: pc-q35-jammy-hpb Jun 11 23:08:05.710959 np0000002687 nova-compute[98431]: pc-i440fx-5.1 Jun 11 23:08:05.710959 np0000002687 nova-compute[98431]: pc-i440fx-2.9 Jun 11 23:08:05.710959 np0000002687 nova-compute[98431]: pc-i440fx-bionic-hpb Jun 11 23:08:05.710959 np0000002687 nova-compute[98431]: pc-i440fx-lunar Jun 11 23:08:05.710959 np0000002687 nova-compute[98431]: isapc Jun 11 23:08:05.710959 np0000002687 nova-compute[98431]: pc-i440fx-mantic-hpb Jun 11 23:08:05.710959 np0000002687 nova-compute[98431]: pc-q35-cosmic Jun 11 23:08:05.710959 np0000002687 nova-compute[98431]: pc-q35-2.6 Jun 11 23:08:05.710959 np0000002687 nova-compute[98431]: pc-q35-mantic-maxcpus Jun 11 23:08:05.710959 np0000002687 nova-compute[98431]: pc-i440fx-3.1 Jun 11 23:08:05.710959 np0000002687 nova-compute[98431]: pc-q35-bionic Jun 11 23:08:05.710959 np0000002687 nova-compute[98431]: pc-q35-disco-hpb Jun 11 23:08:05.710959 np0000002687 nova-compute[98431]: pc-i440fx-cosmic Jun 11 23:08:05.710959 np0000002687 nova-compute[98431]: pc-q35-2.12 Jun 11 23:08:05.710959 np0000002687 nova-compute[98431]: pc-i440fx-bionic Jun 11 23:08:05.710959 np0000002687 nova-compute[98431]: pc-q35-kinetic-hpb Jun 11 23:08:05.710959 np0000002687 nova-compute[98431]: pc-q35-groovy-hpb Jun 11 23:08:05.710959 np0000002687 nova-compute[98431]: pc-q35-7.0 Jun 11 23:08:05.710959 np0000002687 nova-compute[98431]: pc-q35-noble-v2 Jun 11 23:08:05.710959 np0000002687 nova-compute[98431]: ubuntu-q35 Jun 11 23:08:05.710959 np0000002687 nova-compute[98431]: pc-i440fx-lunar-hpb Jun 11 23:08:05.710959 np0000002687 nova-compute[98431]: pc-q35-disco Jun 11 23:08:05.710959 np0000002687 nova-compute[98431]: pc-i440fx-cosmic-hpb Jun 11 23:08:05.710959 np0000002687 nova-compute[98431]: pc-q35-noble Jun 11 23:08:05.710959 np0000002687 nova-compute[98431]: q35 Jun 11 23:08:05.710959 np0000002687 nova-compute[98431]: pc-i440fx-2.1 Jun 11 23:08:05.710959 np0000002687 nova-compute[98431]: pc-q35-8.0 Jun 11 23:08:05.710959 np0000002687 nova-compute[98431]: pc-q35-impish Jun 11 23:08:05.710959 np0000002687 nova-compute[98431]: pc-i440fx-wily Jun 11 23:08:05.710959 np0000002687 nova-compute[98431]: pc-i440fx-8.0 Jun 11 23:08:05.710959 np0000002687 nova-compute[98431]: pc-i440fx-2.6 Jun 11 23:08:05.710959 np0000002687 nova-compute[98431]: pc-q35-6.0 Jun 11 23:08:05.710959 np0000002687 nova-compute[98431]: pc-i440fx-impish Jun 11 23:08:05.710959 np0000002687 nova-compute[98431]: pc-i440fx-jammy Jun 11 23:08:05.710959 np0000002687 nova-compute[98431]: pc-q35-impish-hpb Jun 11 23:08:05.711691 np0000002687 nova-compute[98431]: pc-q35-hirsute Jun 11 23:08:05.711691 np0000002687 nova-compute[98431]: pc-q35-4.0.1 Jun 11 23:08:05.711691 np0000002687 nova-compute[98431]: pc-q35-hirsute-hpb Jun 11 23:08:05.711691 np0000002687 nova-compute[98431]: pc-i440fx-7.0 Jun 11 23:08:05.711691 np0000002687 nova-compute[98431]: pc-q35-5.0 Jun 11 23:08:05.711691 np0000002687 nova-compute[98431]: pc-q35-2.8 Jun 11 23:08:05.711691 np0000002687 nova-compute[98431]: pc-i440fx-2.10 Jun 11 23:08:05.711691 np0000002687 nova-compute[98431]: pc-q35-3.0 Jun 11 23:08:05.711691 np0000002687 nova-compute[98431]: pc-i440fx-6.0 Jun 11 23:08:05.711691 np0000002687 nova-compute[98431]: pc-q35-zesty Jun 11 23:08:05.711691 np0000002687 nova-compute[98431]: pc-q35-7.2 Jun 11 23:08:05.711691 np0000002687 nova-compute[98431]: pc-q35-4.0 Jun 11 23:08:05.711691 np0000002687 nova-compute[98431]: pc-q35-focal Jun 11 23:08:05.711691 np0000002687 nova-compute[98431]: microvm Jun 11 23:08:05.711691 np0000002687 nova-compute[98431]: pc-i440fx-2.3 Jun 11 23:08:05.711691 np0000002687 nova-compute[98431]: pc-q35-jammy-hpb-maxcpus Jun 11 23:08:05.711691 np0000002687 nova-compute[98431]: pc-q35-8.2 Jun 11 23:08:05.711691 np0000002687 nova-compute[98431]: q35 Jun 11 23:08:05.711691 np0000002687 nova-compute[98431]: pc-i440fx-kinetic-hpb Jun 11 23:08:05.711691 np0000002687 nova-compute[98431]: pc-i440fx-focal-hpb Jun 11 23:08:05.711691 np0000002687 nova-compute[98431]: pc-i440fx-4.0 Jun 11 23:08:05.711691 np0000002687 nova-compute[98431]: pc-i440fx-noble Jun 11 23:08:05.711691 np0000002687 nova-compute[98431]: pc Jun 11 23:08:05.711691 np0000002687 nova-compute[98431]: pc-i440fx-disco Jun 11 23:08:05.711691 np0000002687 nova-compute[98431]: pc-i440fx-groovy-hpb Jun 11 23:08:05.711691 np0000002687 nova-compute[98431]: pc-i440fx-8.2 Jun 11 23:08:05.711691 np0000002687 nova-compute[98431]: pc Jun 11 23:08:05.711691 np0000002687 nova-compute[98431]: pc-i440fx-hirsute-hpb Jun 11 23:08:05.711691 np0000002687 nova-compute[98431]: pc-i440fx-5.0 Jun 11 23:08:05.711691 np0000002687 nova-compute[98431]: pc-q35-6.2 Jun 11 23:08:05.711691 np0000002687 nova-compute[98431]: pc-i440fx-2.8 Jun 11 23:08:05.711691 np0000002687 nova-compute[98431]: pc-i440fx-eoan Jun 11 23:08:05.711691 np0000002687 nova-compute[98431]: pc-q35-2.5 Jun 11 23:08:05.711691 np0000002687 nova-compute[98431]: pc-i440fx-3.0 Jun 11 23:08:05.711691 np0000002687 nova-compute[98431]: pc-q35-yakkety Jun 11 23:08:05.711691 np0000002687 nova-compute[98431]: pc-i440fx-mantic-hpb-maxcpus Jun 11 23:08:05.712309 np0000002687 nova-compute[98431]: pc-i440fx-7.2 Jun 11 23:08:05.712309 np0000002687 nova-compute[98431]: pc-q35-2.11 Jun 11 23:08:05.712309 np0000002687 nova-compute[98431]: Jun 11 23:08:05.712309 np0000002687 nova-compute[98431]: Jun 11 23:08:05.712309 np0000002687 nova-compute[98431]: Jun 11 23:08:05.712309 np0000002687 nova-compute[98431]: Jun 11 23:08:05.712309 np0000002687 nova-compute[98431]: Jun 11 23:08:05.712309 np0000002687 nova-compute[98431]: Jun 11 23:08:05.712309 np0000002687 nova-compute[98431]: Jun 11 23:08:05.712309 np0000002687 nova-compute[98431]: Jun 11 23:08:05.712309 np0000002687 nova-compute[98431]: Jun 11 23:08:05.712309 np0000002687 nova-compute[98431]: Jun 11 23:08:05.712309 np0000002687 nova-compute[98431]: Jun 11 23:08:05.712309 np0000002687 nova-compute[98431]: Jun 11 23:08:05.712309 np0000002687 nova-compute[98431]: Jun 11 23:08:05.712309 np0000002687 nova-compute[98431]: Jun 11 23:08:05.712309 np0000002687 nova-compute[98431]: Jun 11 23:08:05.712309 np0000002687 nova-compute[98431]: hvm Jun 11 23:08:05.712309 np0000002687 nova-compute[98431]: Jun 11 23:08:05.712309 np0000002687 nova-compute[98431]: 32 Jun 11 23:08:05.712309 np0000002687 nova-compute[98431]: /usr/bin/qemu-system-m68k Jun 11 23:08:05.712309 np0000002687 nova-compute[98431]: mcf5208evb Jun 11 23:08:05.712309 np0000002687 nova-compute[98431]: virt-7.0 Jun 11 23:08:05.712309 np0000002687 nova-compute[98431]: an5206 Jun 11 23:08:05.712309 np0000002687 nova-compute[98431]: virt-6.0 Jun 11 23:08:05.712309 np0000002687 nova-compute[98431]: q800 Jun 11 23:08:05.712309 np0000002687 nova-compute[98431]: virt-8.1 Jun 11 23:08:05.712309 np0000002687 nova-compute[98431]: virt-7.2 Jun 11 23:08:05.712309 np0000002687 nova-compute[98431]: virt-6.2 Jun 11 23:08:05.712309 np0000002687 nova-compute[98431]: virt-8.0 Jun 11 23:08:05.712309 np0000002687 nova-compute[98431]: next-cube Jun 11 23:08:05.712309 np0000002687 nova-compute[98431]: virt-7.1 Jun 11 23:08:05.712309 np0000002687 nova-compute[98431]: virt-6.1 Jun 11 23:08:05.712309 np0000002687 nova-compute[98431]: virt-8.2 Jun 11 23:08:05.712309 np0000002687 nova-compute[98431]: virt Jun 11 23:08:05.712309 np0000002687 nova-compute[98431]: Jun 11 23:08:05.712309 np0000002687 nova-compute[98431]: Jun 11 23:08:05.712309 np0000002687 nova-compute[98431]: Jun 11 23:08:05.712309 np0000002687 nova-compute[98431]: Jun 11 23:08:05.712309 np0000002687 nova-compute[98431]: Jun 11 23:08:05.712309 np0000002687 nova-compute[98431]: Jun 11 23:08:05.712309 np0000002687 nova-compute[98431]: Jun 11 23:08:05.712309 np0000002687 nova-compute[98431]: Jun 11 23:08:05.712309 np0000002687 nova-compute[98431]: Jun 11 23:08:05.712309 np0000002687 nova-compute[98431]: Jun 11 23:08:05.712309 np0000002687 nova-compute[98431]: hvm Jun 11 23:08:05.712309 np0000002687 nova-compute[98431]: Jun 11 23:08:05.712309 np0000002687 nova-compute[98431]: 32 Jun 11 23:08:05.712309 np0000002687 nova-compute[98431]: /usr/bin/qemu-system-microblaze Jun 11 23:08:05.712309 np0000002687 nova-compute[98431]: petalogix-s3adsp1800 Jun 11 23:08:05.712309 np0000002687 nova-compute[98431]: petalogix-ml605 Jun 11 23:08:05.712309 np0000002687 nova-compute[98431]: xlnx-zynqmp-pmu Jun 11 23:08:05.712309 np0000002687 nova-compute[98431]: Jun 11 23:08:05.712309 np0000002687 nova-compute[98431]: Jun 11 23:08:05.712309 np0000002687 nova-compute[98431]: Jun 11 23:08:05.712309 np0000002687 nova-compute[98431]: Jun 11 23:08:05.712309 np0000002687 nova-compute[98431]: Jun 11 23:08:05.712309 np0000002687 nova-compute[98431]: Jun 11 23:08:05.712309 np0000002687 nova-compute[98431]: Jun 11 23:08:05.712309 np0000002687 nova-compute[98431]: Jun 11 23:08:05.712309 np0000002687 nova-compute[98431]: Jun 11 23:08:05.712309 np0000002687 nova-compute[98431]: Jun 11 23:08:05.712309 np0000002687 nova-compute[98431]: hvm Jun 11 23:08:05.712309 np0000002687 nova-compute[98431]: Jun 11 23:08:05.712309 np0000002687 nova-compute[98431]: 32 Jun 11 23:08:05.713456 np0000002687 nova-compute[98431]: /usr/bin/qemu-system-microblazeel Jun 11 23:08:05.713456 np0000002687 nova-compute[98431]: petalogix-s3adsp1800 Jun 11 23:08:05.713456 np0000002687 nova-compute[98431]: petalogix-ml605 Jun 11 23:08:05.713456 np0000002687 nova-compute[98431]: xlnx-zynqmp-pmu Jun 11 23:08:05.713456 np0000002687 nova-compute[98431]: Jun 11 23:08:05.713456 np0000002687 nova-compute[98431]: Jun 11 23:08:05.713456 np0000002687 nova-compute[98431]: Jun 11 23:08:05.713456 np0000002687 nova-compute[98431]: Jun 11 23:08:05.713456 np0000002687 nova-compute[98431]: Jun 11 23:08:05.713456 np0000002687 nova-compute[98431]: Jun 11 23:08:05.713456 np0000002687 nova-compute[98431]: Jun 11 23:08:05.713456 np0000002687 nova-compute[98431]: Jun 11 23:08:05.713456 np0000002687 nova-compute[98431]: Jun 11 23:08:05.713456 np0000002687 nova-compute[98431]: Jun 11 23:08:05.713456 np0000002687 nova-compute[98431]: hvm Jun 11 23:08:05.713456 np0000002687 nova-compute[98431]: Jun 11 23:08:05.713456 np0000002687 nova-compute[98431]: 32 Jun 11 23:08:05.713456 np0000002687 nova-compute[98431]: /usr/bin/qemu-system-mips Jun 11 23:08:05.713456 np0000002687 nova-compute[98431]: malta Jun 11 23:08:05.713456 np0000002687 nova-compute[98431]: mipssim Jun 11 23:08:05.713456 np0000002687 nova-compute[98431]: Jun 11 23:08:05.713456 np0000002687 nova-compute[98431]: Jun 11 23:08:05.713456 np0000002687 nova-compute[98431]: Jun 11 23:08:05.713456 np0000002687 nova-compute[98431]: Jun 11 23:08:05.713456 np0000002687 nova-compute[98431]: Jun 11 23:08:05.713456 np0000002687 nova-compute[98431]: Jun 11 23:08:05.713456 np0000002687 nova-compute[98431]: Jun 11 23:08:05.713456 np0000002687 nova-compute[98431]: Jun 11 23:08:05.713456 np0000002687 nova-compute[98431]: Jun 11 23:08:05.713456 np0000002687 nova-compute[98431]: Jun 11 23:08:05.713456 np0000002687 nova-compute[98431]: hvm Jun 11 23:08:05.713456 np0000002687 nova-compute[98431]: Jun 11 23:08:05.713456 np0000002687 nova-compute[98431]: 32 Jun 11 23:08:05.713456 np0000002687 nova-compute[98431]: /usr/bin/qemu-system-mipsel Jun 11 23:08:05.713456 np0000002687 nova-compute[98431]: malta Jun 11 23:08:05.713456 np0000002687 nova-compute[98431]: mipssim Jun 11 23:08:05.713456 np0000002687 nova-compute[98431]: Jun 11 23:08:05.713456 np0000002687 nova-compute[98431]: Jun 11 23:08:05.713456 np0000002687 nova-compute[98431]: Jun 11 23:08:05.713456 np0000002687 nova-compute[98431]: Jun 11 23:08:05.713456 np0000002687 nova-compute[98431]: Jun 11 23:08:05.713456 np0000002687 nova-compute[98431]: Jun 11 23:08:05.713456 np0000002687 nova-compute[98431]: Jun 11 23:08:05.713456 np0000002687 nova-compute[98431]: Jun 11 23:08:05.713456 np0000002687 nova-compute[98431]: Jun 11 23:08:05.713456 np0000002687 nova-compute[98431]: Jun 11 23:08:05.713456 np0000002687 nova-compute[98431]: hvm Jun 11 23:08:05.713456 np0000002687 nova-compute[98431]: Jun 11 23:08:05.713456 np0000002687 nova-compute[98431]: 64 Jun 11 23:08:05.713456 np0000002687 nova-compute[98431]: /usr/bin/qemu-system-mips64 Jun 11 23:08:05.713456 np0000002687 nova-compute[98431]: malta Jun 11 23:08:05.713456 np0000002687 nova-compute[98431]: mipssim Jun 11 23:08:05.713456 np0000002687 nova-compute[98431]: pica61 Jun 11 23:08:05.713456 np0000002687 nova-compute[98431]: magnum Jun 11 23:08:05.713456 np0000002687 nova-compute[98431]: Jun 11 23:08:05.713456 np0000002687 nova-compute[98431]: Jun 11 23:08:05.713456 np0000002687 nova-compute[98431]: Jun 11 23:08:05.713456 np0000002687 nova-compute[98431]: Jun 11 23:08:05.713456 np0000002687 nova-compute[98431]: Jun 11 23:08:05.713456 np0000002687 nova-compute[98431]: Jun 11 23:08:05.713456 np0000002687 nova-compute[98431]: Jun 11 23:08:05.713456 np0000002687 nova-compute[98431]: Jun 11 23:08:05.713456 np0000002687 nova-compute[98431]: Jun 11 23:08:05.713456 np0000002687 nova-compute[98431]: Jun 11 23:08:05.713456 np0000002687 nova-compute[98431]: hvm Jun 11 23:08:05.713456 np0000002687 nova-compute[98431]: Jun 11 23:08:05.713456 np0000002687 nova-compute[98431]: 64 Jun 11 23:08:05.713456 np0000002687 nova-compute[98431]: /usr/bin/qemu-system-mips64el Jun 11 23:08:05.713456 np0000002687 nova-compute[98431]: malta Jun 11 23:08:05.714557 np0000002687 nova-compute[98431]: loongson3-virt Jun 11 23:08:05.714557 np0000002687 nova-compute[98431]: mipssim Jun 11 23:08:05.714557 np0000002687 nova-compute[98431]: pica61 Jun 11 23:08:05.714557 np0000002687 nova-compute[98431]: magnum Jun 11 23:08:05.714557 np0000002687 nova-compute[98431]: boston Jun 11 23:08:05.714557 np0000002687 nova-compute[98431]: fuloong2e Jun 11 23:08:05.714557 np0000002687 nova-compute[98431]: Jun 11 23:08:05.714557 np0000002687 nova-compute[98431]: Jun 11 23:08:05.714557 np0000002687 nova-compute[98431]: Jun 11 23:08:05.714557 np0000002687 nova-compute[98431]: Jun 11 23:08:05.714557 np0000002687 nova-compute[98431]: Jun 11 23:08:05.714557 np0000002687 nova-compute[98431]: Jun 11 23:08:05.714557 np0000002687 nova-compute[98431]: Jun 11 23:08:05.714557 np0000002687 nova-compute[98431]: Jun 11 23:08:05.714557 np0000002687 nova-compute[98431]: Jun 11 23:08:05.714557 np0000002687 nova-compute[98431]: Jun 11 23:08:05.714557 np0000002687 nova-compute[98431]: hvm Jun 11 23:08:05.714557 np0000002687 nova-compute[98431]: Jun 11 23:08:05.714557 np0000002687 nova-compute[98431]: 32 Jun 11 23:08:05.714557 np0000002687 nova-compute[98431]: /usr/bin/qemu-system-ppc Jun 11 23:08:05.714557 np0000002687 nova-compute[98431]: g3beige Jun 11 23:08:05.714557 np0000002687 nova-compute[98431]: amigaone Jun 11 23:08:05.714557 np0000002687 nova-compute[98431]: virtex-ml507 Jun 11 23:08:05.714557 np0000002687 nova-compute[98431]: mac99 Jun 11 23:08:05.714557 np0000002687 nova-compute[98431]: ppce500 Jun 11 23:08:05.714557 np0000002687 nova-compute[98431]: sam460ex Jun 11 23:08:05.714557 np0000002687 nova-compute[98431]: pegasos2 Jun 11 23:08:05.714557 np0000002687 nova-compute[98431]: bamboo Jun 11 23:08:05.714557 np0000002687 nova-compute[98431]: 40p Jun 11 23:08:05.714557 np0000002687 nova-compute[98431]: ref405ep Jun 11 23:08:05.714557 np0000002687 nova-compute[98431]: mpc8544ds Jun 11 23:08:05.714557 np0000002687 nova-compute[98431]: Jun 11 23:08:05.714557 np0000002687 nova-compute[98431]: Jun 11 23:08:05.714557 np0000002687 nova-compute[98431]: Jun 11 23:08:05.714557 np0000002687 nova-compute[98431]: Jun 11 23:08:05.714557 np0000002687 nova-compute[98431]: Jun 11 23:08:05.714557 np0000002687 nova-compute[98431]: Jun 11 23:08:05.714557 np0000002687 nova-compute[98431]: Jun 11 23:08:05.714557 np0000002687 nova-compute[98431]: Jun 11 23:08:05.714557 np0000002687 nova-compute[98431]: Jun 11 23:08:05.714557 np0000002687 nova-compute[98431]: Jun 11 23:08:05.714557 np0000002687 nova-compute[98431]: hvm Jun 11 23:08:05.714557 np0000002687 nova-compute[98431]: Jun 11 23:08:05.714557 np0000002687 nova-compute[98431]: 64 Jun 11 23:08:05.714557 np0000002687 nova-compute[98431]: /usr/bin/qemu-system-ppc64 Jun 11 23:08:05.714557 np0000002687 nova-compute[98431]: pseries-noble Jun 11 23:08:05.714557 np0000002687 nova-compute[98431]: pseries Jun 11 23:08:05.714557 np0000002687 nova-compute[98431]: amigaone Jun 11 23:08:05.714557 np0000002687 nova-compute[98431]: powernv9 Jun 11 23:08:05.714557 np0000002687 nova-compute[98431]: powernv Jun 11 23:08:05.714557 np0000002687 nova-compute[98431]: pseries-4.1 Jun 11 23:08:05.714557 np0000002687 nova-compute[98431]: mpc8544ds Jun 11 23:08:05.714557 np0000002687 nova-compute[98431]: pseries-6.1 Jun 11 23:08:05.714557 np0000002687 nova-compute[98431]: pseries-2.5 Jun 11 23:08:05.714557 np0000002687 nova-compute[98431]: powernv10 Jun 11 23:08:05.715676 np0000002687 nova-compute[98431]: pseries-xenial Jun 11 23:08:05.715676 np0000002687 nova-compute[98431]: pseries-4.2 Jun 11 23:08:05.715676 np0000002687 nova-compute[98431]: pseries-6.2 Jun 11 23:08:05.715676 np0000002687 nova-compute[98431]: pseries-yakkety Jun 11 23:08:05.715676 np0000002687 nova-compute[98431]: pseries-2.6 Jun 11 23:08:05.715676 np0000002687 nova-compute[98431]: ppce500 Jun 11 23:08:05.715676 np0000002687 nova-compute[98431]: pseries-bionic-sxxm Jun 11 23:08:05.715676 np0000002687 nova-compute[98431]: pseries-2.7 Jun 11 23:08:05.715676 np0000002687 nova-compute[98431]: pseries-3.0 Jun 11 23:08:05.715676 np0000002687 nova-compute[98431]: pseries-8.0 Jun 11 23:08:05.715676 np0000002687 nova-compute[98431]: pseries-5.0 Jun 11 23:08:05.715676 np0000002687 nova-compute[98431]: 40p Jun 11 23:08:05.715676 np0000002687 nova-compute[98431]: pseries-lunar Jun 11 23:08:05.715676 np0000002687 nova-compute[98431]: pseries-2.8 Jun 11 23:08:05.715676 np0000002687 nova-compute[98431]: pegasos2 Jun 11 23:08:05.715676 np0000002687 nova-compute[98431]: pseries-hirsute Jun 11 23:08:05.715676 np0000002687 nova-compute[98431]: pseries-3.1 Jun 11 23:08:05.715676 np0000002687 nova-compute[98431]: pseries-8.1 Jun 11 23:08:05.715676 np0000002687 nova-compute[98431]: pseries-5.1 Jun 11 23:08:05.715676 np0000002687 nova-compute[98431]: pseries-eoan Jun 11 23:08:05.715676 np0000002687 nova-compute[98431]: pseries-2.9 Jun 11 23:08:05.715676 np0000002687 nova-compute[98431]: pseries-zesty Jun 11 23:08:05.715676 np0000002687 nova-compute[98431]: bamboo Jun 11 23:08:05.715676 np0000002687 nova-compute[98431]: pseries-groovy Jun 11 23:08:05.715676 np0000002687 nova-compute[98431]: pseries-focal Jun 11 23:08:05.715676 np0000002687 nova-compute[98431]: g3beige Jun 11 23:08:05.715676 np0000002687 nova-compute[98431]: pseries-8.2 Jun 11 23:08:05.715676 np0000002687 nova-compute[98431]: pseries-5.2 Jun 11 23:08:05.715676 np0000002687 nova-compute[98431]: pseries-disco Jun 11 23:08:05.715676 np0000002687 nova-compute[98431]: pseries-2.12-sxxm Jun 11 23:08:05.715676 np0000002687 nova-compute[98431]: pseries-mantic Jun 11 23:08:05.715676 np0000002687 nova-compute[98431]: pseries-kinetic Jun 11 23:08:05.715676 np0000002687 nova-compute[98431]: pseries-2.10 Jun 11 23:08:05.715676 np0000002687 nova-compute[98431]: pseries-7.0 Jun 11 23:08:05.715676 np0000002687 nova-compute[98431]: virtex-ml507 Jun 11 23:08:05.715676 np0000002687 nova-compute[98431]: pseries-2.11 Jun 11 23:08:05.715676 np0000002687 nova-compute[98431]: pseries-2.1 Jun 11 23:08:05.715676 np0000002687 nova-compute[98431]: pseries-7.1 Jun 11 23:08:05.715676 np0000002687 nova-compute[98431]: pseries-cosmic Jun 11 23:08:05.716346 np0000002687 nova-compute[98431]: pseries-bionic Jun 11 23:08:05.716346 np0000002687 nova-compute[98431]: pseries-2.12 Jun 11 23:08:05.716346 np0000002687 nova-compute[98431]: pseries-2.2 Jun 11 23:08:05.716346 np0000002687 nova-compute[98431]: pseries-7.2 Jun 11 23:08:05.716346 np0000002687 nova-compute[98431]: mac99 Jun 11 23:08:05.716346 np0000002687 nova-compute[98431]: pseries-impish Jun 11 23:08:05.716346 np0000002687 nova-compute[98431]: pseries-jammy Jun 11 23:08:05.716346 np0000002687 nova-compute[98431]: pseries-artful Jun 11 23:08:05.716346 np0000002687 nova-compute[98431]: sam460ex Jun 11 23:08:05.716346 np0000002687 nova-compute[98431]: ref405ep Jun 11 23:08:05.716346 np0000002687 nova-compute[98431]: pseries-2.3 Jun 11 23:08:05.716346 np0000002687 nova-compute[98431]: powernv8 Jun 11 23:08:05.716346 np0000002687 nova-compute[98431]: pseries-4.0 Jun 11 23:08:05.716346 np0000002687 nova-compute[98431]: pseries-6.0 Jun 11 23:08:05.716346 np0000002687 nova-compute[98431]: pseries-2.4 Jun 11 23:08:05.716346 np0000002687 nova-compute[98431]: Jun 11 23:08:05.716346 np0000002687 nova-compute[98431]: Jun 11 23:08:05.716346 np0000002687 nova-compute[98431]: Jun 11 23:08:05.716346 np0000002687 nova-compute[98431]: Jun 11 23:08:05.716346 np0000002687 nova-compute[98431]: Jun 11 23:08:05.716346 np0000002687 nova-compute[98431]: Jun 11 23:08:05.716346 np0000002687 nova-compute[98431]: Jun 11 23:08:05.716346 np0000002687 nova-compute[98431]: Jun 11 23:08:05.716346 np0000002687 nova-compute[98431]: Jun 11 23:08:05.716346 np0000002687 nova-compute[98431]: Jun 11 23:08:05.716346 np0000002687 nova-compute[98431]: hvm Jun 11 23:08:05.716346 np0000002687 nova-compute[98431]: Jun 11 23:08:05.716346 np0000002687 nova-compute[98431]: 64 Jun 11 23:08:05.716346 np0000002687 nova-compute[98431]: /usr/bin/qemu-system-ppc64le Jun 11 23:08:05.716346 np0000002687 nova-compute[98431]: pseries-noble Jun 11 23:08:05.716346 np0000002687 nova-compute[98431]: pseries Jun 11 23:08:05.716346 np0000002687 nova-compute[98431]: amigaone Jun 11 23:08:05.716346 np0000002687 nova-compute[98431]: powernv9 Jun 11 23:08:05.716346 np0000002687 nova-compute[98431]: powernv Jun 11 23:08:05.716346 np0000002687 nova-compute[98431]: pseries-4.1 Jun 11 23:08:05.716346 np0000002687 nova-compute[98431]: mpc8544ds Jun 11 23:08:05.716346 np0000002687 nova-compute[98431]: pseries-6.1 Jun 11 23:08:05.716346 np0000002687 nova-compute[98431]: pseries-2.5 Jun 11 23:08:05.716346 np0000002687 nova-compute[98431]: powernv10 Jun 11 23:08:05.716346 np0000002687 nova-compute[98431]: pseries-xenial Jun 11 23:08:05.716346 np0000002687 nova-compute[98431]: pseries-4.2 Jun 11 23:08:05.716346 np0000002687 nova-compute[98431]: pseries-6.2 Jun 11 23:08:05.716346 np0000002687 nova-compute[98431]: pseries-yakkety Jun 11 23:08:05.716346 np0000002687 nova-compute[98431]: pseries-2.6 Jun 11 23:08:05.716346 np0000002687 nova-compute[98431]: ppce500 Jun 11 23:08:05.716346 np0000002687 nova-compute[98431]: pseries-bionic-sxxm Jun 11 23:08:05.717122 np0000002687 nova-compute[98431]: pseries-2.7 Jun 11 23:08:05.717122 np0000002687 nova-compute[98431]: pseries-3.0 Jun 11 23:08:05.717122 np0000002687 nova-compute[98431]: pseries-8.0 Jun 11 23:08:05.717122 np0000002687 nova-compute[98431]: pseries-5.0 Jun 11 23:08:05.717122 np0000002687 nova-compute[98431]: 40p Jun 11 23:08:05.717122 np0000002687 nova-compute[98431]: pseries-lunar Jun 11 23:08:05.717122 np0000002687 nova-compute[98431]: pseries-2.8 Jun 11 23:08:05.717122 np0000002687 nova-compute[98431]: pegasos2 Jun 11 23:08:05.717122 np0000002687 nova-compute[98431]: pseries-hirsute Jun 11 23:08:05.717122 np0000002687 nova-compute[98431]: pseries-3.1 Jun 11 23:08:05.717122 np0000002687 nova-compute[98431]: pseries-8.1 Jun 11 23:08:05.717122 np0000002687 nova-compute[98431]: pseries-5.1 Jun 11 23:08:05.717122 np0000002687 nova-compute[98431]: pseries-eoan Jun 11 23:08:05.717122 np0000002687 nova-compute[98431]: pseries-2.9 Jun 11 23:08:05.717122 np0000002687 nova-compute[98431]: pseries-zesty Jun 11 23:08:05.717122 np0000002687 nova-compute[98431]: bamboo Jun 11 23:08:05.717122 np0000002687 nova-compute[98431]: pseries-groovy Jun 11 23:08:05.717122 np0000002687 nova-compute[98431]: pseries-focal Jun 11 23:08:05.717122 np0000002687 nova-compute[98431]: g3beige Jun 11 23:08:05.717122 np0000002687 nova-compute[98431]: pseries-8.2 Jun 11 23:08:05.717122 np0000002687 nova-compute[98431]: pseries-5.2 Jun 11 23:08:05.717122 np0000002687 nova-compute[98431]: pseries-disco Jun 11 23:08:05.717122 np0000002687 nova-compute[98431]: pseries-2.12-sxxm Jun 11 23:08:05.717122 np0000002687 nova-compute[98431]: pseries-mantic Jun 11 23:08:05.717122 np0000002687 nova-compute[98431]: pseries-kinetic Jun 11 23:08:05.717122 np0000002687 nova-compute[98431]: pseries-2.10 Jun 11 23:08:05.717122 np0000002687 nova-compute[98431]: pseries-7.0 Jun 11 23:08:05.717122 np0000002687 nova-compute[98431]: virtex-ml507 Jun 11 23:08:05.717122 np0000002687 nova-compute[98431]: pseries-2.11 Jun 11 23:08:05.717122 np0000002687 nova-compute[98431]: pseries-2.1 Jun 11 23:08:05.717122 np0000002687 nova-compute[98431]: pseries-7.1 Jun 11 23:08:05.717122 np0000002687 nova-compute[98431]: pseries-cosmic Jun 11 23:08:05.717122 np0000002687 nova-compute[98431]: pseries-bionic Jun 11 23:08:05.717122 np0000002687 nova-compute[98431]: pseries-2.12 Jun 11 23:08:05.717122 np0000002687 nova-compute[98431]: pseries-2.2 Jun 11 23:08:05.717122 np0000002687 nova-compute[98431]: pseries-7.2 Jun 11 23:08:05.717122 np0000002687 nova-compute[98431]: mac99 Jun 11 23:08:05.717122 np0000002687 nova-compute[98431]: pseries-impish Jun 11 23:08:05.717122 np0000002687 nova-compute[98431]: pseries-jammy Jun 11 23:08:05.717823 np0000002687 nova-compute[98431]: pseries-artful Jun 11 23:08:05.717823 np0000002687 nova-compute[98431]: sam460ex Jun 11 23:08:05.717823 np0000002687 nova-compute[98431]: ref405ep Jun 11 23:08:05.717823 np0000002687 nova-compute[98431]: pseries-2.3 Jun 11 23:08:05.717823 np0000002687 nova-compute[98431]: powernv8 Jun 11 23:08:05.717823 np0000002687 nova-compute[98431]: pseries-4.0 Jun 11 23:08:05.717823 np0000002687 nova-compute[98431]: pseries-6.0 Jun 11 23:08:05.717823 np0000002687 nova-compute[98431]: pseries-2.4 Jun 11 23:08:05.717823 np0000002687 nova-compute[98431]: Jun 11 23:08:05.717823 np0000002687 nova-compute[98431]: Jun 11 23:08:05.717823 np0000002687 nova-compute[98431]: Jun 11 23:08:05.717823 np0000002687 nova-compute[98431]: Jun 11 23:08:05.717823 np0000002687 nova-compute[98431]: Jun 11 23:08:05.717823 np0000002687 nova-compute[98431]: Jun 11 23:08:05.717823 np0000002687 nova-compute[98431]: Jun 11 23:08:05.717823 np0000002687 nova-compute[98431]: Jun 11 23:08:05.717823 np0000002687 nova-compute[98431]: Jun 11 23:08:05.717823 np0000002687 nova-compute[98431]: Jun 11 23:08:05.717823 np0000002687 nova-compute[98431]: hvm Jun 11 23:08:05.717823 np0000002687 nova-compute[98431]: Jun 11 23:08:05.717823 np0000002687 nova-compute[98431]: 32 Jun 11 23:08:05.717823 np0000002687 nova-compute[98431]: /usr/bin/qemu-system-riscv32 Jun 11 23:08:05.717823 np0000002687 nova-compute[98431]: virt Jun 11 23:08:05.717823 np0000002687 nova-compute[98431]: spike Jun 11 23:08:05.717823 np0000002687 nova-compute[98431]: opentitan Jun 11 23:08:05.717823 np0000002687 nova-compute[98431]: sifive_u Jun 11 23:08:05.717823 np0000002687 nova-compute[98431]: sifive_e Jun 11 23:08:05.717823 np0000002687 nova-compute[98431]: Jun 11 23:08:05.717823 np0000002687 nova-compute[98431]: Jun 11 23:08:05.717823 np0000002687 nova-compute[98431]: Jun 11 23:08:05.717823 np0000002687 nova-compute[98431]: Jun 11 23:08:05.717823 np0000002687 nova-compute[98431]: Jun 11 23:08:05.717823 np0000002687 nova-compute[98431]: Jun 11 23:08:05.717823 np0000002687 nova-compute[98431]: Jun 11 23:08:05.717823 np0000002687 nova-compute[98431]: Jun 11 23:08:05.717823 np0000002687 nova-compute[98431]: Jun 11 23:08:05.717823 np0000002687 nova-compute[98431]: Jun 11 23:08:05.717823 np0000002687 nova-compute[98431]: hvm Jun 11 23:08:05.717823 np0000002687 nova-compute[98431]: Jun 11 23:08:05.717823 np0000002687 nova-compute[98431]: 64 Jun 11 23:08:05.717823 np0000002687 nova-compute[98431]: /usr/bin/qemu-system-riscv64 Jun 11 23:08:05.717823 np0000002687 nova-compute[98431]: virt Jun 11 23:08:05.717823 np0000002687 nova-compute[98431]: spike Jun 11 23:08:05.717823 np0000002687 nova-compute[98431]: microchip-icicle-kit Jun 11 23:08:05.717823 np0000002687 nova-compute[98431]: sifive_u Jun 11 23:08:05.717823 np0000002687 nova-compute[98431]: shakti_c Jun 11 23:08:05.717823 np0000002687 nova-compute[98431]: sifive_e Jun 11 23:08:05.717823 np0000002687 nova-compute[98431]: Jun 11 23:08:05.717823 np0000002687 nova-compute[98431]: Jun 11 23:08:05.717823 np0000002687 nova-compute[98431]: Jun 11 23:08:05.717823 np0000002687 nova-compute[98431]: Jun 11 23:08:05.717823 np0000002687 nova-compute[98431]: Jun 11 23:08:05.717823 np0000002687 nova-compute[98431]: Jun 11 23:08:05.717823 np0000002687 nova-compute[98431]: Jun 11 23:08:05.717823 np0000002687 nova-compute[98431]: Jun 11 23:08:05.717823 np0000002687 nova-compute[98431]: Jun 11 23:08:05.717823 np0000002687 nova-compute[98431]: Jun 11 23:08:05.717823 np0000002687 nova-compute[98431]: hvm Jun 11 23:08:05.717823 np0000002687 nova-compute[98431]: Jun 11 23:08:05.717823 np0000002687 nova-compute[98431]: 64 Jun 11 23:08:05.717823 np0000002687 nova-compute[98431]: /usr/bin/qemu-system-s390x Jun 11 23:08:05.717823 np0000002687 nova-compute[98431]: s390-ccw-virtio-noble Jun 11 23:08:05.718969 np0000002687 nova-compute[98431]: s390-ccw-virtio Jun 11 23:08:05.718969 np0000002687 nova-compute[98431]: s390-ccw-virtio-8.0 Jun 11 23:08:05.718969 np0000002687 nova-compute[98431]: s390-ccw-virtio-disco Jun 11 23:08:05.718969 np0000002687 nova-compute[98431]: s390-ccw-virtio-6.0 Jun 11 23:08:05.718969 np0000002687 nova-compute[98431]: s390-ccw-virtio-2.11 Jun 11 23:08:05.718969 np0000002687 nova-compute[98431]: s390-ccw-virtio-7.0 Jun 11 23:08:05.718969 np0000002687 nova-compute[98431]: s390-ccw-virtio-mantic Jun 11 23:08:05.718969 np0000002687 nova-compute[98431]: s390-ccw-virtio-xenial Jun 11 23:08:05.718969 np0000002687 nova-compute[98431]: s390-ccw-virtio-5.0 Jun 11 23:08:05.718969 np0000002687 nova-compute[98431]: s390-ccw-virtio-focal Jun 11 23:08:05.718969 np0000002687 nova-compute[98431]: s390-ccw-virtio-2.8 Jun 11 23:08:05.718969 np0000002687 nova-compute[98431]: s390-ccw-virtio-4.0 Jun 11 23:08:05.718969 np0000002687 nova-compute[98431]: s390-ccw-virtio-zesty Jun 11 23:08:05.718969 np0000002687 nova-compute[98431]: s390-ccw-virtio-8.2 Jun 11 23:08:05.718969 np0000002687 nova-compute[98431]: s390-ccw-virtio-6.2 Jun 11 23:08:05.718969 np0000002687 nova-compute[98431]: s390-ccw-virtio-3.0 Jun 11 23:08:05.718969 np0000002687 nova-compute[98431]: s390-ccw-virtio-groovy Jun 11 23:08:05.718969 np0000002687 nova-compute[98431]: s390-ccw-virtio-2.5 Jun 11 23:08:05.718969 np0000002687 nova-compute[98431]: s390-ccw-virtio-7.2 Jun 11 23:08:05.718969 np0000002687 nova-compute[98431]: s390-ccw-virtio-5.2 Jun 11 23:08:05.718969 np0000002687 nova-compute[98431]: s390-ccw-virtio-artful Jun 11 23:08:05.718969 np0000002687 nova-compute[98431]: s390-ccw-virtio-hirsute Jun 11 23:08:05.718969 np0000002687 nova-compute[98431]: s390-ccw-virtio-4.2 Jun 11 23:08:05.718969 np0000002687 nova-compute[98431]: s390-ccw-virtio-2.10 Jun 11 23:08:05.718969 np0000002687 nova-compute[98431]: s390-ccw-virtio-2.7 Jun 11 23:08:05.718969 np0000002687 nova-compute[98431]: s390-ccw-virtio-lunar Jun 11 23:08:05.718969 np0000002687 nova-compute[98431]: s390-ccw-virtio-eoan Jun 11 23:08:05.718969 np0000002687 nova-compute[98431]: s390-ccw-virtio-kinetic Jun 11 23:08:05.718969 np0000002687 nova-compute[98431]: s390-ccw-virtio-8.1 Jun 11 23:08:05.718969 np0000002687 nova-compute[98431]: s390-ccw-virtio-yakkety Jun 11 23:08:05.718969 np0000002687 nova-compute[98431]: s390-ccw-virtio-6.1 Jun 11 23:08:05.718969 np0000002687 nova-compute[98431]: s390-ccw-virtio-cosmic Jun 11 23:08:05.718969 np0000002687 nova-compute[98431]: s390-ccw-virtio-bionic Jun 11 23:08:05.719650 np0000002687 nova-compute[98431]: s390-ccw-virtio-2.12 Jun 11 23:08:05.719650 np0000002687 nova-compute[98431]: s390-ccw-virtio-7.1 Jun 11 23:08:05.719650 np0000002687 nova-compute[98431]: s390-ccw-virtio-2.4 Jun 11 23:08:05.719650 np0000002687 nova-compute[98431]: s390-ccw-virtio-5.1 Jun 11 23:08:05.719650 np0000002687 nova-compute[98431]: s390-ccw-virtio-2.9 Jun 11 23:08:05.719650 np0000002687 nova-compute[98431]: s390-ccw-virtio-impish Jun 11 23:08:05.719650 np0000002687 nova-compute[98431]: s390-ccw-virtio-4.1 Jun 11 23:08:05.719650 np0000002687 nova-compute[98431]: s390-ccw-virtio-jammy Jun 11 23:08:05.719650 np0000002687 nova-compute[98431]: s390-ccw-virtio-3.1 Jun 11 23:08:05.719650 np0000002687 nova-compute[98431]: s390-ccw-virtio-2.6 Jun 11 23:08:05.719650 np0000002687 nova-compute[98431]: Jun 11 23:08:05.719650 np0000002687 nova-compute[98431]: Jun 11 23:08:05.719650 np0000002687 nova-compute[98431]: Jun 11 23:08:05.719650 np0000002687 nova-compute[98431]: Jun 11 23:08:05.719650 np0000002687 nova-compute[98431]: Jun 11 23:08:05.719650 np0000002687 nova-compute[98431]: Jun 11 23:08:05.719650 np0000002687 nova-compute[98431]: Jun 11 23:08:05.719650 np0000002687 nova-compute[98431]: Jun 11 23:08:05.719650 np0000002687 nova-compute[98431]: Jun 11 23:08:05.719650 np0000002687 nova-compute[98431]: Jun 11 23:08:05.719650 np0000002687 nova-compute[98431]: hvm Jun 11 23:08:05.719650 np0000002687 nova-compute[98431]: Jun 11 23:08:05.719650 np0000002687 nova-compute[98431]: 32 Jun 11 23:08:05.719650 np0000002687 nova-compute[98431]: /usr/bin/qemu-system-sh4 Jun 11 23:08:05.719650 np0000002687 nova-compute[98431]: shix Jun 11 23:08:05.719650 np0000002687 nova-compute[98431]: r2d Jun 11 23:08:05.719650 np0000002687 nova-compute[98431]: Jun 11 23:08:05.719650 np0000002687 nova-compute[98431]: Jun 11 23:08:05.719650 np0000002687 nova-compute[98431]: Jun 11 23:08:05.719650 np0000002687 nova-compute[98431]: Jun 11 23:08:05.719650 np0000002687 nova-compute[98431]: Jun 11 23:08:05.719650 np0000002687 nova-compute[98431]: Jun 11 23:08:05.719650 np0000002687 nova-compute[98431]: Jun 11 23:08:05.719650 np0000002687 nova-compute[98431]: Jun 11 23:08:05.719650 np0000002687 nova-compute[98431]: Jun 11 23:08:05.719650 np0000002687 nova-compute[98431]: Jun 11 23:08:05.719650 np0000002687 nova-compute[98431]: hvm Jun 11 23:08:05.719650 np0000002687 nova-compute[98431]: Jun 11 23:08:05.719650 np0000002687 nova-compute[98431]: 64 Jun 11 23:08:05.719650 np0000002687 nova-compute[98431]: /usr/bin/qemu-system-sh4eb Jun 11 23:08:05.719650 np0000002687 nova-compute[98431]: shix Jun 11 23:08:05.719650 np0000002687 nova-compute[98431]: r2d Jun 11 23:08:05.719650 np0000002687 nova-compute[98431]: Jun 11 23:08:05.719650 np0000002687 nova-compute[98431]: Jun 11 23:08:05.719650 np0000002687 nova-compute[98431]: Jun 11 23:08:05.719650 np0000002687 nova-compute[98431]: Jun 11 23:08:05.719650 np0000002687 nova-compute[98431]: Jun 11 23:08:05.719650 np0000002687 nova-compute[98431]: Jun 11 23:08:05.719650 np0000002687 nova-compute[98431]: Jun 11 23:08:05.719650 np0000002687 nova-compute[98431]: Jun 11 23:08:05.719650 np0000002687 nova-compute[98431]: Jun 11 23:08:05.719650 np0000002687 nova-compute[98431]: Jun 11 23:08:05.719650 np0000002687 nova-compute[98431]: hvm Jun 11 23:08:05.719650 np0000002687 nova-compute[98431]: Jun 11 23:08:05.719650 np0000002687 nova-compute[98431]: 32 Jun 11 23:08:05.719650 np0000002687 nova-compute[98431]: /usr/bin/qemu-system-sparc Jun 11 23:08:05.719650 np0000002687 nova-compute[98431]: SS-5 Jun 11 23:08:05.719650 np0000002687 nova-compute[98431]: SS-20 Jun 11 23:08:05.719650 np0000002687 nova-compute[98431]: LX Jun 11 23:08:05.719650 np0000002687 nova-compute[98431]: SPARCClassic Jun 11 23:08:05.719650 np0000002687 nova-compute[98431]: leon3_generic Jun 11 23:08:05.720936 np0000002687 nova-compute[98431]: SPARCbook Jun 11 23:08:05.720936 np0000002687 nova-compute[98431]: SS-4 Jun 11 23:08:05.720936 np0000002687 nova-compute[98431]: SS-600MP Jun 11 23:08:05.720936 np0000002687 nova-compute[98431]: SS-10 Jun 11 23:08:05.720936 np0000002687 nova-compute[98431]: Voyager Jun 11 23:08:05.720936 np0000002687 nova-compute[98431]: Jun 11 23:08:05.720936 np0000002687 nova-compute[98431]: Jun 11 23:08:05.720936 np0000002687 nova-compute[98431]: Jun 11 23:08:05.720936 np0000002687 nova-compute[98431]: Jun 11 23:08:05.720936 np0000002687 nova-compute[98431]: Jun 11 23:08:05.720936 np0000002687 nova-compute[98431]: Jun 11 23:08:05.720936 np0000002687 nova-compute[98431]: Jun 11 23:08:05.720936 np0000002687 nova-compute[98431]: Jun 11 23:08:05.720936 np0000002687 nova-compute[98431]: Jun 11 23:08:05.720936 np0000002687 nova-compute[98431]: Jun 11 23:08:05.720936 np0000002687 nova-compute[98431]: hvm Jun 11 23:08:05.720936 np0000002687 nova-compute[98431]: Jun 11 23:08:05.720936 np0000002687 nova-compute[98431]: 64 Jun 11 23:08:05.720936 np0000002687 nova-compute[98431]: /usr/bin/qemu-system-sparc64 Jun 11 23:08:05.720936 np0000002687 nova-compute[98431]: sun4u Jun 11 23:08:05.720936 np0000002687 nova-compute[98431]: niagara Jun 11 23:08:05.720936 np0000002687 nova-compute[98431]: sun4v Jun 11 23:08:05.720936 np0000002687 nova-compute[98431]: Jun 11 23:08:05.720936 np0000002687 nova-compute[98431]: Jun 11 23:08:05.720936 np0000002687 nova-compute[98431]: Jun 11 23:08:05.720936 np0000002687 nova-compute[98431]: Jun 11 23:08:05.720936 np0000002687 nova-compute[98431]: Jun 11 23:08:05.720936 np0000002687 nova-compute[98431]: Jun 11 23:08:05.720936 np0000002687 nova-compute[98431]: Jun 11 23:08:05.720936 np0000002687 nova-compute[98431]: Jun 11 23:08:05.720936 np0000002687 nova-compute[98431]: Jun 11 23:08:05.720936 np0000002687 nova-compute[98431]: Jun 11 23:08:05.720936 np0000002687 nova-compute[98431]: hvm Jun 11 23:08:05.720936 np0000002687 nova-compute[98431]: Jun 11 23:08:05.720936 np0000002687 nova-compute[98431]: 64 Jun 11 23:08:05.720936 np0000002687 nova-compute[98431]: /usr/bin/qemu-system-x86_64 Jun 11 23:08:05.720936 np0000002687 nova-compute[98431]: pc-i440fx-noble-v2 Jun 11 23:08:05.720936 np0000002687 nova-compute[98431]: ubuntu Jun 11 23:08:05.720936 np0000002687 nova-compute[98431]: pc-q35-mantic Jun 11 23:08:05.720936 np0000002687 nova-compute[98431]: pc-i440fx-impish-hpb Jun 11 23:08:05.720936 np0000002687 nova-compute[98431]: pc-q35-5.2 Jun 11 23:08:05.720936 np0000002687 nova-compute[98431]: pc-q35-lunar-hpb Jun 11 23:08:05.720936 np0000002687 nova-compute[98431]: pc-i440fx-mantic Jun 11 23:08:05.720936 np0000002687 nova-compute[98431]: pc-i440fx-2.12 Jun 11 23:08:05.720936 np0000002687 nova-compute[98431]: pc-i440fx-2.0 Jun 11 23:08:05.720936 np0000002687 nova-compute[98431]: pc-i440fx-xenial Jun 11 23:08:05.720936 np0000002687 nova-compute[98431]: pc-q35-kinetic Jun 11 23:08:05.720936 np0000002687 nova-compute[98431]: pc-i440fx-6.2 Jun 11 23:08:05.720936 np0000002687 nova-compute[98431]: pc-q35-4.2 Jun 11 23:08:05.720936 np0000002687 nova-compute[98431]: pc-i440fx-mantic-maxcpus Jun 11 23:08:05.720936 np0000002687 nova-compute[98431]: pc-i440fx-2.5 Jun 11 23:08:05.720936 np0000002687 nova-compute[98431]: pc-i440fx-4.2 Jun 11 23:08:05.720936 np0000002687 nova-compute[98431]: pc-i440fx-focal Jun 11 23:08:05.721934 np0000002687 nova-compute[98431]: pc-i440fx-hirsute Jun 11 23:08:05.721934 np0000002687 nova-compute[98431]: pc-q35-xenial Jun 11 23:08:05.721934 np0000002687 nova-compute[98431]: pc-i440fx-jammy-hpb Jun 11 23:08:05.721934 np0000002687 nova-compute[98431]: pc-i440fx-5.2 Jun 11 23:08:05.721934 np0000002687 nova-compute[98431]: pc-q35-2.7 Jun 11 23:08:05.721934 np0000002687 nova-compute[98431]: pc-q35-eoan-hpb Jun 11 23:08:05.721934 np0000002687 nova-compute[98431]: pc-i440fx-zesty Jun 11 23:08:05.721934 np0000002687 nova-compute[98431]: pc-q35-groovy Jun 11 23:08:05.721934 np0000002687 nova-compute[98431]: pc-i440fx-disco-hpb Jun 11 23:08:05.721934 np0000002687 nova-compute[98431]: pc-q35-lunar Jun 11 23:08:05.721934 np0000002687 nova-compute[98431]: pc-q35-mantic-hpb-maxcpus Jun 11 23:08:05.721934 np0000002687 nova-compute[98431]: pc-i440fx-groovy Jun 11 23:08:05.721934 np0000002687 nova-compute[98431]: pc-q35-7.1 Jun 11 23:08:05.721934 np0000002687 nova-compute[98431]: pc-q35-artful Jun 11 23:08:05.721934 np0000002687 nova-compute[98431]: pc-i440fx-trusty Jun 11 23:08:05.721934 np0000002687 nova-compute[98431]: pc-i440fx-2.2 Jun 11 23:08:05.721934 np0000002687 nova-compute[98431]: pc-q35-focal-hpb Jun 11 23:08:05.721934 np0000002687 nova-compute[98431]: pc-q35-8.1 Jun 11 23:08:05.721934 np0000002687 nova-compute[98431]: pc-i440fx-eoan-hpb Jun 11 23:08:05.721934 np0000002687 nova-compute[98431]: pc-q35-jammy-maxcpus Jun 11 23:08:05.721934 np0000002687 nova-compute[98431]: pc-q35-bionic-hpb Jun 11 23:08:05.721934 np0000002687 nova-compute[98431]: pc-q35-mantic-hpb Jun 11 23:08:05.721934 np0000002687 nova-compute[98431]: pc-i440fx-artful Jun 11 23:08:05.721934 np0000002687 nova-compute[98431]: pc-i440fx-8.1 Jun 11 23:08:05.721934 np0000002687 nova-compute[98431]: pc-i440fx-2.7 Jun 11 23:08:05.721934 np0000002687 nova-compute[98431]: pc-q35-6.1 Jun 11 23:08:05.721934 np0000002687 nova-compute[98431]: pc-i440fx-kinetic Jun 11 23:08:05.721934 np0000002687 nova-compute[98431]: pc-i440fx-jammy-maxcpus Jun 11 23:08:05.721934 np0000002687 nova-compute[98431]: pc-i440fx-yakkety Jun 11 23:08:05.721934 np0000002687 nova-compute[98431]: pc-q35-2.4 Jun 11 23:08:05.721934 np0000002687 nova-compute[98431]: pc-q35-cosmic-hpb Jun 11 23:08:05.721934 np0000002687 nova-compute[98431]: pc-i440fx-7.1 Jun 11 23:08:05.721934 np0000002687 nova-compute[98431]: pc-q35-2.10 Jun 11 23:08:05.721934 np0000002687 nova-compute[98431]: x-remote Jun 11 23:08:05.721934 np0000002687 nova-compute[98431]: pc-q35-5.1 Jun 11 23:08:05.721934 np0000002687 nova-compute[98431]: pc-q35-2.9 Jun 11 23:08:05.721934 np0000002687 nova-compute[98431]: pc-i440fx-2.11 Jun 11 23:08:05.722584 np0000002687 nova-compute[98431]: pc-i440fx-jammy-hpb-maxcpus Jun 11 23:08:05.722584 np0000002687 nova-compute[98431]: pc-q35-3.1 Jun 11 23:08:05.722584 np0000002687 nova-compute[98431]: pc-i440fx-6.1 Jun 11 23:08:05.722584 np0000002687 nova-compute[98431]: pc-q35-4.1 Jun 11 23:08:05.722584 np0000002687 nova-compute[98431]: pc-q35-jammy Jun 11 23:08:05.722584 np0000002687 nova-compute[98431]: pc-i440fx-2.4 Jun 11 23:08:05.722584 np0000002687 nova-compute[98431]: pc-i440fx-4.1 Jun 11 23:08:05.722584 np0000002687 nova-compute[98431]: pc-q35-eoan Jun 11 23:08:05.722584 np0000002687 nova-compute[98431]: pc-q35-jammy-hpb Jun 11 23:08:05.722584 np0000002687 nova-compute[98431]: pc-i440fx-5.1 Jun 11 23:08:05.722584 np0000002687 nova-compute[98431]: pc-i440fx-2.9 Jun 11 23:08:05.722584 np0000002687 nova-compute[98431]: pc-i440fx-bionic-hpb Jun 11 23:08:05.722584 np0000002687 nova-compute[98431]: pc-i440fx-lunar Jun 11 23:08:05.722584 np0000002687 nova-compute[98431]: isapc Jun 11 23:08:05.722584 np0000002687 nova-compute[98431]: pc-i440fx-mantic-hpb Jun 11 23:08:05.722584 np0000002687 nova-compute[98431]: pc-q35-cosmic Jun 11 23:08:05.722584 np0000002687 nova-compute[98431]: pc-q35-2.6 Jun 11 23:08:05.722584 np0000002687 nova-compute[98431]: pc-q35-mantic-maxcpus Jun 11 23:08:05.722584 np0000002687 nova-compute[98431]: pc-i440fx-3.1 Jun 11 23:08:05.722584 np0000002687 nova-compute[98431]: pc-q35-bionic Jun 11 23:08:05.722584 np0000002687 nova-compute[98431]: pc-q35-disco-hpb Jun 11 23:08:05.722584 np0000002687 nova-compute[98431]: pc-i440fx-cosmic Jun 11 23:08:05.722584 np0000002687 nova-compute[98431]: pc-q35-2.12 Jun 11 23:08:05.722584 np0000002687 nova-compute[98431]: pc-i440fx-bionic Jun 11 23:08:05.722584 np0000002687 nova-compute[98431]: pc-q35-kinetic-hpb Jun 11 23:08:05.722584 np0000002687 nova-compute[98431]: pc-q35-groovy-hpb Jun 11 23:08:05.722584 np0000002687 nova-compute[98431]: pc-q35-7.0 Jun 11 23:08:05.722584 np0000002687 nova-compute[98431]: pc-q35-noble-v2 Jun 11 23:08:05.722584 np0000002687 nova-compute[98431]: ubuntu-q35 Jun 11 23:08:05.722584 np0000002687 nova-compute[98431]: pc-i440fx-lunar-hpb Jun 11 23:08:05.722584 np0000002687 nova-compute[98431]: pc-q35-disco Jun 11 23:08:05.722584 np0000002687 nova-compute[98431]: pc-i440fx-cosmic-hpb Jun 11 23:08:05.722584 np0000002687 nova-compute[98431]: pc-i440fx-2.1 Jun 11 23:08:05.722584 np0000002687 nova-compute[98431]: pc-q35-noble Jun 11 23:08:05.722584 np0000002687 nova-compute[98431]: q35 Jun 11 23:08:05.722584 np0000002687 nova-compute[98431]: pc-q35-8.0 Jun 11 23:08:05.723271 np0000002687 nova-compute[98431]: pc-i440fx-wily Jun 11 23:08:05.723271 np0000002687 nova-compute[98431]: pc-q35-impish Jun 11 23:08:05.723271 np0000002687 nova-compute[98431]: pc-i440fx-8.0 Jun 11 23:08:05.723271 np0000002687 nova-compute[98431]: pc-i440fx-2.6 Jun 11 23:08:05.723271 np0000002687 nova-compute[98431]: pc-q35-6.0 Jun 11 23:08:05.723271 np0000002687 nova-compute[98431]: pc-i440fx-impish Jun 11 23:08:05.723271 np0000002687 nova-compute[98431]: pc-i440fx-jammy Jun 11 23:08:05.723271 np0000002687 nova-compute[98431]: pc-q35-impish-hpb Jun 11 23:08:05.723271 np0000002687 nova-compute[98431]: pc-q35-hirsute Jun 11 23:08:05.723271 np0000002687 nova-compute[98431]: pc-q35-4.0.1 Jun 11 23:08:05.723271 np0000002687 nova-compute[98431]: pc-q35-hirsute-hpb Jun 11 23:08:05.723271 np0000002687 nova-compute[98431]: pc-i440fx-7.0 Jun 11 23:08:05.723271 np0000002687 nova-compute[98431]: pc-q35-5.0 Jun 11 23:08:05.723271 np0000002687 nova-compute[98431]: pc-q35-2.8 Jun 11 23:08:05.723271 np0000002687 nova-compute[98431]: pc-i440fx-2.10 Jun 11 23:08:05.723271 np0000002687 nova-compute[98431]: pc-q35-3.0 Jun 11 23:08:05.723271 np0000002687 nova-compute[98431]: pc-q35-zesty Jun 11 23:08:05.723271 np0000002687 nova-compute[98431]: pc-q35-7.2 Jun 11 23:08:05.723271 np0000002687 nova-compute[98431]: pc-q35-4.0 Jun 11 23:08:05.723271 np0000002687 nova-compute[98431]: pc-i440fx-6.0 Jun 11 23:08:05.723271 np0000002687 nova-compute[98431]: pc-q35-focal Jun 11 23:08:05.723271 np0000002687 nova-compute[98431]: microvm Jun 11 23:08:05.723271 np0000002687 nova-compute[98431]: pc-i440fx-2.3 Jun 11 23:08:05.723271 np0000002687 nova-compute[98431]: pc-q35-jammy-hpb-maxcpus Jun 11 23:08:05.723271 np0000002687 nova-compute[98431]: pc-i440fx-disco Jun 11 23:08:05.723271 np0000002687 nova-compute[98431]: pc-i440fx-kinetic-hpb Jun 11 23:08:05.723271 np0000002687 nova-compute[98431]: pc-i440fx-4.0 Jun 11 23:08:05.723271 np0000002687 nova-compute[98431]: pc-i440fx-focal-hpb Jun 11 23:08:05.723271 np0000002687 nova-compute[98431]: pc-i440fx-noble Jun 11 23:08:05.723271 np0000002687 nova-compute[98431]: pc Jun 11 23:08:05.723271 np0000002687 nova-compute[98431]: pc-q35-8.2 Jun 11 23:08:05.723271 np0000002687 nova-compute[98431]: q35 Jun 11 23:08:05.723271 np0000002687 nova-compute[98431]: pc-i440fx-groovy-hpb Jun 11 23:08:05.723271 np0000002687 nova-compute[98431]: pc-i440fx-hirsute-hpb Jun 11 23:08:05.723271 np0000002687 nova-compute[98431]: pc-i440fx-8.2 Jun 11 23:08:05.723271 np0000002687 nova-compute[98431]: pc Jun 11 23:08:05.723908 np0000002687 nova-compute[98431]: pc-i440fx-5.0 Jun 11 23:08:05.723908 np0000002687 nova-compute[98431]: pc-i440fx-2.8 Jun 11 23:08:05.723908 np0000002687 nova-compute[98431]: pc-q35-6.2 Jun 11 23:08:05.723908 np0000002687 nova-compute[98431]: pc-i440fx-eoan Jun 11 23:08:05.723908 np0000002687 nova-compute[98431]: pc-q35-2.5 Jun 11 23:08:05.723908 np0000002687 nova-compute[98431]: pc-i440fx-3.0 Jun 11 23:08:05.723908 np0000002687 nova-compute[98431]: pc-q35-yakkety Jun 11 23:08:05.723908 np0000002687 nova-compute[98431]: pc-i440fx-mantic-hpb-maxcpus Jun 11 23:08:05.723908 np0000002687 nova-compute[98431]: pc-i440fx-7.2 Jun 11 23:08:05.723908 np0000002687 nova-compute[98431]: pc-q35-2.11 Jun 11 23:08:05.723908 np0000002687 nova-compute[98431]: Jun 11 23:08:05.723908 np0000002687 nova-compute[98431]: Jun 11 23:08:05.723908 np0000002687 nova-compute[98431]: Jun 11 23:08:05.723908 np0000002687 nova-compute[98431]: Jun 11 23:08:05.723908 np0000002687 nova-compute[98431]: Jun 11 23:08:05.723908 np0000002687 nova-compute[98431]: Jun 11 23:08:05.723908 np0000002687 nova-compute[98431]: Jun 11 23:08:05.723908 np0000002687 nova-compute[98431]: Jun 11 23:08:05.723908 np0000002687 nova-compute[98431]: Jun 11 23:08:05.723908 np0000002687 nova-compute[98431]: Jun 11 23:08:05.723908 np0000002687 nova-compute[98431]: Jun 11 23:08:05.723908 np0000002687 nova-compute[98431]: Jun 11 23:08:05.723908 np0000002687 nova-compute[98431]: Jun 11 23:08:05.723908 np0000002687 nova-compute[98431]: hvm Jun 11 23:08:05.723908 np0000002687 nova-compute[98431]: Jun 11 23:08:05.723908 np0000002687 nova-compute[98431]: 32 Jun 11 23:08:05.723908 np0000002687 nova-compute[98431]: /usr/bin/qemu-system-xtensa Jun 11 23:08:05.723908 np0000002687 nova-compute[98431]: sim Jun 11 23:08:05.723908 np0000002687 nova-compute[98431]: kc705 Jun 11 23:08:05.723908 np0000002687 nova-compute[98431]: ml605 Jun 11 23:08:05.723908 np0000002687 nova-compute[98431]: ml605-nommu Jun 11 23:08:05.723908 np0000002687 nova-compute[98431]: virt Jun 11 23:08:05.723908 np0000002687 nova-compute[98431]: lx60-nommu Jun 11 23:08:05.723908 np0000002687 nova-compute[98431]: lx200 Jun 11 23:08:05.723908 np0000002687 nova-compute[98431]: lx200-nommu Jun 11 23:08:05.723908 np0000002687 nova-compute[98431]: lx60 Jun 11 23:08:05.723908 np0000002687 nova-compute[98431]: kc705-nommu Jun 11 23:08:05.723908 np0000002687 nova-compute[98431]: Jun 11 23:08:05.723908 np0000002687 nova-compute[98431]: Jun 11 23:08:05.723908 np0000002687 nova-compute[98431]: Jun 11 23:08:05.723908 np0000002687 nova-compute[98431]: Jun 11 23:08:05.723908 np0000002687 nova-compute[98431]: Jun 11 23:08:05.723908 np0000002687 nova-compute[98431]: Jun 11 23:08:05.723908 np0000002687 nova-compute[98431]: Jun 11 23:08:05.723908 np0000002687 nova-compute[98431]: Jun 11 23:08:05.723908 np0000002687 nova-compute[98431]: Jun 11 23:08:05.723908 np0000002687 nova-compute[98431]: Jun 11 23:08:05.723908 np0000002687 nova-compute[98431]: hvm Jun 11 23:08:05.723908 np0000002687 nova-compute[98431]: Jun 11 23:08:05.723908 np0000002687 nova-compute[98431]: 32 Jun 11 23:08:05.723908 np0000002687 nova-compute[98431]: /usr/bin/qemu-system-xtensaeb Jun 11 23:08:05.723908 np0000002687 nova-compute[98431]: sim Jun 11 23:08:05.723908 np0000002687 nova-compute[98431]: kc705 Jun 11 23:08:05.723908 np0000002687 nova-compute[98431]: ml605 Jun 11 23:08:05.723908 np0000002687 nova-compute[98431]: ml605-nommu Jun 11 23:08:05.723908 np0000002687 nova-compute[98431]: virt Jun 11 23:08:05.724827 np0000002687 nova-compute[98431]: lx60-nommu Jun 11 23:08:05.724827 np0000002687 nova-compute[98431]: lx200 Jun 11 23:08:05.724827 np0000002687 nova-compute[98431]: lx200-nommu Jun 11 23:08:05.724827 np0000002687 nova-compute[98431]: lx60 Jun 11 23:08:05.724827 np0000002687 nova-compute[98431]: kc705-nommu Jun 11 23:08:05.724827 np0000002687 nova-compute[98431]: Jun 11 23:08:05.724827 np0000002687 nova-compute[98431]: Jun 11 23:08:05.724827 np0000002687 nova-compute[98431]: Jun 11 23:08:05.724827 np0000002687 nova-compute[98431]: Jun 11 23:08:05.724827 np0000002687 nova-compute[98431]: Jun 11 23:08:05.724827 np0000002687 nova-compute[98431]: Jun 11 23:08:05.724827 np0000002687 nova-compute[98431]: Jun 11 23:08:05.724827 np0000002687 nova-compute[98431]: Jun 11 23:08:05.724827 np0000002687 nova-compute[98431]: Jun 11 23:08:05.724827 np0000002687 nova-compute[98431]: Jun 11 23:08:05.724827 np0000002687 nova-compute[98431]: Jun 11 23:08:05.724827 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=98431) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 11 23:08:05.725636 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] Libvirt host hypervisor capabilities for arch=alpha and machine_type=None: Jun 11 23:08:05.725636 np0000002687 nova-compute[98431]: Jun 11 23:08:05.725636 np0000002687 nova-compute[98431]: /usr/bin/qemu-system-alpha Jun 11 23:08:05.725636 np0000002687 nova-compute[98431]: qemu Jun 11 23:08:05.725636 np0000002687 nova-compute[98431]: clipper Jun 11 23:08:05.725636 np0000002687 nova-compute[98431]: alpha Jun 11 23:08:05.725636 np0000002687 nova-compute[98431]: Jun 11 23:08:05.725636 np0000002687 nova-compute[98431]: Jun 11 23:08:05.725636 np0000002687 nova-compute[98431]: Jun 11 23:08:05.725636 np0000002687 nova-compute[98431]: Jun 11 23:08:05.725636 np0000002687 nova-compute[98431]: Jun 11 23:08:05.725636 np0000002687 nova-compute[98431]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 11 23:08:05.725636 np0000002687 nova-compute[98431]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 11 23:08:05.725636 np0000002687 nova-compute[98431]: Jun 11 23:08:05.725636 np0000002687 nova-compute[98431]: rom Jun 11 23:08:05.725636 np0000002687 nova-compute[98431]: pflash Jun 11 23:08:05.725636 np0000002687 nova-compute[98431]: Jun 11 23:08:05.725636 np0000002687 nova-compute[98431]: Jun 11 23:08:05.725636 np0000002687 nova-compute[98431]: yes Jun 11 23:08:05.725636 np0000002687 nova-compute[98431]: no Jun 11 23:08:05.725636 np0000002687 nova-compute[98431]: Jun 11 23:08:05.725636 np0000002687 nova-compute[98431]: Jun 11 23:08:05.725636 np0000002687 nova-compute[98431]: no Jun 11 23:08:05.725636 np0000002687 nova-compute[98431]: Jun 11 23:08:05.725636 np0000002687 nova-compute[98431]: Jun 11 23:08:05.725636 np0000002687 nova-compute[98431]: Jun 11 23:08:05.725636 np0000002687 nova-compute[98431]: Jun 11 23:08:05.725636 np0000002687 nova-compute[98431]: Jun 11 23:08:05.725636 np0000002687 nova-compute[98431]: Jun 11 23:08:05.725636 np0000002687 nova-compute[98431]: Jun 11 23:08:05.725636 np0000002687 nova-compute[98431]: Jun 11 23:08:05.725636 np0000002687 nova-compute[98431]: Jun 11 23:08:05.725636 np0000002687 nova-compute[98431]: Jun 11 23:08:05.725636 np0000002687 nova-compute[98431]: Jun 11 23:08:05.725636 np0000002687 nova-compute[98431]: file Jun 11 23:08:05.725636 np0000002687 nova-compute[98431]: anonymous Jun 11 23:08:05.725636 np0000002687 nova-compute[98431]: memfd Jun 11 23:08:05.725636 np0000002687 nova-compute[98431]: Jun 11 23:08:05.725636 np0000002687 nova-compute[98431]: Jun 11 23:08:05.725636 np0000002687 nova-compute[98431]: Jun 11 23:08:05.725636 np0000002687 nova-compute[98431]: Jun 11 23:08:05.725636 np0000002687 nova-compute[98431]: Jun 11 23:08:05.725636 np0000002687 nova-compute[98431]: disk Jun 11 23:08:05.725636 np0000002687 nova-compute[98431]: cdrom Jun 11 23:08:05.725636 np0000002687 nova-compute[98431]: floppy Jun 11 23:08:05.725636 np0000002687 nova-compute[98431]: lun Jun 11 23:08:05.725636 np0000002687 nova-compute[98431]: Jun 11 23:08:05.725636 np0000002687 nova-compute[98431]: Jun 11 23:08:05.725636 np0000002687 nova-compute[98431]: fdc Jun 11 23:08:05.725636 np0000002687 nova-compute[98431]: scsi Jun 11 23:08:05.725636 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.725636 np0000002687 nova-compute[98431]: usb Jun 11 23:08:05.725636 np0000002687 nova-compute[98431]: sata Jun 11 23:08:05.725636 np0000002687 nova-compute[98431]: Jun 11 23:08:05.725636 np0000002687 nova-compute[98431]: Jun 11 23:08:05.725636 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.725636 np0000002687 nova-compute[98431]: virtio-transitional Jun 11 23:08:05.725636 np0000002687 nova-compute[98431]: virtio-non-transitional Jun 11 23:08:05.725636 np0000002687 nova-compute[98431]: Jun 11 23:08:05.725636 np0000002687 nova-compute[98431]: Jun 11 23:08:05.725636 np0000002687 nova-compute[98431]: Jun 11 23:08:05.725636 np0000002687 nova-compute[98431]: Jun 11 23:08:05.725636 np0000002687 nova-compute[98431]: sdl Jun 11 23:08:05.725636 np0000002687 nova-compute[98431]: vnc Jun 11 23:08:05.725636 np0000002687 nova-compute[98431]: spice Jun 11 23:08:05.725636 np0000002687 nova-compute[98431]: egl-headless Jun 11 23:08:05.725636 np0000002687 nova-compute[98431]: dbus Jun 11 23:08:05.725636 np0000002687 nova-compute[98431]: Jun 11 23:08:05.725636 np0000002687 nova-compute[98431]: Jun 11 23:08:05.725636 np0000002687 nova-compute[98431]: Jun 11 23:08:05.727140 np0000002687 nova-compute[98431]: Jun 11 23:08:05.727140 np0000002687 nova-compute[98431]: Jun 11 23:08:05.727140 np0000002687 nova-compute[98431]: subsystem Jun 11 23:08:05.727140 np0000002687 nova-compute[98431]: Jun 11 23:08:05.727140 np0000002687 nova-compute[98431]: Jun 11 23:08:05.727140 np0000002687 nova-compute[98431]: default Jun 11 23:08:05.727140 np0000002687 nova-compute[98431]: mandatory Jun 11 23:08:05.727140 np0000002687 nova-compute[98431]: requisite Jun 11 23:08:05.727140 np0000002687 nova-compute[98431]: optional Jun 11 23:08:05.727140 np0000002687 nova-compute[98431]: Jun 11 23:08:05.727140 np0000002687 nova-compute[98431]: Jun 11 23:08:05.727140 np0000002687 nova-compute[98431]: usb Jun 11 23:08:05.727140 np0000002687 nova-compute[98431]: pci Jun 11 23:08:05.727140 np0000002687 nova-compute[98431]: scsi Jun 11 23:08:05.727140 np0000002687 nova-compute[98431]: Jun 11 23:08:05.727140 np0000002687 nova-compute[98431]: Jun 11 23:08:05.727140 np0000002687 nova-compute[98431]: Jun 11 23:08:05.727140 np0000002687 nova-compute[98431]: Jun 11 23:08:05.727140 np0000002687 nova-compute[98431]: Jun 11 23:08:05.727140 np0000002687 nova-compute[98431]: Jun 11 23:08:05.727140 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.727140 np0000002687 nova-compute[98431]: virtio-transitional Jun 11 23:08:05.727140 np0000002687 nova-compute[98431]: virtio-non-transitional Jun 11 23:08:05.727140 np0000002687 nova-compute[98431]: Jun 11 23:08:05.727140 np0000002687 nova-compute[98431]: Jun 11 23:08:05.727140 np0000002687 nova-compute[98431]: random Jun 11 23:08:05.727140 np0000002687 nova-compute[98431]: egd Jun 11 23:08:05.727140 np0000002687 nova-compute[98431]: builtin Jun 11 23:08:05.727140 np0000002687 nova-compute[98431]: Jun 11 23:08:05.727140 np0000002687 nova-compute[98431]: Jun 11 23:08:05.727140 np0000002687 nova-compute[98431]: Jun 11 23:08:05.727140 np0000002687 nova-compute[98431]: Jun 11 23:08:05.727140 np0000002687 nova-compute[98431]: path Jun 11 23:08:05.727140 np0000002687 nova-compute[98431]: handle Jun 11 23:08:05.727140 np0000002687 nova-compute[98431]: virtiofs Jun 11 23:08:05.727140 np0000002687 nova-compute[98431]: Jun 11 23:08:05.727140 np0000002687 nova-compute[98431]: Jun 11 23:08:05.727140 np0000002687 nova-compute[98431]: Jun 11 23:08:05.727140 np0000002687 nova-compute[98431]: Jun 11 23:08:05.727140 np0000002687 nova-compute[98431]: Jun 11 23:08:05.727140 np0000002687 nova-compute[98431]: usb Jun 11 23:08:05.727140 np0000002687 nova-compute[98431]: Jun 11 23:08:05.727140 np0000002687 nova-compute[98431]: Jun 11 23:08:05.727140 np0000002687 nova-compute[98431]: Jun 11 23:08:05.727140 np0000002687 nova-compute[98431]: Jun 11 23:08:05.727140 np0000002687 nova-compute[98431]: pty Jun 11 23:08:05.727140 np0000002687 nova-compute[98431]: unix Jun 11 23:08:05.727140 np0000002687 nova-compute[98431]: spicevmc Jun 11 23:08:05.727140 np0000002687 nova-compute[98431]: Jun 11 23:08:05.727140 np0000002687 nova-compute[98431]: Jun 11 23:08:05.727140 np0000002687 nova-compute[98431]: Jun 11 23:08:05.727140 np0000002687 nova-compute[98431]: Jun 11 23:08:05.727140 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.727140 np0000002687 nova-compute[98431]: Jun 11 23:08:05.727140 np0000002687 nova-compute[98431]: Jun 11 23:08:05.727140 np0000002687 nova-compute[98431]: qemu Jun 11 23:08:05.727140 np0000002687 nova-compute[98431]: Jun 11 23:08:05.727140 np0000002687 nova-compute[98431]: Jun 11 23:08:05.727140 np0000002687 nova-compute[98431]: builtin Jun 11 23:08:05.727140 np0000002687 nova-compute[98431]: Jun 11 23:08:05.727140 np0000002687 nova-compute[98431]: Jun 11 23:08:05.727140 np0000002687 nova-compute[98431]: Jun 11 23:08:05.727140 np0000002687 nova-compute[98431]: Jun 11 23:08:05.727140 np0000002687 nova-compute[98431]: Jun 11 23:08:05.727140 np0000002687 nova-compute[98431]: Jun 11 23:08:05.727140 np0000002687 nova-compute[98431]: Jun 11 23:08:05.727140 np0000002687 nova-compute[98431]: Jun 11 23:08:05.727140 np0000002687 nova-compute[98431]: Jun 11 23:08:05.727140 np0000002687 nova-compute[98431]: Jun 11 23:08:05.727140 np0000002687 nova-compute[98431]: Jun 11 23:08:05.727140 np0000002687 nova-compute[98431]: Jun 11 23:08:05.727140 np0000002687 nova-compute[98431]: Jun 11 23:08:05.727140 np0000002687 nova-compute[98431]: Jun 11 23:08:05.728888 np0000002687 nova-compute[98431]: {{(pid=98431) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 11 23:08:05.728888 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] Getting domain capabilities for armv6l via machine types: {None, 'virt'} {{(pid=98431) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 11 23:08:05.728888 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] Libvirt host hypervisor capabilities for arch=armv6l and machine_type=None: Jun 11 23:08:05.728888 np0000002687 nova-compute[98431]: Jun 11 23:08:05.728888 np0000002687 nova-compute[98431]: /usr/bin/qemu-system-arm Jun 11 23:08:05.728888 np0000002687 nova-compute[98431]: qemu Jun 11 23:08:05.728888 np0000002687 nova-compute[98431]: virt-8.2 Jun 11 23:08:05.728888 np0000002687 nova-compute[98431]: armv6l Jun 11 23:08:05.728888 np0000002687 nova-compute[98431]: Jun 11 23:08:05.728888 np0000002687 nova-compute[98431]: Jun 11 23:08:05.728888 np0000002687 nova-compute[98431]: Jun 11 23:08:05.728888 np0000002687 nova-compute[98431]: Jun 11 23:08:05.728888 np0000002687 nova-compute[98431]: Jun 11 23:08:05.728888 np0000002687 nova-compute[98431]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 11 23:08:05.728888 np0000002687 nova-compute[98431]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 11 23:08:05.728888 np0000002687 nova-compute[98431]: Jun 11 23:08:05.728888 np0000002687 nova-compute[98431]: rom Jun 11 23:08:05.728888 np0000002687 nova-compute[98431]: pflash Jun 11 23:08:05.728888 np0000002687 nova-compute[98431]: Jun 11 23:08:05.728888 np0000002687 nova-compute[98431]: Jun 11 23:08:05.728888 np0000002687 nova-compute[98431]: yes Jun 11 23:08:05.728888 np0000002687 nova-compute[98431]: no Jun 11 23:08:05.728888 np0000002687 nova-compute[98431]: Jun 11 23:08:05.728888 np0000002687 nova-compute[98431]: Jun 11 23:08:05.728888 np0000002687 nova-compute[98431]: no Jun 11 23:08:05.728888 np0000002687 nova-compute[98431]: Jun 11 23:08:05.728888 np0000002687 nova-compute[98431]: Jun 11 23:08:05.728888 np0000002687 nova-compute[98431]: Jun 11 23:08:05.728888 np0000002687 nova-compute[98431]: Jun 11 23:08:05.728888 np0000002687 nova-compute[98431]: Jun 11 23:08:05.728888 np0000002687 nova-compute[98431]: Jun 11 23:08:05.728888 np0000002687 nova-compute[98431]: Jun 11 23:08:05.728888 np0000002687 nova-compute[98431]: on Jun 11 23:08:05.728888 np0000002687 nova-compute[98431]: off Jun 11 23:08:05.728888 np0000002687 nova-compute[98431]: Jun 11 23:08:05.728888 np0000002687 nova-compute[98431]: Jun 11 23:08:05.728888 np0000002687 nova-compute[98431]: Jun 11 23:08:05.728888 np0000002687 nova-compute[98431]: Jun 11 23:08:05.728888 np0000002687 nova-compute[98431]: pxa270-c0 Jun 11 23:08:05.728888 np0000002687 nova-compute[98431]: cortex-a15 Jun 11 23:08:05.728888 np0000002687 nova-compute[98431]: pxa270-b0 Jun 11 23:08:05.728888 np0000002687 nova-compute[98431]: cortex-m4 Jun 11 23:08:05.728888 np0000002687 nova-compute[98431]: pxa270-a0 Jun 11 23:08:05.728888 np0000002687 nova-compute[98431]: arm1176 Jun 11 23:08:05.728888 np0000002687 nova-compute[98431]: pxa270-b1 Jun 11 23:08:05.729752 np0000002687 nova-compute[98431]: cortex-a7 Jun 11 23:08:05.729752 np0000002687 nova-compute[98431]: pxa270-a1 Jun 11 23:08:05.729752 np0000002687 nova-compute[98431]: cortex-a8 Jun 11 23:08:05.729752 np0000002687 nova-compute[98431]: cortex-r5 Jun 11 23:08:05.729752 np0000002687 nova-compute[98431]: ti925t Jun 11 23:08:05.729752 np0000002687 nova-compute[98431]: cortex-r5f Jun 11 23:08:05.729752 np0000002687 nova-compute[98431]: arm1026 Jun 11 23:08:05.729752 np0000002687 nova-compute[98431]: cortex-a9 Jun 11 23:08:05.729752 np0000002687 nova-compute[98431]: cortex-m7 Jun 11 23:08:05.729752 np0000002687 nova-compute[98431]: pxa270 Jun 11 23:08:05.729752 np0000002687 nova-compute[98431]: pxa260 Jun 11 23:08:05.729752 np0000002687 nova-compute[98431]: pxa250 Jun 11 23:08:05.729752 np0000002687 nova-compute[98431]: pxa270-c5 Jun 11 23:08:05.729752 np0000002687 nova-compute[98431]: pxa261 Jun 11 23:08:05.729752 np0000002687 nova-compute[98431]: pxa262 Jun 11 23:08:05.729752 np0000002687 nova-compute[98431]: sa1110 Jun 11 23:08:05.729752 np0000002687 nova-compute[98431]: cortex-r52 Jun 11 23:08:05.729752 np0000002687 nova-compute[98431]: sa1100 Jun 11 23:08:05.729752 np0000002687 nova-compute[98431]: max Jun 11 23:08:05.729752 np0000002687 nova-compute[98431]: cortex-m0 Jun 11 23:08:05.729752 np0000002687 nova-compute[98431]: cortex-m33 Jun 11 23:08:05.729752 np0000002687 nova-compute[98431]: arm946 Jun 11 23:08:05.729752 np0000002687 nova-compute[98431]: pxa255 Jun 11 23:08:05.729752 np0000002687 nova-compute[98431]: arm11mpcore Jun 11 23:08:05.729752 np0000002687 nova-compute[98431]: cortex-m55 Jun 11 23:08:05.729752 np0000002687 nova-compute[98431]: arm926 Jun 11 23:08:05.729752 np0000002687 nova-compute[98431]: arm1136 Jun 11 23:08:05.729752 np0000002687 nova-compute[98431]: arm1136-r2 Jun 11 23:08:05.729752 np0000002687 nova-compute[98431]: cortex-m3 Jun 11 23:08:05.729752 np0000002687 nova-compute[98431]: Jun 11 23:08:05.729752 np0000002687 nova-compute[98431]: Jun 11 23:08:05.729752 np0000002687 nova-compute[98431]: Jun 11 23:08:05.729752 np0000002687 nova-compute[98431]: Jun 11 23:08:05.729752 np0000002687 nova-compute[98431]: file Jun 11 23:08:05.729752 np0000002687 nova-compute[98431]: anonymous Jun 11 23:08:05.729752 np0000002687 nova-compute[98431]: memfd Jun 11 23:08:05.729752 np0000002687 nova-compute[98431]: Jun 11 23:08:05.729752 np0000002687 nova-compute[98431]: Jun 11 23:08:05.730557 np0000002687 nova-compute[98431]: Jun 11 23:08:05.730557 np0000002687 nova-compute[98431]: Jun 11 23:08:05.730557 np0000002687 nova-compute[98431]: Jun 11 23:08:05.730557 np0000002687 nova-compute[98431]: disk Jun 11 23:08:05.730557 np0000002687 nova-compute[98431]: cdrom Jun 11 23:08:05.730557 np0000002687 nova-compute[98431]: floppy Jun 11 23:08:05.730557 np0000002687 nova-compute[98431]: lun Jun 11 23:08:05.730557 np0000002687 nova-compute[98431]: Jun 11 23:08:05.730557 np0000002687 nova-compute[98431]: Jun 11 23:08:05.730557 np0000002687 nova-compute[98431]: fdc Jun 11 23:08:05.730557 np0000002687 nova-compute[98431]: scsi Jun 11 23:08:05.730557 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.730557 np0000002687 nova-compute[98431]: usb Jun 11 23:08:05.730557 np0000002687 nova-compute[98431]: sata Jun 11 23:08:05.730557 np0000002687 nova-compute[98431]: Jun 11 23:08:05.730557 np0000002687 nova-compute[98431]: Jun 11 23:08:05.730557 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.730557 np0000002687 nova-compute[98431]: virtio-transitional Jun 11 23:08:05.730557 np0000002687 nova-compute[98431]: virtio-non-transitional Jun 11 23:08:05.730557 np0000002687 nova-compute[98431]: Jun 11 23:08:05.730557 np0000002687 nova-compute[98431]: Jun 11 23:08:05.730557 np0000002687 nova-compute[98431]: Jun 11 23:08:05.730557 np0000002687 nova-compute[98431]: Jun 11 23:08:05.730557 np0000002687 nova-compute[98431]: sdl Jun 11 23:08:05.730557 np0000002687 nova-compute[98431]: vnc Jun 11 23:08:05.730557 np0000002687 nova-compute[98431]: spice Jun 11 23:08:05.730557 np0000002687 nova-compute[98431]: egl-headless Jun 11 23:08:05.730557 np0000002687 nova-compute[98431]: dbus Jun 11 23:08:05.730557 np0000002687 nova-compute[98431]: Jun 11 23:08:05.730557 np0000002687 nova-compute[98431]: Jun 11 23:08:05.730557 np0000002687 nova-compute[98431]: Jun 11 23:08:05.730557 np0000002687 nova-compute[98431]: Jun 11 23:08:05.730557 np0000002687 nova-compute[98431]: Jun 11 23:08:05.730557 np0000002687 nova-compute[98431]: subsystem Jun 11 23:08:05.730557 np0000002687 nova-compute[98431]: Jun 11 23:08:05.730557 np0000002687 nova-compute[98431]: Jun 11 23:08:05.730557 np0000002687 nova-compute[98431]: default Jun 11 23:08:05.730557 np0000002687 nova-compute[98431]: mandatory Jun 11 23:08:05.730557 np0000002687 nova-compute[98431]: requisite Jun 11 23:08:05.730557 np0000002687 nova-compute[98431]: optional Jun 11 23:08:05.730557 np0000002687 nova-compute[98431]: Jun 11 23:08:05.730557 np0000002687 nova-compute[98431]: Jun 11 23:08:05.730557 np0000002687 nova-compute[98431]: usb Jun 11 23:08:05.730557 np0000002687 nova-compute[98431]: pci Jun 11 23:08:05.730557 np0000002687 nova-compute[98431]: scsi Jun 11 23:08:05.730557 np0000002687 nova-compute[98431]: Jun 11 23:08:05.730557 np0000002687 nova-compute[98431]: Jun 11 23:08:05.730557 np0000002687 nova-compute[98431]: Jun 11 23:08:05.730557 np0000002687 nova-compute[98431]: Jun 11 23:08:05.730557 np0000002687 nova-compute[98431]: Jun 11 23:08:05.730557 np0000002687 nova-compute[98431]: Jun 11 23:08:05.730557 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.730557 np0000002687 nova-compute[98431]: virtio-transitional Jun 11 23:08:05.730557 np0000002687 nova-compute[98431]: virtio-non-transitional Jun 11 23:08:05.730557 np0000002687 nova-compute[98431]: Jun 11 23:08:05.730557 np0000002687 nova-compute[98431]: Jun 11 23:08:05.730557 np0000002687 nova-compute[98431]: random Jun 11 23:08:05.730557 np0000002687 nova-compute[98431]: egd Jun 11 23:08:05.730557 np0000002687 nova-compute[98431]: builtin Jun 11 23:08:05.730557 np0000002687 nova-compute[98431]: Jun 11 23:08:05.730557 np0000002687 nova-compute[98431]: Jun 11 23:08:05.730557 np0000002687 nova-compute[98431]: Jun 11 23:08:05.730557 np0000002687 nova-compute[98431]: Jun 11 23:08:05.730557 np0000002687 nova-compute[98431]: path Jun 11 23:08:05.730557 np0000002687 nova-compute[98431]: handle Jun 11 23:08:05.730557 np0000002687 nova-compute[98431]: virtiofs Jun 11 23:08:05.730557 np0000002687 nova-compute[98431]: Jun 11 23:08:05.730557 np0000002687 nova-compute[98431]: Jun 11 23:08:05.732030 np0000002687 nova-compute[98431]: Jun 11 23:08:05.732030 np0000002687 nova-compute[98431]: Jun 11 23:08:05.732030 np0000002687 nova-compute[98431]: tpm-tis Jun 11 23:08:05.732030 np0000002687 nova-compute[98431]: Jun 11 23:08:05.732030 np0000002687 nova-compute[98431]: Jun 11 23:08:05.732030 np0000002687 nova-compute[98431]: passthrough Jun 11 23:08:05.732030 np0000002687 nova-compute[98431]: emulator Jun 11 23:08:05.732030 np0000002687 nova-compute[98431]: external Jun 11 23:08:05.732030 np0000002687 nova-compute[98431]: Jun 11 23:08:05.732030 np0000002687 nova-compute[98431]: Jun 11 23:08:05.732030 np0000002687 nova-compute[98431]: 1.2 Jun 11 23:08:05.732030 np0000002687 nova-compute[98431]: 2.0 Jun 11 23:08:05.732030 np0000002687 nova-compute[98431]: Jun 11 23:08:05.732030 np0000002687 nova-compute[98431]: Jun 11 23:08:05.732030 np0000002687 nova-compute[98431]: Jun 11 23:08:05.732030 np0000002687 nova-compute[98431]: Jun 11 23:08:05.732030 np0000002687 nova-compute[98431]: usb Jun 11 23:08:05.732030 np0000002687 nova-compute[98431]: Jun 11 23:08:05.732030 np0000002687 nova-compute[98431]: Jun 11 23:08:05.732030 np0000002687 nova-compute[98431]: Jun 11 23:08:05.732030 np0000002687 nova-compute[98431]: Jun 11 23:08:05.732030 np0000002687 nova-compute[98431]: pty Jun 11 23:08:05.732030 np0000002687 nova-compute[98431]: unix Jun 11 23:08:05.732030 np0000002687 nova-compute[98431]: spicevmc Jun 11 23:08:05.732030 np0000002687 nova-compute[98431]: Jun 11 23:08:05.732030 np0000002687 nova-compute[98431]: Jun 11 23:08:05.732030 np0000002687 nova-compute[98431]: Jun 11 23:08:05.732030 np0000002687 nova-compute[98431]: Jun 11 23:08:05.732030 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.732030 np0000002687 nova-compute[98431]: Jun 11 23:08:05.732030 np0000002687 nova-compute[98431]: Jun 11 23:08:05.732030 np0000002687 nova-compute[98431]: qemu Jun 11 23:08:05.732030 np0000002687 nova-compute[98431]: Jun 11 23:08:05.732030 np0000002687 nova-compute[98431]: Jun 11 23:08:05.732030 np0000002687 nova-compute[98431]: builtin Jun 11 23:08:05.732030 np0000002687 nova-compute[98431]: Jun 11 23:08:05.732030 np0000002687 nova-compute[98431]: Jun 11 23:08:05.732030 np0000002687 nova-compute[98431]: Jun 11 23:08:05.732030 np0000002687 nova-compute[98431]: Jun 11 23:08:05.732030 np0000002687 nova-compute[98431]: Jun 11 23:08:05.732030 np0000002687 nova-compute[98431]: Jun 11 23:08:05.732030 np0000002687 nova-compute[98431]: 2 Jun 11 23:08:05.732030 np0000002687 nova-compute[98431]: 3 Jun 11 23:08:05.732030 np0000002687 nova-compute[98431]: Jun 11 23:08:05.732030 np0000002687 nova-compute[98431]: Jun 11 23:08:05.732030 np0000002687 nova-compute[98431]: Jun 11 23:08:05.732030 np0000002687 nova-compute[98431]: Jun 11 23:08:05.732030 np0000002687 nova-compute[98431]: Jun 11 23:08:05.732030 np0000002687 nova-compute[98431]: Jun 11 23:08:05.732030 np0000002687 nova-compute[98431]: Jun 11 23:08:05.732030 np0000002687 nova-compute[98431]: Jun 11 23:08:05.732030 np0000002687 nova-compute[98431]: Jun 11 23:08:05.732030 np0000002687 nova-compute[98431]: Jun 11 23:08:05.732030 np0000002687 nova-compute[98431]: Jun 11 23:08:05.732030 np0000002687 nova-compute[98431]: {{(pid=98431) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 11 23:08:05.732030 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] Libvirt host hypervisor capabilities for arch=armv6l and machine_type=virt: Jun 11 23:08:05.732030 np0000002687 nova-compute[98431]: Jun 11 23:08:05.732030 np0000002687 nova-compute[98431]: /usr/bin/qemu-system-arm Jun 11 23:08:05.732030 np0000002687 nova-compute[98431]: qemu Jun 11 23:08:05.732030 np0000002687 nova-compute[98431]: virt-8.2 Jun 11 23:08:05.732030 np0000002687 nova-compute[98431]: armv6l Jun 11 23:08:05.732030 np0000002687 nova-compute[98431]: Jun 11 23:08:05.732030 np0000002687 nova-compute[98431]: Jun 11 23:08:05.732030 np0000002687 nova-compute[98431]: Jun 11 23:08:05.732030 np0000002687 nova-compute[98431]: Jun 11 23:08:05.732030 np0000002687 nova-compute[98431]: Jun 11 23:08:05.732030 np0000002687 nova-compute[98431]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 11 23:08:05.732030 np0000002687 nova-compute[98431]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 11 23:08:05.732030 np0000002687 nova-compute[98431]: Jun 11 23:08:05.732030 np0000002687 nova-compute[98431]: rom Jun 11 23:08:05.733245 np0000002687 nova-compute[98431]: pflash Jun 11 23:08:05.733245 np0000002687 nova-compute[98431]: Jun 11 23:08:05.733245 np0000002687 nova-compute[98431]: Jun 11 23:08:05.733245 np0000002687 nova-compute[98431]: yes Jun 11 23:08:05.733245 np0000002687 nova-compute[98431]: no Jun 11 23:08:05.733245 np0000002687 nova-compute[98431]: Jun 11 23:08:05.733245 np0000002687 nova-compute[98431]: Jun 11 23:08:05.733245 np0000002687 nova-compute[98431]: no Jun 11 23:08:05.733245 np0000002687 nova-compute[98431]: Jun 11 23:08:05.733245 np0000002687 nova-compute[98431]: Jun 11 23:08:05.733245 np0000002687 nova-compute[98431]: Jun 11 23:08:05.733245 np0000002687 nova-compute[98431]: Jun 11 23:08:05.733245 np0000002687 nova-compute[98431]: Jun 11 23:08:05.733245 np0000002687 nova-compute[98431]: Jun 11 23:08:05.733245 np0000002687 nova-compute[98431]: Jun 11 23:08:05.733245 np0000002687 nova-compute[98431]: on Jun 11 23:08:05.733245 np0000002687 nova-compute[98431]: off Jun 11 23:08:05.733245 np0000002687 nova-compute[98431]: Jun 11 23:08:05.733245 np0000002687 nova-compute[98431]: Jun 11 23:08:05.733245 np0000002687 nova-compute[98431]: Jun 11 23:08:05.733245 np0000002687 nova-compute[98431]: Jun 11 23:08:05.733245 np0000002687 nova-compute[98431]: pxa270-c0 Jun 11 23:08:05.733245 np0000002687 nova-compute[98431]: cortex-a15 Jun 11 23:08:05.733245 np0000002687 nova-compute[98431]: pxa270-b0 Jun 11 23:08:05.733245 np0000002687 nova-compute[98431]: cortex-m4 Jun 11 23:08:05.733245 np0000002687 nova-compute[98431]: pxa270-a0 Jun 11 23:08:05.733245 np0000002687 nova-compute[98431]: arm1176 Jun 11 23:08:05.733245 np0000002687 nova-compute[98431]: pxa270-b1 Jun 11 23:08:05.733245 np0000002687 nova-compute[98431]: cortex-a7 Jun 11 23:08:05.733245 np0000002687 nova-compute[98431]: pxa270-a1 Jun 11 23:08:05.733245 np0000002687 nova-compute[98431]: cortex-a8 Jun 11 23:08:05.733245 np0000002687 nova-compute[98431]: cortex-r5 Jun 11 23:08:05.733245 np0000002687 nova-compute[98431]: ti925t Jun 11 23:08:05.733245 np0000002687 nova-compute[98431]: cortex-r5f Jun 11 23:08:05.733245 np0000002687 nova-compute[98431]: arm1026 Jun 11 23:08:05.733245 np0000002687 nova-compute[98431]: cortex-a9 Jun 11 23:08:05.733245 np0000002687 nova-compute[98431]: cortex-m7 Jun 11 23:08:05.733245 np0000002687 nova-compute[98431]: pxa270 Jun 11 23:08:05.733245 np0000002687 nova-compute[98431]: pxa260 Jun 11 23:08:05.733245 np0000002687 nova-compute[98431]: pxa250 Jun 11 23:08:05.733245 np0000002687 nova-compute[98431]: pxa270-c5 Jun 11 23:08:05.733245 np0000002687 nova-compute[98431]: pxa261 Jun 11 23:08:05.733245 np0000002687 nova-compute[98431]: pxa262 Jun 11 23:08:05.733245 np0000002687 nova-compute[98431]: sa1110 Jun 11 23:08:05.735157 np0000002687 nova-compute[98431]: cortex-r52 Jun 11 23:08:05.735157 np0000002687 nova-compute[98431]: sa1100 Jun 11 23:08:05.735157 np0000002687 nova-compute[98431]: max Jun 11 23:08:05.735157 np0000002687 nova-compute[98431]: cortex-m0 Jun 11 23:08:05.735157 np0000002687 nova-compute[98431]: cortex-m33 Jun 11 23:08:05.735157 np0000002687 nova-compute[98431]: arm946 Jun 11 23:08:05.735157 np0000002687 nova-compute[98431]: pxa255 Jun 11 23:08:05.735157 np0000002687 nova-compute[98431]: arm11mpcore Jun 11 23:08:05.735157 np0000002687 nova-compute[98431]: cortex-m55 Jun 11 23:08:05.735157 np0000002687 nova-compute[98431]: arm926 Jun 11 23:08:05.735157 np0000002687 nova-compute[98431]: arm1136 Jun 11 23:08:05.735157 np0000002687 nova-compute[98431]: arm1136-r2 Jun 11 23:08:05.735157 np0000002687 nova-compute[98431]: cortex-m3 Jun 11 23:08:05.735157 np0000002687 nova-compute[98431]: Jun 11 23:08:05.735157 np0000002687 nova-compute[98431]: Jun 11 23:08:05.735157 np0000002687 nova-compute[98431]: Jun 11 23:08:05.735157 np0000002687 nova-compute[98431]: Jun 11 23:08:05.735157 np0000002687 nova-compute[98431]: file Jun 11 23:08:05.735157 np0000002687 nova-compute[98431]: anonymous Jun 11 23:08:05.735157 np0000002687 nova-compute[98431]: memfd Jun 11 23:08:05.735157 np0000002687 nova-compute[98431]: Jun 11 23:08:05.735157 np0000002687 nova-compute[98431]: Jun 11 23:08:05.735157 np0000002687 nova-compute[98431]: Jun 11 23:08:05.735157 np0000002687 nova-compute[98431]: Jun 11 23:08:05.735157 np0000002687 nova-compute[98431]: Jun 11 23:08:05.735157 np0000002687 nova-compute[98431]: disk Jun 11 23:08:05.735157 np0000002687 nova-compute[98431]: cdrom Jun 11 23:08:05.735157 np0000002687 nova-compute[98431]: floppy Jun 11 23:08:05.735157 np0000002687 nova-compute[98431]: lun Jun 11 23:08:05.735157 np0000002687 nova-compute[98431]: Jun 11 23:08:05.735157 np0000002687 nova-compute[98431]: Jun 11 23:08:05.735157 np0000002687 nova-compute[98431]: fdc Jun 11 23:08:05.735157 np0000002687 nova-compute[98431]: scsi Jun 11 23:08:05.735157 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.735157 np0000002687 nova-compute[98431]: usb Jun 11 23:08:05.735157 np0000002687 nova-compute[98431]: sata Jun 11 23:08:05.735157 np0000002687 nova-compute[98431]: Jun 11 23:08:05.735157 np0000002687 nova-compute[98431]: Jun 11 23:08:05.735157 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.735157 np0000002687 nova-compute[98431]: virtio-transitional Jun 11 23:08:05.735157 np0000002687 nova-compute[98431]: virtio-non-transitional Jun 11 23:08:05.735157 np0000002687 nova-compute[98431]: Jun 11 23:08:05.735157 np0000002687 nova-compute[98431]: Jun 11 23:08:05.735157 np0000002687 nova-compute[98431]: Jun 11 23:08:05.735157 np0000002687 nova-compute[98431]: Jun 11 23:08:05.735157 np0000002687 nova-compute[98431]: sdl Jun 11 23:08:05.735157 np0000002687 nova-compute[98431]: vnc Jun 11 23:08:05.735157 np0000002687 nova-compute[98431]: spice Jun 11 23:08:05.735157 np0000002687 nova-compute[98431]: egl-headless Jun 11 23:08:05.735157 np0000002687 nova-compute[98431]: dbus Jun 11 23:08:05.735157 np0000002687 nova-compute[98431]: Jun 11 23:08:05.735157 np0000002687 nova-compute[98431]: Jun 11 23:08:05.735157 np0000002687 nova-compute[98431]: Jun 11 23:08:05.736341 np0000002687 nova-compute[98431]: Jun 11 23:08:05.736341 np0000002687 nova-compute[98431]: Jun 11 23:08:05.736341 np0000002687 nova-compute[98431]: subsystem Jun 11 23:08:05.736341 np0000002687 nova-compute[98431]: Jun 11 23:08:05.736341 np0000002687 nova-compute[98431]: Jun 11 23:08:05.736341 np0000002687 nova-compute[98431]: default Jun 11 23:08:05.736341 np0000002687 nova-compute[98431]: mandatory Jun 11 23:08:05.736341 np0000002687 nova-compute[98431]: requisite Jun 11 23:08:05.736341 np0000002687 nova-compute[98431]: optional Jun 11 23:08:05.736341 np0000002687 nova-compute[98431]: Jun 11 23:08:05.736341 np0000002687 nova-compute[98431]: Jun 11 23:08:05.736341 np0000002687 nova-compute[98431]: usb Jun 11 23:08:05.736341 np0000002687 nova-compute[98431]: pci Jun 11 23:08:05.736341 np0000002687 nova-compute[98431]: scsi Jun 11 23:08:05.736341 np0000002687 nova-compute[98431]: Jun 11 23:08:05.736341 np0000002687 nova-compute[98431]: Jun 11 23:08:05.736341 np0000002687 nova-compute[98431]: Jun 11 23:08:05.736341 np0000002687 nova-compute[98431]: Jun 11 23:08:05.736341 np0000002687 nova-compute[98431]: Jun 11 23:08:05.736341 np0000002687 nova-compute[98431]: Jun 11 23:08:05.736341 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.736341 np0000002687 nova-compute[98431]: virtio-transitional Jun 11 23:08:05.736341 np0000002687 nova-compute[98431]: virtio-non-transitional Jun 11 23:08:05.736341 np0000002687 nova-compute[98431]: Jun 11 23:08:05.736341 np0000002687 nova-compute[98431]: Jun 11 23:08:05.736341 np0000002687 nova-compute[98431]: random Jun 11 23:08:05.736341 np0000002687 nova-compute[98431]: egd Jun 11 23:08:05.736341 np0000002687 nova-compute[98431]: builtin Jun 11 23:08:05.736341 np0000002687 nova-compute[98431]: Jun 11 23:08:05.736341 np0000002687 nova-compute[98431]: Jun 11 23:08:05.736341 np0000002687 nova-compute[98431]: Jun 11 23:08:05.736341 np0000002687 nova-compute[98431]: Jun 11 23:08:05.736341 np0000002687 nova-compute[98431]: path Jun 11 23:08:05.736341 np0000002687 nova-compute[98431]: handle Jun 11 23:08:05.736341 np0000002687 nova-compute[98431]: virtiofs Jun 11 23:08:05.736341 np0000002687 nova-compute[98431]: Jun 11 23:08:05.736341 np0000002687 nova-compute[98431]: Jun 11 23:08:05.736341 np0000002687 nova-compute[98431]: Jun 11 23:08:05.736341 np0000002687 nova-compute[98431]: Jun 11 23:08:05.736341 np0000002687 nova-compute[98431]: tpm-tis Jun 11 23:08:05.736341 np0000002687 nova-compute[98431]: Jun 11 23:08:05.736341 np0000002687 nova-compute[98431]: Jun 11 23:08:05.736341 np0000002687 nova-compute[98431]: passthrough Jun 11 23:08:05.736341 np0000002687 nova-compute[98431]: emulator Jun 11 23:08:05.736341 np0000002687 nova-compute[98431]: external Jun 11 23:08:05.736341 np0000002687 nova-compute[98431]: Jun 11 23:08:05.736341 np0000002687 nova-compute[98431]: Jun 11 23:08:05.736341 np0000002687 nova-compute[98431]: 1.2 Jun 11 23:08:05.736341 np0000002687 nova-compute[98431]: 2.0 Jun 11 23:08:05.736341 np0000002687 nova-compute[98431]: Jun 11 23:08:05.736341 np0000002687 nova-compute[98431]: Jun 11 23:08:05.736341 np0000002687 nova-compute[98431]: Jun 11 23:08:05.736341 np0000002687 nova-compute[98431]: Jun 11 23:08:05.736341 np0000002687 nova-compute[98431]: usb Jun 11 23:08:05.736341 np0000002687 nova-compute[98431]: Jun 11 23:08:05.736341 np0000002687 nova-compute[98431]: Jun 11 23:08:05.736341 np0000002687 nova-compute[98431]: Jun 11 23:08:05.736341 np0000002687 nova-compute[98431]: Jun 11 23:08:05.736341 np0000002687 nova-compute[98431]: pty Jun 11 23:08:05.736341 np0000002687 nova-compute[98431]: unix Jun 11 23:08:05.736341 np0000002687 nova-compute[98431]: spicevmc Jun 11 23:08:05.736341 np0000002687 nova-compute[98431]: Jun 11 23:08:05.736341 np0000002687 nova-compute[98431]: Jun 11 23:08:05.736341 np0000002687 nova-compute[98431]: Jun 11 23:08:05.736341 np0000002687 nova-compute[98431]: Jun 11 23:08:05.736341 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.736341 np0000002687 nova-compute[98431]: Jun 11 23:08:05.736341 np0000002687 nova-compute[98431]: Jun 11 23:08:05.736341 np0000002687 nova-compute[98431]: qemu Jun 11 23:08:05.736341 np0000002687 nova-compute[98431]: Jun 11 23:08:05.736341 np0000002687 nova-compute[98431]: Jun 11 23:08:05.736341 np0000002687 nova-compute[98431]: builtin Jun 11 23:08:05.736341 np0000002687 nova-compute[98431]: Jun 11 23:08:05.736341 np0000002687 nova-compute[98431]: Jun 11 23:08:05.736341 np0000002687 nova-compute[98431]: Jun 11 23:08:05.736341 np0000002687 nova-compute[98431]: Jun 11 23:08:05.736341 np0000002687 nova-compute[98431]: Jun 11 23:08:05.736341 np0000002687 nova-compute[98431]: Jun 11 23:08:05.736341 np0000002687 nova-compute[98431]: 2 Jun 11 23:08:05.737727 np0000002687 nova-compute[98431]: 3 Jun 11 23:08:05.737727 np0000002687 nova-compute[98431]: Jun 11 23:08:05.737727 np0000002687 nova-compute[98431]: Jun 11 23:08:05.737727 np0000002687 nova-compute[98431]: Jun 11 23:08:05.737727 np0000002687 nova-compute[98431]: Jun 11 23:08:05.737727 np0000002687 nova-compute[98431]: Jun 11 23:08:05.737727 np0000002687 nova-compute[98431]: Jun 11 23:08:05.737727 np0000002687 nova-compute[98431]: Jun 11 23:08:05.737727 np0000002687 nova-compute[98431]: Jun 11 23:08:05.737727 np0000002687 nova-compute[98431]: Jun 11 23:08:05.737727 np0000002687 nova-compute[98431]: Jun 11 23:08:05.737727 np0000002687 nova-compute[98431]: Jun 11 23:08:05.737727 np0000002687 nova-compute[98431]: {{(pid=98431) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 11 23:08:05.737727 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=98431) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 11 23:08:05.737727 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] Libvirt host hypervisor capabilities for arch=armv7l and machine_type=virt: Jun 11 23:08:05.737727 np0000002687 nova-compute[98431]: Jun 11 23:08:05.737727 np0000002687 nova-compute[98431]: /usr/bin/qemu-system-arm Jun 11 23:08:05.737727 np0000002687 nova-compute[98431]: qemu Jun 11 23:08:05.737727 np0000002687 nova-compute[98431]: virt-8.2 Jun 11 23:08:05.737727 np0000002687 nova-compute[98431]: armv7l Jun 11 23:08:05.737727 np0000002687 nova-compute[98431]: Jun 11 23:08:05.737727 np0000002687 nova-compute[98431]: Jun 11 23:08:05.737727 np0000002687 nova-compute[98431]: Jun 11 23:08:05.737727 np0000002687 nova-compute[98431]: Jun 11 23:08:05.737727 np0000002687 nova-compute[98431]: efi Jun 11 23:08:05.737727 np0000002687 nova-compute[98431]: Jun 11 23:08:05.737727 np0000002687 nova-compute[98431]: Jun 11 23:08:05.737727 np0000002687 nova-compute[98431]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 11 23:08:05.737727 np0000002687 nova-compute[98431]: Jun 11 23:08:05.737727 np0000002687 nova-compute[98431]: rom Jun 11 23:08:05.737727 np0000002687 nova-compute[98431]: pflash Jun 11 23:08:05.737727 np0000002687 nova-compute[98431]: Jun 11 23:08:05.737727 np0000002687 nova-compute[98431]: Jun 11 23:08:05.737727 np0000002687 nova-compute[98431]: yes Jun 11 23:08:05.737727 np0000002687 nova-compute[98431]: no Jun 11 23:08:05.737727 np0000002687 nova-compute[98431]: Jun 11 23:08:05.737727 np0000002687 nova-compute[98431]: Jun 11 23:08:05.737727 np0000002687 nova-compute[98431]: no Jun 11 23:08:05.737727 np0000002687 nova-compute[98431]: Jun 11 23:08:05.737727 np0000002687 nova-compute[98431]: Jun 11 23:08:05.737727 np0000002687 nova-compute[98431]: Jun 11 23:08:05.737727 np0000002687 nova-compute[98431]: Jun 11 23:08:05.737727 np0000002687 nova-compute[98431]: Jun 11 23:08:05.737727 np0000002687 nova-compute[98431]: Jun 11 23:08:05.737727 np0000002687 nova-compute[98431]: Jun 11 23:08:05.737727 np0000002687 nova-compute[98431]: on Jun 11 23:08:05.737727 np0000002687 nova-compute[98431]: off Jun 11 23:08:05.737727 np0000002687 nova-compute[98431]: Jun 11 23:08:05.737727 np0000002687 nova-compute[98431]: Jun 11 23:08:05.737727 np0000002687 nova-compute[98431]: Jun 11 23:08:05.737727 np0000002687 nova-compute[98431]: Jun 11 23:08:05.737727 np0000002687 nova-compute[98431]: pxa270-c0 Jun 11 23:08:05.737727 np0000002687 nova-compute[98431]: cortex-a15 Jun 11 23:08:05.737727 np0000002687 nova-compute[98431]: pxa270-b0 Jun 11 23:08:05.738680 np0000002687 nova-compute[98431]: cortex-m4 Jun 11 23:08:05.738680 np0000002687 nova-compute[98431]: pxa270-a0 Jun 11 23:08:05.738680 np0000002687 nova-compute[98431]: arm1176 Jun 11 23:08:05.738680 np0000002687 nova-compute[98431]: pxa270-b1 Jun 11 23:08:05.738680 np0000002687 nova-compute[98431]: cortex-a7 Jun 11 23:08:05.738680 np0000002687 nova-compute[98431]: pxa270-a1 Jun 11 23:08:05.738680 np0000002687 nova-compute[98431]: cortex-a8 Jun 11 23:08:05.738680 np0000002687 nova-compute[98431]: cortex-r5 Jun 11 23:08:05.738680 np0000002687 nova-compute[98431]: ti925t Jun 11 23:08:05.738680 np0000002687 nova-compute[98431]: cortex-r5f Jun 11 23:08:05.738680 np0000002687 nova-compute[98431]: arm1026 Jun 11 23:08:05.738680 np0000002687 nova-compute[98431]: cortex-a9 Jun 11 23:08:05.738680 np0000002687 nova-compute[98431]: cortex-m7 Jun 11 23:08:05.738680 np0000002687 nova-compute[98431]: pxa270 Jun 11 23:08:05.738680 np0000002687 nova-compute[98431]: pxa260 Jun 11 23:08:05.738680 np0000002687 nova-compute[98431]: pxa250 Jun 11 23:08:05.738680 np0000002687 nova-compute[98431]: pxa270-c5 Jun 11 23:08:05.738680 np0000002687 nova-compute[98431]: pxa261 Jun 11 23:08:05.738680 np0000002687 nova-compute[98431]: pxa262 Jun 11 23:08:05.738680 np0000002687 nova-compute[98431]: sa1110 Jun 11 23:08:05.738680 np0000002687 nova-compute[98431]: cortex-r52 Jun 11 23:08:05.738680 np0000002687 nova-compute[98431]: sa1100 Jun 11 23:08:05.738680 np0000002687 nova-compute[98431]: max Jun 11 23:08:05.738680 np0000002687 nova-compute[98431]: cortex-m0 Jun 11 23:08:05.738680 np0000002687 nova-compute[98431]: cortex-m33 Jun 11 23:08:05.738680 np0000002687 nova-compute[98431]: arm946 Jun 11 23:08:05.738680 np0000002687 nova-compute[98431]: pxa255 Jun 11 23:08:05.738680 np0000002687 nova-compute[98431]: arm11mpcore Jun 11 23:08:05.738680 np0000002687 nova-compute[98431]: cortex-m55 Jun 11 23:08:05.738680 np0000002687 nova-compute[98431]: arm926 Jun 11 23:08:05.738680 np0000002687 nova-compute[98431]: arm1136 Jun 11 23:08:05.738680 np0000002687 nova-compute[98431]: arm1136-r2 Jun 11 23:08:05.739260 np0000002687 nova-compute[98431]: cortex-m3 Jun 11 23:08:05.739260 np0000002687 nova-compute[98431]: Jun 11 23:08:05.739260 np0000002687 nova-compute[98431]: Jun 11 23:08:05.739260 np0000002687 nova-compute[98431]: Jun 11 23:08:05.739260 np0000002687 nova-compute[98431]: Jun 11 23:08:05.739260 np0000002687 nova-compute[98431]: file Jun 11 23:08:05.739260 np0000002687 nova-compute[98431]: anonymous Jun 11 23:08:05.739260 np0000002687 nova-compute[98431]: memfd Jun 11 23:08:05.739260 np0000002687 nova-compute[98431]: Jun 11 23:08:05.739260 np0000002687 nova-compute[98431]: Jun 11 23:08:05.739260 np0000002687 nova-compute[98431]: Jun 11 23:08:05.739260 np0000002687 nova-compute[98431]: Jun 11 23:08:05.739260 np0000002687 nova-compute[98431]: Jun 11 23:08:05.739260 np0000002687 nova-compute[98431]: disk Jun 11 23:08:05.739260 np0000002687 nova-compute[98431]: cdrom Jun 11 23:08:05.739260 np0000002687 nova-compute[98431]: floppy Jun 11 23:08:05.739260 np0000002687 nova-compute[98431]: lun Jun 11 23:08:05.739260 np0000002687 nova-compute[98431]: Jun 11 23:08:05.739260 np0000002687 nova-compute[98431]: Jun 11 23:08:05.739260 np0000002687 nova-compute[98431]: fdc Jun 11 23:08:05.739260 np0000002687 nova-compute[98431]: scsi Jun 11 23:08:05.739260 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.739260 np0000002687 nova-compute[98431]: usb Jun 11 23:08:05.739260 np0000002687 nova-compute[98431]: sata Jun 11 23:08:05.739260 np0000002687 nova-compute[98431]: Jun 11 23:08:05.739260 np0000002687 nova-compute[98431]: Jun 11 23:08:05.739260 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.739260 np0000002687 nova-compute[98431]: virtio-transitional Jun 11 23:08:05.739260 np0000002687 nova-compute[98431]: virtio-non-transitional Jun 11 23:08:05.739260 np0000002687 nova-compute[98431]: Jun 11 23:08:05.739260 np0000002687 nova-compute[98431]: Jun 11 23:08:05.739260 np0000002687 nova-compute[98431]: Jun 11 23:08:05.739260 np0000002687 nova-compute[98431]: Jun 11 23:08:05.739260 np0000002687 nova-compute[98431]: sdl Jun 11 23:08:05.739260 np0000002687 nova-compute[98431]: vnc Jun 11 23:08:05.739260 np0000002687 nova-compute[98431]: spice Jun 11 23:08:05.739260 np0000002687 nova-compute[98431]: egl-headless Jun 11 23:08:05.739260 np0000002687 nova-compute[98431]: dbus Jun 11 23:08:05.739260 np0000002687 nova-compute[98431]: Jun 11 23:08:05.739260 np0000002687 nova-compute[98431]: Jun 11 23:08:05.739260 np0000002687 nova-compute[98431]: Jun 11 23:08:05.739260 np0000002687 nova-compute[98431]: Jun 11 23:08:05.739260 np0000002687 nova-compute[98431]: Jun 11 23:08:05.739260 np0000002687 nova-compute[98431]: subsystem Jun 11 23:08:05.739260 np0000002687 nova-compute[98431]: Jun 11 23:08:05.739260 np0000002687 nova-compute[98431]: Jun 11 23:08:05.739260 np0000002687 nova-compute[98431]: default Jun 11 23:08:05.739260 np0000002687 nova-compute[98431]: mandatory Jun 11 23:08:05.739260 np0000002687 nova-compute[98431]: requisite Jun 11 23:08:05.739260 np0000002687 nova-compute[98431]: optional Jun 11 23:08:05.739260 np0000002687 nova-compute[98431]: Jun 11 23:08:05.739260 np0000002687 nova-compute[98431]: Jun 11 23:08:05.739260 np0000002687 nova-compute[98431]: usb Jun 11 23:08:05.739260 np0000002687 nova-compute[98431]: pci Jun 11 23:08:05.739260 np0000002687 nova-compute[98431]: scsi Jun 11 23:08:05.739260 np0000002687 nova-compute[98431]: Jun 11 23:08:05.739260 np0000002687 nova-compute[98431]: Jun 11 23:08:05.739260 np0000002687 nova-compute[98431]: Jun 11 23:08:05.739260 np0000002687 nova-compute[98431]: Jun 11 23:08:05.739260 np0000002687 nova-compute[98431]: Jun 11 23:08:05.739260 np0000002687 nova-compute[98431]: Jun 11 23:08:05.739260 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.739260 np0000002687 nova-compute[98431]: virtio-transitional Jun 11 23:08:05.739260 np0000002687 nova-compute[98431]: virtio-non-transitional Jun 11 23:08:05.739260 np0000002687 nova-compute[98431]: Jun 11 23:08:05.739260 np0000002687 nova-compute[98431]: Jun 11 23:08:05.739260 np0000002687 nova-compute[98431]: random Jun 11 23:08:05.740680 np0000002687 nova-compute[98431]: egd Jun 11 23:08:05.740680 np0000002687 nova-compute[98431]: builtin Jun 11 23:08:05.740680 np0000002687 nova-compute[98431]: Jun 11 23:08:05.740680 np0000002687 nova-compute[98431]: Jun 11 23:08:05.740680 np0000002687 nova-compute[98431]: Jun 11 23:08:05.740680 np0000002687 nova-compute[98431]: Jun 11 23:08:05.740680 np0000002687 nova-compute[98431]: path Jun 11 23:08:05.740680 np0000002687 nova-compute[98431]: handle Jun 11 23:08:05.740680 np0000002687 nova-compute[98431]: virtiofs Jun 11 23:08:05.740680 np0000002687 nova-compute[98431]: Jun 11 23:08:05.740680 np0000002687 nova-compute[98431]: Jun 11 23:08:05.740680 np0000002687 nova-compute[98431]: Jun 11 23:08:05.740680 np0000002687 nova-compute[98431]: Jun 11 23:08:05.740680 np0000002687 nova-compute[98431]: tpm-tis Jun 11 23:08:05.740680 np0000002687 nova-compute[98431]: Jun 11 23:08:05.740680 np0000002687 nova-compute[98431]: Jun 11 23:08:05.740680 np0000002687 nova-compute[98431]: passthrough Jun 11 23:08:05.740680 np0000002687 nova-compute[98431]: emulator Jun 11 23:08:05.740680 np0000002687 nova-compute[98431]: external Jun 11 23:08:05.740680 np0000002687 nova-compute[98431]: Jun 11 23:08:05.740680 np0000002687 nova-compute[98431]: Jun 11 23:08:05.740680 np0000002687 nova-compute[98431]: 1.2 Jun 11 23:08:05.740680 np0000002687 nova-compute[98431]: 2.0 Jun 11 23:08:05.740680 np0000002687 nova-compute[98431]: Jun 11 23:08:05.740680 np0000002687 nova-compute[98431]: Jun 11 23:08:05.740680 np0000002687 nova-compute[98431]: Jun 11 23:08:05.740680 np0000002687 nova-compute[98431]: Jun 11 23:08:05.740680 np0000002687 nova-compute[98431]: usb Jun 11 23:08:05.740680 np0000002687 nova-compute[98431]: Jun 11 23:08:05.740680 np0000002687 nova-compute[98431]: Jun 11 23:08:05.740680 np0000002687 nova-compute[98431]: Jun 11 23:08:05.740680 np0000002687 nova-compute[98431]: Jun 11 23:08:05.740680 np0000002687 nova-compute[98431]: pty Jun 11 23:08:05.740680 np0000002687 nova-compute[98431]: unix Jun 11 23:08:05.740680 np0000002687 nova-compute[98431]: spicevmc Jun 11 23:08:05.740680 np0000002687 nova-compute[98431]: Jun 11 23:08:05.740680 np0000002687 nova-compute[98431]: Jun 11 23:08:05.740680 np0000002687 nova-compute[98431]: Jun 11 23:08:05.740680 np0000002687 nova-compute[98431]: Jun 11 23:08:05.740680 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.740680 np0000002687 nova-compute[98431]: Jun 11 23:08:05.740680 np0000002687 nova-compute[98431]: Jun 11 23:08:05.740680 np0000002687 nova-compute[98431]: qemu Jun 11 23:08:05.740680 np0000002687 nova-compute[98431]: Jun 11 23:08:05.740680 np0000002687 nova-compute[98431]: Jun 11 23:08:05.740680 np0000002687 nova-compute[98431]: builtin Jun 11 23:08:05.740680 np0000002687 nova-compute[98431]: Jun 11 23:08:05.740680 np0000002687 nova-compute[98431]: Jun 11 23:08:05.740680 np0000002687 nova-compute[98431]: Jun 11 23:08:05.740680 np0000002687 nova-compute[98431]: Jun 11 23:08:05.740680 np0000002687 nova-compute[98431]: Jun 11 23:08:05.740680 np0000002687 nova-compute[98431]: Jun 11 23:08:05.740680 np0000002687 nova-compute[98431]: 2 Jun 11 23:08:05.740680 np0000002687 nova-compute[98431]: 3 Jun 11 23:08:05.740680 np0000002687 nova-compute[98431]: Jun 11 23:08:05.740680 np0000002687 nova-compute[98431]: Jun 11 23:08:05.740680 np0000002687 nova-compute[98431]: Jun 11 23:08:05.740680 np0000002687 nova-compute[98431]: Jun 11 23:08:05.740680 np0000002687 nova-compute[98431]: Jun 11 23:08:05.740680 np0000002687 nova-compute[98431]: Jun 11 23:08:05.740680 np0000002687 nova-compute[98431]: Jun 11 23:08:05.740680 np0000002687 nova-compute[98431]: Jun 11 23:08:05.740680 np0000002687 nova-compute[98431]: Jun 11 23:08:05.740680 np0000002687 nova-compute[98431]: Jun 11 23:08:05.740680 np0000002687 nova-compute[98431]: Jun 11 23:08:05.740680 np0000002687 nova-compute[98431]: {{(pid=98431) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 11 23:08:05.740680 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=98431) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 11 23:08:05.742030 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] Libvirt host hypervisor capabilities for arch=aarch64 and machine_type=virt: Jun 11 23:08:05.742030 np0000002687 nova-compute[98431]: Jun 11 23:08:05.742030 np0000002687 nova-compute[98431]: /usr/bin/qemu-system-aarch64 Jun 11 23:08:05.742030 np0000002687 nova-compute[98431]: qemu Jun 11 23:08:05.742030 np0000002687 nova-compute[98431]: virt-8.2 Jun 11 23:08:05.742030 np0000002687 nova-compute[98431]: aarch64 Jun 11 23:08:05.742030 np0000002687 nova-compute[98431]: Jun 11 23:08:05.742030 np0000002687 nova-compute[98431]: Jun 11 23:08:05.742030 np0000002687 nova-compute[98431]: Jun 11 23:08:05.742030 np0000002687 nova-compute[98431]: Jun 11 23:08:05.742030 np0000002687 nova-compute[98431]: efi Jun 11 23:08:05.742030 np0000002687 nova-compute[98431]: Jun 11 23:08:05.742030 np0000002687 nova-compute[98431]: Jun 11 23:08:05.742030 np0000002687 nova-compute[98431]: /usr/share/AAVMF/AAVMF_CODE.ms.fd Jun 11 23:08:05.742030 np0000002687 nova-compute[98431]: /usr/share/AAVMF/AAVMF_CODE.secboot.fd Jun 11 23:08:05.742030 np0000002687 nova-compute[98431]: /usr/share/AAVMF/AAVMF_CODE.no-secboot.fd Jun 11 23:08:05.742030 np0000002687 nova-compute[98431]: Jun 11 23:08:05.742030 np0000002687 nova-compute[98431]: rom Jun 11 23:08:05.742030 np0000002687 nova-compute[98431]: pflash Jun 11 23:08:05.742030 np0000002687 nova-compute[98431]: Jun 11 23:08:05.742030 np0000002687 nova-compute[98431]: Jun 11 23:08:05.742030 np0000002687 nova-compute[98431]: yes Jun 11 23:08:05.742030 np0000002687 nova-compute[98431]: no Jun 11 23:08:05.742030 np0000002687 nova-compute[98431]: Jun 11 23:08:05.742030 np0000002687 nova-compute[98431]: Jun 11 23:08:05.742030 np0000002687 nova-compute[98431]: no Jun 11 23:08:05.742030 np0000002687 nova-compute[98431]: Jun 11 23:08:05.742030 np0000002687 nova-compute[98431]: Jun 11 23:08:05.742030 np0000002687 nova-compute[98431]: Jun 11 23:08:05.742030 np0000002687 nova-compute[98431]: Jun 11 23:08:05.742030 np0000002687 nova-compute[98431]: Jun 11 23:08:05.742030 np0000002687 nova-compute[98431]: Jun 11 23:08:05.742030 np0000002687 nova-compute[98431]: Jun 11 23:08:05.742030 np0000002687 nova-compute[98431]: on Jun 11 23:08:05.742030 np0000002687 nova-compute[98431]: off Jun 11 23:08:05.742030 np0000002687 nova-compute[98431]: Jun 11 23:08:05.742030 np0000002687 nova-compute[98431]: Jun 11 23:08:05.742030 np0000002687 nova-compute[98431]: Jun 11 23:08:05.742030 np0000002687 nova-compute[98431]: Jun 11 23:08:05.742030 np0000002687 nova-compute[98431]: neoverse-n2 Jun 11 23:08:05.742030 np0000002687 nova-compute[98431]: pxa270-c0 Jun 11 23:08:05.742030 np0000002687 nova-compute[98431]: cortex-a15 Jun 11 23:08:05.742030 np0000002687 nova-compute[98431]: pxa270-b0 Jun 11 23:08:05.742030 np0000002687 nova-compute[98431]: cortex-a57 Jun 11 23:08:05.742030 np0000002687 nova-compute[98431]: cortex-m4 Jun 11 23:08:05.742030 np0000002687 nova-compute[98431]: pxa270-a0 Jun 11 23:08:05.742030 np0000002687 nova-compute[98431]: arm1176 Jun 11 23:08:05.742030 np0000002687 nova-compute[98431]: pxa270-b1 Jun 11 23:08:05.742030 np0000002687 nova-compute[98431]: cortex-a7 Jun 11 23:08:05.742030 np0000002687 nova-compute[98431]: pxa270-a1 Jun 11 23:08:05.742030 np0000002687 nova-compute[98431]: cortex-a76 Jun 11 23:08:05.743071 np0000002687 nova-compute[98431]: a64fx Jun 11 23:08:05.743071 np0000002687 nova-compute[98431]: cortex-a8 Jun 11 23:08:05.743071 np0000002687 nova-compute[98431]: neoverse-v1 Jun 11 23:08:05.743071 np0000002687 nova-compute[98431]: cortex-r5 Jun 11 23:08:05.743071 np0000002687 nova-compute[98431]: ti925t Jun 11 23:08:05.743071 np0000002687 nova-compute[98431]: cortex-r5f Jun 11 23:08:05.743071 np0000002687 nova-compute[98431]: arm1026 Jun 11 23:08:05.743071 np0000002687 nova-compute[98431]: cortex-a9 Jun 11 23:08:05.743071 np0000002687 nova-compute[98431]: cortex-m7 Jun 11 23:08:05.743071 np0000002687 nova-compute[98431]: pxa270 Jun 11 23:08:05.743071 np0000002687 nova-compute[98431]: pxa260 Jun 11 23:08:05.743071 np0000002687 nova-compute[98431]: pxa250 Jun 11 23:08:05.743071 np0000002687 nova-compute[98431]: pxa270-c5 Jun 11 23:08:05.743071 np0000002687 nova-compute[98431]: pxa261 Jun 11 23:08:05.743071 np0000002687 nova-compute[98431]: pxa262 Jun 11 23:08:05.743071 np0000002687 nova-compute[98431]: cortex-a710 Jun 11 23:08:05.743071 np0000002687 nova-compute[98431]: sa1110 Jun 11 23:08:05.743071 np0000002687 nova-compute[98431]: cortex-r52 Jun 11 23:08:05.743071 np0000002687 nova-compute[98431]: sa1100 Jun 11 23:08:05.743071 np0000002687 nova-compute[98431]: max Jun 11 23:08:05.743071 np0000002687 nova-compute[98431]: cortex-a53 Jun 11 23:08:05.743071 np0000002687 nova-compute[98431]: cortex-m0 Jun 11 23:08:05.743071 np0000002687 nova-compute[98431]: cortex-m33 Jun 11 23:08:05.743071 np0000002687 nova-compute[98431]: cortex-a72 Jun 11 23:08:05.743071 np0000002687 nova-compute[98431]: arm946 Jun 11 23:08:05.743071 np0000002687 nova-compute[98431]: pxa255 Jun 11 23:08:05.743071 np0000002687 nova-compute[98431]: cortex-a55 Jun 11 23:08:05.743071 np0000002687 nova-compute[98431]: arm11mpcore Jun 11 23:08:05.743071 np0000002687 nova-compute[98431]: cortex-m55 Jun 11 23:08:05.743071 np0000002687 nova-compute[98431]: neoverse-n1 Jun 11 23:08:05.743071 np0000002687 nova-compute[98431]: arm926 Jun 11 23:08:05.743071 np0000002687 nova-compute[98431]: arm1136 Jun 11 23:08:05.743582 np0000002687 nova-compute[98431]: cortex-a35 Jun 11 23:08:05.743582 np0000002687 nova-compute[98431]: arm1136-r2 Jun 11 23:08:05.743582 np0000002687 nova-compute[98431]: cortex-m3 Jun 11 23:08:05.743582 np0000002687 nova-compute[98431]: Jun 11 23:08:05.743582 np0000002687 nova-compute[98431]: Jun 11 23:08:05.743582 np0000002687 nova-compute[98431]: Jun 11 23:08:05.743582 np0000002687 nova-compute[98431]: Jun 11 23:08:05.743582 np0000002687 nova-compute[98431]: file Jun 11 23:08:05.743582 np0000002687 nova-compute[98431]: anonymous Jun 11 23:08:05.743582 np0000002687 nova-compute[98431]: memfd Jun 11 23:08:05.743582 np0000002687 nova-compute[98431]: Jun 11 23:08:05.743582 np0000002687 nova-compute[98431]: Jun 11 23:08:05.743582 np0000002687 nova-compute[98431]: Jun 11 23:08:05.743582 np0000002687 nova-compute[98431]: Jun 11 23:08:05.743582 np0000002687 nova-compute[98431]: Jun 11 23:08:05.743582 np0000002687 nova-compute[98431]: disk Jun 11 23:08:05.743582 np0000002687 nova-compute[98431]: cdrom Jun 11 23:08:05.743582 np0000002687 nova-compute[98431]: floppy Jun 11 23:08:05.743582 np0000002687 nova-compute[98431]: lun Jun 11 23:08:05.743582 np0000002687 nova-compute[98431]: Jun 11 23:08:05.743582 np0000002687 nova-compute[98431]: Jun 11 23:08:05.743582 np0000002687 nova-compute[98431]: fdc Jun 11 23:08:05.743582 np0000002687 nova-compute[98431]: scsi Jun 11 23:08:05.743582 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.743582 np0000002687 nova-compute[98431]: usb Jun 11 23:08:05.743582 np0000002687 nova-compute[98431]: sata Jun 11 23:08:05.743582 np0000002687 nova-compute[98431]: Jun 11 23:08:05.743582 np0000002687 nova-compute[98431]: Jun 11 23:08:05.743582 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.743582 np0000002687 nova-compute[98431]: virtio-transitional Jun 11 23:08:05.743582 np0000002687 nova-compute[98431]: virtio-non-transitional Jun 11 23:08:05.743582 np0000002687 nova-compute[98431]: Jun 11 23:08:05.743582 np0000002687 nova-compute[98431]: Jun 11 23:08:05.743582 np0000002687 nova-compute[98431]: Jun 11 23:08:05.743582 np0000002687 nova-compute[98431]: Jun 11 23:08:05.743582 np0000002687 nova-compute[98431]: sdl Jun 11 23:08:05.743582 np0000002687 nova-compute[98431]: vnc Jun 11 23:08:05.743582 np0000002687 nova-compute[98431]: spice Jun 11 23:08:05.743582 np0000002687 nova-compute[98431]: egl-headless Jun 11 23:08:05.743582 np0000002687 nova-compute[98431]: dbus Jun 11 23:08:05.743582 np0000002687 nova-compute[98431]: Jun 11 23:08:05.743582 np0000002687 nova-compute[98431]: Jun 11 23:08:05.743582 np0000002687 nova-compute[98431]: Jun 11 23:08:05.743582 np0000002687 nova-compute[98431]: Jun 11 23:08:05.743582 np0000002687 nova-compute[98431]: Jun 11 23:08:05.743582 np0000002687 nova-compute[98431]: subsystem Jun 11 23:08:05.743582 np0000002687 nova-compute[98431]: Jun 11 23:08:05.743582 np0000002687 nova-compute[98431]: Jun 11 23:08:05.743582 np0000002687 nova-compute[98431]: default Jun 11 23:08:05.743582 np0000002687 nova-compute[98431]: mandatory Jun 11 23:08:05.743582 np0000002687 nova-compute[98431]: requisite Jun 11 23:08:05.743582 np0000002687 nova-compute[98431]: optional Jun 11 23:08:05.743582 np0000002687 nova-compute[98431]: Jun 11 23:08:05.743582 np0000002687 nova-compute[98431]: Jun 11 23:08:05.743582 np0000002687 nova-compute[98431]: usb Jun 11 23:08:05.743582 np0000002687 nova-compute[98431]: pci Jun 11 23:08:05.743582 np0000002687 nova-compute[98431]: scsi Jun 11 23:08:05.743582 np0000002687 nova-compute[98431]: Jun 11 23:08:05.743582 np0000002687 nova-compute[98431]: Jun 11 23:08:05.743582 np0000002687 nova-compute[98431]: Jun 11 23:08:05.743582 np0000002687 nova-compute[98431]: Jun 11 23:08:05.743582 np0000002687 nova-compute[98431]: Jun 11 23:08:05.743582 np0000002687 nova-compute[98431]: Jun 11 23:08:05.743582 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.743582 np0000002687 nova-compute[98431]: virtio-transitional Jun 11 23:08:05.744778 np0000002687 nova-compute[98431]: virtio-non-transitional Jun 11 23:08:05.744778 np0000002687 nova-compute[98431]: Jun 11 23:08:05.744778 np0000002687 nova-compute[98431]: Jun 11 23:08:05.744778 np0000002687 nova-compute[98431]: random Jun 11 23:08:05.744778 np0000002687 nova-compute[98431]: egd Jun 11 23:08:05.744778 np0000002687 nova-compute[98431]: builtin Jun 11 23:08:05.744778 np0000002687 nova-compute[98431]: Jun 11 23:08:05.744778 np0000002687 nova-compute[98431]: Jun 11 23:08:05.744778 np0000002687 nova-compute[98431]: Jun 11 23:08:05.744778 np0000002687 nova-compute[98431]: Jun 11 23:08:05.744778 np0000002687 nova-compute[98431]: path Jun 11 23:08:05.744778 np0000002687 nova-compute[98431]: handle Jun 11 23:08:05.744778 np0000002687 nova-compute[98431]: virtiofs Jun 11 23:08:05.744778 np0000002687 nova-compute[98431]: Jun 11 23:08:05.744778 np0000002687 nova-compute[98431]: Jun 11 23:08:05.744778 np0000002687 nova-compute[98431]: Jun 11 23:08:05.744778 np0000002687 nova-compute[98431]: Jun 11 23:08:05.744778 np0000002687 nova-compute[98431]: tpm-tis Jun 11 23:08:05.744778 np0000002687 nova-compute[98431]: Jun 11 23:08:05.744778 np0000002687 nova-compute[98431]: Jun 11 23:08:05.744778 np0000002687 nova-compute[98431]: passthrough Jun 11 23:08:05.744778 np0000002687 nova-compute[98431]: emulator Jun 11 23:08:05.744778 np0000002687 nova-compute[98431]: external Jun 11 23:08:05.744778 np0000002687 nova-compute[98431]: Jun 11 23:08:05.744778 np0000002687 nova-compute[98431]: Jun 11 23:08:05.744778 np0000002687 nova-compute[98431]: 1.2 Jun 11 23:08:05.744778 np0000002687 nova-compute[98431]: 2.0 Jun 11 23:08:05.744778 np0000002687 nova-compute[98431]: Jun 11 23:08:05.744778 np0000002687 nova-compute[98431]: Jun 11 23:08:05.744778 np0000002687 nova-compute[98431]: Jun 11 23:08:05.744778 np0000002687 nova-compute[98431]: Jun 11 23:08:05.744778 np0000002687 nova-compute[98431]: usb Jun 11 23:08:05.744778 np0000002687 nova-compute[98431]: Jun 11 23:08:05.744778 np0000002687 nova-compute[98431]: Jun 11 23:08:05.744778 np0000002687 nova-compute[98431]: Jun 11 23:08:05.744778 np0000002687 nova-compute[98431]: Jun 11 23:08:05.744778 np0000002687 nova-compute[98431]: pty Jun 11 23:08:05.744778 np0000002687 nova-compute[98431]: unix Jun 11 23:08:05.744778 np0000002687 nova-compute[98431]: spicevmc Jun 11 23:08:05.744778 np0000002687 nova-compute[98431]: Jun 11 23:08:05.744778 np0000002687 nova-compute[98431]: Jun 11 23:08:05.744778 np0000002687 nova-compute[98431]: Jun 11 23:08:05.744778 np0000002687 nova-compute[98431]: Jun 11 23:08:05.744778 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.744778 np0000002687 nova-compute[98431]: Jun 11 23:08:05.744778 np0000002687 nova-compute[98431]: Jun 11 23:08:05.744778 np0000002687 nova-compute[98431]: qemu Jun 11 23:08:05.744778 np0000002687 nova-compute[98431]: Jun 11 23:08:05.744778 np0000002687 nova-compute[98431]: Jun 11 23:08:05.744778 np0000002687 nova-compute[98431]: builtin Jun 11 23:08:05.744778 np0000002687 nova-compute[98431]: Jun 11 23:08:05.744778 np0000002687 nova-compute[98431]: Jun 11 23:08:05.744778 np0000002687 nova-compute[98431]: Jun 11 23:08:05.744778 np0000002687 nova-compute[98431]: Jun 11 23:08:05.744778 np0000002687 nova-compute[98431]: Jun 11 23:08:05.744778 np0000002687 nova-compute[98431]: Jun 11 23:08:05.744778 np0000002687 nova-compute[98431]: 2 Jun 11 23:08:05.744778 np0000002687 nova-compute[98431]: 3 Jun 11 23:08:05.744778 np0000002687 nova-compute[98431]: Jun 11 23:08:05.744778 np0000002687 nova-compute[98431]: Jun 11 23:08:05.744778 np0000002687 nova-compute[98431]: Jun 11 23:08:05.744778 np0000002687 nova-compute[98431]: Jun 11 23:08:05.744778 np0000002687 nova-compute[98431]: Jun 11 23:08:05.744778 np0000002687 nova-compute[98431]: Jun 11 23:08:05.744778 np0000002687 nova-compute[98431]: Jun 11 23:08:05.744778 np0000002687 nova-compute[98431]: Jun 11 23:08:05.744778 np0000002687 nova-compute[98431]: Jun 11 23:08:05.744778 np0000002687 nova-compute[98431]: Jun 11 23:08:05.744778 np0000002687 nova-compute[98431]: Jun 11 23:08:05.744778 np0000002687 nova-compute[98431]: {{(pid=98431) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 11 23:08:05.746036 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=98431) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 11 23:08:05.746036 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] Libvirt host hypervisor capabilities for arch=cris and machine_type=None: Jun 11 23:08:05.746036 np0000002687 nova-compute[98431]: Jun 11 23:08:05.746036 np0000002687 nova-compute[98431]: /usr/bin/qemu-system-cris Jun 11 23:08:05.746036 np0000002687 nova-compute[98431]: qemu Jun 11 23:08:05.746036 np0000002687 nova-compute[98431]: axis-dev88 Jun 11 23:08:05.746036 np0000002687 nova-compute[98431]: cris Jun 11 23:08:05.746036 np0000002687 nova-compute[98431]: Jun 11 23:08:05.746036 np0000002687 nova-compute[98431]: Jun 11 23:08:05.746036 np0000002687 nova-compute[98431]: Jun 11 23:08:05.746036 np0000002687 nova-compute[98431]: Jun 11 23:08:05.746036 np0000002687 nova-compute[98431]: Jun 11 23:08:05.746036 np0000002687 nova-compute[98431]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 11 23:08:05.746036 np0000002687 nova-compute[98431]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 11 23:08:05.746036 np0000002687 nova-compute[98431]: Jun 11 23:08:05.746036 np0000002687 nova-compute[98431]: rom Jun 11 23:08:05.746036 np0000002687 nova-compute[98431]: pflash Jun 11 23:08:05.746036 np0000002687 nova-compute[98431]: Jun 11 23:08:05.746036 np0000002687 nova-compute[98431]: Jun 11 23:08:05.746036 np0000002687 nova-compute[98431]: yes Jun 11 23:08:05.746036 np0000002687 nova-compute[98431]: no Jun 11 23:08:05.746036 np0000002687 nova-compute[98431]: Jun 11 23:08:05.746036 np0000002687 nova-compute[98431]: Jun 11 23:08:05.746036 np0000002687 nova-compute[98431]: no Jun 11 23:08:05.746036 np0000002687 nova-compute[98431]: Jun 11 23:08:05.746036 np0000002687 nova-compute[98431]: Jun 11 23:08:05.746036 np0000002687 nova-compute[98431]: Jun 11 23:08:05.746036 np0000002687 nova-compute[98431]: Jun 11 23:08:05.746036 np0000002687 nova-compute[98431]: Jun 11 23:08:05.746036 np0000002687 nova-compute[98431]: Jun 11 23:08:05.746036 np0000002687 nova-compute[98431]: Jun 11 23:08:05.746036 np0000002687 nova-compute[98431]: Jun 11 23:08:05.746036 np0000002687 nova-compute[98431]: Jun 11 23:08:05.746036 np0000002687 nova-compute[98431]: Jun 11 23:08:05.746036 np0000002687 nova-compute[98431]: Jun 11 23:08:05.746036 np0000002687 nova-compute[98431]: file Jun 11 23:08:05.746036 np0000002687 nova-compute[98431]: anonymous Jun 11 23:08:05.746036 np0000002687 nova-compute[98431]: memfd Jun 11 23:08:05.746036 np0000002687 nova-compute[98431]: Jun 11 23:08:05.746036 np0000002687 nova-compute[98431]: Jun 11 23:08:05.746036 np0000002687 nova-compute[98431]: Jun 11 23:08:05.746036 np0000002687 nova-compute[98431]: Jun 11 23:08:05.746036 np0000002687 nova-compute[98431]: Jun 11 23:08:05.746036 np0000002687 nova-compute[98431]: disk Jun 11 23:08:05.746036 np0000002687 nova-compute[98431]: cdrom Jun 11 23:08:05.746036 np0000002687 nova-compute[98431]: floppy Jun 11 23:08:05.746036 np0000002687 nova-compute[98431]: lun Jun 11 23:08:05.746036 np0000002687 nova-compute[98431]: Jun 11 23:08:05.746036 np0000002687 nova-compute[98431]: Jun 11 23:08:05.746036 np0000002687 nova-compute[98431]: fdc Jun 11 23:08:05.746036 np0000002687 nova-compute[98431]: scsi Jun 11 23:08:05.746036 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.746036 np0000002687 nova-compute[98431]: Jun 11 23:08:05.746036 np0000002687 nova-compute[98431]: Jun 11 23:08:05.746036 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.746036 np0000002687 nova-compute[98431]: Jun 11 23:08:05.746036 np0000002687 nova-compute[98431]: Jun 11 23:08:05.746036 np0000002687 nova-compute[98431]: Jun 11 23:08:05.746036 np0000002687 nova-compute[98431]: Jun 11 23:08:05.746036 np0000002687 nova-compute[98431]: sdl Jun 11 23:08:05.746036 np0000002687 nova-compute[98431]: vnc Jun 11 23:08:05.746036 np0000002687 nova-compute[98431]: spice Jun 11 23:08:05.747147 np0000002687 nova-compute[98431]: egl-headless Jun 11 23:08:05.747147 np0000002687 nova-compute[98431]: dbus Jun 11 23:08:05.747147 np0000002687 nova-compute[98431]: Jun 11 23:08:05.747147 np0000002687 nova-compute[98431]: Jun 11 23:08:05.747147 np0000002687 nova-compute[98431]: Jun 11 23:08:05.747147 np0000002687 nova-compute[98431]: Jun 11 23:08:05.747147 np0000002687 nova-compute[98431]: Jun 11 23:08:05.747147 np0000002687 nova-compute[98431]: subsystem Jun 11 23:08:05.747147 np0000002687 nova-compute[98431]: Jun 11 23:08:05.747147 np0000002687 nova-compute[98431]: Jun 11 23:08:05.747147 np0000002687 nova-compute[98431]: default Jun 11 23:08:05.747147 np0000002687 nova-compute[98431]: mandatory Jun 11 23:08:05.747147 np0000002687 nova-compute[98431]: requisite Jun 11 23:08:05.747147 np0000002687 nova-compute[98431]: optional Jun 11 23:08:05.747147 np0000002687 nova-compute[98431]: Jun 11 23:08:05.747147 np0000002687 nova-compute[98431]: Jun 11 23:08:05.747147 np0000002687 nova-compute[98431]: pci Jun 11 23:08:05.747147 np0000002687 nova-compute[98431]: scsi Jun 11 23:08:05.747147 np0000002687 nova-compute[98431]: Jun 11 23:08:05.747147 np0000002687 nova-compute[98431]: Jun 11 23:08:05.747147 np0000002687 nova-compute[98431]: Jun 11 23:08:05.747147 np0000002687 nova-compute[98431]: Jun 11 23:08:05.747147 np0000002687 nova-compute[98431]: Jun 11 23:08:05.747147 np0000002687 nova-compute[98431]: Jun 11 23:08:05.747147 np0000002687 nova-compute[98431]: Jun 11 23:08:05.747147 np0000002687 nova-compute[98431]: random Jun 11 23:08:05.747147 np0000002687 nova-compute[98431]: egd Jun 11 23:08:05.747147 np0000002687 nova-compute[98431]: builtin Jun 11 23:08:05.747147 np0000002687 nova-compute[98431]: Jun 11 23:08:05.747147 np0000002687 nova-compute[98431]: Jun 11 23:08:05.747147 np0000002687 nova-compute[98431]: Jun 11 23:08:05.747147 np0000002687 nova-compute[98431]: Jun 11 23:08:05.747147 np0000002687 nova-compute[98431]: path Jun 11 23:08:05.747147 np0000002687 nova-compute[98431]: handle Jun 11 23:08:05.747147 np0000002687 nova-compute[98431]: Jun 11 23:08:05.747147 np0000002687 nova-compute[98431]: Jun 11 23:08:05.747147 np0000002687 nova-compute[98431]: Jun 11 23:08:05.747147 np0000002687 nova-compute[98431]: Jun 11 23:08:05.747147 np0000002687 nova-compute[98431]: Jun 11 23:08:05.747147 np0000002687 nova-compute[98431]: Jun 11 23:08:05.747147 np0000002687 nova-compute[98431]: pty Jun 11 23:08:05.747147 np0000002687 nova-compute[98431]: unix Jun 11 23:08:05.747147 np0000002687 nova-compute[98431]: spicevmc Jun 11 23:08:05.747147 np0000002687 nova-compute[98431]: Jun 11 23:08:05.747147 np0000002687 nova-compute[98431]: Jun 11 23:08:05.747147 np0000002687 nova-compute[98431]: Jun 11 23:08:05.747147 np0000002687 nova-compute[98431]: Jun 11 23:08:05.747147 np0000002687 nova-compute[98431]: Jun 11 23:08:05.747147 np0000002687 nova-compute[98431]: qemu Jun 11 23:08:05.747147 np0000002687 nova-compute[98431]: Jun 11 23:08:05.747147 np0000002687 nova-compute[98431]: Jun 11 23:08:05.747147 np0000002687 nova-compute[98431]: builtin Jun 11 23:08:05.747147 np0000002687 nova-compute[98431]: Jun 11 23:08:05.747147 np0000002687 nova-compute[98431]: Jun 11 23:08:05.747147 np0000002687 nova-compute[98431]: Jun 11 23:08:05.747147 np0000002687 nova-compute[98431]: Jun 11 23:08:05.747147 np0000002687 nova-compute[98431]: Jun 11 23:08:05.747147 np0000002687 nova-compute[98431]: Jun 11 23:08:05.747147 np0000002687 nova-compute[98431]: Jun 11 23:08:05.747147 np0000002687 nova-compute[98431]: Jun 11 23:08:05.747147 np0000002687 nova-compute[98431]: Jun 11 23:08:05.747147 np0000002687 nova-compute[98431]: Jun 11 23:08:05.747147 np0000002687 nova-compute[98431]: Jun 11 23:08:05.747147 np0000002687 nova-compute[98431]: Jun 11 23:08:05.747147 np0000002687 nova-compute[98431]: Jun 11 23:08:05.747147 np0000002687 nova-compute[98431]: Jun 11 23:08:05.747147 np0000002687 nova-compute[98431]: {{(pid=98431) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 11 23:08:05.748347 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] Getting domain capabilities for i686 via machine types: {'pc', 'ubuntu', 'ubuntu-q35', 'q35'} {{(pid=98431) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 11 23:08:05.829151 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc: Jun 11 23:08:05.829151 np0000002687 nova-compute[98431]: Jun 11 23:08:05.829151 np0000002687 nova-compute[98431]: /usr/bin/qemu-system-i386 Jun 11 23:08:05.829151 np0000002687 nova-compute[98431]: qemu Jun 11 23:08:05.829151 np0000002687 nova-compute[98431]: pc-i440fx-noble Jun 11 23:08:05.829151 np0000002687 nova-compute[98431]: i686 Jun 11 23:08:05.829151 np0000002687 nova-compute[98431]: Jun 11 23:08:05.829151 np0000002687 nova-compute[98431]: Jun 11 23:08:05.829151 np0000002687 nova-compute[98431]: Jun 11 23:08:05.829151 np0000002687 nova-compute[98431]: Jun 11 23:08:05.829151 np0000002687 nova-compute[98431]: Jun 11 23:08:05.829151 np0000002687 nova-compute[98431]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 11 23:08:05.829151 np0000002687 nova-compute[98431]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 11 23:08:05.829151 np0000002687 nova-compute[98431]: Jun 11 23:08:05.829151 np0000002687 nova-compute[98431]: rom Jun 11 23:08:05.829151 np0000002687 nova-compute[98431]: pflash Jun 11 23:08:05.829151 np0000002687 nova-compute[98431]: Jun 11 23:08:05.829151 np0000002687 nova-compute[98431]: Jun 11 23:08:05.829151 np0000002687 nova-compute[98431]: yes Jun 11 23:08:05.829151 np0000002687 nova-compute[98431]: no Jun 11 23:08:05.829151 np0000002687 nova-compute[98431]: Jun 11 23:08:05.829151 np0000002687 nova-compute[98431]: Jun 11 23:08:05.829151 np0000002687 nova-compute[98431]: no Jun 11 23:08:05.829151 np0000002687 nova-compute[98431]: Jun 11 23:08:05.829151 np0000002687 nova-compute[98431]: Jun 11 23:08:05.829151 np0000002687 nova-compute[98431]: Jun 11 23:08:05.829151 np0000002687 nova-compute[98431]: Jun 11 23:08:05.829151 np0000002687 nova-compute[98431]: Jun 11 23:08:05.829151 np0000002687 nova-compute[98431]: Jun 11 23:08:05.829151 np0000002687 nova-compute[98431]: Jun 11 23:08:05.829151 np0000002687 nova-compute[98431]: on Jun 11 23:08:05.829151 np0000002687 nova-compute[98431]: off Jun 11 23:08:05.829151 np0000002687 nova-compute[98431]: Jun 11 23:08:05.829151 np0000002687 nova-compute[98431]: Jun 11 23:08:05.829151 np0000002687 nova-compute[98431]: Jun 11 23:08:05.829151 np0000002687 nova-compute[98431]: EPYC Jun 11 23:08:05.829151 np0000002687 nova-compute[98431]: AMD Jun 11 23:08:05.829151 np0000002687 nova-compute[98431]: Jun 11 23:08:05.829151 np0000002687 nova-compute[98431]: Jun 11 23:08:05.829151 np0000002687 nova-compute[98431]: Jun 11 23:08:05.829151 np0000002687 nova-compute[98431]: Jun 11 23:08:05.829151 np0000002687 nova-compute[98431]: Jun 11 23:08:05.829151 np0000002687 nova-compute[98431]: Jun 11 23:08:05.829151 np0000002687 nova-compute[98431]: Jun 11 23:08:05.829151 np0000002687 nova-compute[98431]: Jun 11 23:08:05.829151 np0000002687 nova-compute[98431]: Jun 11 23:08:05.829151 np0000002687 nova-compute[98431]: Jun 11 23:08:05.829151 np0000002687 nova-compute[98431]: Jun 11 23:08:05.829151 np0000002687 nova-compute[98431]: Jun 11 23:08:05.829151 np0000002687 nova-compute[98431]: Jun 11 23:08:05.829151 np0000002687 nova-compute[98431]: Jun 11 23:08:05.829151 np0000002687 nova-compute[98431]: Jun 11 23:08:05.829151 np0000002687 nova-compute[98431]: Jun 11 23:08:05.829151 np0000002687 nova-compute[98431]: Jun 11 23:08:05.829151 np0000002687 nova-compute[98431]: Jun 11 23:08:05.830354 np0000002687 nova-compute[98431]: Jun 11 23:08:05.830354 np0000002687 nova-compute[98431]: Jun 11 23:08:05.830354 np0000002687 nova-compute[98431]: Jun 11 23:08:05.830354 np0000002687 nova-compute[98431]: Jun 11 23:08:05.830354 np0000002687 nova-compute[98431]: Jun 11 23:08:05.830354 np0000002687 nova-compute[98431]: Jun 11 23:08:05.830354 np0000002687 nova-compute[98431]: Jun 11 23:08:05.830354 np0000002687 nova-compute[98431]: Jun 11 23:08:05.830354 np0000002687 nova-compute[98431]: Jun 11 23:08:05.830354 np0000002687 nova-compute[98431]: Jun 11 23:08:05.830354 np0000002687 nova-compute[98431]: Jun 11 23:08:05.830354 np0000002687 nova-compute[98431]: Jun 11 23:08:05.830354 np0000002687 nova-compute[98431]: Jun 11 23:08:05.830354 np0000002687 nova-compute[98431]: Jun 11 23:08:05.830354 np0000002687 nova-compute[98431]: Jun 11 23:08:05.830354 np0000002687 nova-compute[98431]: Jun 11 23:08:05.830354 np0000002687 nova-compute[98431]: Jun 11 23:08:05.830354 np0000002687 nova-compute[98431]: qemu64 Jun 11 23:08:05.830354 np0000002687 nova-compute[98431]: qemu32 Jun 11 23:08:05.830354 np0000002687 nova-compute[98431]: phenom Jun 11 23:08:05.830354 np0000002687 nova-compute[98431]: pentium3 Jun 11 23:08:05.830354 np0000002687 nova-compute[98431]: pentium2 Jun 11 23:08:05.830354 np0000002687 nova-compute[98431]: pentium Jun 11 23:08:05.830354 np0000002687 nova-compute[98431]: n270 Jun 11 23:08:05.830354 np0000002687 nova-compute[98431]: kvm64 Jun 11 23:08:05.830354 np0000002687 nova-compute[98431]: kvm32 Jun 11 23:08:05.830354 np0000002687 nova-compute[98431]: coreduo Jun 11 23:08:05.830354 np0000002687 nova-compute[98431]: core2duo Jun 11 23:08:05.830354 np0000002687 nova-compute[98431]: athlon Jun 11 23:08:05.830354 np0000002687 nova-compute[98431]: Westmere-IBRS Jun 11 23:08:05.830354 np0000002687 nova-compute[98431]: Westmere Jun 11 23:08:05.830354 np0000002687 nova-compute[98431]: Snowridge Jun 11 23:08:05.830354 np0000002687 nova-compute[98431]: Skylake-Server-noTSX-IBRS Jun 11 23:08:05.830354 np0000002687 nova-compute[98431]: Skylake-Server-IBRS Jun 11 23:08:05.830354 np0000002687 nova-compute[98431]: Skylake-Server Jun 11 23:08:05.830354 np0000002687 nova-compute[98431]: Skylake-Client-noTSX-IBRS Jun 11 23:08:05.830354 np0000002687 nova-compute[98431]: Skylake-Client-IBRS Jun 11 23:08:05.830354 np0000002687 nova-compute[98431]: Skylake-Client Jun 11 23:08:05.831088 np0000002687 nova-compute[98431]: SapphireRapids Jun 11 23:08:05.831088 np0000002687 nova-compute[98431]: SandyBridge-IBRS Jun 11 23:08:05.831088 np0000002687 nova-compute[98431]: SandyBridge Jun 11 23:08:05.831088 np0000002687 nova-compute[98431]: Penryn Jun 11 23:08:05.831088 np0000002687 nova-compute[98431]: Opteron_G5 Jun 11 23:08:05.831088 np0000002687 nova-compute[98431]: Opteron_G4 Jun 11 23:08:05.831088 np0000002687 nova-compute[98431]: Opteron_G3 Jun 11 23:08:05.831088 np0000002687 nova-compute[98431]: Opteron_G2 Jun 11 23:08:05.831088 np0000002687 nova-compute[98431]: Opteron_G1 Jun 11 23:08:05.831088 np0000002687 nova-compute[98431]: Nehalem-IBRS Jun 11 23:08:05.831088 np0000002687 nova-compute[98431]: Nehalem Jun 11 23:08:05.831088 np0000002687 nova-compute[98431]: IvyBridge-IBRS Jun 11 23:08:05.831088 np0000002687 nova-compute[98431]: IvyBridge Jun 11 23:08:05.831088 np0000002687 nova-compute[98431]: Icelake-Server-noTSX Jun 11 23:08:05.831088 np0000002687 nova-compute[98431]: Icelake-Server Jun 11 23:08:05.831088 np0000002687 nova-compute[98431]: Haswell-noTSX-IBRS Jun 11 23:08:05.831088 np0000002687 nova-compute[98431]: Haswell-noTSX Jun 11 23:08:05.831088 np0000002687 nova-compute[98431]: Haswell-IBRS Jun 11 23:08:05.831088 np0000002687 nova-compute[98431]: Haswell Jun 11 23:08:05.831088 np0000002687 nova-compute[98431]: EPYC-Rome Jun 11 23:08:05.831088 np0000002687 nova-compute[98431]: EPYC-Milan Jun 11 23:08:05.831088 np0000002687 nova-compute[98431]: EPYC-IBPB Jun 11 23:08:05.831088 np0000002687 nova-compute[98431]: EPYC-Genoa Jun 11 23:08:05.831088 np0000002687 nova-compute[98431]: EPYC Jun 11 23:08:05.831088 np0000002687 nova-compute[98431]: Dhyana Jun 11 23:08:05.831088 np0000002687 nova-compute[98431]: Cooperlake Jun 11 23:08:05.831088 np0000002687 nova-compute[98431]: Conroe Jun 11 23:08:05.831088 np0000002687 nova-compute[98431]: Cascadelake-Server-noTSX Jun 11 23:08:05.831088 np0000002687 nova-compute[98431]: Cascadelake-Server Jun 11 23:08:05.831088 np0000002687 nova-compute[98431]: Broadwell-noTSX-IBRS Jun 11 23:08:05.831088 np0000002687 nova-compute[98431]: Broadwell-noTSX Jun 11 23:08:05.831088 np0000002687 nova-compute[98431]: Broadwell-IBRS Jun 11 23:08:05.831088 np0000002687 nova-compute[98431]: Broadwell Jun 11 23:08:05.831088 np0000002687 nova-compute[98431]: 486 Jun 11 23:08:05.831088 np0000002687 nova-compute[98431]: Jun 11 23:08:05.831709 np0000002687 nova-compute[98431]: Jun 11 23:08:05.831709 np0000002687 nova-compute[98431]: Jun 11 23:08:05.831709 np0000002687 nova-compute[98431]: Jun 11 23:08:05.831709 np0000002687 nova-compute[98431]: file Jun 11 23:08:05.831709 np0000002687 nova-compute[98431]: anonymous Jun 11 23:08:05.831709 np0000002687 nova-compute[98431]: memfd Jun 11 23:08:05.831709 np0000002687 nova-compute[98431]: Jun 11 23:08:05.831709 np0000002687 nova-compute[98431]: Jun 11 23:08:05.831709 np0000002687 nova-compute[98431]: Jun 11 23:08:05.831709 np0000002687 nova-compute[98431]: Jun 11 23:08:05.831709 np0000002687 nova-compute[98431]: Jun 11 23:08:05.831709 np0000002687 nova-compute[98431]: disk Jun 11 23:08:05.831709 np0000002687 nova-compute[98431]: cdrom Jun 11 23:08:05.831709 np0000002687 nova-compute[98431]: floppy Jun 11 23:08:05.831709 np0000002687 nova-compute[98431]: lun Jun 11 23:08:05.831709 np0000002687 nova-compute[98431]: Jun 11 23:08:05.831709 np0000002687 nova-compute[98431]: Jun 11 23:08:05.831709 np0000002687 nova-compute[98431]: ide Jun 11 23:08:05.831709 np0000002687 nova-compute[98431]: fdc Jun 11 23:08:05.831709 np0000002687 nova-compute[98431]: scsi Jun 11 23:08:05.831709 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.831709 np0000002687 nova-compute[98431]: usb Jun 11 23:08:05.831709 np0000002687 nova-compute[98431]: sata Jun 11 23:08:05.831709 np0000002687 nova-compute[98431]: Jun 11 23:08:05.831709 np0000002687 nova-compute[98431]: Jun 11 23:08:05.831709 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.831709 np0000002687 nova-compute[98431]: virtio-transitional Jun 11 23:08:05.831709 np0000002687 nova-compute[98431]: virtio-non-transitional Jun 11 23:08:05.831709 np0000002687 nova-compute[98431]: Jun 11 23:08:05.831709 np0000002687 nova-compute[98431]: Jun 11 23:08:05.831709 np0000002687 nova-compute[98431]: Jun 11 23:08:05.831709 np0000002687 nova-compute[98431]: Jun 11 23:08:05.831709 np0000002687 nova-compute[98431]: sdl Jun 11 23:08:05.831709 np0000002687 nova-compute[98431]: vnc Jun 11 23:08:05.831709 np0000002687 nova-compute[98431]: spice Jun 11 23:08:05.831709 np0000002687 nova-compute[98431]: egl-headless Jun 11 23:08:05.831709 np0000002687 nova-compute[98431]: dbus Jun 11 23:08:05.831709 np0000002687 nova-compute[98431]: Jun 11 23:08:05.831709 np0000002687 nova-compute[98431]: Jun 11 23:08:05.831709 np0000002687 nova-compute[98431]: Jun 11 23:08:05.831709 np0000002687 nova-compute[98431]: Jun 11 23:08:05.831709 np0000002687 nova-compute[98431]: Jun 11 23:08:05.831709 np0000002687 nova-compute[98431]: subsystem Jun 11 23:08:05.831709 np0000002687 nova-compute[98431]: Jun 11 23:08:05.831709 np0000002687 nova-compute[98431]: Jun 11 23:08:05.831709 np0000002687 nova-compute[98431]: default Jun 11 23:08:05.831709 np0000002687 nova-compute[98431]: mandatory Jun 11 23:08:05.831709 np0000002687 nova-compute[98431]: requisite Jun 11 23:08:05.831709 np0000002687 nova-compute[98431]: optional Jun 11 23:08:05.831709 np0000002687 nova-compute[98431]: Jun 11 23:08:05.831709 np0000002687 nova-compute[98431]: Jun 11 23:08:05.831709 np0000002687 nova-compute[98431]: usb Jun 11 23:08:05.831709 np0000002687 nova-compute[98431]: pci Jun 11 23:08:05.831709 np0000002687 nova-compute[98431]: scsi Jun 11 23:08:05.831709 np0000002687 nova-compute[98431]: Jun 11 23:08:05.831709 np0000002687 nova-compute[98431]: Jun 11 23:08:05.831709 np0000002687 nova-compute[98431]: Jun 11 23:08:05.831709 np0000002687 nova-compute[98431]: Jun 11 23:08:05.831709 np0000002687 nova-compute[98431]: Jun 11 23:08:05.831709 np0000002687 nova-compute[98431]: Jun 11 23:08:05.831709 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.831709 np0000002687 nova-compute[98431]: virtio-transitional Jun 11 23:08:05.831709 np0000002687 nova-compute[98431]: virtio-non-transitional Jun 11 23:08:05.831709 np0000002687 nova-compute[98431]: Jun 11 23:08:05.831709 np0000002687 nova-compute[98431]: Jun 11 23:08:05.831709 np0000002687 nova-compute[98431]: random Jun 11 23:08:05.832984 np0000002687 nova-compute[98431]: egd Jun 11 23:08:05.832984 np0000002687 nova-compute[98431]: builtin Jun 11 23:08:05.832984 np0000002687 nova-compute[98431]: Jun 11 23:08:05.832984 np0000002687 nova-compute[98431]: Jun 11 23:08:05.832984 np0000002687 nova-compute[98431]: Jun 11 23:08:05.832984 np0000002687 nova-compute[98431]: Jun 11 23:08:05.832984 np0000002687 nova-compute[98431]: path Jun 11 23:08:05.832984 np0000002687 nova-compute[98431]: handle Jun 11 23:08:05.832984 np0000002687 nova-compute[98431]: virtiofs Jun 11 23:08:05.832984 np0000002687 nova-compute[98431]: Jun 11 23:08:05.832984 np0000002687 nova-compute[98431]: Jun 11 23:08:05.832984 np0000002687 nova-compute[98431]: Jun 11 23:08:05.832984 np0000002687 nova-compute[98431]: Jun 11 23:08:05.832984 np0000002687 nova-compute[98431]: tpm-tis Jun 11 23:08:05.832984 np0000002687 nova-compute[98431]: tpm-crb Jun 11 23:08:05.832984 np0000002687 nova-compute[98431]: Jun 11 23:08:05.832984 np0000002687 nova-compute[98431]: Jun 11 23:08:05.832984 np0000002687 nova-compute[98431]: passthrough Jun 11 23:08:05.832984 np0000002687 nova-compute[98431]: emulator Jun 11 23:08:05.832984 np0000002687 nova-compute[98431]: external Jun 11 23:08:05.832984 np0000002687 nova-compute[98431]: Jun 11 23:08:05.832984 np0000002687 nova-compute[98431]: Jun 11 23:08:05.832984 np0000002687 nova-compute[98431]: 1.2 Jun 11 23:08:05.832984 np0000002687 nova-compute[98431]: 2.0 Jun 11 23:08:05.832984 np0000002687 nova-compute[98431]: Jun 11 23:08:05.832984 np0000002687 nova-compute[98431]: Jun 11 23:08:05.832984 np0000002687 nova-compute[98431]: Jun 11 23:08:05.832984 np0000002687 nova-compute[98431]: Jun 11 23:08:05.832984 np0000002687 nova-compute[98431]: usb Jun 11 23:08:05.832984 np0000002687 nova-compute[98431]: Jun 11 23:08:05.832984 np0000002687 nova-compute[98431]: Jun 11 23:08:05.832984 np0000002687 nova-compute[98431]: Jun 11 23:08:05.832984 np0000002687 nova-compute[98431]: Jun 11 23:08:05.832984 np0000002687 nova-compute[98431]: pty Jun 11 23:08:05.832984 np0000002687 nova-compute[98431]: unix Jun 11 23:08:05.832984 np0000002687 nova-compute[98431]: spicevmc Jun 11 23:08:05.832984 np0000002687 nova-compute[98431]: Jun 11 23:08:05.832984 np0000002687 nova-compute[98431]: Jun 11 23:08:05.832984 np0000002687 nova-compute[98431]: Jun 11 23:08:05.832984 np0000002687 nova-compute[98431]: Jun 11 23:08:05.832984 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.832984 np0000002687 nova-compute[98431]: Jun 11 23:08:05.832984 np0000002687 nova-compute[98431]: Jun 11 23:08:05.832984 np0000002687 nova-compute[98431]: qemu Jun 11 23:08:05.832984 np0000002687 nova-compute[98431]: Jun 11 23:08:05.832984 np0000002687 nova-compute[98431]: Jun 11 23:08:05.832984 np0000002687 nova-compute[98431]: builtin Jun 11 23:08:05.832984 np0000002687 nova-compute[98431]: Jun 11 23:08:05.832984 np0000002687 nova-compute[98431]: Jun 11 23:08:05.832984 np0000002687 nova-compute[98431]: Jun 11 23:08:05.832984 np0000002687 nova-compute[98431]: Jun 11 23:08:05.832984 np0000002687 nova-compute[98431]: Jun 11 23:08:05.832984 np0000002687 nova-compute[98431]: Jun 11 23:08:05.832984 np0000002687 nova-compute[98431]: Jun 11 23:08:05.832984 np0000002687 nova-compute[98431]: Jun 11 23:08:05.832984 np0000002687 nova-compute[98431]: Jun 11 23:08:05.832984 np0000002687 nova-compute[98431]: Jun 11 23:08:05.832984 np0000002687 nova-compute[98431]: Jun 11 23:08:05.832984 np0000002687 nova-compute[98431]: Jun 11 23:08:05.832984 np0000002687 nova-compute[98431]: Jun 11 23:08:05.832984 np0000002687 nova-compute[98431]: Jun 11 23:08:05.832984 np0000002687 nova-compute[98431]: relaxed Jun 11 23:08:05.832984 np0000002687 nova-compute[98431]: vapic Jun 11 23:08:05.832984 np0000002687 nova-compute[98431]: spinlocks Jun 11 23:08:05.832984 np0000002687 nova-compute[98431]: vpindex Jun 11 23:08:05.832984 np0000002687 nova-compute[98431]: runtime Jun 11 23:08:05.832984 np0000002687 nova-compute[98431]: synic Jun 11 23:08:05.832984 np0000002687 nova-compute[98431]: stimer Jun 11 23:08:05.832984 np0000002687 nova-compute[98431]: reset Jun 11 23:08:05.832984 np0000002687 nova-compute[98431]: vendor_id Jun 11 23:08:05.832984 np0000002687 nova-compute[98431]: frequencies Jun 11 23:08:05.832984 np0000002687 nova-compute[98431]: reenlightenment Jun 11 23:08:05.832984 np0000002687 nova-compute[98431]: tlbflush Jun 11 23:08:05.832984 np0000002687 nova-compute[98431]: ipi Jun 11 23:08:05.832984 np0000002687 nova-compute[98431]: avic Jun 11 23:08:05.832984 np0000002687 nova-compute[98431]: Jun 11 23:08:05.832984 np0000002687 nova-compute[98431]: Jun 11 23:08:05.832984 np0000002687 nova-compute[98431]: Jun 11 23:08:05.832984 np0000002687 nova-compute[98431]: Jun 11 23:08:05.834313 np0000002687 nova-compute[98431]: {{(pid=98431) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 11 23:08:05.834313 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu: Jun 11 23:08:05.834313 np0000002687 nova-compute[98431]: Jun 11 23:08:05.834313 np0000002687 nova-compute[98431]: /usr/bin/qemu-system-i386 Jun 11 23:08:05.834313 np0000002687 nova-compute[98431]: qemu Jun 11 23:08:05.834313 np0000002687 nova-compute[98431]: pc-i440fx-noble-v2 Jun 11 23:08:05.834313 np0000002687 nova-compute[98431]: i686 Jun 11 23:08:05.834313 np0000002687 nova-compute[98431]: Jun 11 23:08:05.834313 np0000002687 nova-compute[98431]: Jun 11 23:08:05.834313 np0000002687 nova-compute[98431]: Jun 11 23:08:05.834313 np0000002687 nova-compute[98431]: Jun 11 23:08:05.834313 np0000002687 nova-compute[98431]: Jun 11 23:08:05.834313 np0000002687 nova-compute[98431]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 11 23:08:05.834313 np0000002687 nova-compute[98431]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 11 23:08:05.834313 np0000002687 nova-compute[98431]: Jun 11 23:08:05.834313 np0000002687 nova-compute[98431]: rom Jun 11 23:08:05.834313 np0000002687 nova-compute[98431]: pflash Jun 11 23:08:05.834313 np0000002687 nova-compute[98431]: Jun 11 23:08:05.834313 np0000002687 nova-compute[98431]: Jun 11 23:08:05.834313 np0000002687 nova-compute[98431]: yes Jun 11 23:08:05.834313 np0000002687 nova-compute[98431]: no Jun 11 23:08:05.834313 np0000002687 nova-compute[98431]: Jun 11 23:08:05.834313 np0000002687 nova-compute[98431]: Jun 11 23:08:05.834313 np0000002687 nova-compute[98431]: no Jun 11 23:08:05.834313 np0000002687 nova-compute[98431]: Jun 11 23:08:05.834313 np0000002687 nova-compute[98431]: Jun 11 23:08:05.834313 np0000002687 nova-compute[98431]: Jun 11 23:08:05.834313 np0000002687 nova-compute[98431]: Jun 11 23:08:05.834313 np0000002687 nova-compute[98431]: Jun 11 23:08:05.834313 np0000002687 nova-compute[98431]: Jun 11 23:08:05.834313 np0000002687 nova-compute[98431]: Jun 11 23:08:05.834313 np0000002687 nova-compute[98431]: on Jun 11 23:08:05.834313 np0000002687 nova-compute[98431]: off Jun 11 23:08:05.834313 np0000002687 nova-compute[98431]: Jun 11 23:08:05.834313 np0000002687 nova-compute[98431]: Jun 11 23:08:05.834313 np0000002687 nova-compute[98431]: Jun 11 23:08:05.834313 np0000002687 nova-compute[98431]: EPYC Jun 11 23:08:05.834313 np0000002687 nova-compute[98431]: AMD Jun 11 23:08:05.834313 np0000002687 nova-compute[98431]: Jun 11 23:08:05.834313 np0000002687 nova-compute[98431]: Jun 11 23:08:05.834313 np0000002687 nova-compute[98431]: Jun 11 23:08:05.834313 np0000002687 nova-compute[98431]: Jun 11 23:08:05.834313 np0000002687 nova-compute[98431]: Jun 11 23:08:05.834313 np0000002687 nova-compute[98431]: Jun 11 23:08:05.834313 np0000002687 nova-compute[98431]: Jun 11 23:08:05.834313 np0000002687 nova-compute[98431]: Jun 11 23:08:05.834313 np0000002687 nova-compute[98431]: Jun 11 23:08:05.834313 np0000002687 nova-compute[98431]: Jun 11 23:08:05.834313 np0000002687 nova-compute[98431]: Jun 11 23:08:05.834313 np0000002687 nova-compute[98431]: Jun 11 23:08:05.834313 np0000002687 nova-compute[98431]: Jun 11 23:08:05.834313 np0000002687 nova-compute[98431]: Jun 11 23:08:05.834313 np0000002687 nova-compute[98431]: Jun 11 23:08:05.834313 np0000002687 nova-compute[98431]: Jun 11 23:08:05.835267 np0000002687 nova-compute[98431]: Jun 11 23:08:05.835267 np0000002687 nova-compute[98431]: Jun 11 23:08:05.835267 np0000002687 nova-compute[98431]: Jun 11 23:08:05.835267 np0000002687 nova-compute[98431]: Jun 11 23:08:05.835267 np0000002687 nova-compute[98431]: Jun 11 23:08:05.835267 np0000002687 nova-compute[98431]: Jun 11 23:08:05.835267 np0000002687 nova-compute[98431]: Jun 11 23:08:05.835267 np0000002687 nova-compute[98431]: Jun 11 23:08:05.835267 np0000002687 nova-compute[98431]: Jun 11 23:08:05.835267 np0000002687 nova-compute[98431]: Jun 11 23:08:05.835267 np0000002687 nova-compute[98431]: Jun 11 23:08:05.835267 np0000002687 nova-compute[98431]: Jun 11 23:08:05.835267 np0000002687 nova-compute[98431]: Jun 11 23:08:05.835267 np0000002687 nova-compute[98431]: Jun 11 23:08:05.835267 np0000002687 nova-compute[98431]: Jun 11 23:08:05.835267 np0000002687 nova-compute[98431]: Jun 11 23:08:05.835267 np0000002687 nova-compute[98431]: Jun 11 23:08:05.835267 np0000002687 nova-compute[98431]: Jun 11 23:08:05.835267 np0000002687 nova-compute[98431]: Jun 11 23:08:05.835267 np0000002687 nova-compute[98431]: qemu64 Jun 11 23:08:05.835267 np0000002687 nova-compute[98431]: qemu32 Jun 11 23:08:05.835267 np0000002687 nova-compute[98431]: phenom Jun 11 23:08:05.835267 np0000002687 nova-compute[98431]: pentium3 Jun 11 23:08:05.835267 np0000002687 nova-compute[98431]: pentium2 Jun 11 23:08:05.835267 np0000002687 nova-compute[98431]: pentium Jun 11 23:08:05.835267 np0000002687 nova-compute[98431]: n270 Jun 11 23:08:05.835267 np0000002687 nova-compute[98431]: kvm64 Jun 11 23:08:05.835267 np0000002687 nova-compute[98431]: kvm32 Jun 11 23:08:05.835267 np0000002687 nova-compute[98431]: coreduo Jun 11 23:08:05.835267 np0000002687 nova-compute[98431]: core2duo Jun 11 23:08:05.835267 np0000002687 nova-compute[98431]: athlon Jun 11 23:08:05.835267 np0000002687 nova-compute[98431]: Westmere-IBRS Jun 11 23:08:05.835267 np0000002687 nova-compute[98431]: Westmere Jun 11 23:08:05.835267 np0000002687 nova-compute[98431]: Snowridge Jun 11 23:08:05.835267 np0000002687 nova-compute[98431]: Skylake-Server-noTSX-IBRS Jun 11 23:08:05.835267 np0000002687 nova-compute[98431]: Skylake-Server-IBRS Jun 11 23:08:05.835267 np0000002687 nova-compute[98431]: Skylake-Server Jun 11 23:08:05.835267 np0000002687 nova-compute[98431]: Skylake-Client-noTSX-IBRS Jun 11 23:08:05.836968 np0000002687 nova-compute[98431]: Skylake-Client-IBRS Jun 11 23:08:05.836968 np0000002687 nova-compute[98431]: Skylake-Client Jun 11 23:08:05.836968 np0000002687 nova-compute[98431]: SapphireRapids Jun 11 23:08:05.836968 np0000002687 nova-compute[98431]: SandyBridge-IBRS Jun 11 23:08:05.836968 np0000002687 nova-compute[98431]: SandyBridge Jun 11 23:08:05.836968 np0000002687 nova-compute[98431]: Penryn Jun 11 23:08:05.836968 np0000002687 nova-compute[98431]: Opteron_G5 Jun 11 23:08:05.836968 np0000002687 nova-compute[98431]: Opteron_G4 Jun 11 23:08:05.836968 np0000002687 nova-compute[98431]: Opteron_G3 Jun 11 23:08:05.836968 np0000002687 nova-compute[98431]: Opteron_G2 Jun 11 23:08:05.836968 np0000002687 nova-compute[98431]: Opteron_G1 Jun 11 23:08:05.836968 np0000002687 nova-compute[98431]: Nehalem-IBRS Jun 11 23:08:05.836968 np0000002687 nova-compute[98431]: Nehalem Jun 11 23:08:05.836968 np0000002687 nova-compute[98431]: IvyBridge-IBRS Jun 11 23:08:05.836968 np0000002687 nova-compute[98431]: IvyBridge Jun 11 23:08:05.836968 np0000002687 nova-compute[98431]: Icelake-Server-noTSX Jun 11 23:08:05.836968 np0000002687 nova-compute[98431]: Icelake-Server Jun 11 23:08:05.836968 np0000002687 nova-compute[98431]: Haswell-noTSX-IBRS Jun 11 23:08:05.836968 np0000002687 nova-compute[98431]: Haswell-noTSX Jun 11 23:08:05.836968 np0000002687 nova-compute[98431]: Haswell-IBRS Jun 11 23:08:05.836968 np0000002687 nova-compute[98431]: Haswell Jun 11 23:08:05.836968 np0000002687 nova-compute[98431]: EPYC-Rome Jun 11 23:08:05.836968 np0000002687 nova-compute[98431]: EPYC-Milan Jun 11 23:08:05.836968 np0000002687 nova-compute[98431]: EPYC-IBPB Jun 11 23:08:05.836968 np0000002687 nova-compute[98431]: EPYC-Genoa Jun 11 23:08:05.836968 np0000002687 nova-compute[98431]: EPYC Jun 11 23:08:05.836968 np0000002687 nova-compute[98431]: Dhyana Jun 11 23:08:05.836968 np0000002687 nova-compute[98431]: Cooperlake Jun 11 23:08:05.836968 np0000002687 nova-compute[98431]: Conroe Jun 11 23:08:05.836968 np0000002687 nova-compute[98431]: Cascadelake-Server-noTSX Jun 11 23:08:05.836968 np0000002687 nova-compute[98431]: Cascadelake-Server Jun 11 23:08:05.836968 np0000002687 nova-compute[98431]: Broadwell-noTSX-IBRS Jun 11 23:08:05.836968 np0000002687 nova-compute[98431]: Broadwell-noTSX Jun 11 23:08:05.837523 np0000002687 nova-compute[98431]: Broadwell-IBRS Jun 11 23:08:05.837523 np0000002687 nova-compute[98431]: Broadwell Jun 11 23:08:05.837523 np0000002687 nova-compute[98431]: 486 Jun 11 23:08:05.837523 np0000002687 nova-compute[98431]: Jun 11 23:08:05.837523 np0000002687 nova-compute[98431]: Jun 11 23:08:05.837523 np0000002687 nova-compute[98431]: Jun 11 23:08:05.837523 np0000002687 nova-compute[98431]: Jun 11 23:08:05.837523 np0000002687 nova-compute[98431]: file Jun 11 23:08:05.837523 np0000002687 nova-compute[98431]: anonymous Jun 11 23:08:05.837523 np0000002687 nova-compute[98431]: memfd Jun 11 23:08:05.837523 np0000002687 nova-compute[98431]: Jun 11 23:08:05.837523 np0000002687 nova-compute[98431]: Jun 11 23:08:05.837523 np0000002687 nova-compute[98431]: Jun 11 23:08:05.837523 np0000002687 nova-compute[98431]: Jun 11 23:08:05.837523 np0000002687 nova-compute[98431]: Jun 11 23:08:05.837523 np0000002687 nova-compute[98431]: disk Jun 11 23:08:05.837523 np0000002687 nova-compute[98431]: cdrom Jun 11 23:08:05.837523 np0000002687 nova-compute[98431]: floppy Jun 11 23:08:05.837523 np0000002687 nova-compute[98431]: lun Jun 11 23:08:05.837523 np0000002687 nova-compute[98431]: Jun 11 23:08:05.837523 np0000002687 nova-compute[98431]: Jun 11 23:08:05.837523 np0000002687 nova-compute[98431]: ide Jun 11 23:08:05.837523 np0000002687 nova-compute[98431]: fdc Jun 11 23:08:05.837523 np0000002687 nova-compute[98431]: scsi Jun 11 23:08:05.837523 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.837523 np0000002687 nova-compute[98431]: usb Jun 11 23:08:05.837523 np0000002687 nova-compute[98431]: sata Jun 11 23:08:05.837523 np0000002687 nova-compute[98431]: Jun 11 23:08:05.837523 np0000002687 nova-compute[98431]: Jun 11 23:08:05.837523 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.837523 np0000002687 nova-compute[98431]: virtio-transitional Jun 11 23:08:05.837523 np0000002687 nova-compute[98431]: virtio-non-transitional Jun 11 23:08:05.837523 np0000002687 nova-compute[98431]: Jun 11 23:08:05.837523 np0000002687 nova-compute[98431]: Jun 11 23:08:05.837523 np0000002687 nova-compute[98431]: Jun 11 23:08:05.837523 np0000002687 nova-compute[98431]: Jun 11 23:08:05.837523 np0000002687 nova-compute[98431]: sdl Jun 11 23:08:05.837523 np0000002687 nova-compute[98431]: vnc Jun 11 23:08:05.837523 np0000002687 nova-compute[98431]: spice Jun 11 23:08:05.837523 np0000002687 nova-compute[98431]: egl-headless Jun 11 23:08:05.837523 np0000002687 nova-compute[98431]: dbus Jun 11 23:08:05.837523 np0000002687 nova-compute[98431]: Jun 11 23:08:05.837523 np0000002687 nova-compute[98431]: Jun 11 23:08:05.837523 np0000002687 nova-compute[98431]: Jun 11 23:08:05.837523 np0000002687 nova-compute[98431]: Jun 11 23:08:05.837523 np0000002687 nova-compute[98431]: Jun 11 23:08:05.837523 np0000002687 nova-compute[98431]: subsystem Jun 11 23:08:05.837523 np0000002687 nova-compute[98431]: Jun 11 23:08:05.837523 np0000002687 nova-compute[98431]: Jun 11 23:08:05.837523 np0000002687 nova-compute[98431]: default Jun 11 23:08:05.837523 np0000002687 nova-compute[98431]: mandatory Jun 11 23:08:05.837523 np0000002687 nova-compute[98431]: requisite Jun 11 23:08:05.837523 np0000002687 nova-compute[98431]: optional Jun 11 23:08:05.837523 np0000002687 nova-compute[98431]: Jun 11 23:08:05.837523 np0000002687 nova-compute[98431]: Jun 11 23:08:05.837523 np0000002687 nova-compute[98431]: usb Jun 11 23:08:05.837523 np0000002687 nova-compute[98431]: pci Jun 11 23:08:05.837523 np0000002687 nova-compute[98431]: scsi Jun 11 23:08:05.837523 np0000002687 nova-compute[98431]: Jun 11 23:08:05.837523 np0000002687 nova-compute[98431]: Jun 11 23:08:05.837523 np0000002687 nova-compute[98431]: Jun 11 23:08:05.837523 np0000002687 nova-compute[98431]: Jun 11 23:08:05.837523 np0000002687 nova-compute[98431]: Jun 11 23:08:05.837523 np0000002687 nova-compute[98431]: Jun 11 23:08:05.838711 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.838711 np0000002687 nova-compute[98431]: virtio-transitional Jun 11 23:08:05.838711 np0000002687 nova-compute[98431]: virtio-non-transitional Jun 11 23:08:05.838711 np0000002687 nova-compute[98431]: Jun 11 23:08:05.838711 np0000002687 nova-compute[98431]: Jun 11 23:08:05.838711 np0000002687 nova-compute[98431]: random Jun 11 23:08:05.838711 np0000002687 nova-compute[98431]: egd Jun 11 23:08:05.838711 np0000002687 nova-compute[98431]: builtin Jun 11 23:08:05.838711 np0000002687 nova-compute[98431]: Jun 11 23:08:05.838711 np0000002687 nova-compute[98431]: Jun 11 23:08:05.838711 np0000002687 nova-compute[98431]: Jun 11 23:08:05.838711 np0000002687 nova-compute[98431]: Jun 11 23:08:05.838711 np0000002687 nova-compute[98431]: path Jun 11 23:08:05.838711 np0000002687 nova-compute[98431]: handle Jun 11 23:08:05.838711 np0000002687 nova-compute[98431]: virtiofs Jun 11 23:08:05.838711 np0000002687 nova-compute[98431]: Jun 11 23:08:05.838711 np0000002687 nova-compute[98431]: Jun 11 23:08:05.838711 np0000002687 nova-compute[98431]: Jun 11 23:08:05.838711 np0000002687 nova-compute[98431]: Jun 11 23:08:05.838711 np0000002687 nova-compute[98431]: tpm-tis Jun 11 23:08:05.838711 np0000002687 nova-compute[98431]: tpm-crb Jun 11 23:08:05.838711 np0000002687 nova-compute[98431]: Jun 11 23:08:05.838711 np0000002687 nova-compute[98431]: Jun 11 23:08:05.838711 np0000002687 nova-compute[98431]: passthrough Jun 11 23:08:05.838711 np0000002687 nova-compute[98431]: emulator Jun 11 23:08:05.838711 np0000002687 nova-compute[98431]: external Jun 11 23:08:05.838711 np0000002687 nova-compute[98431]: Jun 11 23:08:05.838711 np0000002687 nova-compute[98431]: Jun 11 23:08:05.838711 np0000002687 nova-compute[98431]: 1.2 Jun 11 23:08:05.838711 np0000002687 nova-compute[98431]: 2.0 Jun 11 23:08:05.838711 np0000002687 nova-compute[98431]: Jun 11 23:08:05.838711 np0000002687 nova-compute[98431]: Jun 11 23:08:05.838711 np0000002687 nova-compute[98431]: Jun 11 23:08:05.838711 np0000002687 nova-compute[98431]: Jun 11 23:08:05.838711 np0000002687 nova-compute[98431]: usb Jun 11 23:08:05.838711 np0000002687 nova-compute[98431]: Jun 11 23:08:05.838711 np0000002687 nova-compute[98431]: Jun 11 23:08:05.838711 np0000002687 nova-compute[98431]: Jun 11 23:08:05.838711 np0000002687 nova-compute[98431]: Jun 11 23:08:05.838711 np0000002687 nova-compute[98431]: pty Jun 11 23:08:05.838711 np0000002687 nova-compute[98431]: unix Jun 11 23:08:05.838711 np0000002687 nova-compute[98431]: spicevmc Jun 11 23:08:05.838711 np0000002687 nova-compute[98431]: Jun 11 23:08:05.838711 np0000002687 nova-compute[98431]: Jun 11 23:08:05.838711 np0000002687 nova-compute[98431]: Jun 11 23:08:05.838711 np0000002687 nova-compute[98431]: Jun 11 23:08:05.838711 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.838711 np0000002687 nova-compute[98431]: Jun 11 23:08:05.838711 np0000002687 nova-compute[98431]: Jun 11 23:08:05.838711 np0000002687 nova-compute[98431]: qemu Jun 11 23:08:05.838711 np0000002687 nova-compute[98431]: Jun 11 23:08:05.838711 np0000002687 nova-compute[98431]: Jun 11 23:08:05.838711 np0000002687 nova-compute[98431]: builtin Jun 11 23:08:05.838711 np0000002687 nova-compute[98431]: Jun 11 23:08:05.838711 np0000002687 nova-compute[98431]: Jun 11 23:08:05.838711 np0000002687 nova-compute[98431]: Jun 11 23:08:05.838711 np0000002687 nova-compute[98431]: Jun 11 23:08:05.838711 np0000002687 nova-compute[98431]: Jun 11 23:08:05.838711 np0000002687 nova-compute[98431]: Jun 11 23:08:05.838711 np0000002687 nova-compute[98431]: Jun 11 23:08:05.838711 np0000002687 nova-compute[98431]: Jun 11 23:08:05.838711 np0000002687 nova-compute[98431]: Jun 11 23:08:05.838711 np0000002687 nova-compute[98431]: Jun 11 23:08:05.838711 np0000002687 nova-compute[98431]: Jun 11 23:08:05.838711 np0000002687 nova-compute[98431]: Jun 11 23:08:05.838711 np0000002687 nova-compute[98431]: Jun 11 23:08:05.838711 np0000002687 nova-compute[98431]: Jun 11 23:08:05.838711 np0000002687 nova-compute[98431]: relaxed Jun 11 23:08:05.838711 np0000002687 nova-compute[98431]: vapic Jun 11 23:08:05.838711 np0000002687 nova-compute[98431]: spinlocks Jun 11 23:08:05.838711 np0000002687 nova-compute[98431]: vpindex Jun 11 23:08:05.838711 np0000002687 nova-compute[98431]: runtime Jun 11 23:08:05.838711 np0000002687 nova-compute[98431]: synic Jun 11 23:08:05.838711 np0000002687 nova-compute[98431]: stimer Jun 11 23:08:05.838711 np0000002687 nova-compute[98431]: reset Jun 11 23:08:05.838711 np0000002687 nova-compute[98431]: vendor_id Jun 11 23:08:05.838711 np0000002687 nova-compute[98431]: frequencies Jun 11 23:08:05.839965 np0000002687 nova-compute[98431]: reenlightenment Jun 11 23:08:05.839965 np0000002687 nova-compute[98431]: tlbflush Jun 11 23:08:05.839965 np0000002687 nova-compute[98431]: ipi Jun 11 23:08:05.839965 np0000002687 nova-compute[98431]: avic Jun 11 23:08:05.839965 np0000002687 nova-compute[98431]: Jun 11 23:08:05.839965 np0000002687 nova-compute[98431]: Jun 11 23:08:05.839965 np0000002687 nova-compute[98431]: Jun 11 23:08:05.839965 np0000002687 nova-compute[98431]: Jun 11 23:08:05.839965 np0000002687 nova-compute[98431]: {{(pid=98431) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 11 23:08:05.839965 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35: Jun 11 23:08:05.839965 np0000002687 nova-compute[98431]: Jun 11 23:08:05.839965 np0000002687 nova-compute[98431]: /usr/bin/qemu-system-i386 Jun 11 23:08:05.839965 np0000002687 nova-compute[98431]: qemu Jun 11 23:08:05.839965 np0000002687 nova-compute[98431]: pc-q35-noble-v2 Jun 11 23:08:05.839965 np0000002687 nova-compute[98431]: i686 Jun 11 23:08:05.839965 np0000002687 nova-compute[98431]: Jun 11 23:08:05.839965 np0000002687 nova-compute[98431]: Jun 11 23:08:05.839965 np0000002687 nova-compute[98431]: Jun 11 23:08:05.839965 np0000002687 nova-compute[98431]: Jun 11 23:08:05.839965 np0000002687 nova-compute[98431]: Jun 11 23:08:05.839965 np0000002687 nova-compute[98431]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 11 23:08:05.839965 np0000002687 nova-compute[98431]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 11 23:08:05.839965 np0000002687 nova-compute[98431]: Jun 11 23:08:05.839965 np0000002687 nova-compute[98431]: rom Jun 11 23:08:05.839965 np0000002687 nova-compute[98431]: pflash Jun 11 23:08:05.839965 np0000002687 nova-compute[98431]: Jun 11 23:08:05.839965 np0000002687 nova-compute[98431]: Jun 11 23:08:05.839965 np0000002687 nova-compute[98431]: yes Jun 11 23:08:05.839965 np0000002687 nova-compute[98431]: no Jun 11 23:08:05.839965 np0000002687 nova-compute[98431]: Jun 11 23:08:05.839965 np0000002687 nova-compute[98431]: Jun 11 23:08:05.839965 np0000002687 nova-compute[98431]: no Jun 11 23:08:05.839965 np0000002687 nova-compute[98431]: Jun 11 23:08:05.839965 np0000002687 nova-compute[98431]: Jun 11 23:08:05.839965 np0000002687 nova-compute[98431]: Jun 11 23:08:05.839965 np0000002687 nova-compute[98431]: Jun 11 23:08:05.839965 np0000002687 nova-compute[98431]: Jun 11 23:08:05.839965 np0000002687 nova-compute[98431]: Jun 11 23:08:05.839965 np0000002687 nova-compute[98431]: Jun 11 23:08:05.839965 np0000002687 nova-compute[98431]: on Jun 11 23:08:05.839965 np0000002687 nova-compute[98431]: off Jun 11 23:08:05.839965 np0000002687 nova-compute[98431]: Jun 11 23:08:05.839965 np0000002687 nova-compute[98431]: Jun 11 23:08:05.839965 np0000002687 nova-compute[98431]: Jun 11 23:08:05.839965 np0000002687 nova-compute[98431]: EPYC Jun 11 23:08:05.839965 np0000002687 nova-compute[98431]: AMD Jun 11 23:08:05.839965 np0000002687 nova-compute[98431]: Jun 11 23:08:05.839965 np0000002687 nova-compute[98431]: Jun 11 23:08:05.839965 np0000002687 nova-compute[98431]: Jun 11 23:08:05.839965 np0000002687 nova-compute[98431]: Jun 11 23:08:05.839965 np0000002687 nova-compute[98431]: Jun 11 23:08:05.839965 np0000002687 nova-compute[98431]: Jun 11 23:08:05.839965 np0000002687 nova-compute[98431]: Jun 11 23:08:05.839965 np0000002687 nova-compute[98431]: Jun 11 23:08:05.839965 np0000002687 nova-compute[98431]: Jun 11 23:08:05.839965 np0000002687 nova-compute[98431]: Jun 11 23:08:05.839965 np0000002687 nova-compute[98431]: Jun 11 23:08:05.839965 np0000002687 nova-compute[98431]: Jun 11 23:08:05.841471 np0000002687 nova-compute[98431]: Jun 11 23:08:05.841471 np0000002687 nova-compute[98431]: Jun 11 23:08:05.841471 np0000002687 nova-compute[98431]: Jun 11 23:08:05.841471 np0000002687 nova-compute[98431]: Jun 11 23:08:05.841471 np0000002687 nova-compute[98431]: Jun 11 23:08:05.841471 np0000002687 nova-compute[98431]: Jun 11 23:08:05.841471 np0000002687 nova-compute[98431]: Jun 11 23:08:05.841471 np0000002687 nova-compute[98431]: Jun 11 23:08:05.841471 np0000002687 nova-compute[98431]: Jun 11 23:08:05.841471 np0000002687 nova-compute[98431]: Jun 11 23:08:05.841471 np0000002687 nova-compute[98431]: Jun 11 23:08:05.841471 np0000002687 nova-compute[98431]: Jun 11 23:08:05.841471 np0000002687 nova-compute[98431]: Jun 11 23:08:05.841471 np0000002687 nova-compute[98431]: Jun 11 23:08:05.841471 np0000002687 nova-compute[98431]: Jun 11 23:08:05.841471 np0000002687 nova-compute[98431]: Jun 11 23:08:05.841471 np0000002687 nova-compute[98431]: Jun 11 23:08:05.841471 np0000002687 nova-compute[98431]: Jun 11 23:08:05.841471 np0000002687 nova-compute[98431]: Jun 11 23:08:05.841471 np0000002687 nova-compute[98431]: Jun 11 23:08:05.841471 np0000002687 nova-compute[98431]: Jun 11 23:08:05.841471 np0000002687 nova-compute[98431]: Jun 11 23:08:05.841471 np0000002687 nova-compute[98431]: Jun 11 23:08:05.841471 np0000002687 nova-compute[98431]: qemu64 Jun 11 23:08:05.841471 np0000002687 nova-compute[98431]: qemu32 Jun 11 23:08:05.841471 np0000002687 nova-compute[98431]: phenom Jun 11 23:08:05.841471 np0000002687 nova-compute[98431]: pentium3 Jun 11 23:08:05.841471 np0000002687 nova-compute[98431]: pentium2 Jun 11 23:08:05.841471 np0000002687 nova-compute[98431]: pentium Jun 11 23:08:05.841471 np0000002687 nova-compute[98431]: n270 Jun 11 23:08:05.841471 np0000002687 nova-compute[98431]: kvm64 Jun 11 23:08:05.841471 np0000002687 nova-compute[98431]: kvm32 Jun 11 23:08:05.841471 np0000002687 nova-compute[98431]: coreduo Jun 11 23:08:05.841471 np0000002687 nova-compute[98431]: core2duo Jun 11 23:08:05.841471 np0000002687 nova-compute[98431]: athlon Jun 11 23:08:05.841471 np0000002687 nova-compute[98431]: Westmere-IBRS Jun 11 23:08:05.841471 np0000002687 nova-compute[98431]: Westmere Jun 11 23:08:05.841471 np0000002687 nova-compute[98431]: Snowridge Jun 11 23:08:05.841471 np0000002687 nova-compute[98431]: Skylake-Server-noTSX-IBRS Jun 11 23:08:05.842228 np0000002687 nova-compute[98431]: Skylake-Server-IBRS Jun 11 23:08:05.842228 np0000002687 nova-compute[98431]: Skylake-Server Jun 11 23:08:05.842228 np0000002687 nova-compute[98431]: Skylake-Client-noTSX-IBRS Jun 11 23:08:05.842228 np0000002687 nova-compute[98431]: Skylake-Client-IBRS Jun 11 23:08:05.842228 np0000002687 nova-compute[98431]: Skylake-Client Jun 11 23:08:05.842228 np0000002687 nova-compute[98431]: SapphireRapids Jun 11 23:08:05.842228 np0000002687 nova-compute[98431]: SandyBridge-IBRS Jun 11 23:08:05.842228 np0000002687 nova-compute[98431]: SandyBridge Jun 11 23:08:05.842228 np0000002687 nova-compute[98431]: Penryn Jun 11 23:08:05.842228 np0000002687 nova-compute[98431]: Opteron_G5 Jun 11 23:08:05.842228 np0000002687 nova-compute[98431]: Opteron_G4 Jun 11 23:08:05.842228 np0000002687 nova-compute[98431]: Opteron_G3 Jun 11 23:08:05.842228 np0000002687 nova-compute[98431]: Opteron_G2 Jun 11 23:08:05.842228 np0000002687 nova-compute[98431]: Opteron_G1 Jun 11 23:08:05.842228 np0000002687 nova-compute[98431]: Nehalem-IBRS Jun 11 23:08:05.842228 np0000002687 nova-compute[98431]: Nehalem Jun 11 23:08:05.842228 np0000002687 nova-compute[98431]: IvyBridge-IBRS Jun 11 23:08:05.842228 np0000002687 nova-compute[98431]: IvyBridge Jun 11 23:08:05.842228 np0000002687 nova-compute[98431]: Icelake-Server-noTSX Jun 11 23:08:05.842228 np0000002687 nova-compute[98431]: Icelake-Server Jun 11 23:08:05.842228 np0000002687 nova-compute[98431]: Haswell-noTSX-IBRS Jun 11 23:08:05.842228 np0000002687 nova-compute[98431]: Haswell-noTSX Jun 11 23:08:05.842228 np0000002687 nova-compute[98431]: Haswell-IBRS Jun 11 23:08:05.842228 np0000002687 nova-compute[98431]: Haswell Jun 11 23:08:05.842228 np0000002687 nova-compute[98431]: EPYC-Rome Jun 11 23:08:05.842228 np0000002687 nova-compute[98431]: EPYC-Milan Jun 11 23:08:05.842228 np0000002687 nova-compute[98431]: EPYC-IBPB Jun 11 23:08:05.842228 np0000002687 nova-compute[98431]: EPYC-Genoa Jun 11 23:08:05.842228 np0000002687 nova-compute[98431]: EPYC Jun 11 23:08:05.842228 np0000002687 nova-compute[98431]: Dhyana Jun 11 23:08:05.842228 np0000002687 nova-compute[98431]: Cooperlake Jun 11 23:08:05.842228 np0000002687 nova-compute[98431]: Conroe Jun 11 23:08:05.842228 np0000002687 nova-compute[98431]: Cascadelake-Server-noTSX Jun 11 23:08:05.843344 np0000002687 nova-compute[98431]: Cascadelake-Server Jun 11 23:08:05.843344 np0000002687 nova-compute[98431]: Broadwell-noTSX-IBRS Jun 11 23:08:05.843344 np0000002687 nova-compute[98431]: Broadwell-noTSX Jun 11 23:08:05.843344 np0000002687 nova-compute[98431]: Broadwell-IBRS Jun 11 23:08:05.843344 np0000002687 nova-compute[98431]: Broadwell Jun 11 23:08:05.843344 np0000002687 nova-compute[98431]: 486 Jun 11 23:08:05.843344 np0000002687 nova-compute[98431]: Jun 11 23:08:05.843344 np0000002687 nova-compute[98431]: Jun 11 23:08:05.843344 np0000002687 nova-compute[98431]: Jun 11 23:08:05.843344 np0000002687 nova-compute[98431]: Jun 11 23:08:05.843344 np0000002687 nova-compute[98431]: file Jun 11 23:08:05.843344 np0000002687 nova-compute[98431]: anonymous Jun 11 23:08:05.843344 np0000002687 nova-compute[98431]: memfd Jun 11 23:08:05.843344 np0000002687 nova-compute[98431]: Jun 11 23:08:05.843344 np0000002687 nova-compute[98431]: Jun 11 23:08:05.843344 np0000002687 nova-compute[98431]: Jun 11 23:08:05.843344 np0000002687 nova-compute[98431]: Jun 11 23:08:05.843344 np0000002687 nova-compute[98431]: Jun 11 23:08:05.843344 np0000002687 nova-compute[98431]: disk Jun 11 23:08:05.843344 np0000002687 nova-compute[98431]: cdrom Jun 11 23:08:05.843344 np0000002687 nova-compute[98431]: floppy Jun 11 23:08:05.843344 np0000002687 nova-compute[98431]: lun Jun 11 23:08:05.843344 np0000002687 nova-compute[98431]: Jun 11 23:08:05.843344 np0000002687 nova-compute[98431]: Jun 11 23:08:05.843344 np0000002687 nova-compute[98431]: fdc Jun 11 23:08:05.843344 np0000002687 nova-compute[98431]: scsi Jun 11 23:08:05.843344 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.843344 np0000002687 nova-compute[98431]: usb Jun 11 23:08:05.843344 np0000002687 nova-compute[98431]: sata Jun 11 23:08:05.843344 np0000002687 nova-compute[98431]: Jun 11 23:08:05.843344 np0000002687 nova-compute[98431]: Jun 11 23:08:05.843344 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.843344 np0000002687 nova-compute[98431]: virtio-transitional Jun 11 23:08:05.843344 np0000002687 nova-compute[98431]: virtio-non-transitional Jun 11 23:08:05.843344 np0000002687 nova-compute[98431]: Jun 11 23:08:05.843344 np0000002687 nova-compute[98431]: Jun 11 23:08:05.843344 np0000002687 nova-compute[98431]: Jun 11 23:08:05.843344 np0000002687 nova-compute[98431]: Jun 11 23:08:05.843344 np0000002687 nova-compute[98431]: sdl Jun 11 23:08:05.843344 np0000002687 nova-compute[98431]: vnc Jun 11 23:08:05.843344 np0000002687 nova-compute[98431]: spice Jun 11 23:08:05.843344 np0000002687 nova-compute[98431]: egl-headless Jun 11 23:08:05.843344 np0000002687 nova-compute[98431]: dbus Jun 11 23:08:05.843344 np0000002687 nova-compute[98431]: Jun 11 23:08:05.843344 np0000002687 nova-compute[98431]: Jun 11 23:08:05.843344 np0000002687 nova-compute[98431]: Jun 11 23:08:05.843344 np0000002687 nova-compute[98431]: Jun 11 23:08:05.843344 np0000002687 nova-compute[98431]: Jun 11 23:08:05.843344 np0000002687 nova-compute[98431]: subsystem Jun 11 23:08:05.843344 np0000002687 nova-compute[98431]: Jun 11 23:08:05.843344 np0000002687 nova-compute[98431]: Jun 11 23:08:05.843344 np0000002687 nova-compute[98431]: default Jun 11 23:08:05.843344 np0000002687 nova-compute[98431]: mandatory Jun 11 23:08:05.843344 np0000002687 nova-compute[98431]: requisite Jun 11 23:08:05.843344 np0000002687 nova-compute[98431]: optional Jun 11 23:08:05.843344 np0000002687 nova-compute[98431]: Jun 11 23:08:05.843344 np0000002687 nova-compute[98431]: Jun 11 23:08:05.843344 np0000002687 nova-compute[98431]: usb Jun 11 23:08:05.843344 np0000002687 nova-compute[98431]: pci Jun 11 23:08:05.844471 np0000002687 nova-compute[98431]: scsi Jun 11 23:08:05.844471 np0000002687 nova-compute[98431]: Jun 11 23:08:05.844471 np0000002687 nova-compute[98431]: Jun 11 23:08:05.844471 np0000002687 nova-compute[98431]: Jun 11 23:08:05.844471 np0000002687 nova-compute[98431]: Jun 11 23:08:05.844471 np0000002687 nova-compute[98431]: Jun 11 23:08:05.844471 np0000002687 nova-compute[98431]: Jun 11 23:08:05.844471 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.844471 np0000002687 nova-compute[98431]: virtio-transitional Jun 11 23:08:05.844471 np0000002687 nova-compute[98431]: virtio-non-transitional Jun 11 23:08:05.844471 np0000002687 nova-compute[98431]: Jun 11 23:08:05.844471 np0000002687 nova-compute[98431]: Jun 11 23:08:05.844471 np0000002687 nova-compute[98431]: random Jun 11 23:08:05.844471 np0000002687 nova-compute[98431]: egd Jun 11 23:08:05.844471 np0000002687 nova-compute[98431]: builtin Jun 11 23:08:05.844471 np0000002687 nova-compute[98431]: Jun 11 23:08:05.844471 np0000002687 nova-compute[98431]: Jun 11 23:08:05.844471 np0000002687 nova-compute[98431]: Jun 11 23:08:05.844471 np0000002687 nova-compute[98431]: Jun 11 23:08:05.844471 np0000002687 nova-compute[98431]: path Jun 11 23:08:05.844471 np0000002687 nova-compute[98431]: handle Jun 11 23:08:05.844471 np0000002687 nova-compute[98431]: virtiofs Jun 11 23:08:05.844471 np0000002687 nova-compute[98431]: Jun 11 23:08:05.844471 np0000002687 nova-compute[98431]: Jun 11 23:08:05.844471 np0000002687 nova-compute[98431]: Jun 11 23:08:05.844471 np0000002687 nova-compute[98431]: Jun 11 23:08:05.844471 np0000002687 nova-compute[98431]: tpm-tis Jun 11 23:08:05.844471 np0000002687 nova-compute[98431]: tpm-crb Jun 11 23:08:05.844471 np0000002687 nova-compute[98431]: Jun 11 23:08:05.844471 np0000002687 nova-compute[98431]: Jun 11 23:08:05.844471 np0000002687 nova-compute[98431]: passthrough Jun 11 23:08:05.844471 np0000002687 nova-compute[98431]: emulator Jun 11 23:08:05.844471 np0000002687 nova-compute[98431]: external Jun 11 23:08:05.844471 np0000002687 nova-compute[98431]: Jun 11 23:08:05.844471 np0000002687 nova-compute[98431]: Jun 11 23:08:05.844471 np0000002687 nova-compute[98431]: 1.2 Jun 11 23:08:05.844471 np0000002687 nova-compute[98431]: 2.0 Jun 11 23:08:05.844471 np0000002687 nova-compute[98431]: Jun 11 23:08:05.844471 np0000002687 nova-compute[98431]: Jun 11 23:08:05.844471 np0000002687 nova-compute[98431]: Jun 11 23:08:05.844471 np0000002687 nova-compute[98431]: Jun 11 23:08:05.844471 np0000002687 nova-compute[98431]: usb Jun 11 23:08:05.844471 np0000002687 nova-compute[98431]: Jun 11 23:08:05.844471 np0000002687 nova-compute[98431]: Jun 11 23:08:05.844471 np0000002687 nova-compute[98431]: Jun 11 23:08:05.844471 np0000002687 nova-compute[98431]: Jun 11 23:08:05.844471 np0000002687 nova-compute[98431]: pty Jun 11 23:08:05.844471 np0000002687 nova-compute[98431]: unix Jun 11 23:08:05.844471 np0000002687 nova-compute[98431]: spicevmc Jun 11 23:08:05.844471 np0000002687 nova-compute[98431]: Jun 11 23:08:05.844471 np0000002687 nova-compute[98431]: Jun 11 23:08:05.844471 np0000002687 nova-compute[98431]: Jun 11 23:08:05.844471 np0000002687 nova-compute[98431]: Jun 11 23:08:05.844471 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.844471 np0000002687 nova-compute[98431]: Jun 11 23:08:05.844471 np0000002687 nova-compute[98431]: Jun 11 23:08:05.844471 np0000002687 nova-compute[98431]: qemu Jun 11 23:08:05.844471 np0000002687 nova-compute[98431]: Jun 11 23:08:05.844471 np0000002687 nova-compute[98431]: Jun 11 23:08:05.844471 np0000002687 nova-compute[98431]: builtin Jun 11 23:08:05.844471 np0000002687 nova-compute[98431]: Jun 11 23:08:05.844471 np0000002687 nova-compute[98431]: Jun 11 23:08:05.844471 np0000002687 nova-compute[98431]: Jun 11 23:08:05.844471 np0000002687 nova-compute[98431]: Jun 11 23:08:05.844471 np0000002687 nova-compute[98431]: Jun 11 23:08:05.844471 np0000002687 nova-compute[98431]: Jun 11 23:08:05.844471 np0000002687 nova-compute[98431]: Jun 11 23:08:05.844471 np0000002687 nova-compute[98431]: Jun 11 23:08:05.844471 np0000002687 nova-compute[98431]: Jun 11 23:08:05.844471 np0000002687 nova-compute[98431]: Jun 11 23:08:05.844471 np0000002687 nova-compute[98431]: Jun 11 23:08:05.844471 np0000002687 nova-compute[98431]: Jun 11 23:08:05.844471 np0000002687 nova-compute[98431]: Jun 11 23:08:05.844471 np0000002687 nova-compute[98431]: Jun 11 23:08:05.844471 np0000002687 nova-compute[98431]: relaxed Jun 11 23:08:05.844471 np0000002687 nova-compute[98431]: vapic Jun 11 23:08:05.844471 np0000002687 nova-compute[98431]: spinlocks Jun 11 23:08:05.844471 np0000002687 nova-compute[98431]: vpindex Jun 11 23:08:05.844471 np0000002687 nova-compute[98431]: runtime Jun 11 23:08:05.845930 np0000002687 nova-compute[98431]: synic Jun 11 23:08:05.845930 np0000002687 nova-compute[98431]: stimer Jun 11 23:08:05.845930 np0000002687 nova-compute[98431]: reset Jun 11 23:08:05.845930 np0000002687 nova-compute[98431]: vendor_id Jun 11 23:08:05.845930 np0000002687 nova-compute[98431]: frequencies Jun 11 23:08:05.845930 np0000002687 nova-compute[98431]: reenlightenment Jun 11 23:08:05.845930 np0000002687 nova-compute[98431]: tlbflush Jun 11 23:08:05.845930 np0000002687 nova-compute[98431]: ipi Jun 11 23:08:05.845930 np0000002687 nova-compute[98431]: avic Jun 11 23:08:05.845930 np0000002687 nova-compute[98431]: Jun 11 23:08:05.845930 np0000002687 nova-compute[98431]: Jun 11 23:08:05.845930 np0000002687 nova-compute[98431]: Jun 11 23:08:05.845930 np0000002687 nova-compute[98431]: Jun 11 23:08:05.845930 np0000002687 nova-compute[98431]: {{(pid=98431) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 11 23:08:05.845930 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35: Jun 11 23:08:05.845930 np0000002687 nova-compute[98431]: Jun 11 23:08:05.845930 np0000002687 nova-compute[98431]: /usr/bin/qemu-system-i386 Jun 11 23:08:05.845930 np0000002687 nova-compute[98431]: qemu Jun 11 23:08:05.845930 np0000002687 nova-compute[98431]: pc-q35-noble Jun 11 23:08:05.845930 np0000002687 nova-compute[98431]: i686 Jun 11 23:08:05.845930 np0000002687 nova-compute[98431]: Jun 11 23:08:05.845930 np0000002687 nova-compute[98431]: Jun 11 23:08:05.845930 np0000002687 nova-compute[98431]: Jun 11 23:08:05.845930 np0000002687 nova-compute[98431]: Jun 11 23:08:05.845930 np0000002687 nova-compute[98431]: Jun 11 23:08:05.845930 np0000002687 nova-compute[98431]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 11 23:08:05.845930 np0000002687 nova-compute[98431]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 11 23:08:05.845930 np0000002687 nova-compute[98431]: Jun 11 23:08:05.845930 np0000002687 nova-compute[98431]: rom Jun 11 23:08:05.845930 np0000002687 nova-compute[98431]: pflash Jun 11 23:08:05.845930 np0000002687 nova-compute[98431]: Jun 11 23:08:05.845930 np0000002687 nova-compute[98431]: Jun 11 23:08:05.845930 np0000002687 nova-compute[98431]: yes Jun 11 23:08:05.845930 np0000002687 nova-compute[98431]: no Jun 11 23:08:05.845930 np0000002687 nova-compute[98431]: Jun 11 23:08:05.845930 np0000002687 nova-compute[98431]: Jun 11 23:08:05.845930 np0000002687 nova-compute[98431]: no Jun 11 23:08:05.845930 np0000002687 nova-compute[98431]: Jun 11 23:08:05.845930 np0000002687 nova-compute[98431]: Jun 11 23:08:05.845930 np0000002687 nova-compute[98431]: Jun 11 23:08:05.845930 np0000002687 nova-compute[98431]: Jun 11 23:08:05.845930 np0000002687 nova-compute[98431]: Jun 11 23:08:05.845930 np0000002687 nova-compute[98431]: Jun 11 23:08:05.845930 np0000002687 nova-compute[98431]: Jun 11 23:08:05.845930 np0000002687 nova-compute[98431]: on Jun 11 23:08:05.845930 np0000002687 nova-compute[98431]: off Jun 11 23:08:05.845930 np0000002687 nova-compute[98431]: Jun 11 23:08:05.845930 np0000002687 nova-compute[98431]: Jun 11 23:08:05.845930 np0000002687 nova-compute[98431]: Jun 11 23:08:05.845930 np0000002687 nova-compute[98431]: EPYC Jun 11 23:08:05.845930 np0000002687 nova-compute[98431]: AMD Jun 11 23:08:05.845930 np0000002687 nova-compute[98431]: Jun 11 23:08:05.845930 np0000002687 nova-compute[98431]: Jun 11 23:08:05.845930 np0000002687 nova-compute[98431]: Jun 11 23:08:05.845930 np0000002687 nova-compute[98431]: Jun 11 23:08:05.845930 np0000002687 nova-compute[98431]: Jun 11 23:08:05.845930 np0000002687 nova-compute[98431]: Jun 11 23:08:05.845930 np0000002687 nova-compute[98431]: Jun 11 23:08:05.845930 np0000002687 nova-compute[98431]: Jun 11 23:08:05.845930 np0000002687 nova-compute[98431]: Jun 11 23:08:05.847284 np0000002687 nova-compute[98431]: Jun 11 23:08:05.847284 np0000002687 nova-compute[98431]: Jun 11 23:08:05.847284 np0000002687 nova-compute[98431]: Jun 11 23:08:05.847284 np0000002687 nova-compute[98431]: Jun 11 23:08:05.847284 np0000002687 nova-compute[98431]: Jun 11 23:08:05.847284 np0000002687 nova-compute[98431]: Jun 11 23:08:05.847284 np0000002687 nova-compute[98431]: Jun 11 23:08:05.847284 np0000002687 nova-compute[98431]: Jun 11 23:08:05.847284 np0000002687 nova-compute[98431]: Jun 11 23:08:05.847284 np0000002687 nova-compute[98431]: Jun 11 23:08:05.847284 np0000002687 nova-compute[98431]: Jun 11 23:08:05.847284 np0000002687 nova-compute[98431]: Jun 11 23:08:05.847284 np0000002687 nova-compute[98431]: Jun 11 23:08:05.847284 np0000002687 nova-compute[98431]: Jun 11 23:08:05.847284 np0000002687 nova-compute[98431]: Jun 11 23:08:05.847284 np0000002687 nova-compute[98431]: Jun 11 23:08:05.847284 np0000002687 nova-compute[98431]: Jun 11 23:08:05.847284 np0000002687 nova-compute[98431]: Jun 11 23:08:05.847284 np0000002687 nova-compute[98431]: Jun 11 23:08:05.847284 np0000002687 nova-compute[98431]: Jun 11 23:08:05.847284 np0000002687 nova-compute[98431]: Jun 11 23:08:05.847284 np0000002687 nova-compute[98431]: Jun 11 23:08:05.847284 np0000002687 nova-compute[98431]: Jun 11 23:08:05.847284 np0000002687 nova-compute[98431]: Jun 11 23:08:05.847284 np0000002687 nova-compute[98431]: Jun 11 23:08:05.847284 np0000002687 nova-compute[98431]: Jun 11 23:08:05.847284 np0000002687 nova-compute[98431]: qemu64 Jun 11 23:08:05.847284 np0000002687 nova-compute[98431]: qemu32 Jun 11 23:08:05.847284 np0000002687 nova-compute[98431]: phenom Jun 11 23:08:05.847284 np0000002687 nova-compute[98431]: pentium3 Jun 11 23:08:05.847284 np0000002687 nova-compute[98431]: pentium2 Jun 11 23:08:05.847284 np0000002687 nova-compute[98431]: pentium Jun 11 23:08:05.847284 np0000002687 nova-compute[98431]: n270 Jun 11 23:08:05.847284 np0000002687 nova-compute[98431]: kvm64 Jun 11 23:08:05.847284 np0000002687 nova-compute[98431]: kvm32 Jun 11 23:08:05.847284 np0000002687 nova-compute[98431]: coreduo Jun 11 23:08:05.847284 np0000002687 nova-compute[98431]: core2duo Jun 11 23:08:05.847284 np0000002687 nova-compute[98431]: athlon Jun 11 23:08:05.847284 np0000002687 nova-compute[98431]: Westmere-IBRS Jun 11 23:08:05.847284 np0000002687 nova-compute[98431]: Westmere Jun 11 23:08:05.848105 np0000002687 nova-compute[98431]: Snowridge Jun 11 23:08:05.848105 np0000002687 nova-compute[98431]: Skylake-Server-noTSX-IBRS Jun 11 23:08:05.848105 np0000002687 nova-compute[98431]: Skylake-Server-IBRS Jun 11 23:08:05.848105 np0000002687 nova-compute[98431]: Skylake-Server Jun 11 23:08:05.848105 np0000002687 nova-compute[98431]: Skylake-Client-noTSX-IBRS Jun 11 23:08:05.848105 np0000002687 nova-compute[98431]: Skylake-Client-IBRS Jun 11 23:08:05.848105 np0000002687 nova-compute[98431]: Skylake-Client Jun 11 23:08:05.848105 np0000002687 nova-compute[98431]: SapphireRapids Jun 11 23:08:05.848105 np0000002687 nova-compute[98431]: SandyBridge-IBRS Jun 11 23:08:05.848105 np0000002687 nova-compute[98431]: SandyBridge Jun 11 23:08:05.848105 np0000002687 nova-compute[98431]: Penryn Jun 11 23:08:05.848105 np0000002687 nova-compute[98431]: Opteron_G5 Jun 11 23:08:05.848105 np0000002687 nova-compute[98431]: Opteron_G4 Jun 11 23:08:05.848105 np0000002687 nova-compute[98431]: Opteron_G3 Jun 11 23:08:05.848105 np0000002687 nova-compute[98431]: Opteron_G2 Jun 11 23:08:05.848105 np0000002687 nova-compute[98431]: Opteron_G1 Jun 11 23:08:05.848105 np0000002687 nova-compute[98431]: Nehalem-IBRS Jun 11 23:08:05.848105 np0000002687 nova-compute[98431]: Nehalem Jun 11 23:08:05.848105 np0000002687 nova-compute[98431]: IvyBridge-IBRS Jun 11 23:08:05.848105 np0000002687 nova-compute[98431]: IvyBridge Jun 11 23:08:05.848105 np0000002687 nova-compute[98431]: Icelake-Server-noTSX Jun 11 23:08:05.848105 np0000002687 nova-compute[98431]: Icelake-Server Jun 11 23:08:05.848105 np0000002687 nova-compute[98431]: Haswell-noTSX-IBRS Jun 11 23:08:05.848105 np0000002687 nova-compute[98431]: Haswell-noTSX Jun 11 23:08:05.848105 np0000002687 nova-compute[98431]: Haswell-IBRS Jun 11 23:08:05.848105 np0000002687 nova-compute[98431]: Haswell Jun 11 23:08:05.848105 np0000002687 nova-compute[98431]: EPYC-Rome Jun 11 23:08:05.848105 np0000002687 nova-compute[98431]: EPYC-Milan Jun 11 23:08:05.848105 np0000002687 nova-compute[98431]: EPYC-IBPB Jun 11 23:08:05.848105 np0000002687 nova-compute[98431]: EPYC-Genoa Jun 11 23:08:05.848105 np0000002687 nova-compute[98431]: EPYC Jun 11 23:08:05.848105 np0000002687 nova-compute[98431]: Dhyana Jun 11 23:08:05.848105 np0000002687 nova-compute[98431]: Cooperlake Jun 11 23:08:05.848693 np0000002687 nova-compute[98431]: Conroe Jun 11 23:08:05.848693 np0000002687 nova-compute[98431]: Cascadelake-Server-noTSX Jun 11 23:08:05.848693 np0000002687 nova-compute[98431]: Cascadelake-Server Jun 11 23:08:05.848693 np0000002687 nova-compute[98431]: Broadwell-noTSX-IBRS Jun 11 23:08:05.848693 np0000002687 nova-compute[98431]: Broadwell-noTSX Jun 11 23:08:05.848693 np0000002687 nova-compute[98431]: Broadwell-IBRS Jun 11 23:08:05.848693 np0000002687 nova-compute[98431]: Broadwell Jun 11 23:08:05.848693 np0000002687 nova-compute[98431]: 486 Jun 11 23:08:05.848693 np0000002687 nova-compute[98431]: Jun 11 23:08:05.848693 np0000002687 nova-compute[98431]: Jun 11 23:08:05.848693 np0000002687 nova-compute[98431]: Jun 11 23:08:05.848693 np0000002687 nova-compute[98431]: Jun 11 23:08:05.848693 np0000002687 nova-compute[98431]: file Jun 11 23:08:05.848693 np0000002687 nova-compute[98431]: anonymous Jun 11 23:08:05.848693 np0000002687 nova-compute[98431]: memfd Jun 11 23:08:05.848693 np0000002687 nova-compute[98431]: Jun 11 23:08:05.848693 np0000002687 nova-compute[98431]: Jun 11 23:08:05.848693 np0000002687 nova-compute[98431]: Jun 11 23:08:05.848693 np0000002687 nova-compute[98431]: Jun 11 23:08:05.848693 np0000002687 nova-compute[98431]: Jun 11 23:08:05.848693 np0000002687 nova-compute[98431]: disk Jun 11 23:08:05.848693 np0000002687 nova-compute[98431]: cdrom Jun 11 23:08:05.848693 np0000002687 nova-compute[98431]: floppy Jun 11 23:08:05.848693 np0000002687 nova-compute[98431]: lun Jun 11 23:08:05.848693 np0000002687 nova-compute[98431]: Jun 11 23:08:05.848693 np0000002687 nova-compute[98431]: Jun 11 23:08:05.848693 np0000002687 nova-compute[98431]: fdc Jun 11 23:08:05.848693 np0000002687 nova-compute[98431]: scsi Jun 11 23:08:05.848693 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.848693 np0000002687 nova-compute[98431]: usb Jun 11 23:08:05.848693 np0000002687 nova-compute[98431]: sata Jun 11 23:08:05.848693 np0000002687 nova-compute[98431]: Jun 11 23:08:05.848693 np0000002687 nova-compute[98431]: Jun 11 23:08:05.848693 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.848693 np0000002687 nova-compute[98431]: virtio-transitional Jun 11 23:08:05.848693 np0000002687 nova-compute[98431]: virtio-non-transitional Jun 11 23:08:05.848693 np0000002687 nova-compute[98431]: Jun 11 23:08:05.848693 np0000002687 nova-compute[98431]: Jun 11 23:08:05.848693 np0000002687 nova-compute[98431]: Jun 11 23:08:05.848693 np0000002687 nova-compute[98431]: Jun 11 23:08:05.848693 np0000002687 nova-compute[98431]: sdl Jun 11 23:08:05.848693 np0000002687 nova-compute[98431]: vnc Jun 11 23:08:05.848693 np0000002687 nova-compute[98431]: spice Jun 11 23:08:05.848693 np0000002687 nova-compute[98431]: egl-headless Jun 11 23:08:05.848693 np0000002687 nova-compute[98431]: dbus Jun 11 23:08:05.848693 np0000002687 nova-compute[98431]: Jun 11 23:08:05.848693 np0000002687 nova-compute[98431]: Jun 11 23:08:05.848693 np0000002687 nova-compute[98431]: Jun 11 23:08:05.848693 np0000002687 nova-compute[98431]: Jun 11 23:08:05.848693 np0000002687 nova-compute[98431]: Jun 11 23:08:05.848693 np0000002687 nova-compute[98431]: subsystem Jun 11 23:08:05.848693 np0000002687 nova-compute[98431]: Jun 11 23:08:05.848693 np0000002687 nova-compute[98431]: Jun 11 23:08:05.848693 np0000002687 nova-compute[98431]: default Jun 11 23:08:05.848693 np0000002687 nova-compute[98431]: mandatory Jun 11 23:08:05.848693 np0000002687 nova-compute[98431]: requisite Jun 11 23:08:05.849831 np0000002687 nova-compute[98431]: optional Jun 11 23:08:05.849831 np0000002687 nova-compute[98431]: Jun 11 23:08:05.849831 np0000002687 nova-compute[98431]: Jun 11 23:08:05.849831 np0000002687 nova-compute[98431]: usb Jun 11 23:08:05.849831 np0000002687 nova-compute[98431]: pci Jun 11 23:08:05.849831 np0000002687 nova-compute[98431]: scsi Jun 11 23:08:05.849831 np0000002687 nova-compute[98431]: Jun 11 23:08:05.849831 np0000002687 nova-compute[98431]: Jun 11 23:08:05.849831 np0000002687 nova-compute[98431]: Jun 11 23:08:05.849831 np0000002687 nova-compute[98431]: Jun 11 23:08:05.849831 np0000002687 nova-compute[98431]: Jun 11 23:08:05.849831 np0000002687 nova-compute[98431]: Jun 11 23:08:05.849831 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.849831 np0000002687 nova-compute[98431]: virtio-transitional Jun 11 23:08:05.849831 np0000002687 nova-compute[98431]: virtio-non-transitional Jun 11 23:08:05.849831 np0000002687 nova-compute[98431]: Jun 11 23:08:05.849831 np0000002687 nova-compute[98431]: Jun 11 23:08:05.849831 np0000002687 nova-compute[98431]: random Jun 11 23:08:05.849831 np0000002687 nova-compute[98431]: egd Jun 11 23:08:05.849831 np0000002687 nova-compute[98431]: builtin Jun 11 23:08:05.849831 np0000002687 nova-compute[98431]: Jun 11 23:08:05.849831 np0000002687 nova-compute[98431]: Jun 11 23:08:05.849831 np0000002687 nova-compute[98431]: Jun 11 23:08:05.849831 np0000002687 nova-compute[98431]: Jun 11 23:08:05.849831 np0000002687 nova-compute[98431]: path Jun 11 23:08:05.849831 np0000002687 nova-compute[98431]: handle Jun 11 23:08:05.849831 np0000002687 nova-compute[98431]: virtiofs Jun 11 23:08:05.849831 np0000002687 nova-compute[98431]: Jun 11 23:08:05.849831 np0000002687 nova-compute[98431]: Jun 11 23:08:05.849831 np0000002687 nova-compute[98431]: Jun 11 23:08:05.849831 np0000002687 nova-compute[98431]: Jun 11 23:08:05.849831 np0000002687 nova-compute[98431]: tpm-tis Jun 11 23:08:05.849831 np0000002687 nova-compute[98431]: tpm-crb Jun 11 23:08:05.849831 np0000002687 nova-compute[98431]: Jun 11 23:08:05.849831 np0000002687 nova-compute[98431]: Jun 11 23:08:05.849831 np0000002687 nova-compute[98431]: passthrough Jun 11 23:08:05.849831 np0000002687 nova-compute[98431]: emulator Jun 11 23:08:05.849831 np0000002687 nova-compute[98431]: external Jun 11 23:08:05.849831 np0000002687 nova-compute[98431]: Jun 11 23:08:05.849831 np0000002687 nova-compute[98431]: Jun 11 23:08:05.849831 np0000002687 nova-compute[98431]: 1.2 Jun 11 23:08:05.849831 np0000002687 nova-compute[98431]: 2.0 Jun 11 23:08:05.849831 np0000002687 nova-compute[98431]: Jun 11 23:08:05.849831 np0000002687 nova-compute[98431]: Jun 11 23:08:05.849831 np0000002687 nova-compute[98431]: Jun 11 23:08:05.849831 np0000002687 nova-compute[98431]: Jun 11 23:08:05.849831 np0000002687 nova-compute[98431]: usb Jun 11 23:08:05.849831 np0000002687 nova-compute[98431]: Jun 11 23:08:05.849831 np0000002687 nova-compute[98431]: Jun 11 23:08:05.849831 np0000002687 nova-compute[98431]: Jun 11 23:08:05.849831 np0000002687 nova-compute[98431]: Jun 11 23:08:05.849831 np0000002687 nova-compute[98431]: pty Jun 11 23:08:05.849831 np0000002687 nova-compute[98431]: unix Jun 11 23:08:05.849831 np0000002687 nova-compute[98431]: spicevmc Jun 11 23:08:05.849831 np0000002687 nova-compute[98431]: Jun 11 23:08:05.849831 np0000002687 nova-compute[98431]: Jun 11 23:08:05.849831 np0000002687 nova-compute[98431]: Jun 11 23:08:05.849831 np0000002687 nova-compute[98431]: Jun 11 23:08:05.849831 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.849831 np0000002687 nova-compute[98431]: Jun 11 23:08:05.849831 np0000002687 nova-compute[98431]: Jun 11 23:08:05.849831 np0000002687 nova-compute[98431]: qemu Jun 11 23:08:05.849831 np0000002687 nova-compute[98431]: Jun 11 23:08:05.849831 np0000002687 nova-compute[98431]: Jun 11 23:08:05.849831 np0000002687 nova-compute[98431]: builtin Jun 11 23:08:05.849831 np0000002687 nova-compute[98431]: Jun 11 23:08:05.849831 np0000002687 nova-compute[98431]: Jun 11 23:08:05.849831 np0000002687 nova-compute[98431]: Jun 11 23:08:05.849831 np0000002687 nova-compute[98431]: Jun 11 23:08:05.849831 np0000002687 nova-compute[98431]: Jun 11 23:08:05.849831 np0000002687 nova-compute[98431]: Jun 11 23:08:05.849831 np0000002687 nova-compute[98431]: Jun 11 23:08:05.849831 np0000002687 nova-compute[98431]: Jun 11 23:08:05.849831 np0000002687 nova-compute[98431]: Jun 11 23:08:05.849831 np0000002687 nova-compute[98431]: Jun 11 23:08:05.849831 np0000002687 nova-compute[98431]: Jun 11 23:08:05.849831 np0000002687 nova-compute[98431]: Jun 11 23:08:05.849831 np0000002687 nova-compute[98431]: Jun 11 23:08:05.849831 np0000002687 nova-compute[98431]: Jun 11 23:08:05.851369 np0000002687 nova-compute[98431]: relaxed Jun 11 23:08:05.851369 np0000002687 nova-compute[98431]: vapic Jun 11 23:08:05.851369 np0000002687 nova-compute[98431]: spinlocks Jun 11 23:08:05.851369 np0000002687 nova-compute[98431]: vpindex Jun 11 23:08:05.851369 np0000002687 nova-compute[98431]: runtime Jun 11 23:08:05.851369 np0000002687 nova-compute[98431]: synic Jun 11 23:08:05.851369 np0000002687 nova-compute[98431]: stimer Jun 11 23:08:05.851369 np0000002687 nova-compute[98431]: reset Jun 11 23:08:05.851369 np0000002687 nova-compute[98431]: vendor_id Jun 11 23:08:05.851369 np0000002687 nova-compute[98431]: frequencies Jun 11 23:08:05.851369 np0000002687 nova-compute[98431]: reenlightenment Jun 11 23:08:05.851369 np0000002687 nova-compute[98431]: tlbflush Jun 11 23:08:05.851369 np0000002687 nova-compute[98431]: ipi Jun 11 23:08:05.851369 np0000002687 nova-compute[98431]: avic Jun 11 23:08:05.851369 np0000002687 nova-compute[98431]: Jun 11 23:08:05.851369 np0000002687 nova-compute[98431]: Jun 11 23:08:05.851369 np0000002687 nova-compute[98431]: Jun 11 23:08:05.851369 np0000002687 nova-compute[98431]: Jun 11 23:08:05.851369 np0000002687 nova-compute[98431]: {{(pid=98431) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 11 23:08:05.851369 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] Getting domain capabilities for m68k via machine types: {None, 'virt'} {{(pid=98431) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 11 23:08:05.851369 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] Libvirt host hypervisor capabilities for arch=m68k and machine_type=None: Jun 11 23:08:05.851369 np0000002687 nova-compute[98431]: Jun 11 23:08:05.851369 np0000002687 nova-compute[98431]: /usr/bin/qemu-system-m68k Jun 11 23:08:05.851369 np0000002687 nova-compute[98431]: qemu Jun 11 23:08:05.851369 np0000002687 nova-compute[98431]: mcf5208evb Jun 11 23:08:05.851369 np0000002687 nova-compute[98431]: m68k Jun 11 23:08:05.851369 np0000002687 nova-compute[98431]: Jun 11 23:08:05.851369 np0000002687 nova-compute[98431]: Jun 11 23:08:05.851369 np0000002687 nova-compute[98431]: Jun 11 23:08:05.851369 np0000002687 nova-compute[98431]: Jun 11 23:08:05.851369 np0000002687 nova-compute[98431]: Jun 11 23:08:05.851369 np0000002687 nova-compute[98431]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 11 23:08:05.851369 np0000002687 nova-compute[98431]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 11 23:08:05.851369 np0000002687 nova-compute[98431]: Jun 11 23:08:05.851369 np0000002687 nova-compute[98431]: rom Jun 11 23:08:05.851369 np0000002687 nova-compute[98431]: pflash Jun 11 23:08:05.851369 np0000002687 nova-compute[98431]: Jun 11 23:08:05.851369 np0000002687 nova-compute[98431]: Jun 11 23:08:05.851369 np0000002687 nova-compute[98431]: yes Jun 11 23:08:05.851369 np0000002687 nova-compute[98431]: no Jun 11 23:08:05.851369 np0000002687 nova-compute[98431]: Jun 11 23:08:05.851369 np0000002687 nova-compute[98431]: Jun 11 23:08:05.851369 np0000002687 nova-compute[98431]: no Jun 11 23:08:05.851369 np0000002687 nova-compute[98431]: Jun 11 23:08:05.851369 np0000002687 nova-compute[98431]: Jun 11 23:08:05.851369 np0000002687 nova-compute[98431]: Jun 11 23:08:05.851369 np0000002687 nova-compute[98431]: Jun 11 23:08:05.851369 np0000002687 nova-compute[98431]: Jun 11 23:08:05.851369 np0000002687 nova-compute[98431]: Jun 11 23:08:05.851369 np0000002687 nova-compute[98431]: Jun 11 23:08:05.851369 np0000002687 nova-compute[98431]: Jun 11 23:08:05.851369 np0000002687 nova-compute[98431]: Jun 11 23:08:05.851369 np0000002687 nova-compute[98431]: Jun 11 23:08:05.851369 np0000002687 nova-compute[98431]: Jun 11 23:08:05.851369 np0000002687 nova-compute[98431]: file Jun 11 23:08:05.851369 np0000002687 nova-compute[98431]: anonymous Jun 11 23:08:05.852352 np0000002687 nova-compute[98431]: memfd Jun 11 23:08:05.852352 np0000002687 nova-compute[98431]: Jun 11 23:08:05.852352 np0000002687 nova-compute[98431]: Jun 11 23:08:05.852352 np0000002687 nova-compute[98431]: Jun 11 23:08:05.852352 np0000002687 nova-compute[98431]: Jun 11 23:08:05.852352 np0000002687 nova-compute[98431]: Jun 11 23:08:05.852352 np0000002687 nova-compute[98431]: disk Jun 11 23:08:05.852352 np0000002687 nova-compute[98431]: cdrom Jun 11 23:08:05.852352 np0000002687 nova-compute[98431]: floppy Jun 11 23:08:05.852352 np0000002687 nova-compute[98431]: lun Jun 11 23:08:05.852352 np0000002687 nova-compute[98431]: Jun 11 23:08:05.852352 np0000002687 nova-compute[98431]: Jun 11 23:08:05.852352 np0000002687 nova-compute[98431]: fdc Jun 11 23:08:05.852352 np0000002687 nova-compute[98431]: scsi Jun 11 23:08:05.852352 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.852352 np0000002687 nova-compute[98431]: Jun 11 23:08:05.852352 np0000002687 nova-compute[98431]: Jun 11 23:08:05.852352 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.852352 np0000002687 nova-compute[98431]: Jun 11 23:08:05.852352 np0000002687 nova-compute[98431]: Jun 11 23:08:05.852352 np0000002687 nova-compute[98431]: Jun 11 23:08:05.852352 np0000002687 nova-compute[98431]: Jun 11 23:08:05.852352 np0000002687 nova-compute[98431]: sdl Jun 11 23:08:05.852352 np0000002687 nova-compute[98431]: vnc Jun 11 23:08:05.852352 np0000002687 nova-compute[98431]: spice Jun 11 23:08:05.852352 np0000002687 nova-compute[98431]: egl-headless Jun 11 23:08:05.852352 np0000002687 nova-compute[98431]: dbus Jun 11 23:08:05.852352 np0000002687 nova-compute[98431]: Jun 11 23:08:05.852352 np0000002687 nova-compute[98431]: Jun 11 23:08:05.852352 np0000002687 nova-compute[98431]: Jun 11 23:08:05.852352 np0000002687 nova-compute[98431]: Jun 11 23:08:05.852352 np0000002687 nova-compute[98431]: Jun 11 23:08:05.852352 np0000002687 nova-compute[98431]: subsystem Jun 11 23:08:05.852352 np0000002687 nova-compute[98431]: Jun 11 23:08:05.852352 np0000002687 nova-compute[98431]: Jun 11 23:08:05.852352 np0000002687 nova-compute[98431]: default Jun 11 23:08:05.852352 np0000002687 nova-compute[98431]: mandatory Jun 11 23:08:05.852352 np0000002687 nova-compute[98431]: requisite Jun 11 23:08:05.852352 np0000002687 nova-compute[98431]: optional Jun 11 23:08:05.852352 np0000002687 nova-compute[98431]: Jun 11 23:08:05.852352 np0000002687 nova-compute[98431]: Jun 11 23:08:05.852352 np0000002687 nova-compute[98431]: pci Jun 11 23:08:05.852352 np0000002687 nova-compute[98431]: scsi Jun 11 23:08:05.852352 np0000002687 nova-compute[98431]: Jun 11 23:08:05.852352 np0000002687 nova-compute[98431]: Jun 11 23:08:05.852352 np0000002687 nova-compute[98431]: Jun 11 23:08:05.852352 np0000002687 nova-compute[98431]: Jun 11 23:08:05.852352 np0000002687 nova-compute[98431]: Jun 11 23:08:05.852352 np0000002687 nova-compute[98431]: Jun 11 23:08:05.852352 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.852352 np0000002687 nova-compute[98431]: Jun 11 23:08:05.852352 np0000002687 nova-compute[98431]: Jun 11 23:08:05.852352 np0000002687 nova-compute[98431]: random Jun 11 23:08:05.852352 np0000002687 nova-compute[98431]: egd Jun 11 23:08:05.852352 np0000002687 nova-compute[98431]: builtin Jun 11 23:08:05.852352 np0000002687 nova-compute[98431]: Jun 11 23:08:05.852352 np0000002687 nova-compute[98431]: Jun 11 23:08:05.852352 np0000002687 nova-compute[98431]: Jun 11 23:08:05.852352 np0000002687 nova-compute[98431]: Jun 11 23:08:05.852352 np0000002687 nova-compute[98431]: path Jun 11 23:08:05.852352 np0000002687 nova-compute[98431]: handle Jun 11 23:08:05.852352 np0000002687 nova-compute[98431]: virtiofs Jun 11 23:08:05.852352 np0000002687 nova-compute[98431]: Jun 11 23:08:05.852352 np0000002687 nova-compute[98431]: Jun 11 23:08:05.852352 np0000002687 nova-compute[98431]: Jun 11 23:08:05.852352 np0000002687 nova-compute[98431]: Jun 11 23:08:05.852352 np0000002687 nova-compute[98431]: Jun 11 23:08:05.852352 np0000002687 nova-compute[98431]: Jun 11 23:08:05.852352 np0000002687 nova-compute[98431]: pty Jun 11 23:08:05.852352 np0000002687 nova-compute[98431]: unix Jun 11 23:08:05.852352 np0000002687 nova-compute[98431]: spicevmc Jun 11 23:08:05.852352 np0000002687 nova-compute[98431]: Jun 11 23:08:05.852352 np0000002687 nova-compute[98431]: Jun 11 23:08:05.852352 np0000002687 nova-compute[98431]: Jun 11 23:08:05.852352 np0000002687 nova-compute[98431]: Jun 11 23:08:05.852352 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.852352 np0000002687 nova-compute[98431]: Jun 11 23:08:05.853988 np0000002687 nova-compute[98431]: Jun 11 23:08:05.853988 np0000002687 nova-compute[98431]: qemu Jun 11 23:08:05.853988 np0000002687 nova-compute[98431]: Jun 11 23:08:05.853988 np0000002687 nova-compute[98431]: Jun 11 23:08:05.853988 np0000002687 nova-compute[98431]: builtin Jun 11 23:08:05.853988 np0000002687 nova-compute[98431]: Jun 11 23:08:05.853988 np0000002687 nova-compute[98431]: Jun 11 23:08:05.853988 np0000002687 nova-compute[98431]: Jun 11 23:08:05.853988 np0000002687 nova-compute[98431]: Jun 11 23:08:05.853988 np0000002687 nova-compute[98431]: Jun 11 23:08:05.853988 np0000002687 nova-compute[98431]: Jun 11 23:08:05.853988 np0000002687 nova-compute[98431]: Jun 11 23:08:05.853988 np0000002687 nova-compute[98431]: Jun 11 23:08:05.853988 np0000002687 nova-compute[98431]: Jun 11 23:08:05.853988 np0000002687 nova-compute[98431]: Jun 11 23:08:05.853988 np0000002687 nova-compute[98431]: Jun 11 23:08:05.853988 np0000002687 nova-compute[98431]: Jun 11 23:08:05.853988 np0000002687 nova-compute[98431]: Jun 11 23:08:05.853988 np0000002687 nova-compute[98431]: Jun 11 23:08:05.853988 np0000002687 nova-compute[98431]: {{(pid=98431) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 11 23:08:05.853988 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] Libvirt host hypervisor capabilities for arch=m68k and machine_type=virt: Jun 11 23:08:05.853988 np0000002687 nova-compute[98431]: Jun 11 23:08:05.853988 np0000002687 nova-compute[98431]: /usr/bin/qemu-system-m68k Jun 11 23:08:05.853988 np0000002687 nova-compute[98431]: qemu Jun 11 23:08:05.853988 np0000002687 nova-compute[98431]: virt-8.2 Jun 11 23:08:05.853988 np0000002687 nova-compute[98431]: m68k Jun 11 23:08:05.853988 np0000002687 nova-compute[98431]: Jun 11 23:08:05.853988 np0000002687 nova-compute[98431]: Jun 11 23:08:05.853988 np0000002687 nova-compute[98431]: Jun 11 23:08:05.853988 np0000002687 nova-compute[98431]: Jun 11 23:08:05.853988 np0000002687 nova-compute[98431]: Jun 11 23:08:05.853988 np0000002687 nova-compute[98431]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 11 23:08:05.853988 np0000002687 nova-compute[98431]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 11 23:08:05.853988 np0000002687 nova-compute[98431]: Jun 11 23:08:05.853988 np0000002687 nova-compute[98431]: rom Jun 11 23:08:05.853988 np0000002687 nova-compute[98431]: pflash Jun 11 23:08:05.853988 np0000002687 nova-compute[98431]: Jun 11 23:08:05.853988 np0000002687 nova-compute[98431]: Jun 11 23:08:05.853988 np0000002687 nova-compute[98431]: yes Jun 11 23:08:05.853988 np0000002687 nova-compute[98431]: no Jun 11 23:08:05.853988 np0000002687 nova-compute[98431]: Jun 11 23:08:05.853988 np0000002687 nova-compute[98431]: Jun 11 23:08:05.853988 np0000002687 nova-compute[98431]: no Jun 11 23:08:05.853988 np0000002687 nova-compute[98431]: Jun 11 23:08:05.853988 np0000002687 nova-compute[98431]: Jun 11 23:08:05.853988 np0000002687 nova-compute[98431]: Jun 11 23:08:05.853988 np0000002687 nova-compute[98431]: Jun 11 23:08:05.853988 np0000002687 nova-compute[98431]: Jun 11 23:08:05.853988 np0000002687 nova-compute[98431]: Jun 11 23:08:05.853988 np0000002687 nova-compute[98431]: Jun 11 23:08:05.853988 np0000002687 nova-compute[98431]: Jun 11 23:08:05.853988 np0000002687 nova-compute[98431]: Jun 11 23:08:05.853988 np0000002687 nova-compute[98431]: Jun 11 23:08:05.853988 np0000002687 nova-compute[98431]: Jun 11 23:08:05.853988 np0000002687 nova-compute[98431]: file Jun 11 23:08:05.853988 np0000002687 nova-compute[98431]: anonymous Jun 11 23:08:05.853988 np0000002687 nova-compute[98431]: memfd Jun 11 23:08:05.853988 np0000002687 nova-compute[98431]: Jun 11 23:08:05.853988 np0000002687 nova-compute[98431]: Jun 11 23:08:05.853988 np0000002687 nova-compute[98431]: Jun 11 23:08:05.853988 np0000002687 nova-compute[98431]: Jun 11 23:08:05.853988 np0000002687 nova-compute[98431]: Jun 11 23:08:05.853988 np0000002687 nova-compute[98431]: disk Jun 11 23:08:05.853988 np0000002687 nova-compute[98431]: cdrom Jun 11 23:08:05.853988 np0000002687 nova-compute[98431]: floppy Jun 11 23:08:05.853988 np0000002687 nova-compute[98431]: lun Jun 11 23:08:05.853988 np0000002687 nova-compute[98431]: Jun 11 23:08:05.853988 np0000002687 nova-compute[98431]: Jun 11 23:08:05.853988 np0000002687 nova-compute[98431]: fdc Jun 11 23:08:05.856173 np0000002687 nova-compute[98431]: scsi Jun 11 23:08:05.856173 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.856173 np0000002687 nova-compute[98431]: Jun 11 23:08:05.856173 np0000002687 nova-compute[98431]: Jun 11 23:08:05.856173 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.856173 np0000002687 nova-compute[98431]: Jun 11 23:08:05.856173 np0000002687 nova-compute[98431]: Jun 11 23:08:05.856173 np0000002687 nova-compute[98431]: Jun 11 23:08:05.856173 np0000002687 nova-compute[98431]: Jun 11 23:08:05.856173 np0000002687 nova-compute[98431]: sdl Jun 11 23:08:05.856173 np0000002687 nova-compute[98431]: vnc Jun 11 23:08:05.856173 np0000002687 nova-compute[98431]: spice Jun 11 23:08:05.856173 np0000002687 nova-compute[98431]: egl-headless Jun 11 23:08:05.856173 np0000002687 nova-compute[98431]: dbus Jun 11 23:08:05.856173 np0000002687 nova-compute[98431]: Jun 11 23:08:05.856173 np0000002687 nova-compute[98431]: Jun 11 23:08:05.856173 np0000002687 nova-compute[98431]: Jun 11 23:08:05.856173 np0000002687 nova-compute[98431]: Jun 11 23:08:05.856173 np0000002687 nova-compute[98431]: Jun 11 23:08:05.856173 np0000002687 nova-compute[98431]: subsystem Jun 11 23:08:05.856173 np0000002687 nova-compute[98431]: Jun 11 23:08:05.856173 np0000002687 nova-compute[98431]: Jun 11 23:08:05.856173 np0000002687 nova-compute[98431]: default Jun 11 23:08:05.856173 np0000002687 nova-compute[98431]: mandatory Jun 11 23:08:05.856173 np0000002687 nova-compute[98431]: requisite Jun 11 23:08:05.856173 np0000002687 nova-compute[98431]: optional Jun 11 23:08:05.856173 np0000002687 nova-compute[98431]: Jun 11 23:08:05.856173 np0000002687 nova-compute[98431]: Jun 11 23:08:05.856173 np0000002687 nova-compute[98431]: pci Jun 11 23:08:05.856173 np0000002687 nova-compute[98431]: scsi Jun 11 23:08:05.856173 np0000002687 nova-compute[98431]: Jun 11 23:08:05.856173 np0000002687 nova-compute[98431]: Jun 11 23:08:05.856173 np0000002687 nova-compute[98431]: Jun 11 23:08:05.856173 np0000002687 nova-compute[98431]: Jun 11 23:08:05.856173 np0000002687 nova-compute[98431]: Jun 11 23:08:05.856173 np0000002687 nova-compute[98431]: Jun 11 23:08:05.856173 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.856173 np0000002687 nova-compute[98431]: Jun 11 23:08:05.856173 np0000002687 nova-compute[98431]: Jun 11 23:08:05.856173 np0000002687 nova-compute[98431]: random Jun 11 23:08:05.856173 np0000002687 nova-compute[98431]: egd Jun 11 23:08:05.856173 np0000002687 nova-compute[98431]: builtin Jun 11 23:08:05.856173 np0000002687 nova-compute[98431]: Jun 11 23:08:05.856173 np0000002687 nova-compute[98431]: Jun 11 23:08:05.856173 np0000002687 nova-compute[98431]: Jun 11 23:08:05.856173 np0000002687 nova-compute[98431]: Jun 11 23:08:05.856173 np0000002687 nova-compute[98431]: path Jun 11 23:08:05.856173 np0000002687 nova-compute[98431]: handle Jun 11 23:08:05.856173 np0000002687 nova-compute[98431]: virtiofs Jun 11 23:08:05.856173 np0000002687 nova-compute[98431]: Jun 11 23:08:05.856173 np0000002687 nova-compute[98431]: Jun 11 23:08:05.856173 np0000002687 nova-compute[98431]: Jun 11 23:08:05.856173 np0000002687 nova-compute[98431]: Jun 11 23:08:05.856173 np0000002687 nova-compute[98431]: Jun 11 23:08:05.856173 np0000002687 nova-compute[98431]: Jun 11 23:08:05.856173 np0000002687 nova-compute[98431]: pty Jun 11 23:08:05.856173 np0000002687 nova-compute[98431]: unix Jun 11 23:08:05.856173 np0000002687 nova-compute[98431]: spicevmc Jun 11 23:08:05.856173 np0000002687 nova-compute[98431]: Jun 11 23:08:05.856173 np0000002687 nova-compute[98431]: Jun 11 23:08:05.856173 np0000002687 nova-compute[98431]: Jun 11 23:08:05.856173 np0000002687 nova-compute[98431]: Jun 11 23:08:05.856173 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.856173 np0000002687 nova-compute[98431]: Jun 11 23:08:05.856173 np0000002687 nova-compute[98431]: Jun 11 23:08:05.856173 np0000002687 nova-compute[98431]: qemu Jun 11 23:08:05.856173 np0000002687 nova-compute[98431]: Jun 11 23:08:05.856173 np0000002687 nova-compute[98431]: Jun 11 23:08:05.856173 np0000002687 nova-compute[98431]: builtin Jun 11 23:08:05.856173 np0000002687 nova-compute[98431]: Jun 11 23:08:05.856173 np0000002687 nova-compute[98431]: Jun 11 23:08:05.856173 np0000002687 nova-compute[98431]: Jun 11 23:08:05.856173 np0000002687 nova-compute[98431]: Jun 11 23:08:05.856173 np0000002687 nova-compute[98431]: Jun 11 23:08:05.856173 np0000002687 nova-compute[98431]: Jun 11 23:08:05.856173 np0000002687 nova-compute[98431]: Jun 11 23:08:05.856173 np0000002687 nova-compute[98431]: Jun 11 23:08:05.858070 np0000002687 nova-compute[98431]: Jun 11 23:08:05.858070 np0000002687 nova-compute[98431]: Jun 11 23:08:05.858070 np0000002687 nova-compute[98431]: Jun 11 23:08:05.858070 np0000002687 nova-compute[98431]: Jun 11 23:08:05.858070 np0000002687 nova-compute[98431]: Jun 11 23:08:05.858070 np0000002687 nova-compute[98431]: Jun 11 23:08:05.858070 np0000002687 nova-compute[98431]: {{(pid=98431) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 11 23:08:05.858070 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=98431) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 11 23:08:05.858070 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] Libvirt host hypervisor capabilities for arch=microblaze and machine_type=None: Jun 11 23:08:05.858070 np0000002687 nova-compute[98431]: Jun 11 23:08:05.858070 np0000002687 nova-compute[98431]: /usr/bin/qemu-system-microblaze Jun 11 23:08:05.858070 np0000002687 nova-compute[98431]: qemu Jun 11 23:08:05.858070 np0000002687 nova-compute[98431]: petalogix-s3adsp1800 Jun 11 23:08:05.858070 np0000002687 nova-compute[98431]: microblaze Jun 11 23:08:05.858070 np0000002687 nova-compute[98431]: Jun 11 23:08:05.858070 np0000002687 nova-compute[98431]: Jun 11 23:08:05.858070 np0000002687 nova-compute[98431]: Jun 11 23:08:05.858070 np0000002687 nova-compute[98431]: Jun 11 23:08:05.858070 np0000002687 nova-compute[98431]: Jun 11 23:08:05.858070 np0000002687 nova-compute[98431]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 11 23:08:05.858070 np0000002687 nova-compute[98431]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 11 23:08:05.858070 np0000002687 nova-compute[98431]: Jun 11 23:08:05.858070 np0000002687 nova-compute[98431]: rom Jun 11 23:08:05.858070 np0000002687 nova-compute[98431]: pflash Jun 11 23:08:05.858070 np0000002687 nova-compute[98431]: Jun 11 23:08:05.858070 np0000002687 nova-compute[98431]: Jun 11 23:08:05.858070 np0000002687 nova-compute[98431]: yes Jun 11 23:08:05.858070 np0000002687 nova-compute[98431]: no Jun 11 23:08:05.858070 np0000002687 nova-compute[98431]: Jun 11 23:08:05.858070 np0000002687 nova-compute[98431]: Jun 11 23:08:05.858070 np0000002687 nova-compute[98431]: no Jun 11 23:08:05.858070 np0000002687 nova-compute[98431]: Jun 11 23:08:05.858070 np0000002687 nova-compute[98431]: Jun 11 23:08:05.858070 np0000002687 nova-compute[98431]: Jun 11 23:08:05.858070 np0000002687 nova-compute[98431]: Jun 11 23:08:05.858070 np0000002687 nova-compute[98431]: Jun 11 23:08:05.858070 np0000002687 nova-compute[98431]: Jun 11 23:08:05.858070 np0000002687 nova-compute[98431]: Jun 11 23:08:05.858070 np0000002687 nova-compute[98431]: Jun 11 23:08:05.858070 np0000002687 nova-compute[98431]: Jun 11 23:08:05.858070 np0000002687 nova-compute[98431]: Jun 11 23:08:05.858070 np0000002687 nova-compute[98431]: Jun 11 23:08:05.858070 np0000002687 nova-compute[98431]: file Jun 11 23:08:05.858070 np0000002687 nova-compute[98431]: anonymous Jun 11 23:08:05.858070 np0000002687 nova-compute[98431]: memfd Jun 11 23:08:05.858070 np0000002687 nova-compute[98431]: Jun 11 23:08:05.858070 np0000002687 nova-compute[98431]: Jun 11 23:08:05.858070 np0000002687 nova-compute[98431]: Jun 11 23:08:05.858070 np0000002687 nova-compute[98431]: Jun 11 23:08:05.858070 np0000002687 nova-compute[98431]: Jun 11 23:08:05.858070 np0000002687 nova-compute[98431]: disk Jun 11 23:08:05.858070 np0000002687 nova-compute[98431]: cdrom Jun 11 23:08:05.858070 np0000002687 nova-compute[98431]: floppy Jun 11 23:08:05.858070 np0000002687 nova-compute[98431]: lun Jun 11 23:08:05.858070 np0000002687 nova-compute[98431]: Jun 11 23:08:05.858070 np0000002687 nova-compute[98431]: Jun 11 23:08:05.858070 np0000002687 nova-compute[98431]: fdc Jun 11 23:08:05.859209 np0000002687 nova-compute[98431]: scsi Jun 11 23:08:05.859209 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.859209 np0000002687 nova-compute[98431]: Jun 11 23:08:05.859209 np0000002687 nova-compute[98431]: Jun 11 23:08:05.859209 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.859209 np0000002687 nova-compute[98431]: Jun 11 23:08:05.859209 np0000002687 nova-compute[98431]: Jun 11 23:08:05.859209 np0000002687 nova-compute[98431]: Jun 11 23:08:05.859209 np0000002687 nova-compute[98431]: Jun 11 23:08:05.859209 np0000002687 nova-compute[98431]: sdl Jun 11 23:08:05.859209 np0000002687 nova-compute[98431]: vnc Jun 11 23:08:05.859209 np0000002687 nova-compute[98431]: spice Jun 11 23:08:05.859209 np0000002687 nova-compute[98431]: egl-headless Jun 11 23:08:05.859209 np0000002687 nova-compute[98431]: dbus Jun 11 23:08:05.859209 np0000002687 nova-compute[98431]: Jun 11 23:08:05.859209 np0000002687 nova-compute[98431]: Jun 11 23:08:05.859209 np0000002687 nova-compute[98431]: Jun 11 23:08:05.859209 np0000002687 nova-compute[98431]: Jun 11 23:08:05.859209 np0000002687 nova-compute[98431]: Jun 11 23:08:05.859209 np0000002687 nova-compute[98431]: subsystem Jun 11 23:08:05.859209 np0000002687 nova-compute[98431]: Jun 11 23:08:05.859209 np0000002687 nova-compute[98431]: Jun 11 23:08:05.859209 np0000002687 nova-compute[98431]: default Jun 11 23:08:05.859209 np0000002687 nova-compute[98431]: mandatory Jun 11 23:08:05.859209 np0000002687 nova-compute[98431]: requisite Jun 11 23:08:05.859209 np0000002687 nova-compute[98431]: optional Jun 11 23:08:05.859209 np0000002687 nova-compute[98431]: Jun 11 23:08:05.859209 np0000002687 nova-compute[98431]: Jun 11 23:08:05.859209 np0000002687 nova-compute[98431]: pci Jun 11 23:08:05.859209 np0000002687 nova-compute[98431]: scsi Jun 11 23:08:05.859209 np0000002687 nova-compute[98431]: Jun 11 23:08:05.859209 np0000002687 nova-compute[98431]: Jun 11 23:08:05.859209 np0000002687 nova-compute[98431]: Jun 11 23:08:05.859209 np0000002687 nova-compute[98431]: Jun 11 23:08:05.859209 np0000002687 nova-compute[98431]: Jun 11 23:08:05.859209 np0000002687 nova-compute[98431]: Jun 11 23:08:05.859209 np0000002687 nova-compute[98431]: Jun 11 23:08:05.859209 np0000002687 nova-compute[98431]: random Jun 11 23:08:05.859209 np0000002687 nova-compute[98431]: egd Jun 11 23:08:05.859209 np0000002687 nova-compute[98431]: builtin Jun 11 23:08:05.859209 np0000002687 nova-compute[98431]: Jun 11 23:08:05.859209 np0000002687 nova-compute[98431]: Jun 11 23:08:05.859209 np0000002687 nova-compute[98431]: Jun 11 23:08:05.859209 np0000002687 nova-compute[98431]: Jun 11 23:08:05.859209 np0000002687 nova-compute[98431]: path Jun 11 23:08:05.859209 np0000002687 nova-compute[98431]: handle Jun 11 23:08:05.859209 np0000002687 nova-compute[98431]: Jun 11 23:08:05.859209 np0000002687 nova-compute[98431]: Jun 11 23:08:05.859209 np0000002687 nova-compute[98431]: Jun 11 23:08:05.859209 np0000002687 nova-compute[98431]: Jun 11 23:08:05.859209 np0000002687 nova-compute[98431]: Jun 11 23:08:05.859209 np0000002687 nova-compute[98431]: Jun 11 23:08:05.859209 np0000002687 nova-compute[98431]: pty Jun 11 23:08:05.859209 np0000002687 nova-compute[98431]: unix Jun 11 23:08:05.859209 np0000002687 nova-compute[98431]: spicevmc Jun 11 23:08:05.859209 np0000002687 nova-compute[98431]: Jun 11 23:08:05.859209 np0000002687 nova-compute[98431]: Jun 11 23:08:05.859209 np0000002687 nova-compute[98431]: Jun 11 23:08:05.859209 np0000002687 nova-compute[98431]: Jun 11 23:08:05.859209 np0000002687 nova-compute[98431]: Jun 11 23:08:05.859209 np0000002687 nova-compute[98431]: qemu Jun 11 23:08:05.859209 np0000002687 nova-compute[98431]: Jun 11 23:08:05.859209 np0000002687 nova-compute[98431]: Jun 11 23:08:05.859209 np0000002687 nova-compute[98431]: builtin Jun 11 23:08:05.859209 np0000002687 nova-compute[98431]: Jun 11 23:08:05.859209 np0000002687 nova-compute[98431]: Jun 11 23:08:05.859209 np0000002687 nova-compute[98431]: Jun 11 23:08:05.859209 np0000002687 nova-compute[98431]: Jun 11 23:08:05.859209 np0000002687 nova-compute[98431]: Jun 11 23:08:05.859209 np0000002687 nova-compute[98431]: Jun 11 23:08:05.859209 np0000002687 nova-compute[98431]: Jun 11 23:08:05.859209 np0000002687 nova-compute[98431]: Jun 11 23:08:05.859209 np0000002687 nova-compute[98431]: Jun 11 23:08:05.859209 np0000002687 nova-compute[98431]: Jun 11 23:08:05.859209 np0000002687 nova-compute[98431]: Jun 11 23:08:05.859209 np0000002687 nova-compute[98431]: Jun 11 23:08:05.859209 np0000002687 nova-compute[98431]: Jun 11 23:08:05.860551 np0000002687 nova-compute[98431]: Jun 11 23:08:05.860551 np0000002687 nova-compute[98431]: {{(pid=98431) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 11 23:08:05.860551 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=98431) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 11 23:08:05.860551 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] Libvirt host hypervisor capabilities for arch=microblazeel and machine_type=None: Jun 11 23:08:05.860551 np0000002687 nova-compute[98431]: Jun 11 23:08:05.860551 np0000002687 nova-compute[98431]: /usr/bin/qemu-system-microblazeel Jun 11 23:08:05.860551 np0000002687 nova-compute[98431]: qemu Jun 11 23:08:05.860551 np0000002687 nova-compute[98431]: petalogix-s3adsp1800 Jun 11 23:08:05.860551 np0000002687 nova-compute[98431]: microblazeel Jun 11 23:08:05.860551 np0000002687 nova-compute[98431]: Jun 11 23:08:05.860551 np0000002687 nova-compute[98431]: Jun 11 23:08:05.860551 np0000002687 nova-compute[98431]: Jun 11 23:08:05.860551 np0000002687 nova-compute[98431]: Jun 11 23:08:05.860551 np0000002687 nova-compute[98431]: Jun 11 23:08:05.860551 np0000002687 nova-compute[98431]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 11 23:08:05.860551 np0000002687 nova-compute[98431]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 11 23:08:05.860551 np0000002687 nova-compute[98431]: Jun 11 23:08:05.860551 np0000002687 nova-compute[98431]: rom Jun 11 23:08:05.860551 np0000002687 nova-compute[98431]: pflash Jun 11 23:08:05.860551 np0000002687 nova-compute[98431]: Jun 11 23:08:05.860551 np0000002687 nova-compute[98431]: Jun 11 23:08:05.860551 np0000002687 nova-compute[98431]: yes Jun 11 23:08:05.860551 np0000002687 nova-compute[98431]: no Jun 11 23:08:05.860551 np0000002687 nova-compute[98431]: Jun 11 23:08:05.860551 np0000002687 nova-compute[98431]: Jun 11 23:08:05.860551 np0000002687 nova-compute[98431]: no Jun 11 23:08:05.860551 np0000002687 nova-compute[98431]: Jun 11 23:08:05.860551 np0000002687 nova-compute[98431]: Jun 11 23:08:05.860551 np0000002687 nova-compute[98431]: Jun 11 23:08:05.860551 np0000002687 nova-compute[98431]: Jun 11 23:08:05.860551 np0000002687 nova-compute[98431]: Jun 11 23:08:05.860551 np0000002687 nova-compute[98431]: Jun 11 23:08:05.860551 np0000002687 nova-compute[98431]: Jun 11 23:08:05.860551 np0000002687 nova-compute[98431]: Jun 11 23:08:05.860551 np0000002687 nova-compute[98431]: Jun 11 23:08:05.860551 np0000002687 nova-compute[98431]: Jun 11 23:08:05.860551 np0000002687 nova-compute[98431]: Jun 11 23:08:05.860551 np0000002687 nova-compute[98431]: file Jun 11 23:08:05.860551 np0000002687 nova-compute[98431]: anonymous Jun 11 23:08:05.860551 np0000002687 nova-compute[98431]: memfd Jun 11 23:08:05.860551 np0000002687 nova-compute[98431]: Jun 11 23:08:05.860551 np0000002687 nova-compute[98431]: Jun 11 23:08:05.860551 np0000002687 nova-compute[98431]: Jun 11 23:08:05.860551 np0000002687 nova-compute[98431]: Jun 11 23:08:05.860551 np0000002687 nova-compute[98431]: Jun 11 23:08:05.860551 np0000002687 nova-compute[98431]: disk Jun 11 23:08:05.860551 np0000002687 nova-compute[98431]: cdrom Jun 11 23:08:05.860551 np0000002687 nova-compute[98431]: floppy Jun 11 23:08:05.860551 np0000002687 nova-compute[98431]: lun Jun 11 23:08:05.860551 np0000002687 nova-compute[98431]: Jun 11 23:08:05.860551 np0000002687 nova-compute[98431]: Jun 11 23:08:05.860551 np0000002687 nova-compute[98431]: fdc Jun 11 23:08:05.860551 np0000002687 nova-compute[98431]: scsi Jun 11 23:08:05.860551 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.860551 np0000002687 nova-compute[98431]: Jun 11 23:08:05.860551 np0000002687 nova-compute[98431]: Jun 11 23:08:05.860551 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.860551 np0000002687 nova-compute[98431]: Jun 11 23:08:05.861857 np0000002687 nova-compute[98431]: Jun 11 23:08:05.861857 np0000002687 nova-compute[98431]: Jun 11 23:08:05.861857 np0000002687 nova-compute[98431]: Jun 11 23:08:05.861857 np0000002687 nova-compute[98431]: sdl Jun 11 23:08:05.861857 np0000002687 nova-compute[98431]: vnc Jun 11 23:08:05.861857 np0000002687 nova-compute[98431]: spice Jun 11 23:08:05.861857 np0000002687 nova-compute[98431]: egl-headless Jun 11 23:08:05.861857 np0000002687 nova-compute[98431]: dbus Jun 11 23:08:05.861857 np0000002687 nova-compute[98431]: Jun 11 23:08:05.861857 np0000002687 nova-compute[98431]: Jun 11 23:08:05.861857 np0000002687 nova-compute[98431]: Jun 11 23:08:05.861857 np0000002687 nova-compute[98431]: Jun 11 23:08:05.861857 np0000002687 nova-compute[98431]: Jun 11 23:08:05.861857 np0000002687 nova-compute[98431]: subsystem Jun 11 23:08:05.861857 np0000002687 nova-compute[98431]: Jun 11 23:08:05.861857 np0000002687 nova-compute[98431]: Jun 11 23:08:05.861857 np0000002687 nova-compute[98431]: default Jun 11 23:08:05.861857 np0000002687 nova-compute[98431]: mandatory Jun 11 23:08:05.861857 np0000002687 nova-compute[98431]: requisite Jun 11 23:08:05.861857 np0000002687 nova-compute[98431]: optional Jun 11 23:08:05.861857 np0000002687 nova-compute[98431]: Jun 11 23:08:05.861857 np0000002687 nova-compute[98431]: Jun 11 23:08:05.861857 np0000002687 nova-compute[98431]: pci Jun 11 23:08:05.861857 np0000002687 nova-compute[98431]: scsi Jun 11 23:08:05.861857 np0000002687 nova-compute[98431]: Jun 11 23:08:05.861857 np0000002687 nova-compute[98431]: Jun 11 23:08:05.861857 np0000002687 nova-compute[98431]: Jun 11 23:08:05.861857 np0000002687 nova-compute[98431]: Jun 11 23:08:05.861857 np0000002687 nova-compute[98431]: Jun 11 23:08:05.861857 np0000002687 nova-compute[98431]: Jun 11 23:08:05.861857 np0000002687 nova-compute[98431]: Jun 11 23:08:05.861857 np0000002687 nova-compute[98431]: random Jun 11 23:08:05.861857 np0000002687 nova-compute[98431]: egd Jun 11 23:08:05.861857 np0000002687 nova-compute[98431]: builtin Jun 11 23:08:05.861857 np0000002687 nova-compute[98431]: Jun 11 23:08:05.861857 np0000002687 nova-compute[98431]: Jun 11 23:08:05.861857 np0000002687 nova-compute[98431]: Jun 11 23:08:05.861857 np0000002687 nova-compute[98431]: Jun 11 23:08:05.861857 np0000002687 nova-compute[98431]: path Jun 11 23:08:05.861857 np0000002687 nova-compute[98431]: handle Jun 11 23:08:05.861857 np0000002687 nova-compute[98431]: Jun 11 23:08:05.861857 np0000002687 nova-compute[98431]: Jun 11 23:08:05.861857 np0000002687 nova-compute[98431]: Jun 11 23:08:05.861857 np0000002687 nova-compute[98431]: Jun 11 23:08:05.861857 np0000002687 nova-compute[98431]: Jun 11 23:08:05.861857 np0000002687 nova-compute[98431]: Jun 11 23:08:05.861857 np0000002687 nova-compute[98431]: pty Jun 11 23:08:05.861857 np0000002687 nova-compute[98431]: unix Jun 11 23:08:05.861857 np0000002687 nova-compute[98431]: spicevmc Jun 11 23:08:05.861857 np0000002687 nova-compute[98431]: Jun 11 23:08:05.861857 np0000002687 nova-compute[98431]: Jun 11 23:08:05.861857 np0000002687 nova-compute[98431]: Jun 11 23:08:05.861857 np0000002687 nova-compute[98431]: Jun 11 23:08:05.861857 np0000002687 nova-compute[98431]: Jun 11 23:08:05.861857 np0000002687 nova-compute[98431]: qemu Jun 11 23:08:05.861857 np0000002687 nova-compute[98431]: Jun 11 23:08:05.861857 np0000002687 nova-compute[98431]: Jun 11 23:08:05.861857 np0000002687 nova-compute[98431]: builtin Jun 11 23:08:05.861857 np0000002687 nova-compute[98431]: Jun 11 23:08:05.861857 np0000002687 nova-compute[98431]: Jun 11 23:08:05.861857 np0000002687 nova-compute[98431]: Jun 11 23:08:05.861857 np0000002687 nova-compute[98431]: Jun 11 23:08:05.861857 np0000002687 nova-compute[98431]: Jun 11 23:08:05.861857 np0000002687 nova-compute[98431]: Jun 11 23:08:05.861857 np0000002687 nova-compute[98431]: Jun 11 23:08:05.861857 np0000002687 nova-compute[98431]: Jun 11 23:08:05.861857 np0000002687 nova-compute[98431]: Jun 11 23:08:05.861857 np0000002687 nova-compute[98431]: Jun 11 23:08:05.861857 np0000002687 nova-compute[98431]: Jun 11 23:08:05.861857 np0000002687 nova-compute[98431]: Jun 11 23:08:05.861857 np0000002687 nova-compute[98431]: Jun 11 23:08:05.861857 np0000002687 nova-compute[98431]: Jun 11 23:08:05.861857 np0000002687 nova-compute[98431]: {{(pid=98431) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 11 23:08:05.863146 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=98431) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 11 23:08:05.863146 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] Libvirt host hypervisor capabilities for arch=mips and machine_type=None: Jun 11 23:08:05.863146 np0000002687 nova-compute[98431]: Jun 11 23:08:05.863146 np0000002687 nova-compute[98431]: /usr/bin/qemu-system-mips Jun 11 23:08:05.863146 np0000002687 nova-compute[98431]: qemu Jun 11 23:08:05.863146 np0000002687 nova-compute[98431]: malta Jun 11 23:08:05.863146 np0000002687 nova-compute[98431]: mips Jun 11 23:08:05.863146 np0000002687 nova-compute[98431]: Jun 11 23:08:05.863146 np0000002687 nova-compute[98431]: Jun 11 23:08:05.863146 np0000002687 nova-compute[98431]: Jun 11 23:08:05.863146 np0000002687 nova-compute[98431]: Jun 11 23:08:05.863146 np0000002687 nova-compute[98431]: Jun 11 23:08:05.863146 np0000002687 nova-compute[98431]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 11 23:08:05.863146 np0000002687 nova-compute[98431]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 11 23:08:05.863146 np0000002687 nova-compute[98431]: Jun 11 23:08:05.863146 np0000002687 nova-compute[98431]: rom Jun 11 23:08:05.863146 np0000002687 nova-compute[98431]: pflash Jun 11 23:08:05.863146 np0000002687 nova-compute[98431]: Jun 11 23:08:05.863146 np0000002687 nova-compute[98431]: Jun 11 23:08:05.863146 np0000002687 nova-compute[98431]: yes Jun 11 23:08:05.863146 np0000002687 nova-compute[98431]: no Jun 11 23:08:05.863146 np0000002687 nova-compute[98431]: Jun 11 23:08:05.863146 np0000002687 nova-compute[98431]: Jun 11 23:08:05.863146 np0000002687 nova-compute[98431]: no Jun 11 23:08:05.863146 np0000002687 nova-compute[98431]: Jun 11 23:08:05.863146 np0000002687 nova-compute[98431]: Jun 11 23:08:05.863146 np0000002687 nova-compute[98431]: Jun 11 23:08:05.863146 np0000002687 nova-compute[98431]: Jun 11 23:08:05.863146 np0000002687 nova-compute[98431]: Jun 11 23:08:05.863146 np0000002687 nova-compute[98431]: Jun 11 23:08:05.863146 np0000002687 nova-compute[98431]: Jun 11 23:08:05.863146 np0000002687 nova-compute[98431]: Jun 11 23:08:05.863146 np0000002687 nova-compute[98431]: Jun 11 23:08:05.863146 np0000002687 nova-compute[98431]: Jun 11 23:08:05.863146 np0000002687 nova-compute[98431]: Jun 11 23:08:05.863146 np0000002687 nova-compute[98431]: file Jun 11 23:08:05.863146 np0000002687 nova-compute[98431]: anonymous Jun 11 23:08:05.863146 np0000002687 nova-compute[98431]: memfd Jun 11 23:08:05.863146 np0000002687 nova-compute[98431]: Jun 11 23:08:05.863146 np0000002687 nova-compute[98431]: Jun 11 23:08:05.863146 np0000002687 nova-compute[98431]: Jun 11 23:08:05.863146 np0000002687 nova-compute[98431]: Jun 11 23:08:05.863146 np0000002687 nova-compute[98431]: Jun 11 23:08:05.863146 np0000002687 nova-compute[98431]: disk Jun 11 23:08:05.863146 np0000002687 nova-compute[98431]: cdrom Jun 11 23:08:05.863146 np0000002687 nova-compute[98431]: floppy Jun 11 23:08:05.863146 np0000002687 nova-compute[98431]: lun Jun 11 23:08:05.863146 np0000002687 nova-compute[98431]: Jun 11 23:08:05.863146 np0000002687 nova-compute[98431]: Jun 11 23:08:05.863146 np0000002687 nova-compute[98431]: ide Jun 11 23:08:05.863146 np0000002687 nova-compute[98431]: fdc Jun 11 23:08:05.863146 np0000002687 nova-compute[98431]: scsi Jun 11 23:08:05.863146 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.863146 np0000002687 nova-compute[98431]: usb Jun 11 23:08:05.863146 np0000002687 nova-compute[98431]: sata Jun 11 23:08:05.863146 np0000002687 nova-compute[98431]: Jun 11 23:08:05.863146 np0000002687 nova-compute[98431]: Jun 11 23:08:05.863146 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.863146 np0000002687 nova-compute[98431]: virtio-transitional Jun 11 23:08:05.863146 np0000002687 nova-compute[98431]: virtio-non-transitional Jun 11 23:08:05.863146 np0000002687 nova-compute[98431]: Jun 11 23:08:05.864233 np0000002687 nova-compute[98431]: Jun 11 23:08:05.864233 np0000002687 nova-compute[98431]: Jun 11 23:08:05.864233 np0000002687 nova-compute[98431]: Jun 11 23:08:05.864233 np0000002687 nova-compute[98431]: sdl Jun 11 23:08:05.864233 np0000002687 nova-compute[98431]: vnc Jun 11 23:08:05.864233 np0000002687 nova-compute[98431]: spice Jun 11 23:08:05.864233 np0000002687 nova-compute[98431]: egl-headless Jun 11 23:08:05.864233 np0000002687 nova-compute[98431]: dbus Jun 11 23:08:05.864233 np0000002687 nova-compute[98431]: Jun 11 23:08:05.864233 np0000002687 nova-compute[98431]: Jun 11 23:08:05.864233 np0000002687 nova-compute[98431]: Jun 11 23:08:05.864233 np0000002687 nova-compute[98431]: Jun 11 23:08:05.864233 np0000002687 nova-compute[98431]: Jun 11 23:08:05.864233 np0000002687 nova-compute[98431]: subsystem Jun 11 23:08:05.864233 np0000002687 nova-compute[98431]: Jun 11 23:08:05.864233 np0000002687 nova-compute[98431]: Jun 11 23:08:05.864233 np0000002687 nova-compute[98431]: default Jun 11 23:08:05.864233 np0000002687 nova-compute[98431]: mandatory Jun 11 23:08:05.864233 np0000002687 nova-compute[98431]: requisite Jun 11 23:08:05.864233 np0000002687 nova-compute[98431]: optional Jun 11 23:08:05.864233 np0000002687 nova-compute[98431]: Jun 11 23:08:05.864233 np0000002687 nova-compute[98431]: Jun 11 23:08:05.864233 np0000002687 nova-compute[98431]: usb Jun 11 23:08:05.864233 np0000002687 nova-compute[98431]: pci Jun 11 23:08:05.864233 np0000002687 nova-compute[98431]: scsi Jun 11 23:08:05.864233 np0000002687 nova-compute[98431]: Jun 11 23:08:05.864233 np0000002687 nova-compute[98431]: Jun 11 23:08:05.864233 np0000002687 nova-compute[98431]: Jun 11 23:08:05.864233 np0000002687 nova-compute[98431]: Jun 11 23:08:05.864233 np0000002687 nova-compute[98431]: Jun 11 23:08:05.864233 np0000002687 nova-compute[98431]: Jun 11 23:08:05.864233 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.864233 np0000002687 nova-compute[98431]: virtio-transitional Jun 11 23:08:05.864233 np0000002687 nova-compute[98431]: virtio-non-transitional Jun 11 23:08:05.864233 np0000002687 nova-compute[98431]: Jun 11 23:08:05.864233 np0000002687 nova-compute[98431]: Jun 11 23:08:05.864233 np0000002687 nova-compute[98431]: random Jun 11 23:08:05.864233 np0000002687 nova-compute[98431]: egd Jun 11 23:08:05.864233 np0000002687 nova-compute[98431]: builtin Jun 11 23:08:05.864233 np0000002687 nova-compute[98431]: Jun 11 23:08:05.864233 np0000002687 nova-compute[98431]: Jun 11 23:08:05.864233 np0000002687 nova-compute[98431]: Jun 11 23:08:05.864233 np0000002687 nova-compute[98431]: Jun 11 23:08:05.864233 np0000002687 nova-compute[98431]: path Jun 11 23:08:05.864233 np0000002687 nova-compute[98431]: handle Jun 11 23:08:05.864233 np0000002687 nova-compute[98431]: virtiofs Jun 11 23:08:05.864233 np0000002687 nova-compute[98431]: Jun 11 23:08:05.864233 np0000002687 nova-compute[98431]: Jun 11 23:08:05.864233 np0000002687 nova-compute[98431]: Jun 11 23:08:05.864233 np0000002687 nova-compute[98431]: Jun 11 23:08:05.864233 np0000002687 nova-compute[98431]: Jun 11 23:08:05.864233 np0000002687 nova-compute[98431]: usb Jun 11 23:08:05.864233 np0000002687 nova-compute[98431]: Jun 11 23:08:05.864233 np0000002687 nova-compute[98431]: Jun 11 23:08:05.864233 np0000002687 nova-compute[98431]: Jun 11 23:08:05.864233 np0000002687 nova-compute[98431]: Jun 11 23:08:05.864233 np0000002687 nova-compute[98431]: pty Jun 11 23:08:05.864233 np0000002687 nova-compute[98431]: unix Jun 11 23:08:05.864233 np0000002687 nova-compute[98431]: spicevmc Jun 11 23:08:05.864233 np0000002687 nova-compute[98431]: Jun 11 23:08:05.864233 np0000002687 nova-compute[98431]: Jun 11 23:08:05.864233 np0000002687 nova-compute[98431]: Jun 11 23:08:05.864233 np0000002687 nova-compute[98431]: Jun 11 23:08:05.864233 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.864233 np0000002687 nova-compute[98431]: Jun 11 23:08:05.864233 np0000002687 nova-compute[98431]: Jun 11 23:08:05.864233 np0000002687 nova-compute[98431]: qemu Jun 11 23:08:05.864233 np0000002687 nova-compute[98431]: Jun 11 23:08:05.864233 np0000002687 nova-compute[98431]: Jun 11 23:08:05.864233 np0000002687 nova-compute[98431]: builtin Jun 11 23:08:05.865532 np0000002687 nova-compute[98431]: Jun 11 23:08:05.865532 np0000002687 nova-compute[98431]: Jun 11 23:08:05.865532 np0000002687 nova-compute[98431]: Jun 11 23:08:05.865532 np0000002687 nova-compute[98431]: Jun 11 23:08:05.865532 np0000002687 nova-compute[98431]: Jun 11 23:08:05.865532 np0000002687 nova-compute[98431]: Jun 11 23:08:05.865532 np0000002687 nova-compute[98431]: Jun 11 23:08:05.865532 np0000002687 nova-compute[98431]: Jun 11 23:08:05.865532 np0000002687 nova-compute[98431]: Jun 11 23:08:05.865532 np0000002687 nova-compute[98431]: Jun 11 23:08:05.865532 np0000002687 nova-compute[98431]: Jun 11 23:08:05.865532 np0000002687 nova-compute[98431]: Jun 11 23:08:05.865532 np0000002687 nova-compute[98431]: Jun 11 23:08:05.865532 np0000002687 nova-compute[98431]: Jun 11 23:08:05.865532 np0000002687 nova-compute[98431]: {{(pid=98431) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 11 23:08:05.865532 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=98431) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 11 23:08:05.865532 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] Libvirt host hypervisor capabilities for arch=mipsel and machine_type=None: Jun 11 23:08:05.865532 np0000002687 nova-compute[98431]: Jun 11 23:08:05.865532 np0000002687 nova-compute[98431]: /usr/bin/qemu-system-mipsel Jun 11 23:08:05.865532 np0000002687 nova-compute[98431]: qemu Jun 11 23:08:05.865532 np0000002687 nova-compute[98431]: malta Jun 11 23:08:05.865532 np0000002687 nova-compute[98431]: mipsel Jun 11 23:08:05.865532 np0000002687 nova-compute[98431]: Jun 11 23:08:05.865532 np0000002687 nova-compute[98431]: Jun 11 23:08:05.865532 np0000002687 nova-compute[98431]: Jun 11 23:08:05.865532 np0000002687 nova-compute[98431]: Jun 11 23:08:05.865532 np0000002687 nova-compute[98431]: Jun 11 23:08:05.865532 np0000002687 nova-compute[98431]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 11 23:08:05.865532 np0000002687 nova-compute[98431]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 11 23:08:05.865532 np0000002687 nova-compute[98431]: Jun 11 23:08:05.865532 np0000002687 nova-compute[98431]: rom Jun 11 23:08:05.865532 np0000002687 nova-compute[98431]: pflash Jun 11 23:08:05.865532 np0000002687 nova-compute[98431]: Jun 11 23:08:05.865532 np0000002687 nova-compute[98431]: Jun 11 23:08:05.865532 np0000002687 nova-compute[98431]: yes Jun 11 23:08:05.865532 np0000002687 nova-compute[98431]: no Jun 11 23:08:05.865532 np0000002687 nova-compute[98431]: Jun 11 23:08:05.865532 np0000002687 nova-compute[98431]: Jun 11 23:08:05.865532 np0000002687 nova-compute[98431]: no Jun 11 23:08:05.865532 np0000002687 nova-compute[98431]: Jun 11 23:08:05.865532 np0000002687 nova-compute[98431]: Jun 11 23:08:05.865532 np0000002687 nova-compute[98431]: Jun 11 23:08:05.865532 np0000002687 nova-compute[98431]: Jun 11 23:08:05.865532 np0000002687 nova-compute[98431]: Jun 11 23:08:05.865532 np0000002687 nova-compute[98431]: Jun 11 23:08:05.865532 np0000002687 nova-compute[98431]: Jun 11 23:08:05.865532 np0000002687 nova-compute[98431]: Jun 11 23:08:05.865532 np0000002687 nova-compute[98431]: Jun 11 23:08:05.865532 np0000002687 nova-compute[98431]: Jun 11 23:08:05.865532 np0000002687 nova-compute[98431]: Jun 11 23:08:05.865532 np0000002687 nova-compute[98431]: file Jun 11 23:08:05.865532 np0000002687 nova-compute[98431]: anonymous Jun 11 23:08:05.865532 np0000002687 nova-compute[98431]: memfd Jun 11 23:08:05.865532 np0000002687 nova-compute[98431]: Jun 11 23:08:05.865532 np0000002687 nova-compute[98431]: Jun 11 23:08:05.865532 np0000002687 nova-compute[98431]: Jun 11 23:08:05.865532 np0000002687 nova-compute[98431]: Jun 11 23:08:05.865532 np0000002687 nova-compute[98431]: Jun 11 23:08:05.865532 np0000002687 nova-compute[98431]: disk Jun 11 23:08:05.866518 np0000002687 nova-compute[98431]: cdrom Jun 11 23:08:05.866518 np0000002687 nova-compute[98431]: floppy Jun 11 23:08:05.866518 np0000002687 nova-compute[98431]: lun Jun 11 23:08:05.866518 np0000002687 nova-compute[98431]: Jun 11 23:08:05.866518 np0000002687 nova-compute[98431]: Jun 11 23:08:05.866518 np0000002687 nova-compute[98431]: ide Jun 11 23:08:05.866518 np0000002687 nova-compute[98431]: fdc Jun 11 23:08:05.866518 np0000002687 nova-compute[98431]: scsi Jun 11 23:08:05.866518 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.866518 np0000002687 nova-compute[98431]: usb Jun 11 23:08:05.866518 np0000002687 nova-compute[98431]: sata Jun 11 23:08:05.866518 np0000002687 nova-compute[98431]: Jun 11 23:08:05.866518 np0000002687 nova-compute[98431]: Jun 11 23:08:05.866518 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.866518 np0000002687 nova-compute[98431]: virtio-transitional Jun 11 23:08:05.866518 np0000002687 nova-compute[98431]: virtio-non-transitional Jun 11 23:08:05.866518 np0000002687 nova-compute[98431]: Jun 11 23:08:05.866518 np0000002687 nova-compute[98431]: Jun 11 23:08:05.866518 np0000002687 nova-compute[98431]: Jun 11 23:08:05.866518 np0000002687 nova-compute[98431]: Jun 11 23:08:05.866518 np0000002687 nova-compute[98431]: sdl Jun 11 23:08:05.866518 np0000002687 nova-compute[98431]: vnc Jun 11 23:08:05.866518 np0000002687 nova-compute[98431]: spice Jun 11 23:08:05.866518 np0000002687 nova-compute[98431]: egl-headless Jun 11 23:08:05.866518 np0000002687 nova-compute[98431]: dbus Jun 11 23:08:05.866518 np0000002687 nova-compute[98431]: Jun 11 23:08:05.866518 np0000002687 nova-compute[98431]: Jun 11 23:08:05.866518 np0000002687 nova-compute[98431]: Jun 11 23:08:05.866518 np0000002687 nova-compute[98431]: Jun 11 23:08:05.866518 np0000002687 nova-compute[98431]: Jun 11 23:08:05.866518 np0000002687 nova-compute[98431]: subsystem Jun 11 23:08:05.866518 np0000002687 nova-compute[98431]: Jun 11 23:08:05.866518 np0000002687 nova-compute[98431]: Jun 11 23:08:05.866518 np0000002687 nova-compute[98431]: default Jun 11 23:08:05.866518 np0000002687 nova-compute[98431]: mandatory Jun 11 23:08:05.866518 np0000002687 nova-compute[98431]: requisite Jun 11 23:08:05.866518 np0000002687 nova-compute[98431]: optional Jun 11 23:08:05.866518 np0000002687 nova-compute[98431]: Jun 11 23:08:05.866518 np0000002687 nova-compute[98431]: Jun 11 23:08:05.866518 np0000002687 nova-compute[98431]: usb Jun 11 23:08:05.866518 np0000002687 nova-compute[98431]: pci Jun 11 23:08:05.866518 np0000002687 nova-compute[98431]: scsi Jun 11 23:08:05.866518 np0000002687 nova-compute[98431]: Jun 11 23:08:05.866518 np0000002687 nova-compute[98431]: Jun 11 23:08:05.866518 np0000002687 nova-compute[98431]: Jun 11 23:08:05.866518 np0000002687 nova-compute[98431]: Jun 11 23:08:05.866518 np0000002687 nova-compute[98431]: Jun 11 23:08:05.866518 np0000002687 nova-compute[98431]: Jun 11 23:08:05.866518 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.866518 np0000002687 nova-compute[98431]: virtio-transitional Jun 11 23:08:05.866518 np0000002687 nova-compute[98431]: virtio-non-transitional Jun 11 23:08:05.866518 np0000002687 nova-compute[98431]: Jun 11 23:08:05.866518 np0000002687 nova-compute[98431]: Jun 11 23:08:05.866518 np0000002687 nova-compute[98431]: random Jun 11 23:08:05.866518 np0000002687 nova-compute[98431]: egd Jun 11 23:08:05.866518 np0000002687 nova-compute[98431]: builtin Jun 11 23:08:05.866518 np0000002687 nova-compute[98431]: Jun 11 23:08:05.866518 np0000002687 nova-compute[98431]: Jun 11 23:08:05.866518 np0000002687 nova-compute[98431]: Jun 11 23:08:05.866518 np0000002687 nova-compute[98431]: Jun 11 23:08:05.866518 np0000002687 nova-compute[98431]: path Jun 11 23:08:05.866518 np0000002687 nova-compute[98431]: handle Jun 11 23:08:05.866518 np0000002687 nova-compute[98431]: virtiofs Jun 11 23:08:05.866518 np0000002687 nova-compute[98431]: Jun 11 23:08:05.866518 np0000002687 nova-compute[98431]: Jun 11 23:08:05.866518 np0000002687 nova-compute[98431]: Jun 11 23:08:05.866518 np0000002687 nova-compute[98431]: Jun 11 23:08:05.866518 np0000002687 nova-compute[98431]: Jun 11 23:08:05.867782 np0000002687 nova-compute[98431]: usb Jun 11 23:08:05.867782 np0000002687 nova-compute[98431]: Jun 11 23:08:05.867782 np0000002687 nova-compute[98431]: Jun 11 23:08:05.867782 np0000002687 nova-compute[98431]: Jun 11 23:08:05.867782 np0000002687 nova-compute[98431]: Jun 11 23:08:05.867782 np0000002687 nova-compute[98431]: pty Jun 11 23:08:05.867782 np0000002687 nova-compute[98431]: unix Jun 11 23:08:05.867782 np0000002687 nova-compute[98431]: spicevmc Jun 11 23:08:05.867782 np0000002687 nova-compute[98431]: Jun 11 23:08:05.867782 np0000002687 nova-compute[98431]: Jun 11 23:08:05.867782 np0000002687 nova-compute[98431]: Jun 11 23:08:05.867782 np0000002687 nova-compute[98431]: Jun 11 23:08:05.867782 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.867782 np0000002687 nova-compute[98431]: Jun 11 23:08:05.867782 np0000002687 nova-compute[98431]: Jun 11 23:08:05.867782 np0000002687 nova-compute[98431]: qemu Jun 11 23:08:05.867782 np0000002687 nova-compute[98431]: Jun 11 23:08:05.867782 np0000002687 nova-compute[98431]: Jun 11 23:08:05.867782 np0000002687 nova-compute[98431]: builtin Jun 11 23:08:05.867782 np0000002687 nova-compute[98431]: Jun 11 23:08:05.867782 np0000002687 nova-compute[98431]: Jun 11 23:08:05.867782 np0000002687 nova-compute[98431]: Jun 11 23:08:05.867782 np0000002687 nova-compute[98431]: Jun 11 23:08:05.867782 np0000002687 nova-compute[98431]: Jun 11 23:08:05.867782 np0000002687 nova-compute[98431]: Jun 11 23:08:05.867782 np0000002687 nova-compute[98431]: Jun 11 23:08:05.867782 np0000002687 nova-compute[98431]: Jun 11 23:08:05.867782 np0000002687 nova-compute[98431]: Jun 11 23:08:05.867782 np0000002687 nova-compute[98431]: Jun 11 23:08:05.867782 np0000002687 nova-compute[98431]: Jun 11 23:08:05.867782 np0000002687 nova-compute[98431]: Jun 11 23:08:05.867782 np0000002687 nova-compute[98431]: Jun 11 23:08:05.867782 np0000002687 nova-compute[98431]: Jun 11 23:08:05.867782 np0000002687 nova-compute[98431]: {{(pid=98431) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 11 23:08:05.867782 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=98431) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 11 23:08:05.867782 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] Libvirt host hypervisor capabilities for arch=mips64 and machine_type=None: Jun 11 23:08:05.867782 np0000002687 nova-compute[98431]: Jun 11 23:08:05.867782 np0000002687 nova-compute[98431]: /usr/bin/qemu-system-mips64 Jun 11 23:08:05.867782 np0000002687 nova-compute[98431]: qemu Jun 11 23:08:05.867782 np0000002687 nova-compute[98431]: malta Jun 11 23:08:05.867782 np0000002687 nova-compute[98431]: mips64 Jun 11 23:08:05.867782 np0000002687 nova-compute[98431]: Jun 11 23:08:05.867782 np0000002687 nova-compute[98431]: Jun 11 23:08:05.867782 np0000002687 nova-compute[98431]: Jun 11 23:08:05.867782 np0000002687 nova-compute[98431]: Jun 11 23:08:05.867782 np0000002687 nova-compute[98431]: Jun 11 23:08:05.867782 np0000002687 nova-compute[98431]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 11 23:08:05.867782 np0000002687 nova-compute[98431]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 11 23:08:05.867782 np0000002687 nova-compute[98431]: Jun 11 23:08:05.867782 np0000002687 nova-compute[98431]: rom Jun 11 23:08:05.867782 np0000002687 nova-compute[98431]: pflash Jun 11 23:08:05.867782 np0000002687 nova-compute[98431]: Jun 11 23:08:05.867782 np0000002687 nova-compute[98431]: Jun 11 23:08:05.867782 np0000002687 nova-compute[98431]: yes Jun 11 23:08:05.867782 np0000002687 nova-compute[98431]: no Jun 11 23:08:05.867782 np0000002687 nova-compute[98431]: Jun 11 23:08:05.867782 np0000002687 nova-compute[98431]: Jun 11 23:08:05.867782 np0000002687 nova-compute[98431]: no Jun 11 23:08:05.867782 np0000002687 nova-compute[98431]: Jun 11 23:08:05.867782 np0000002687 nova-compute[98431]: Jun 11 23:08:05.867782 np0000002687 nova-compute[98431]: Jun 11 23:08:05.867782 np0000002687 nova-compute[98431]: Jun 11 23:08:05.868839 np0000002687 nova-compute[98431]: Jun 11 23:08:05.868839 np0000002687 nova-compute[98431]: Jun 11 23:08:05.868839 np0000002687 nova-compute[98431]: Jun 11 23:08:05.868839 np0000002687 nova-compute[98431]: Jun 11 23:08:05.868839 np0000002687 nova-compute[98431]: Jun 11 23:08:05.868839 np0000002687 nova-compute[98431]: Jun 11 23:08:05.868839 np0000002687 nova-compute[98431]: Jun 11 23:08:05.868839 np0000002687 nova-compute[98431]: file Jun 11 23:08:05.868839 np0000002687 nova-compute[98431]: anonymous Jun 11 23:08:05.868839 np0000002687 nova-compute[98431]: memfd Jun 11 23:08:05.868839 np0000002687 nova-compute[98431]: Jun 11 23:08:05.868839 np0000002687 nova-compute[98431]: Jun 11 23:08:05.868839 np0000002687 nova-compute[98431]: Jun 11 23:08:05.868839 np0000002687 nova-compute[98431]: Jun 11 23:08:05.868839 np0000002687 nova-compute[98431]: Jun 11 23:08:05.868839 np0000002687 nova-compute[98431]: disk Jun 11 23:08:05.868839 np0000002687 nova-compute[98431]: cdrom Jun 11 23:08:05.868839 np0000002687 nova-compute[98431]: floppy Jun 11 23:08:05.868839 np0000002687 nova-compute[98431]: lun Jun 11 23:08:05.868839 np0000002687 nova-compute[98431]: Jun 11 23:08:05.868839 np0000002687 nova-compute[98431]: Jun 11 23:08:05.868839 np0000002687 nova-compute[98431]: ide Jun 11 23:08:05.868839 np0000002687 nova-compute[98431]: fdc Jun 11 23:08:05.868839 np0000002687 nova-compute[98431]: scsi Jun 11 23:08:05.868839 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.868839 np0000002687 nova-compute[98431]: usb Jun 11 23:08:05.868839 np0000002687 nova-compute[98431]: sata Jun 11 23:08:05.868839 np0000002687 nova-compute[98431]: Jun 11 23:08:05.868839 np0000002687 nova-compute[98431]: Jun 11 23:08:05.868839 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.868839 np0000002687 nova-compute[98431]: virtio-transitional Jun 11 23:08:05.868839 np0000002687 nova-compute[98431]: virtio-non-transitional Jun 11 23:08:05.868839 np0000002687 nova-compute[98431]: Jun 11 23:08:05.868839 np0000002687 nova-compute[98431]: Jun 11 23:08:05.868839 np0000002687 nova-compute[98431]: Jun 11 23:08:05.868839 np0000002687 nova-compute[98431]: Jun 11 23:08:05.868839 np0000002687 nova-compute[98431]: sdl Jun 11 23:08:05.868839 np0000002687 nova-compute[98431]: vnc Jun 11 23:08:05.868839 np0000002687 nova-compute[98431]: spice Jun 11 23:08:05.868839 np0000002687 nova-compute[98431]: egl-headless Jun 11 23:08:05.868839 np0000002687 nova-compute[98431]: dbus Jun 11 23:08:05.868839 np0000002687 nova-compute[98431]: Jun 11 23:08:05.868839 np0000002687 nova-compute[98431]: Jun 11 23:08:05.868839 np0000002687 nova-compute[98431]: Jun 11 23:08:05.868839 np0000002687 nova-compute[98431]: Jun 11 23:08:05.868839 np0000002687 nova-compute[98431]: Jun 11 23:08:05.868839 np0000002687 nova-compute[98431]: subsystem Jun 11 23:08:05.868839 np0000002687 nova-compute[98431]: Jun 11 23:08:05.868839 np0000002687 nova-compute[98431]: Jun 11 23:08:05.868839 np0000002687 nova-compute[98431]: default Jun 11 23:08:05.868839 np0000002687 nova-compute[98431]: mandatory Jun 11 23:08:05.868839 np0000002687 nova-compute[98431]: requisite Jun 11 23:08:05.868839 np0000002687 nova-compute[98431]: optional Jun 11 23:08:05.868839 np0000002687 nova-compute[98431]: Jun 11 23:08:05.868839 np0000002687 nova-compute[98431]: Jun 11 23:08:05.868839 np0000002687 nova-compute[98431]: usb Jun 11 23:08:05.868839 np0000002687 nova-compute[98431]: pci Jun 11 23:08:05.868839 np0000002687 nova-compute[98431]: scsi Jun 11 23:08:05.868839 np0000002687 nova-compute[98431]: Jun 11 23:08:05.868839 np0000002687 nova-compute[98431]: Jun 11 23:08:05.868839 np0000002687 nova-compute[98431]: Jun 11 23:08:05.868839 np0000002687 nova-compute[98431]: Jun 11 23:08:05.868839 np0000002687 nova-compute[98431]: Jun 11 23:08:05.868839 np0000002687 nova-compute[98431]: Jun 11 23:08:05.868839 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.868839 np0000002687 nova-compute[98431]: virtio-transitional Jun 11 23:08:05.870131 np0000002687 nova-compute[98431]: virtio-non-transitional Jun 11 23:08:05.870131 np0000002687 nova-compute[98431]: Jun 11 23:08:05.870131 np0000002687 nova-compute[98431]: Jun 11 23:08:05.870131 np0000002687 nova-compute[98431]: random Jun 11 23:08:05.870131 np0000002687 nova-compute[98431]: egd Jun 11 23:08:05.870131 np0000002687 nova-compute[98431]: builtin Jun 11 23:08:05.870131 np0000002687 nova-compute[98431]: Jun 11 23:08:05.870131 np0000002687 nova-compute[98431]: Jun 11 23:08:05.870131 np0000002687 nova-compute[98431]: Jun 11 23:08:05.870131 np0000002687 nova-compute[98431]: Jun 11 23:08:05.870131 np0000002687 nova-compute[98431]: path Jun 11 23:08:05.870131 np0000002687 nova-compute[98431]: handle Jun 11 23:08:05.870131 np0000002687 nova-compute[98431]: virtiofs Jun 11 23:08:05.870131 np0000002687 nova-compute[98431]: Jun 11 23:08:05.870131 np0000002687 nova-compute[98431]: Jun 11 23:08:05.870131 np0000002687 nova-compute[98431]: Jun 11 23:08:05.870131 np0000002687 nova-compute[98431]: Jun 11 23:08:05.870131 np0000002687 nova-compute[98431]: Jun 11 23:08:05.870131 np0000002687 nova-compute[98431]: usb Jun 11 23:08:05.870131 np0000002687 nova-compute[98431]: Jun 11 23:08:05.870131 np0000002687 nova-compute[98431]: Jun 11 23:08:05.870131 np0000002687 nova-compute[98431]: Jun 11 23:08:05.870131 np0000002687 nova-compute[98431]: Jun 11 23:08:05.870131 np0000002687 nova-compute[98431]: pty Jun 11 23:08:05.870131 np0000002687 nova-compute[98431]: unix Jun 11 23:08:05.870131 np0000002687 nova-compute[98431]: spicevmc Jun 11 23:08:05.870131 np0000002687 nova-compute[98431]: Jun 11 23:08:05.870131 np0000002687 nova-compute[98431]: Jun 11 23:08:05.870131 np0000002687 nova-compute[98431]: Jun 11 23:08:05.870131 np0000002687 nova-compute[98431]: Jun 11 23:08:05.870131 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.870131 np0000002687 nova-compute[98431]: Jun 11 23:08:05.870131 np0000002687 nova-compute[98431]: Jun 11 23:08:05.870131 np0000002687 nova-compute[98431]: qemu Jun 11 23:08:05.870131 np0000002687 nova-compute[98431]: Jun 11 23:08:05.870131 np0000002687 nova-compute[98431]: Jun 11 23:08:05.870131 np0000002687 nova-compute[98431]: builtin Jun 11 23:08:05.870131 np0000002687 nova-compute[98431]: Jun 11 23:08:05.870131 np0000002687 nova-compute[98431]: Jun 11 23:08:05.870131 np0000002687 nova-compute[98431]: Jun 11 23:08:05.870131 np0000002687 nova-compute[98431]: Jun 11 23:08:05.870131 np0000002687 nova-compute[98431]: Jun 11 23:08:05.870131 np0000002687 nova-compute[98431]: Jun 11 23:08:05.870131 np0000002687 nova-compute[98431]: Jun 11 23:08:05.870131 np0000002687 nova-compute[98431]: Jun 11 23:08:05.870131 np0000002687 nova-compute[98431]: Jun 11 23:08:05.870131 np0000002687 nova-compute[98431]: Jun 11 23:08:05.870131 np0000002687 nova-compute[98431]: Jun 11 23:08:05.870131 np0000002687 nova-compute[98431]: Jun 11 23:08:05.870131 np0000002687 nova-compute[98431]: Jun 11 23:08:05.870131 np0000002687 nova-compute[98431]: Jun 11 23:08:05.870131 np0000002687 nova-compute[98431]: {{(pid=98431) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 11 23:08:05.870131 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=98431) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 11 23:08:05.870131 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] Libvirt host hypervisor capabilities for arch=mips64el and machine_type=None: Jun 11 23:08:05.870131 np0000002687 nova-compute[98431]: Jun 11 23:08:05.870131 np0000002687 nova-compute[98431]: /usr/bin/qemu-system-mips64el Jun 11 23:08:05.870131 np0000002687 nova-compute[98431]: qemu Jun 11 23:08:05.870131 np0000002687 nova-compute[98431]: malta Jun 11 23:08:05.870131 np0000002687 nova-compute[98431]: mips64el Jun 11 23:08:05.870131 np0000002687 nova-compute[98431]: Jun 11 23:08:05.870131 np0000002687 nova-compute[98431]: Jun 11 23:08:05.871192 np0000002687 nova-compute[98431]: Jun 11 23:08:05.871192 np0000002687 nova-compute[98431]: Jun 11 23:08:05.871192 np0000002687 nova-compute[98431]: Jun 11 23:08:05.871192 np0000002687 nova-compute[98431]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 11 23:08:05.871192 np0000002687 nova-compute[98431]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 11 23:08:05.871192 np0000002687 nova-compute[98431]: Jun 11 23:08:05.871192 np0000002687 nova-compute[98431]: rom Jun 11 23:08:05.871192 np0000002687 nova-compute[98431]: pflash Jun 11 23:08:05.871192 np0000002687 nova-compute[98431]: Jun 11 23:08:05.871192 np0000002687 nova-compute[98431]: Jun 11 23:08:05.871192 np0000002687 nova-compute[98431]: yes Jun 11 23:08:05.871192 np0000002687 nova-compute[98431]: no Jun 11 23:08:05.871192 np0000002687 nova-compute[98431]: Jun 11 23:08:05.871192 np0000002687 nova-compute[98431]: Jun 11 23:08:05.871192 np0000002687 nova-compute[98431]: no Jun 11 23:08:05.871192 np0000002687 nova-compute[98431]: Jun 11 23:08:05.871192 np0000002687 nova-compute[98431]: Jun 11 23:08:05.871192 np0000002687 nova-compute[98431]: Jun 11 23:08:05.871192 np0000002687 nova-compute[98431]: Jun 11 23:08:05.871192 np0000002687 nova-compute[98431]: Jun 11 23:08:05.871192 np0000002687 nova-compute[98431]: Jun 11 23:08:05.871192 np0000002687 nova-compute[98431]: Jun 11 23:08:05.871192 np0000002687 nova-compute[98431]: Jun 11 23:08:05.871192 np0000002687 nova-compute[98431]: Jun 11 23:08:05.871192 np0000002687 nova-compute[98431]: Jun 11 23:08:05.871192 np0000002687 nova-compute[98431]: Jun 11 23:08:05.871192 np0000002687 nova-compute[98431]: file Jun 11 23:08:05.871192 np0000002687 nova-compute[98431]: anonymous Jun 11 23:08:05.871192 np0000002687 nova-compute[98431]: memfd Jun 11 23:08:05.871192 np0000002687 nova-compute[98431]: Jun 11 23:08:05.871192 np0000002687 nova-compute[98431]: Jun 11 23:08:05.871192 np0000002687 nova-compute[98431]: Jun 11 23:08:05.871192 np0000002687 nova-compute[98431]: Jun 11 23:08:05.871192 np0000002687 nova-compute[98431]: Jun 11 23:08:05.871192 np0000002687 nova-compute[98431]: disk Jun 11 23:08:05.871192 np0000002687 nova-compute[98431]: cdrom Jun 11 23:08:05.871192 np0000002687 nova-compute[98431]: floppy Jun 11 23:08:05.871192 np0000002687 nova-compute[98431]: lun Jun 11 23:08:05.871192 np0000002687 nova-compute[98431]: Jun 11 23:08:05.871192 np0000002687 nova-compute[98431]: Jun 11 23:08:05.871192 np0000002687 nova-compute[98431]: ide Jun 11 23:08:05.871192 np0000002687 nova-compute[98431]: fdc Jun 11 23:08:05.871192 np0000002687 nova-compute[98431]: scsi Jun 11 23:08:05.871192 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.871192 np0000002687 nova-compute[98431]: usb Jun 11 23:08:05.871192 np0000002687 nova-compute[98431]: sata Jun 11 23:08:05.871192 np0000002687 nova-compute[98431]: Jun 11 23:08:05.871192 np0000002687 nova-compute[98431]: Jun 11 23:08:05.871192 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.871192 np0000002687 nova-compute[98431]: virtio-transitional Jun 11 23:08:05.871192 np0000002687 nova-compute[98431]: virtio-non-transitional Jun 11 23:08:05.871192 np0000002687 nova-compute[98431]: Jun 11 23:08:05.871192 np0000002687 nova-compute[98431]: Jun 11 23:08:05.871192 np0000002687 nova-compute[98431]: Jun 11 23:08:05.871192 np0000002687 nova-compute[98431]: Jun 11 23:08:05.871192 np0000002687 nova-compute[98431]: sdl Jun 11 23:08:05.871192 np0000002687 nova-compute[98431]: vnc Jun 11 23:08:05.871192 np0000002687 nova-compute[98431]: spice Jun 11 23:08:05.871192 np0000002687 nova-compute[98431]: egl-headless Jun 11 23:08:05.871192 np0000002687 nova-compute[98431]: dbus Jun 11 23:08:05.871192 np0000002687 nova-compute[98431]: Jun 11 23:08:05.871192 np0000002687 nova-compute[98431]: Jun 11 23:08:05.871192 np0000002687 nova-compute[98431]: Jun 11 23:08:05.871192 np0000002687 nova-compute[98431]: Jun 11 23:08:05.871192 np0000002687 nova-compute[98431]: Jun 11 23:08:05.871192 np0000002687 nova-compute[98431]: subsystem Jun 11 23:08:05.871192 np0000002687 nova-compute[98431]: Jun 11 23:08:05.871192 np0000002687 nova-compute[98431]: Jun 11 23:08:05.872491 np0000002687 nova-compute[98431]: default Jun 11 23:08:05.872491 np0000002687 nova-compute[98431]: mandatory Jun 11 23:08:05.872491 np0000002687 nova-compute[98431]: requisite Jun 11 23:08:05.872491 np0000002687 nova-compute[98431]: optional Jun 11 23:08:05.872491 np0000002687 nova-compute[98431]: Jun 11 23:08:05.872491 np0000002687 nova-compute[98431]: Jun 11 23:08:05.872491 np0000002687 nova-compute[98431]: usb Jun 11 23:08:05.872491 np0000002687 nova-compute[98431]: pci Jun 11 23:08:05.872491 np0000002687 nova-compute[98431]: scsi Jun 11 23:08:05.872491 np0000002687 nova-compute[98431]: Jun 11 23:08:05.872491 np0000002687 nova-compute[98431]: Jun 11 23:08:05.872491 np0000002687 nova-compute[98431]: Jun 11 23:08:05.872491 np0000002687 nova-compute[98431]: Jun 11 23:08:05.872491 np0000002687 nova-compute[98431]: Jun 11 23:08:05.872491 np0000002687 nova-compute[98431]: Jun 11 23:08:05.872491 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.872491 np0000002687 nova-compute[98431]: virtio-transitional Jun 11 23:08:05.872491 np0000002687 nova-compute[98431]: virtio-non-transitional Jun 11 23:08:05.872491 np0000002687 nova-compute[98431]: Jun 11 23:08:05.872491 np0000002687 nova-compute[98431]: Jun 11 23:08:05.872491 np0000002687 nova-compute[98431]: random Jun 11 23:08:05.872491 np0000002687 nova-compute[98431]: egd Jun 11 23:08:05.872491 np0000002687 nova-compute[98431]: builtin Jun 11 23:08:05.872491 np0000002687 nova-compute[98431]: Jun 11 23:08:05.872491 np0000002687 nova-compute[98431]: Jun 11 23:08:05.872491 np0000002687 nova-compute[98431]: Jun 11 23:08:05.872491 np0000002687 nova-compute[98431]: Jun 11 23:08:05.872491 np0000002687 nova-compute[98431]: path Jun 11 23:08:05.872491 np0000002687 nova-compute[98431]: handle Jun 11 23:08:05.872491 np0000002687 nova-compute[98431]: virtiofs Jun 11 23:08:05.872491 np0000002687 nova-compute[98431]: Jun 11 23:08:05.872491 np0000002687 nova-compute[98431]: Jun 11 23:08:05.872491 np0000002687 nova-compute[98431]: Jun 11 23:08:05.872491 np0000002687 nova-compute[98431]: Jun 11 23:08:05.872491 np0000002687 nova-compute[98431]: Jun 11 23:08:05.872491 np0000002687 nova-compute[98431]: usb Jun 11 23:08:05.872491 np0000002687 nova-compute[98431]: Jun 11 23:08:05.872491 np0000002687 nova-compute[98431]: Jun 11 23:08:05.872491 np0000002687 nova-compute[98431]: Jun 11 23:08:05.872491 np0000002687 nova-compute[98431]: Jun 11 23:08:05.872491 np0000002687 nova-compute[98431]: pty Jun 11 23:08:05.872491 np0000002687 nova-compute[98431]: unix Jun 11 23:08:05.872491 np0000002687 nova-compute[98431]: spicevmc Jun 11 23:08:05.872491 np0000002687 nova-compute[98431]: Jun 11 23:08:05.872491 np0000002687 nova-compute[98431]: Jun 11 23:08:05.872491 np0000002687 nova-compute[98431]: Jun 11 23:08:05.872491 np0000002687 nova-compute[98431]: Jun 11 23:08:05.872491 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.872491 np0000002687 nova-compute[98431]: Jun 11 23:08:05.872491 np0000002687 nova-compute[98431]: Jun 11 23:08:05.872491 np0000002687 nova-compute[98431]: qemu Jun 11 23:08:05.872491 np0000002687 nova-compute[98431]: Jun 11 23:08:05.872491 np0000002687 nova-compute[98431]: Jun 11 23:08:05.872491 np0000002687 nova-compute[98431]: builtin Jun 11 23:08:05.872491 np0000002687 nova-compute[98431]: Jun 11 23:08:05.872491 np0000002687 nova-compute[98431]: Jun 11 23:08:05.872491 np0000002687 nova-compute[98431]: Jun 11 23:08:05.872491 np0000002687 nova-compute[98431]: Jun 11 23:08:05.872491 np0000002687 nova-compute[98431]: Jun 11 23:08:05.872491 np0000002687 nova-compute[98431]: Jun 11 23:08:05.872491 np0000002687 nova-compute[98431]: Jun 11 23:08:05.872491 np0000002687 nova-compute[98431]: Jun 11 23:08:05.872491 np0000002687 nova-compute[98431]: Jun 11 23:08:05.872491 np0000002687 nova-compute[98431]: Jun 11 23:08:05.872491 np0000002687 nova-compute[98431]: Jun 11 23:08:05.872491 np0000002687 nova-compute[98431]: Jun 11 23:08:05.872491 np0000002687 nova-compute[98431]: Jun 11 23:08:05.872491 np0000002687 nova-compute[98431]: Jun 11 23:08:05.872491 np0000002687 nova-compute[98431]: {{(pid=98431) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 11 23:08:05.873654 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=98431) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 11 23:08:05.873654 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] Libvirt host hypervisor capabilities for arch=ppc and machine_type=None: Jun 11 23:08:05.873654 np0000002687 nova-compute[98431]: Jun 11 23:08:05.873654 np0000002687 nova-compute[98431]: /usr/bin/qemu-system-ppc Jun 11 23:08:05.873654 np0000002687 nova-compute[98431]: qemu Jun 11 23:08:05.873654 np0000002687 nova-compute[98431]: g3beige Jun 11 23:08:05.873654 np0000002687 nova-compute[98431]: ppc Jun 11 23:08:05.873654 np0000002687 nova-compute[98431]: Jun 11 23:08:05.873654 np0000002687 nova-compute[98431]: Jun 11 23:08:05.873654 np0000002687 nova-compute[98431]: Jun 11 23:08:05.873654 np0000002687 nova-compute[98431]: Jun 11 23:08:05.873654 np0000002687 nova-compute[98431]: Jun 11 23:08:05.873654 np0000002687 nova-compute[98431]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 11 23:08:05.873654 np0000002687 nova-compute[98431]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 11 23:08:05.873654 np0000002687 nova-compute[98431]: Jun 11 23:08:05.873654 np0000002687 nova-compute[98431]: rom Jun 11 23:08:05.873654 np0000002687 nova-compute[98431]: pflash Jun 11 23:08:05.873654 np0000002687 nova-compute[98431]: Jun 11 23:08:05.873654 np0000002687 nova-compute[98431]: Jun 11 23:08:05.873654 np0000002687 nova-compute[98431]: yes Jun 11 23:08:05.873654 np0000002687 nova-compute[98431]: no Jun 11 23:08:05.873654 np0000002687 nova-compute[98431]: Jun 11 23:08:05.873654 np0000002687 nova-compute[98431]: Jun 11 23:08:05.873654 np0000002687 nova-compute[98431]: no Jun 11 23:08:05.873654 np0000002687 nova-compute[98431]: Jun 11 23:08:05.873654 np0000002687 nova-compute[98431]: Jun 11 23:08:05.873654 np0000002687 nova-compute[98431]: Jun 11 23:08:05.873654 np0000002687 nova-compute[98431]: Jun 11 23:08:05.873654 np0000002687 nova-compute[98431]: Jun 11 23:08:05.873654 np0000002687 nova-compute[98431]: Jun 11 23:08:05.873654 np0000002687 nova-compute[98431]: Jun 11 23:08:05.873654 np0000002687 nova-compute[98431]: Jun 11 23:08:05.873654 np0000002687 nova-compute[98431]: Jun 11 23:08:05.873654 np0000002687 nova-compute[98431]: Jun 11 23:08:05.873654 np0000002687 nova-compute[98431]: Jun 11 23:08:05.873654 np0000002687 nova-compute[98431]: file Jun 11 23:08:05.873654 np0000002687 nova-compute[98431]: anonymous Jun 11 23:08:05.873654 np0000002687 nova-compute[98431]: memfd Jun 11 23:08:05.873654 np0000002687 nova-compute[98431]: Jun 11 23:08:05.873654 np0000002687 nova-compute[98431]: Jun 11 23:08:05.873654 np0000002687 nova-compute[98431]: Jun 11 23:08:05.873654 np0000002687 nova-compute[98431]: Jun 11 23:08:05.873654 np0000002687 nova-compute[98431]: Jun 11 23:08:05.873654 np0000002687 nova-compute[98431]: disk Jun 11 23:08:05.873654 np0000002687 nova-compute[98431]: cdrom Jun 11 23:08:05.873654 np0000002687 nova-compute[98431]: floppy Jun 11 23:08:05.873654 np0000002687 nova-compute[98431]: lun Jun 11 23:08:05.873654 np0000002687 nova-compute[98431]: Jun 11 23:08:05.873654 np0000002687 nova-compute[98431]: Jun 11 23:08:05.873654 np0000002687 nova-compute[98431]: ide Jun 11 23:08:05.873654 np0000002687 nova-compute[98431]: fdc Jun 11 23:08:05.873654 np0000002687 nova-compute[98431]: scsi Jun 11 23:08:05.873654 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.873654 np0000002687 nova-compute[98431]: usb Jun 11 23:08:05.873654 np0000002687 nova-compute[98431]: sata Jun 11 23:08:05.873654 np0000002687 nova-compute[98431]: Jun 11 23:08:05.873654 np0000002687 nova-compute[98431]: Jun 11 23:08:05.873654 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.873654 np0000002687 nova-compute[98431]: virtio-transitional Jun 11 23:08:05.873654 np0000002687 nova-compute[98431]: virtio-non-transitional Jun 11 23:08:05.873654 np0000002687 nova-compute[98431]: Jun 11 23:08:05.873654 np0000002687 nova-compute[98431]: Jun 11 23:08:05.874593 np0000002687 nova-compute[98431]: Jun 11 23:08:05.874593 np0000002687 nova-compute[98431]: Jun 11 23:08:05.874593 np0000002687 nova-compute[98431]: sdl Jun 11 23:08:05.874593 np0000002687 nova-compute[98431]: vnc Jun 11 23:08:05.874593 np0000002687 nova-compute[98431]: spice Jun 11 23:08:05.874593 np0000002687 nova-compute[98431]: egl-headless Jun 11 23:08:05.874593 np0000002687 nova-compute[98431]: dbus Jun 11 23:08:05.874593 np0000002687 nova-compute[98431]: Jun 11 23:08:05.874593 np0000002687 nova-compute[98431]: Jun 11 23:08:05.874593 np0000002687 nova-compute[98431]: Jun 11 23:08:05.874593 np0000002687 nova-compute[98431]: Jun 11 23:08:05.874593 np0000002687 nova-compute[98431]: Jun 11 23:08:05.874593 np0000002687 nova-compute[98431]: subsystem Jun 11 23:08:05.874593 np0000002687 nova-compute[98431]: Jun 11 23:08:05.874593 np0000002687 nova-compute[98431]: Jun 11 23:08:05.874593 np0000002687 nova-compute[98431]: default Jun 11 23:08:05.874593 np0000002687 nova-compute[98431]: mandatory Jun 11 23:08:05.874593 np0000002687 nova-compute[98431]: requisite Jun 11 23:08:05.874593 np0000002687 nova-compute[98431]: optional Jun 11 23:08:05.874593 np0000002687 nova-compute[98431]: Jun 11 23:08:05.874593 np0000002687 nova-compute[98431]: Jun 11 23:08:05.874593 np0000002687 nova-compute[98431]: usb Jun 11 23:08:05.874593 np0000002687 nova-compute[98431]: pci Jun 11 23:08:05.874593 np0000002687 nova-compute[98431]: scsi Jun 11 23:08:05.874593 np0000002687 nova-compute[98431]: Jun 11 23:08:05.874593 np0000002687 nova-compute[98431]: Jun 11 23:08:05.874593 np0000002687 nova-compute[98431]: Jun 11 23:08:05.874593 np0000002687 nova-compute[98431]: Jun 11 23:08:05.874593 np0000002687 nova-compute[98431]: Jun 11 23:08:05.874593 np0000002687 nova-compute[98431]: Jun 11 23:08:05.874593 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.874593 np0000002687 nova-compute[98431]: virtio-transitional Jun 11 23:08:05.874593 np0000002687 nova-compute[98431]: virtio-non-transitional Jun 11 23:08:05.874593 np0000002687 nova-compute[98431]: Jun 11 23:08:05.874593 np0000002687 nova-compute[98431]: Jun 11 23:08:05.874593 np0000002687 nova-compute[98431]: random Jun 11 23:08:05.874593 np0000002687 nova-compute[98431]: egd Jun 11 23:08:05.874593 np0000002687 nova-compute[98431]: builtin Jun 11 23:08:05.874593 np0000002687 nova-compute[98431]: Jun 11 23:08:05.874593 np0000002687 nova-compute[98431]: Jun 11 23:08:05.874593 np0000002687 nova-compute[98431]: Jun 11 23:08:05.874593 np0000002687 nova-compute[98431]: Jun 11 23:08:05.874593 np0000002687 nova-compute[98431]: path Jun 11 23:08:05.874593 np0000002687 nova-compute[98431]: handle Jun 11 23:08:05.874593 np0000002687 nova-compute[98431]: virtiofs Jun 11 23:08:05.874593 np0000002687 nova-compute[98431]: Jun 11 23:08:05.874593 np0000002687 nova-compute[98431]: Jun 11 23:08:05.874593 np0000002687 nova-compute[98431]: Jun 11 23:08:05.874593 np0000002687 nova-compute[98431]: Jun 11 23:08:05.874593 np0000002687 nova-compute[98431]: Jun 11 23:08:05.874593 np0000002687 nova-compute[98431]: usb Jun 11 23:08:05.874593 np0000002687 nova-compute[98431]: Jun 11 23:08:05.874593 np0000002687 nova-compute[98431]: Jun 11 23:08:05.874593 np0000002687 nova-compute[98431]: Jun 11 23:08:05.874593 np0000002687 nova-compute[98431]: Jun 11 23:08:05.874593 np0000002687 nova-compute[98431]: pty Jun 11 23:08:05.874593 np0000002687 nova-compute[98431]: unix Jun 11 23:08:05.874593 np0000002687 nova-compute[98431]: spicevmc Jun 11 23:08:05.874593 np0000002687 nova-compute[98431]: Jun 11 23:08:05.874593 np0000002687 nova-compute[98431]: Jun 11 23:08:05.874593 np0000002687 nova-compute[98431]: Jun 11 23:08:05.874593 np0000002687 nova-compute[98431]: Jun 11 23:08:05.874593 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.874593 np0000002687 nova-compute[98431]: Jun 11 23:08:05.874593 np0000002687 nova-compute[98431]: Jun 11 23:08:05.874593 np0000002687 nova-compute[98431]: qemu Jun 11 23:08:05.874593 np0000002687 nova-compute[98431]: Jun 11 23:08:05.874593 np0000002687 nova-compute[98431]: Jun 11 23:08:05.874593 np0000002687 nova-compute[98431]: builtin Jun 11 23:08:05.874593 np0000002687 nova-compute[98431]: Jun 11 23:08:05.874593 np0000002687 nova-compute[98431]: Jun 11 23:08:05.874593 np0000002687 nova-compute[98431]: Jun 11 23:08:05.875915 np0000002687 nova-compute[98431]: Jun 11 23:08:05.875915 np0000002687 nova-compute[98431]: Jun 11 23:08:05.875915 np0000002687 nova-compute[98431]: Jun 11 23:08:05.875915 np0000002687 nova-compute[98431]: Jun 11 23:08:05.875915 np0000002687 nova-compute[98431]: Jun 11 23:08:05.875915 np0000002687 nova-compute[98431]: Jun 11 23:08:05.875915 np0000002687 nova-compute[98431]: Jun 11 23:08:05.875915 np0000002687 nova-compute[98431]: Jun 11 23:08:05.875915 np0000002687 nova-compute[98431]: Jun 11 23:08:05.875915 np0000002687 nova-compute[98431]: Jun 11 23:08:05.875915 np0000002687 nova-compute[98431]: Jun 11 23:08:05.875915 np0000002687 nova-compute[98431]: {{(pid=98431) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 11 23:08:05.875915 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] Getting domain capabilities for ppc64 via machine types: {None, 'powernv', 'pseries'} {{(pid=98431) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 11 23:08:05.875915 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] Libvirt host hypervisor capabilities for arch=ppc64 and machine_type=None: Jun 11 23:08:05.875915 np0000002687 nova-compute[98431]: Jun 11 23:08:05.875915 np0000002687 nova-compute[98431]: /usr/bin/qemu-system-ppc64 Jun 11 23:08:05.875915 np0000002687 nova-compute[98431]: qemu Jun 11 23:08:05.875915 np0000002687 nova-compute[98431]: pseries-noble Jun 11 23:08:05.875915 np0000002687 nova-compute[98431]: ppc64 Jun 11 23:08:05.875915 np0000002687 nova-compute[98431]: Jun 11 23:08:05.875915 np0000002687 nova-compute[98431]: Jun 11 23:08:05.875915 np0000002687 nova-compute[98431]: Jun 11 23:08:05.875915 np0000002687 nova-compute[98431]: Jun 11 23:08:05.875915 np0000002687 nova-compute[98431]: Jun 11 23:08:05.875915 np0000002687 nova-compute[98431]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 11 23:08:05.875915 np0000002687 nova-compute[98431]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 11 23:08:05.875915 np0000002687 nova-compute[98431]: Jun 11 23:08:05.875915 np0000002687 nova-compute[98431]: rom Jun 11 23:08:05.875915 np0000002687 nova-compute[98431]: pflash Jun 11 23:08:05.875915 np0000002687 nova-compute[98431]: Jun 11 23:08:05.875915 np0000002687 nova-compute[98431]: Jun 11 23:08:05.875915 np0000002687 nova-compute[98431]: yes Jun 11 23:08:05.875915 np0000002687 nova-compute[98431]: no Jun 11 23:08:05.875915 np0000002687 nova-compute[98431]: Jun 11 23:08:05.875915 np0000002687 nova-compute[98431]: Jun 11 23:08:05.875915 np0000002687 nova-compute[98431]: no Jun 11 23:08:05.875915 np0000002687 nova-compute[98431]: Jun 11 23:08:05.875915 np0000002687 nova-compute[98431]: Jun 11 23:08:05.875915 np0000002687 nova-compute[98431]: Jun 11 23:08:05.875915 np0000002687 nova-compute[98431]: Jun 11 23:08:05.875915 np0000002687 nova-compute[98431]: Jun 11 23:08:05.875915 np0000002687 nova-compute[98431]: Jun 11 23:08:05.875915 np0000002687 nova-compute[98431]: Jun 11 23:08:05.875915 np0000002687 nova-compute[98431]: Jun 11 23:08:05.875915 np0000002687 nova-compute[98431]: POWER10 Jun 11 23:08:05.875915 np0000002687 nova-compute[98431]: POWER9 Jun 11 23:08:05.875915 np0000002687 nova-compute[98431]: POWER8 Jun 11 23:08:05.875915 np0000002687 nova-compute[98431]: POWER7 Jun 11 23:08:05.875915 np0000002687 nova-compute[98431]: Jun 11 23:08:05.875915 np0000002687 nova-compute[98431]: Jun 11 23:08:05.875915 np0000002687 nova-compute[98431]: Jun 11 23:08:05.875915 np0000002687 nova-compute[98431]: Jun 11 23:08:05.877025 np0000002687 nova-compute[98431]: file Jun 11 23:08:05.877025 np0000002687 nova-compute[98431]: anonymous Jun 11 23:08:05.877025 np0000002687 nova-compute[98431]: memfd Jun 11 23:08:05.877025 np0000002687 nova-compute[98431]: Jun 11 23:08:05.877025 np0000002687 nova-compute[98431]: Jun 11 23:08:05.877025 np0000002687 nova-compute[98431]: Jun 11 23:08:05.877025 np0000002687 nova-compute[98431]: Jun 11 23:08:05.877025 np0000002687 nova-compute[98431]: Jun 11 23:08:05.877025 np0000002687 nova-compute[98431]: disk Jun 11 23:08:05.877025 np0000002687 nova-compute[98431]: cdrom Jun 11 23:08:05.877025 np0000002687 nova-compute[98431]: lun Jun 11 23:08:05.877025 np0000002687 nova-compute[98431]: Jun 11 23:08:05.877025 np0000002687 nova-compute[98431]: Jun 11 23:08:05.877025 np0000002687 nova-compute[98431]: scsi Jun 11 23:08:05.877025 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.877025 np0000002687 nova-compute[98431]: usb Jun 11 23:08:05.877025 np0000002687 nova-compute[98431]: sata Jun 11 23:08:05.877025 np0000002687 nova-compute[98431]: Jun 11 23:08:05.877025 np0000002687 nova-compute[98431]: Jun 11 23:08:05.877025 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.877025 np0000002687 nova-compute[98431]: virtio-transitional Jun 11 23:08:05.877025 np0000002687 nova-compute[98431]: virtio-non-transitional Jun 11 23:08:05.877025 np0000002687 nova-compute[98431]: Jun 11 23:08:05.877025 np0000002687 nova-compute[98431]: Jun 11 23:08:05.877025 np0000002687 nova-compute[98431]: Jun 11 23:08:05.877025 np0000002687 nova-compute[98431]: Jun 11 23:08:05.877025 np0000002687 nova-compute[98431]: sdl Jun 11 23:08:05.877025 np0000002687 nova-compute[98431]: vnc Jun 11 23:08:05.877025 np0000002687 nova-compute[98431]: spice Jun 11 23:08:05.877025 np0000002687 nova-compute[98431]: egl-headless Jun 11 23:08:05.877025 np0000002687 nova-compute[98431]: dbus Jun 11 23:08:05.877025 np0000002687 nova-compute[98431]: Jun 11 23:08:05.877025 np0000002687 nova-compute[98431]: Jun 11 23:08:05.877025 np0000002687 nova-compute[98431]: Jun 11 23:08:05.877025 np0000002687 nova-compute[98431]: Jun 11 23:08:05.877025 np0000002687 nova-compute[98431]: Jun 11 23:08:05.877025 np0000002687 nova-compute[98431]: subsystem Jun 11 23:08:05.877025 np0000002687 nova-compute[98431]: Jun 11 23:08:05.877025 np0000002687 nova-compute[98431]: Jun 11 23:08:05.877025 np0000002687 nova-compute[98431]: default Jun 11 23:08:05.877025 np0000002687 nova-compute[98431]: mandatory Jun 11 23:08:05.877025 np0000002687 nova-compute[98431]: requisite Jun 11 23:08:05.877025 np0000002687 nova-compute[98431]: optional Jun 11 23:08:05.877025 np0000002687 nova-compute[98431]: Jun 11 23:08:05.877025 np0000002687 nova-compute[98431]: Jun 11 23:08:05.877025 np0000002687 nova-compute[98431]: usb Jun 11 23:08:05.877025 np0000002687 nova-compute[98431]: pci Jun 11 23:08:05.877025 np0000002687 nova-compute[98431]: scsi Jun 11 23:08:05.877025 np0000002687 nova-compute[98431]: Jun 11 23:08:05.877025 np0000002687 nova-compute[98431]: Jun 11 23:08:05.877025 np0000002687 nova-compute[98431]: Jun 11 23:08:05.877025 np0000002687 nova-compute[98431]: Jun 11 23:08:05.877025 np0000002687 nova-compute[98431]: Jun 11 23:08:05.877025 np0000002687 nova-compute[98431]: Jun 11 23:08:05.877025 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.877025 np0000002687 nova-compute[98431]: virtio-transitional Jun 11 23:08:05.877025 np0000002687 nova-compute[98431]: virtio-non-transitional Jun 11 23:08:05.877025 np0000002687 nova-compute[98431]: Jun 11 23:08:05.877025 np0000002687 nova-compute[98431]: Jun 11 23:08:05.877025 np0000002687 nova-compute[98431]: random Jun 11 23:08:05.877025 np0000002687 nova-compute[98431]: egd Jun 11 23:08:05.877025 np0000002687 nova-compute[98431]: builtin Jun 11 23:08:05.877025 np0000002687 nova-compute[98431]: Jun 11 23:08:05.877025 np0000002687 nova-compute[98431]: Jun 11 23:08:05.877025 np0000002687 nova-compute[98431]: Jun 11 23:08:05.877025 np0000002687 nova-compute[98431]: Jun 11 23:08:05.877025 np0000002687 nova-compute[98431]: path Jun 11 23:08:05.877025 np0000002687 nova-compute[98431]: handle Jun 11 23:08:05.877025 np0000002687 nova-compute[98431]: virtiofs Jun 11 23:08:05.877025 np0000002687 nova-compute[98431]: Jun 11 23:08:05.878349 np0000002687 nova-compute[98431]: Jun 11 23:08:05.878349 np0000002687 nova-compute[98431]: Jun 11 23:08:05.878349 np0000002687 nova-compute[98431]: Jun 11 23:08:05.878349 np0000002687 nova-compute[98431]: tpm-spapr Jun 11 23:08:05.878349 np0000002687 nova-compute[98431]: spapr-tpm-proxy Jun 11 23:08:05.878349 np0000002687 nova-compute[98431]: Jun 11 23:08:05.878349 np0000002687 nova-compute[98431]: Jun 11 23:08:05.878349 np0000002687 nova-compute[98431]: passthrough Jun 11 23:08:05.878349 np0000002687 nova-compute[98431]: emulator Jun 11 23:08:05.878349 np0000002687 nova-compute[98431]: external Jun 11 23:08:05.878349 np0000002687 nova-compute[98431]: Jun 11 23:08:05.878349 np0000002687 nova-compute[98431]: Jun 11 23:08:05.878349 np0000002687 nova-compute[98431]: 1.2 Jun 11 23:08:05.878349 np0000002687 nova-compute[98431]: 2.0 Jun 11 23:08:05.878349 np0000002687 nova-compute[98431]: Jun 11 23:08:05.878349 np0000002687 nova-compute[98431]: Jun 11 23:08:05.878349 np0000002687 nova-compute[98431]: Jun 11 23:08:05.878349 np0000002687 nova-compute[98431]: Jun 11 23:08:05.878349 np0000002687 nova-compute[98431]: usb Jun 11 23:08:05.878349 np0000002687 nova-compute[98431]: Jun 11 23:08:05.878349 np0000002687 nova-compute[98431]: Jun 11 23:08:05.878349 np0000002687 nova-compute[98431]: Jun 11 23:08:05.878349 np0000002687 nova-compute[98431]: Jun 11 23:08:05.878349 np0000002687 nova-compute[98431]: pty Jun 11 23:08:05.878349 np0000002687 nova-compute[98431]: unix Jun 11 23:08:05.878349 np0000002687 nova-compute[98431]: spicevmc Jun 11 23:08:05.878349 np0000002687 nova-compute[98431]: Jun 11 23:08:05.878349 np0000002687 nova-compute[98431]: Jun 11 23:08:05.878349 np0000002687 nova-compute[98431]: Jun 11 23:08:05.878349 np0000002687 nova-compute[98431]: Jun 11 23:08:05.878349 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.878349 np0000002687 nova-compute[98431]: Jun 11 23:08:05.878349 np0000002687 nova-compute[98431]: Jun 11 23:08:05.878349 np0000002687 nova-compute[98431]: qemu Jun 11 23:08:05.878349 np0000002687 nova-compute[98431]: Jun 11 23:08:05.878349 np0000002687 nova-compute[98431]: Jun 11 23:08:05.878349 np0000002687 nova-compute[98431]: builtin Jun 11 23:08:05.878349 np0000002687 nova-compute[98431]: Jun 11 23:08:05.878349 np0000002687 nova-compute[98431]: Jun 11 23:08:05.878349 np0000002687 nova-compute[98431]: Jun 11 23:08:05.878349 np0000002687 nova-compute[98431]: Jun 11 23:08:05.878349 np0000002687 nova-compute[98431]: Jun 11 23:08:05.878349 np0000002687 nova-compute[98431]: Jun 11 23:08:05.878349 np0000002687 nova-compute[98431]: Jun 11 23:08:05.878349 np0000002687 nova-compute[98431]: Jun 11 23:08:05.878349 np0000002687 nova-compute[98431]: Jun 11 23:08:05.878349 np0000002687 nova-compute[98431]: Jun 11 23:08:05.878349 np0000002687 nova-compute[98431]: Jun 11 23:08:05.878349 np0000002687 nova-compute[98431]: Jun 11 23:08:05.878349 np0000002687 nova-compute[98431]: Jun 11 23:08:05.878349 np0000002687 nova-compute[98431]: Jun 11 23:08:05.878349 np0000002687 nova-compute[98431]: {{(pid=98431) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 11 23:08:05.878349 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] Libvirt host hypervisor capabilities for arch=ppc64 and machine_type=powernv: Jun 11 23:08:05.878349 np0000002687 nova-compute[98431]: Jun 11 23:08:05.878349 np0000002687 nova-compute[98431]: /usr/bin/qemu-system-ppc64 Jun 11 23:08:05.878349 np0000002687 nova-compute[98431]: qemu Jun 11 23:08:05.878349 np0000002687 nova-compute[98431]: powernv9 Jun 11 23:08:05.878349 np0000002687 nova-compute[98431]: ppc64 Jun 11 23:08:05.878349 np0000002687 nova-compute[98431]: Jun 11 23:08:05.878349 np0000002687 nova-compute[98431]: Jun 11 23:08:05.878349 np0000002687 nova-compute[98431]: Jun 11 23:08:05.878349 np0000002687 nova-compute[98431]: Jun 11 23:08:05.878349 np0000002687 nova-compute[98431]: Jun 11 23:08:05.878349 np0000002687 nova-compute[98431]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 11 23:08:05.878349 np0000002687 nova-compute[98431]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 11 23:08:05.878349 np0000002687 nova-compute[98431]: Jun 11 23:08:05.878349 np0000002687 nova-compute[98431]: rom Jun 11 23:08:05.878349 np0000002687 nova-compute[98431]: pflash Jun 11 23:08:05.878349 np0000002687 nova-compute[98431]: Jun 11 23:08:05.879519 np0000002687 nova-compute[98431]: Jun 11 23:08:05.879519 np0000002687 nova-compute[98431]: yes Jun 11 23:08:05.879519 np0000002687 nova-compute[98431]: no Jun 11 23:08:05.879519 np0000002687 nova-compute[98431]: Jun 11 23:08:05.879519 np0000002687 nova-compute[98431]: Jun 11 23:08:05.879519 np0000002687 nova-compute[98431]: no Jun 11 23:08:05.879519 np0000002687 nova-compute[98431]: Jun 11 23:08:05.879519 np0000002687 nova-compute[98431]: Jun 11 23:08:05.879519 np0000002687 nova-compute[98431]: Jun 11 23:08:05.879519 np0000002687 nova-compute[98431]: Jun 11 23:08:05.879519 np0000002687 nova-compute[98431]: Jun 11 23:08:05.879519 np0000002687 nova-compute[98431]: Jun 11 23:08:05.879519 np0000002687 nova-compute[98431]: Jun 11 23:08:05.879519 np0000002687 nova-compute[98431]: Jun 11 23:08:05.879519 np0000002687 nova-compute[98431]: POWER10 Jun 11 23:08:05.879519 np0000002687 nova-compute[98431]: POWER9 Jun 11 23:08:05.879519 np0000002687 nova-compute[98431]: POWER8 Jun 11 23:08:05.879519 np0000002687 nova-compute[98431]: POWER7 Jun 11 23:08:05.879519 np0000002687 nova-compute[98431]: Jun 11 23:08:05.879519 np0000002687 nova-compute[98431]: Jun 11 23:08:05.879519 np0000002687 nova-compute[98431]: Jun 11 23:08:05.879519 np0000002687 nova-compute[98431]: Jun 11 23:08:05.879519 np0000002687 nova-compute[98431]: file Jun 11 23:08:05.879519 np0000002687 nova-compute[98431]: anonymous Jun 11 23:08:05.879519 np0000002687 nova-compute[98431]: memfd Jun 11 23:08:05.879519 np0000002687 nova-compute[98431]: Jun 11 23:08:05.879519 np0000002687 nova-compute[98431]: Jun 11 23:08:05.879519 np0000002687 nova-compute[98431]: Jun 11 23:08:05.879519 np0000002687 nova-compute[98431]: Jun 11 23:08:05.879519 np0000002687 nova-compute[98431]: Jun 11 23:08:05.879519 np0000002687 nova-compute[98431]: disk Jun 11 23:08:05.879519 np0000002687 nova-compute[98431]: cdrom Jun 11 23:08:05.879519 np0000002687 nova-compute[98431]: floppy Jun 11 23:08:05.879519 np0000002687 nova-compute[98431]: lun Jun 11 23:08:05.879519 np0000002687 nova-compute[98431]: Jun 11 23:08:05.879519 np0000002687 nova-compute[98431]: Jun 11 23:08:05.879519 np0000002687 nova-compute[98431]: fdc Jun 11 23:08:05.879519 np0000002687 nova-compute[98431]: scsi Jun 11 23:08:05.879519 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.879519 np0000002687 nova-compute[98431]: usb Jun 11 23:08:05.879519 np0000002687 nova-compute[98431]: sata Jun 11 23:08:05.879519 np0000002687 nova-compute[98431]: Jun 11 23:08:05.879519 np0000002687 nova-compute[98431]: Jun 11 23:08:05.879519 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.879519 np0000002687 nova-compute[98431]: virtio-transitional Jun 11 23:08:05.879519 np0000002687 nova-compute[98431]: virtio-non-transitional Jun 11 23:08:05.879519 np0000002687 nova-compute[98431]: Jun 11 23:08:05.879519 np0000002687 nova-compute[98431]: Jun 11 23:08:05.879519 np0000002687 nova-compute[98431]: Jun 11 23:08:05.879519 np0000002687 nova-compute[98431]: Jun 11 23:08:05.879519 np0000002687 nova-compute[98431]: sdl Jun 11 23:08:05.879519 np0000002687 nova-compute[98431]: vnc Jun 11 23:08:05.879519 np0000002687 nova-compute[98431]: spice Jun 11 23:08:05.879519 np0000002687 nova-compute[98431]: egl-headless Jun 11 23:08:05.879519 np0000002687 nova-compute[98431]: dbus Jun 11 23:08:05.879519 np0000002687 nova-compute[98431]: Jun 11 23:08:05.879519 np0000002687 nova-compute[98431]: Jun 11 23:08:05.879519 np0000002687 nova-compute[98431]: Jun 11 23:08:05.879519 np0000002687 nova-compute[98431]: Jun 11 23:08:05.879519 np0000002687 nova-compute[98431]: Jun 11 23:08:05.879519 np0000002687 nova-compute[98431]: subsystem Jun 11 23:08:05.879519 np0000002687 nova-compute[98431]: Jun 11 23:08:05.879519 np0000002687 nova-compute[98431]: Jun 11 23:08:05.879519 np0000002687 nova-compute[98431]: default Jun 11 23:08:05.879519 np0000002687 nova-compute[98431]: mandatory Jun 11 23:08:05.879519 np0000002687 nova-compute[98431]: requisite Jun 11 23:08:05.880715 np0000002687 nova-compute[98431]: optional Jun 11 23:08:05.880715 np0000002687 nova-compute[98431]: Jun 11 23:08:05.880715 np0000002687 nova-compute[98431]: Jun 11 23:08:05.880715 np0000002687 nova-compute[98431]: usb Jun 11 23:08:05.880715 np0000002687 nova-compute[98431]: pci Jun 11 23:08:05.880715 np0000002687 nova-compute[98431]: scsi Jun 11 23:08:05.880715 np0000002687 nova-compute[98431]: Jun 11 23:08:05.880715 np0000002687 nova-compute[98431]: Jun 11 23:08:05.880715 np0000002687 nova-compute[98431]: Jun 11 23:08:05.880715 np0000002687 nova-compute[98431]: Jun 11 23:08:05.880715 np0000002687 nova-compute[98431]: Jun 11 23:08:05.880715 np0000002687 nova-compute[98431]: Jun 11 23:08:05.880715 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.880715 np0000002687 nova-compute[98431]: virtio-transitional Jun 11 23:08:05.880715 np0000002687 nova-compute[98431]: virtio-non-transitional Jun 11 23:08:05.880715 np0000002687 nova-compute[98431]: Jun 11 23:08:05.880715 np0000002687 nova-compute[98431]: Jun 11 23:08:05.880715 np0000002687 nova-compute[98431]: random Jun 11 23:08:05.880715 np0000002687 nova-compute[98431]: egd Jun 11 23:08:05.880715 np0000002687 nova-compute[98431]: builtin Jun 11 23:08:05.880715 np0000002687 nova-compute[98431]: Jun 11 23:08:05.880715 np0000002687 nova-compute[98431]: Jun 11 23:08:05.880715 np0000002687 nova-compute[98431]: Jun 11 23:08:05.880715 np0000002687 nova-compute[98431]: Jun 11 23:08:05.880715 np0000002687 nova-compute[98431]: path Jun 11 23:08:05.880715 np0000002687 nova-compute[98431]: handle Jun 11 23:08:05.880715 np0000002687 nova-compute[98431]: virtiofs Jun 11 23:08:05.880715 np0000002687 nova-compute[98431]: Jun 11 23:08:05.880715 np0000002687 nova-compute[98431]: Jun 11 23:08:05.880715 np0000002687 nova-compute[98431]: Jun 11 23:08:05.880715 np0000002687 nova-compute[98431]: Jun 11 23:08:05.880715 np0000002687 nova-compute[98431]: tpm-spapr Jun 11 23:08:05.880715 np0000002687 nova-compute[98431]: spapr-tpm-proxy Jun 11 23:08:05.880715 np0000002687 nova-compute[98431]: Jun 11 23:08:05.880715 np0000002687 nova-compute[98431]: Jun 11 23:08:05.880715 np0000002687 nova-compute[98431]: passthrough Jun 11 23:08:05.880715 np0000002687 nova-compute[98431]: emulator Jun 11 23:08:05.880715 np0000002687 nova-compute[98431]: external Jun 11 23:08:05.880715 np0000002687 nova-compute[98431]: Jun 11 23:08:05.880715 np0000002687 nova-compute[98431]: Jun 11 23:08:05.880715 np0000002687 nova-compute[98431]: 1.2 Jun 11 23:08:05.880715 np0000002687 nova-compute[98431]: 2.0 Jun 11 23:08:05.880715 np0000002687 nova-compute[98431]: Jun 11 23:08:05.880715 np0000002687 nova-compute[98431]: Jun 11 23:08:05.880715 np0000002687 nova-compute[98431]: Jun 11 23:08:05.880715 np0000002687 nova-compute[98431]: Jun 11 23:08:05.880715 np0000002687 nova-compute[98431]: usb Jun 11 23:08:05.880715 np0000002687 nova-compute[98431]: Jun 11 23:08:05.880715 np0000002687 nova-compute[98431]: Jun 11 23:08:05.880715 np0000002687 nova-compute[98431]: Jun 11 23:08:05.880715 np0000002687 nova-compute[98431]: Jun 11 23:08:05.880715 np0000002687 nova-compute[98431]: pty Jun 11 23:08:05.880715 np0000002687 nova-compute[98431]: unix Jun 11 23:08:05.880715 np0000002687 nova-compute[98431]: spicevmc Jun 11 23:08:05.880715 np0000002687 nova-compute[98431]: Jun 11 23:08:05.880715 np0000002687 nova-compute[98431]: Jun 11 23:08:05.880715 np0000002687 nova-compute[98431]: Jun 11 23:08:05.880715 np0000002687 nova-compute[98431]: Jun 11 23:08:05.880715 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.880715 np0000002687 nova-compute[98431]: Jun 11 23:08:05.880715 np0000002687 nova-compute[98431]: Jun 11 23:08:05.880715 np0000002687 nova-compute[98431]: qemu Jun 11 23:08:05.880715 np0000002687 nova-compute[98431]: Jun 11 23:08:05.880715 np0000002687 nova-compute[98431]: Jun 11 23:08:05.880715 np0000002687 nova-compute[98431]: builtin Jun 11 23:08:05.880715 np0000002687 nova-compute[98431]: Jun 11 23:08:05.880715 np0000002687 nova-compute[98431]: Jun 11 23:08:05.880715 np0000002687 nova-compute[98431]: Jun 11 23:08:05.880715 np0000002687 nova-compute[98431]: Jun 11 23:08:05.880715 np0000002687 nova-compute[98431]: Jun 11 23:08:05.880715 np0000002687 nova-compute[98431]: Jun 11 23:08:05.880715 np0000002687 nova-compute[98431]: Jun 11 23:08:05.880715 np0000002687 nova-compute[98431]: Jun 11 23:08:05.880715 np0000002687 nova-compute[98431]: Jun 11 23:08:05.880715 np0000002687 nova-compute[98431]: Jun 11 23:08:05.880715 np0000002687 nova-compute[98431]: Jun 11 23:08:05.880715 np0000002687 nova-compute[98431]: Jun 11 23:08:05.880715 np0000002687 nova-compute[98431]: Jun 11 23:08:05.880715 np0000002687 nova-compute[98431]: Jun 11 23:08:05.881982 np0000002687 nova-compute[98431]: {{(pid=98431) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 11 23:08:05.881982 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] Libvirt host hypervisor capabilities for arch=ppc64 and machine_type=pseries: Jun 11 23:08:05.881982 np0000002687 nova-compute[98431]: Jun 11 23:08:05.881982 np0000002687 nova-compute[98431]: /usr/bin/qemu-system-ppc64 Jun 11 23:08:05.881982 np0000002687 nova-compute[98431]: qemu Jun 11 23:08:05.881982 np0000002687 nova-compute[98431]: pseries-noble Jun 11 23:08:05.881982 np0000002687 nova-compute[98431]: ppc64 Jun 11 23:08:05.881982 np0000002687 nova-compute[98431]: Jun 11 23:08:05.881982 np0000002687 nova-compute[98431]: Jun 11 23:08:05.881982 np0000002687 nova-compute[98431]: Jun 11 23:08:05.881982 np0000002687 nova-compute[98431]: Jun 11 23:08:05.881982 np0000002687 nova-compute[98431]: Jun 11 23:08:05.881982 np0000002687 nova-compute[98431]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 11 23:08:05.881982 np0000002687 nova-compute[98431]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 11 23:08:05.881982 np0000002687 nova-compute[98431]: Jun 11 23:08:05.881982 np0000002687 nova-compute[98431]: rom Jun 11 23:08:05.881982 np0000002687 nova-compute[98431]: pflash Jun 11 23:08:05.881982 np0000002687 nova-compute[98431]: Jun 11 23:08:05.881982 np0000002687 nova-compute[98431]: Jun 11 23:08:05.881982 np0000002687 nova-compute[98431]: yes Jun 11 23:08:05.881982 np0000002687 nova-compute[98431]: no Jun 11 23:08:05.881982 np0000002687 nova-compute[98431]: Jun 11 23:08:05.881982 np0000002687 nova-compute[98431]: Jun 11 23:08:05.881982 np0000002687 nova-compute[98431]: no Jun 11 23:08:05.881982 np0000002687 nova-compute[98431]: Jun 11 23:08:05.881982 np0000002687 nova-compute[98431]: Jun 11 23:08:05.881982 np0000002687 nova-compute[98431]: Jun 11 23:08:05.881982 np0000002687 nova-compute[98431]: Jun 11 23:08:05.881982 np0000002687 nova-compute[98431]: Jun 11 23:08:05.881982 np0000002687 nova-compute[98431]: Jun 11 23:08:05.881982 np0000002687 nova-compute[98431]: Jun 11 23:08:05.881982 np0000002687 nova-compute[98431]: Jun 11 23:08:05.881982 np0000002687 nova-compute[98431]: POWER10 Jun 11 23:08:05.881982 np0000002687 nova-compute[98431]: POWER9 Jun 11 23:08:05.881982 np0000002687 nova-compute[98431]: POWER8 Jun 11 23:08:05.881982 np0000002687 nova-compute[98431]: POWER7 Jun 11 23:08:05.881982 np0000002687 nova-compute[98431]: Jun 11 23:08:05.881982 np0000002687 nova-compute[98431]: Jun 11 23:08:05.881982 np0000002687 nova-compute[98431]: Jun 11 23:08:05.881982 np0000002687 nova-compute[98431]: Jun 11 23:08:05.881982 np0000002687 nova-compute[98431]: file Jun 11 23:08:05.881982 np0000002687 nova-compute[98431]: anonymous Jun 11 23:08:05.881982 np0000002687 nova-compute[98431]: memfd Jun 11 23:08:05.881982 np0000002687 nova-compute[98431]: Jun 11 23:08:05.881982 np0000002687 nova-compute[98431]: Jun 11 23:08:05.881982 np0000002687 nova-compute[98431]: Jun 11 23:08:05.881982 np0000002687 nova-compute[98431]: Jun 11 23:08:05.881982 np0000002687 nova-compute[98431]: Jun 11 23:08:05.881982 np0000002687 nova-compute[98431]: disk Jun 11 23:08:05.881982 np0000002687 nova-compute[98431]: cdrom Jun 11 23:08:05.881982 np0000002687 nova-compute[98431]: lun Jun 11 23:08:05.881982 np0000002687 nova-compute[98431]: Jun 11 23:08:05.881982 np0000002687 nova-compute[98431]: Jun 11 23:08:05.881982 np0000002687 nova-compute[98431]: scsi Jun 11 23:08:05.881982 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.881982 np0000002687 nova-compute[98431]: usb Jun 11 23:08:05.881982 np0000002687 nova-compute[98431]: sata Jun 11 23:08:05.881982 np0000002687 nova-compute[98431]: Jun 11 23:08:05.881982 np0000002687 nova-compute[98431]: Jun 11 23:08:05.881982 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.881982 np0000002687 nova-compute[98431]: virtio-transitional Jun 11 23:08:05.881982 np0000002687 nova-compute[98431]: virtio-non-transitional Jun 11 23:08:05.883049 np0000002687 nova-compute[98431]: Jun 11 23:08:05.883049 np0000002687 nova-compute[98431]: Jun 11 23:08:05.883049 np0000002687 nova-compute[98431]: Jun 11 23:08:05.883049 np0000002687 nova-compute[98431]: Jun 11 23:08:05.883049 np0000002687 nova-compute[98431]: sdl Jun 11 23:08:05.883049 np0000002687 nova-compute[98431]: vnc Jun 11 23:08:05.883049 np0000002687 nova-compute[98431]: spice Jun 11 23:08:05.883049 np0000002687 nova-compute[98431]: egl-headless Jun 11 23:08:05.883049 np0000002687 nova-compute[98431]: dbus Jun 11 23:08:05.883049 np0000002687 nova-compute[98431]: Jun 11 23:08:05.883049 np0000002687 nova-compute[98431]: Jun 11 23:08:05.883049 np0000002687 nova-compute[98431]: Jun 11 23:08:05.883049 np0000002687 nova-compute[98431]: Jun 11 23:08:05.883049 np0000002687 nova-compute[98431]: Jun 11 23:08:05.883049 np0000002687 nova-compute[98431]: subsystem Jun 11 23:08:05.883049 np0000002687 nova-compute[98431]: Jun 11 23:08:05.883049 np0000002687 nova-compute[98431]: Jun 11 23:08:05.883049 np0000002687 nova-compute[98431]: default Jun 11 23:08:05.883049 np0000002687 nova-compute[98431]: mandatory Jun 11 23:08:05.883049 np0000002687 nova-compute[98431]: requisite Jun 11 23:08:05.883049 np0000002687 nova-compute[98431]: optional Jun 11 23:08:05.883049 np0000002687 nova-compute[98431]: Jun 11 23:08:05.883049 np0000002687 nova-compute[98431]: Jun 11 23:08:05.883049 np0000002687 nova-compute[98431]: usb Jun 11 23:08:05.883049 np0000002687 nova-compute[98431]: pci Jun 11 23:08:05.883049 np0000002687 nova-compute[98431]: scsi Jun 11 23:08:05.883049 np0000002687 nova-compute[98431]: Jun 11 23:08:05.883049 np0000002687 nova-compute[98431]: Jun 11 23:08:05.883049 np0000002687 nova-compute[98431]: Jun 11 23:08:05.883049 np0000002687 nova-compute[98431]: Jun 11 23:08:05.883049 np0000002687 nova-compute[98431]: Jun 11 23:08:05.883049 np0000002687 nova-compute[98431]: Jun 11 23:08:05.883049 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.883049 np0000002687 nova-compute[98431]: virtio-transitional Jun 11 23:08:05.883049 np0000002687 nova-compute[98431]: virtio-non-transitional Jun 11 23:08:05.883049 np0000002687 nova-compute[98431]: Jun 11 23:08:05.883049 np0000002687 nova-compute[98431]: Jun 11 23:08:05.883049 np0000002687 nova-compute[98431]: random Jun 11 23:08:05.883049 np0000002687 nova-compute[98431]: egd Jun 11 23:08:05.883049 np0000002687 nova-compute[98431]: builtin Jun 11 23:08:05.883049 np0000002687 nova-compute[98431]: Jun 11 23:08:05.883049 np0000002687 nova-compute[98431]: Jun 11 23:08:05.883049 np0000002687 nova-compute[98431]: Jun 11 23:08:05.883049 np0000002687 nova-compute[98431]: Jun 11 23:08:05.883049 np0000002687 nova-compute[98431]: path Jun 11 23:08:05.883049 np0000002687 nova-compute[98431]: handle Jun 11 23:08:05.883049 np0000002687 nova-compute[98431]: virtiofs Jun 11 23:08:05.883049 np0000002687 nova-compute[98431]: Jun 11 23:08:05.883049 np0000002687 nova-compute[98431]: Jun 11 23:08:05.883049 np0000002687 nova-compute[98431]: Jun 11 23:08:05.883049 np0000002687 nova-compute[98431]: Jun 11 23:08:05.883049 np0000002687 nova-compute[98431]: tpm-spapr Jun 11 23:08:05.883049 np0000002687 nova-compute[98431]: spapr-tpm-proxy Jun 11 23:08:05.883049 np0000002687 nova-compute[98431]: Jun 11 23:08:05.883049 np0000002687 nova-compute[98431]: Jun 11 23:08:05.883049 np0000002687 nova-compute[98431]: passthrough Jun 11 23:08:05.883049 np0000002687 nova-compute[98431]: emulator Jun 11 23:08:05.883049 np0000002687 nova-compute[98431]: external Jun 11 23:08:05.883049 np0000002687 nova-compute[98431]: Jun 11 23:08:05.883049 np0000002687 nova-compute[98431]: Jun 11 23:08:05.883049 np0000002687 nova-compute[98431]: 1.2 Jun 11 23:08:05.883049 np0000002687 nova-compute[98431]: 2.0 Jun 11 23:08:05.883049 np0000002687 nova-compute[98431]: Jun 11 23:08:05.883049 np0000002687 nova-compute[98431]: Jun 11 23:08:05.883049 np0000002687 nova-compute[98431]: Jun 11 23:08:05.883049 np0000002687 nova-compute[98431]: Jun 11 23:08:05.883049 np0000002687 nova-compute[98431]: usb Jun 11 23:08:05.883049 np0000002687 nova-compute[98431]: Jun 11 23:08:05.883049 np0000002687 nova-compute[98431]: Jun 11 23:08:05.883049 np0000002687 nova-compute[98431]: Jun 11 23:08:05.883049 np0000002687 nova-compute[98431]: Jun 11 23:08:05.884497 np0000002687 nova-compute[98431]: pty Jun 11 23:08:05.884497 np0000002687 nova-compute[98431]: unix Jun 11 23:08:05.884497 np0000002687 nova-compute[98431]: spicevmc Jun 11 23:08:05.884497 np0000002687 nova-compute[98431]: Jun 11 23:08:05.884497 np0000002687 nova-compute[98431]: Jun 11 23:08:05.884497 np0000002687 nova-compute[98431]: Jun 11 23:08:05.884497 np0000002687 nova-compute[98431]: Jun 11 23:08:05.884497 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.884497 np0000002687 nova-compute[98431]: Jun 11 23:08:05.884497 np0000002687 nova-compute[98431]: Jun 11 23:08:05.884497 np0000002687 nova-compute[98431]: qemu Jun 11 23:08:05.884497 np0000002687 nova-compute[98431]: Jun 11 23:08:05.884497 np0000002687 nova-compute[98431]: Jun 11 23:08:05.884497 np0000002687 nova-compute[98431]: builtin Jun 11 23:08:05.884497 np0000002687 nova-compute[98431]: Jun 11 23:08:05.884497 np0000002687 nova-compute[98431]: Jun 11 23:08:05.884497 np0000002687 nova-compute[98431]: Jun 11 23:08:05.884497 np0000002687 nova-compute[98431]: Jun 11 23:08:05.884497 np0000002687 nova-compute[98431]: Jun 11 23:08:05.884497 np0000002687 nova-compute[98431]: Jun 11 23:08:05.884497 np0000002687 nova-compute[98431]: Jun 11 23:08:05.884497 np0000002687 nova-compute[98431]: Jun 11 23:08:05.884497 np0000002687 nova-compute[98431]: Jun 11 23:08:05.884497 np0000002687 nova-compute[98431]: Jun 11 23:08:05.884497 np0000002687 nova-compute[98431]: Jun 11 23:08:05.884497 np0000002687 nova-compute[98431]: Jun 11 23:08:05.884497 np0000002687 nova-compute[98431]: Jun 11 23:08:05.884497 np0000002687 nova-compute[98431]: Jun 11 23:08:05.884497 np0000002687 nova-compute[98431]: {{(pid=98431) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 11 23:08:05.884497 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=98431) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 11 23:08:05.884497 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] Libvirt host hypervisor capabilities for arch=ppc64le and machine_type=powernv: Jun 11 23:08:05.884497 np0000002687 nova-compute[98431]: Jun 11 23:08:05.884497 np0000002687 nova-compute[98431]: /usr/bin/qemu-system-ppc64le Jun 11 23:08:05.884497 np0000002687 nova-compute[98431]: qemu Jun 11 23:08:05.884497 np0000002687 nova-compute[98431]: powernv9 Jun 11 23:08:05.884497 np0000002687 nova-compute[98431]: ppc64le Jun 11 23:08:05.884497 np0000002687 nova-compute[98431]: Jun 11 23:08:05.884497 np0000002687 nova-compute[98431]: Jun 11 23:08:05.884497 np0000002687 nova-compute[98431]: Jun 11 23:08:05.884497 np0000002687 nova-compute[98431]: Jun 11 23:08:05.884497 np0000002687 nova-compute[98431]: Jun 11 23:08:05.884497 np0000002687 nova-compute[98431]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 11 23:08:05.884497 np0000002687 nova-compute[98431]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 11 23:08:05.884497 np0000002687 nova-compute[98431]: Jun 11 23:08:05.884497 np0000002687 nova-compute[98431]: rom Jun 11 23:08:05.884497 np0000002687 nova-compute[98431]: pflash Jun 11 23:08:05.884497 np0000002687 nova-compute[98431]: Jun 11 23:08:05.884497 np0000002687 nova-compute[98431]: Jun 11 23:08:05.884497 np0000002687 nova-compute[98431]: yes Jun 11 23:08:05.884497 np0000002687 nova-compute[98431]: no Jun 11 23:08:05.884497 np0000002687 nova-compute[98431]: Jun 11 23:08:05.884497 np0000002687 nova-compute[98431]: Jun 11 23:08:05.884497 np0000002687 nova-compute[98431]: no Jun 11 23:08:05.884497 np0000002687 nova-compute[98431]: Jun 11 23:08:05.884497 np0000002687 nova-compute[98431]: Jun 11 23:08:05.884497 np0000002687 nova-compute[98431]: Jun 11 23:08:05.884497 np0000002687 nova-compute[98431]: Jun 11 23:08:05.884497 np0000002687 nova-compute[98431]: Jun 11 23:08:05.884497 np0000002687 nova-compute[98431]: Jun 11 23:08:05.885534 np0000002687 nova-compute[98431]: Jun 11 23:08:05.885534 np0000002687 nova-compute[98431]: Jun 11 23:08:05.885534 np0000002687 nova-compute[98431]: POWER10 Jun 11 23:08:05.885534 np0000002687 nova-compute[98431]: POWER9 Jun 11 23:08:05.885534 np0000002687 nova-compute[98431]: POWER8 Jun 11 23:08:05.885534 np0000002687 nova-compute[98431]: POWER7 Jun 11 23:08:05.885534 np0000002687 nova-compute[98431]: Jun 11 23:08:05.885534 np0000002687 nova-compute[98431]: Jun 11 23:08:05.885534 np0000002687 nova-compute[98431]: Jun 11 23:08:05.885534 np0000002687 nova-compute[98431]: Jun 11 23:08:05.885534 np0000002687 nova-compute[98431]: file Jun 11 23:08:05.885534 np0000002687 nova-compute[98431]: anonymous Jun 11 23:08:05.885534 np0000002687 nova-compute[98431]: memfd Jun 11 23:08:05.885534 np0000002687 nova-compute[98431]: Jun 11 23:08:05.885534 np0000002687 nova-compute[98431]: Jun 11 23:08:05.885534 np0000002687 nova-compute[98431]: Jun 11 23:08:05.885534 np0000002687 nova-compute[98431]: Jun 11 23:08:05.885534 np0000002687 nova-compute[98431]: Jun 11 23:08:05.885534 np0000002687 nova-compute[98431]: disk Jun 11 23:08:05.885534 np0000002687 nova-compute[98431]: cdrom Jun 11 23:08:05.885534 np0000002687 nova-compute[98431]: floppy Jun 11 23:08:05.885534 np0000002687 nova-compute[98431]: lun Jun 11 23:08:05.885534 np0000002687 nova-compute[98431]: Jun 11 23:08:05.885534 np0000002687 nova-compute[98431]: Jun 11 23:08:05.885534 np0000002687 nova-compute[98431]: fdc Jun 11 23:08:05.885534 np0000002687 nova-compute[98431]: scsi Jun 11 23:08:05.885534 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.885534 np0000002687 nova-compute[98431]: usb Jun 11 23:08:05.885534 np0000002687 nova-compute[98431]: sata Jun 11 23:08:05.885534 np0000002687 nova-compute[98431]: Jun 11 23:08:05.885534 np0000002687 nova-compute[98431]: Jun 11 23:08:05.885534 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.885534 np0000002687 nova-compute[98431]: virtio-transitional Jun 11 23:08:05.885534 np0000002687 nova-compute[98431]: virtio-non-transitional Jun 11 23:08:05.885534 np0000002687 nova-compute[98431]: Jun 11 23:08:05.885534 np0000002687 nova-compute[98431]: Jun 11 23:08:05.885534 np0000002687 nova-compute[98431]: Jun 11 23:08:05.885534 np0000002687 nova-compute[98431]: Jun 11 23:08:05.885534 np0000002687 nova-compute[98431]: sdl Jun 11 23:08:05.885534 np0000002687 nova-compute[98431]: vnc Jun 11 23:08:05.885534 np0000002687 nova-compute[98431]: spice Jun 11 23:08:05.885534 np0000002687 nova-compute[98431]: egl-headless Jun 11 23:08:05.885534 np0000002687 nova-compute[98431]: dbus Jun 11 23:08:05.885534 np0000002687 nova-compute[98431]: Jun 11 23:08:05.885534 np0000002687 nova-compute[98431]: Jun 11 23:08:05.885534 np0000002687 nova-compute[98431]: Jun 11 23:08:05.885534 np0000002687 nova-compute[98431]: Jun 11 23:08:05.885534 np0000002687 nova-compute[98431]: Jun 11 23:08:05.885534 np0000002687 nova-compute[98431]: subsystem Jun 11 23:08:05.885534 np0000002687 nova-compute[98431]: Jun 11 23:08:05.885534 np0000002687 nova-compute[98431]: Jun 11 23:08:05.885534 np0000002687 nova-compute[98431]: default Jun 11 23:08:05.885534 np0000002687 nova-compute[98431]: mandatory Jun 11 23:08:05.885534 np0000002687 nova-compute[98431]: requisite Jun 11 23:08:05.885534 np0000002687 nova-compute[98431]: optional Jun 11 23:08:05.885534 np0000002687 nova-compute[98431]: Jun 11 23:08:05.885534 np0000002687 nova-compute[98431]: Jun 11 23:08:05.885534 np0000002687 nova-compute[98431]: usb Jun 11 23:08:05.885534 np0000002687 nova-compute[98431]: pci Jun 11 23:08:05.885534 np0000002687 nova-compute[98431]: scsi Jun 11 23:08:05.885534 np0000002687 nova-compute[98431]: Jun 11 23:08:05.885534 np0000002687 nova-compute[98431]: Jun 11 23:08:05.885534 np0000002687 nova-compute[98431]: Jun 11 23:08:05.885534 np0000002687 nova-compute[98431]: Jun 11 23:08:05.885534 np0000002687 nova-compute[98431]: Jun 11 23:08:05.886688 np0000002687 nova-compute[98431]: Jun 11 23:08:05.886688 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.886688 np0000002687 nova-compute[98431]: virtio-transitional Jun 11 23:08:05.886688 np0000002687 nova-compute[98431]: virtio-non-transitional Jun 11 23:08:05.886688 np0000002687 nova-compute[98431]: Jun 11 23:08:05.886688 np0000002687 nova-compute[98431]: Jun 11 23:08:05.886688 np0000002687 nova-compute[98431]: random Jun 11 23:08:05.886688 np0000002687 nova-compute[98431]: egd Jun 11 23:08:05.886688 np0000002687 nova-compute[98431]: builtin Jun 11 23:08:05.886688 np0000002687 nova-compute[98431]: Jun 11 23:08:05.886688 np0000002687 nova-compute[98431]: Jun 11 23:08:05.886688 np0000002687 nova-compute[98431]: Jun 11 23:08:05.886688 np0000002687 nova-compute[98431]: Jun 11 23:08:05.886688 np0000002687 nova-compute[98431]: path Jun 11 23:08:05.886688 np0000002687 nova-compute[98431]: handle Jun 11 23:08:05.886688 np0000002687 nova-compute[98431]: virtiofs Jun 11 23:08:05.886688 np0000002687 nova-compute[98431]: Jun 11 23:08:05.886688 np0000002687 nova-compute[98431]: Jun 11 23:08:05.886688 np0000002687 nova-compute[98431]: Jun 11 23:08:05.886688 np0000002687 nova-compute[98431]: Jun 11 23:08:05.886688 np0000002687 nova-compute[98431]: tpm-spapr Jun 11 23:08:05.886688 np0000002687 nova-compute[98431]: spapr-tpm-proxy Jun 11 23:08:05.886688 np0000002687 nova-compute[98431]: Jun 11 23:08:05.886688 np0000002687 nova-compute[98431]: Jun 11 23:08:05.886688 np0000002687 nova-compute[98431]: passthrough Jun 11 23:08:05.886688 np0000002687 nova-compute[98431]: emulator Jun 11 23:08:05.886688 np0000002687 nova-compute[98431]: external Jun 11 23:08:05.886688 np0000002687 nova-compute[98431]: Jun 11 23:08:05.886688 np0000002687 nova-compute[98431]: Jun 11 23:08:05.886688 np0000002687 nova-compute[98431]: 1.2 Jun 11 23:08:05.886688 np0000002687 nova-compute[98431]: 2.0 Jun 11 23:08:05.886688 np0000002687 nova-compute[98431]: Jun 11 23:08:05.886688 np0000002687 nova-compute[98431]: Jun 11 23:08:05.886688 np0000002687 nova-compute[98431]: Jun 11 23:08:05.886688 np0000002687 nova-compute[98431]: Jun 11 23:08:05.886688 np0000002687 nova-compute[98431]: usb Jun 11 23:08:05.886688 np0000002687 nova-compute[98431]: Jun 11 23:08:05.886688 np0000002687 nova-compute[98431]: Jun 11 23:08:05.886688 np0000002687 nova-compute[98431]: Jun 11 23:08:05.886688 np0000002687 nova-compute[98431]: Jun 11 23:08:05.886688 np0000002687 nova-compute[98431]: pty Jun 11 23:08:05.886688 np0000002687 nova-compute[98431]: unix Jun 11 23:08:05.886688 np0000002687 nova-compute[98431]: spicevmc Jun 11 23:08:05.886688 np0000002687 nova-compute[98431]: Jun 11 23:08:05.886688 np0000002687 nova-compute[98431]: Jun 11 23:08:05.886688 np0000002687 nova-compute[98431]: Jun 11 23:08:05.886688 np0000002687 nova-compute[98431]: Jun 11 23:08:05.886688 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.886688 np0000002687 nova-compute[98431]: Jun 11 23:08:05.886688 np0000002687 nova-compute[98431]: Jun 11 23:08:05.886688 np0000002687 nova-compute[98431]: qemu Jun 11 23:08:05.886688 np0000002687 nova-compute[98431]: Jun 11 23:08:05.886688 np0000002687 nova-compute[98431]: Jun 11 23:08:05.886688 np0000002687 nova-compute[98431]: builtin Jun 11 23:08:05.886688 np0000002687 nova-compute[98431]: Jun 11 23:08:05.886688 np0000002687 nova-compute[98431]: Jun 11 23:08:05.886688 np0000002687 nova-compute[98431]: Jun 11 23:08:05.886688 np0000002687 nova-compute[98431]: Jun 11 23:08:05.886688 np0000002687 nova-compute[98431]: Jun 11 23:08:05.886688 np0000002687 nova-compute[98431]: Jun 11 23:08:05.886688 np0000002687 nova-compute[98431]: Jun 11 23:08:05.886688 np0000002687 nova-compute[98431]: Jun 11 23:08:05.886688 np0000002687 nova-compute[98431]: Jun 11 23:08:05.886688 np0000002687 nova-compute[98431]: Jun 11 23:08:05.886688 np0000002687 nova-compute[98431]: Jun 11 23:08:05.886688 np0000002687 nova-compute[98431]: Jun 11 23:08:05.886688 np0000002687 nova-compute[98431]: Jun 11 23:08:05.886688 np0000002687 nova-compute[98431]: Jun 11 23:08:05.886688 np0000002687 nova-compute[98431]: {{(pid=98431) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 11 23:08:05.886688 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] Libvirt host hypervisor capabilities for arch=ppc64le and machine_type=pseries: Jun 11 23:08:05.887904 np0000002687 nova-compute[98431]: Jun 11 23:08:05.887904 np0000002687 nova-compute[98431]: /usr/bin/qemu-system-ppc64le Jun 11 23:08:05.887904 np0000002687 nova-compute[98431]: qemu Jun 11 23:08:05.887904 np0000002687 nova-compute[98431]: pseries-noble Jun 11 23:08:05.887904 np0000002687 nova-compute[98431]: ppc64le Jun 11 23:08:05.887904 np0000002687 nova-compute[98431]: Jun 11 23:08:05.887904 np0000002687 nova-compute[98431]: Jun 11 23:08:05.887904 np0000002687 nova-compute[98431]: Jun 11 23:08:05.887904 np0000002687 nova-compute[98431]: Jun 11 23:08:05.887904 np0000002687 nova-compute[98431]: Jun 11 23:08:05.887904 np0000002687 nova-compute[98431]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 11 23:08:05.887904 np0000002687 nova-compute[98431]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 11 23:08:05.887904 np0000002687 nova-compute[98431]: Jun 11 23:08:05.887904 np0000002687 nova-compute[98431]: rom Jun 11 23:08:05.887904 np0000002687 nova-compute[98431]: pflash Jun 11 23:08:05.887904 np0000002687 nova-compute[98431]: Jun 11 23:08:05.887904 np0000002687 nova-compute[98431]: Jun 11 23:08:05.887904 np0000002687 nova-compute[98431]: yes Jun 11 23:08:05.887904 np0000002687 nova-compute[98431]: no Jun 11 23:08:05.887904 np0000002687 nova-compute[98431]: Jun 11 23:08:05.887904 np0000002687 nova-compute[98431]: Jun 11 23:08:05.887904 np0000002687 nova-compute[98431]: no Jun 11 23:08:05.887904 np0000002687 nova-compute[98431]: Jun 11 23:08:05.887904 np0000002687 nova-compute[98431]: Jun 11 23:08:05.887904 np0000002687 nova-compute[98431]: Jun 11 23:08:05.887904 np0000002687 nova-compute[98431]: Jun 11 23:08:05.887904 np0000002687 nova-compute[98431]: Jun 11 23:08:05.887904 np0000002687 nova-compute[98431]: Jun 11 23:08:05.887904 np0000002687 nova-compute[98431]: Jun 11 23:08:05.887904 np0000002687 nova-compute[98431]: Jun 11 23:08:05.887904 np0000002687 nova-compute[98431]: POWER10 Jun 11 23:08:05.887904 np0000002687 nova-compute[98431]: POWER9 Jun 11 23:08:05.887904 np0000002687 nova-compute[98431]: POWER8 Jun 11 23:08:05.887904 np0000002687 nova-compute[98431]: POWER7 Jun 11 23:08:05.887904 np0000002687 nova-compute[98431]: Jun 11 23:08:05.887904 np0000002687 nova-compute[98431]: Jun 11 23:08:05.887904 np0000002687 nova-compute[98431]: Jun 11 23:08:05.887904 np0000002687 nova-compute[98431]: Jun 11 23:08:05.887904 np0000002687 nova-compute[98431]: file Jun 11 23:08:05.887904 np0000002687 nova-compute[98431]: anonymous Jun 11 23:08:05.887904 np0000002687 nova-compute[98431]: memfd Jun 11 23:08:05.887904 np0000002687 nova-compute[98431]: Jun 11 23:08:05.887904 np0000002687 nova-compute[98431]: Jun 11 23:08:05.887904 np0000002687 nova-compute[98431]: Jun 11 23:08:05.887904 np0000002687 nova-compute[98431]: Jun 11 23:08:05.887904 np0000002687 nova-compute[98431]: Jun 11 23:08:05.887904 np0000002687 nova-compute[98431]: disk Jun 11 23:08:05.887904 np0000002687 nova-compute[98431]: cdrom Jun 11 23:08:05.887904 np0000002687 nova-compute[98431]: lun Jun 11 23:08:05.887904 np0000002687 nova-compute[98431]: Jun 11 23:08:05.887904 np0000002687 nova-compute[98431]: Jun 11 23:08:05.887904 np0000002687 nova-compute[98431]: scsi Jun 11 23:08:05.887904 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.887904 np0000002687 nova-compute[98431]: usb Jun 11 23:08:05.887904 np0000002687 nova-compute[98431]: sata Jun 11 23:08:05.887904 np0000002687 nova-compute[98431]: Jun 11 23:08:05.887904 np0000002687 nova-compute[98431]: Jun 11 23:08:05.887904 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.887904 np0000002687 nova-compute[98431]: virtio-transitional Jun 11 23:08:05.887904 np0000002687 nova-compute[98431]: virtio-non-transitional Jun 11 23:08:05.887904 np0000002687 nova-compute[98431]: Jun 11 23:08:05.887904 np0000002687 nova-compute[98431]: Jun 11 23:08:05.887904 np0000002687 nova-compute[98431]: Jun 11 23:08:05.887904 np0000002687 nova-compute[98431]: Jun 11 23:08:05.887904 np0000002687 nova-compute[98431]: sdl Jun 11 23:08:05.887904 np0000002687 nova-compute[98431]: vnc Jun 11 23:08:05.887904 np0000002687 nova-compute[98431]: spice Jun 11 23:08:05.887904 np0000002687 nova-compute[98431]: egl-headless Jun 11 23:08:05.887904 np0000002687 nova-compute[98431]: dbus Jun 11 23:08:05.887904 np0000002687 nova-compute[98431]: Jun 11 23:08:05.887904 np0000002687 nova-compute[98431]: Jun 11 23:08:05.887904 np0000002687 nova-compute[98431]: Jun 11 23:08:05.889372 np0000002687 nova-compute[98431]: Jun 11 23:08:05.889372 np0000002687 nova-compute[98431]: Jun 11 23:08:05.889372 np0000002687 nova-compute[98431]: subsystem Jun 11 23:08:05.889372 np0000002687 nova-compute[98431]: Jun 11 23:08:05.889372 np0000002687 nova-compute[98431]: Jun 11 23:08:05.889372 np0000002687 nova-compute[98431]: default Jun 11 23:08:05.889372 np0000002687 nova-compute[98431]: mandatory Jun 11 23:08:05.889372 np0000002687 nova-compute[98431]: requisite Jun 11 23:08:05.889372 np0000002687 nova-compute[98431]: optional Jun 11 23:08:05.889372 np0000002687 nova-compute[98431]: Jun 11 23:08:05.889372 np0000002687 nova-compute[98431]: Jun 11 23:08:05.889372 np0000002687 nova-compute[98431]: usb Jun 11 23:08:05.889372 np0000002687 nova-compute[98431]: pci Jun 11 23:08:05.889372 np0000002687 nova-compute[98431]: scsi Jun 11 23:08:05.889372 np0000002687 nova-compute[98431]: Jun 11 23:08:05.889372 np0000002687 nova-compute[98431]: Jun 11 23:08:05.889372 np0000002687 nova-compute[98431]: Jun 11 23:08:05.889372 np0000002687 nova-compute[98431]: Jun 11 23:08:05.889372 np0000002687 nova-compute[98431]: Jun 11 23:08:05.889372 np0000002687 nova-compute[98431]: Jun 11 23:08:05.889372 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.889372 np0000002687 nova-compute[98431]: virtio-transitional Jun 11 23:08:05.889372 np0000002687 nova-compute[98431]: virtio-non-transitional Jun 11 23:08:05.889372 np0000002687 nova-compute[98431]: Jun 11 23:08:05.889372 np0000002687 nova-compute[98431]: Jun 11 23:08:05.889372 np0000002687 nova-compute[98431]: random Jun 11 23:08:05.889372 np0000002687 nova-compute[98431]: egd Jun 11 23:08:05.889372 np0000002687 nova-compute[98431]: builtin Jun 11 23:08:05.889372 np0000002687 nova-compute[98431]: Jun 11 23:08:05.889372 np0000002687 nova-compute[98431]: Jun 11 23:08:05.889372 np0000002687 nova-compute[98431]: Jun 11 23:08:05.889372 np0000002687 nova-compute[98431]: Jun 11 23:08:05.889372 np0000002687 nova-compute[98431]: path Jun 11 23:08:05.889372 np0000002687 nova-compute[98431]: handle Jun 11 23:08:05.889372 np0000002687 nova-compute[98431]: virtiofs Jun 11 23:08:05.889372 np0000002687 nova-compute[98431]: Jun 11 23:08:05.889372 np0000002687 nova-compute[98431]: Jun 11 23:08:05.889372 np0000002687 nova-compute[98431]: Jun 11 23:08:05.889372 np0000002687 nova-compute[98431]: Jun 11 23:08:05.889372 np0000002687 nova-compute[98431]: tpm-spapr Jun 11 23:08:05.889372 np0000002687 nova-compute[98431]: spapr-tpm-proxy Jun 11 23:08:05.889372 np0000002687 nova-compute[98431]: Jun 11 23:08:05.889372 np0000002687 nova-compute[98431]: Jun 11 23:08:05.889372 np0000002687 nova-compute[98431]: passthrough Jun 11 23:08:05.889372 np0000002687 nova-compute[98431]: emulator Jun 11 23:08:05.889372 np0000002687 nova-compute[98431]: external Jun 11 23:08:05.889372 np0000002687 nova-compute[98431]: Jun 11 23:08:05.889372 np0000002687 nova-compute[98431]: Jun 11 23:08:05.889372 np0000002687 nova-compute[98431]: 1.2 Jun 11 23:08:05.889372 np0000002687 nova-compute[98431]: 2.0 Jun 11 23:08:05.889372 np0000002687 nova-compute[98431]: Jun 11 23:08:05.889372 np0000002687 nova-compute[98431]: Jun 11 23:08:05.889372 np0000002687 nova-compute[98431]: Jun 11 23:08:05.889372 np0000002687 nova-compute[98431]: Jun 11 23:08:05.889372 np0000002687 nova-compute[98431]: usb Jun 11 23:08:05.889372 np0000002687 nova-compute[98431]: Jun 11 23:08:05.889372 np0000002687 nova-compute[98431]: Jun 11 23:08:05.889372 np0000002687 nova-compute[98431]: Jun 11 23:08:05.889372 np0000002687 nova-compute[98431]: Jun 11 23:08:05.889372 np0000002687 nova-compute[98431]: pty Jun 11 23:08:05.889372 np0000002687 nova-compute[98431]: unix Jun 11 23:08:05.889372 np0000002687 nova-compute[98431]: spicevmc Jun 11 23:08:05.889372 np0000002687 nova-compute[98431]: Jun 11 23:08:05.889372 np0000002687 nova-compute[98431]: Jun 11 23:08:05.889372 np0000002687 nova-compute[98431]: Jun 11 23:08:05.889372 np0000002687 nova-compute[98431]: Jun 11 23:08:05.889372 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.889372 np0000002687 nova-compute[98431]: Jun 11 23:08:05.889372 np0000002687 nova-compute[98431]: Jun 11 23:08:05.889372 np0000002687 nova-compute[98431]: qemu Jun 11 23:08:05.889372 np0000002687 nova-compute[98431]: Jun 11 23:08:05.890816 np0000002687 nova-compute[98431]: Jun 11 23:08:05.890816 np0000002687 nova-compute[98431]: builtin Jun 11 23:08:05.890816 np0000002687 nova-compute[98431]: Jun 11 23:08:05.890816 np0000002687 nova-compute[98431]: Jun 11 23:08:05.890816 np0000002687 nova-compute[98431]: Jun 11 23:08:05.890816 np0000002687 nova-compute[98431]: Jun 11 23:08:05.890816 np0000002687 nova-compute[98431]: Jun 11 23:08:05.890816 np0000002687 nova-compute[98431]: Jun 11 23:08:05.890816 np0000002687 nova-compute[98431]: Jun 11 23:08:05.890816 np0000002687 nova-compute[98431]: Jun 11 23:08:05.890816 np0000002687 nova-compute[98431]: Jun 11 23:08:05.890816 np0000002687 nova-compute[98431]: Jun 11 23:08:05.890816 np0000002687 nova-compute[98431]: Jun 11 23:08:05.890816 np0000002687 nova-compute[98431]: Jun 11 23:08:05.890816 np0000002687 nova-compute[98431]: Jun 11 23:08:05.890816 np0000002687 nova-compute[98431]: Jun 11 23:08:05.890816 np0000002687 nova-compute[98431]: {{(pid=98431) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 11 23:08:05.890816 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=98431) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 11 23:08:05.890816 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] Libvirt host hypervisor capabilities for arch=riscv32 and machine_type=None: Jun 11 23:08:05.890816 np0000002687 nova-compute[98431]: Jun 11 23:08:05.890816 np0000002687 nova-compute[98431]: /usr/bin/qemu-system-riscv32 Jun 11 23:08:05.890816 np0000002687 nova-compute[98431]: qemu Jun 11 23:08:05.890816 np0000002687 nova-compute[98431]: virt Jun 11 23:08:05.890816 np0000002687 nova-compute[98431]: riscv32 Jun 11 23:08:05.890816 np0000002687 nova-compute[98431]: Jun 11 23:08:05.890816 np0000002687 nova-compute[98431]: Jun 11 23:08:05.890816 np0000002687 nova-compute[98431]: Jun 11 23:08:05.890816 np0000002687 nova-compute[98431]: Jun 11 23:08:05.890816 np0000002687 nova-compute[98431]: Jun 11 23:08:05.890816 np0000002687 nova-compute[98431]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 11 23:08:05.890816 np0000002687 nova-compute[98431]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 11 23:08:05.890816 np0000002687 nova-compute[98431]: Jun 11 23:08:05.890816 np0000002687 nova-compute[98431]: rom Jun 11 23:08:05.890816 np0000002687 nova-compute[98431]: pflash Jun 11 23:08:05.890816 np0000002687 nova-compute[98431]: Jun 11 23:08:05.890816 np0000002687 nova-compute[98431]: Jun 11 23:08:05.890816 np0000002687 nova-compute[98431]: yes Jun 11 23:08:05.890816 np0000002687 nova-compute[98431]: no Jun 11 23:08:05.890816 np0000002687 nova-compute[98431]: Jun 11 23:08:05.890816 np0000002687 nova-compute[98431]: Jun 11 23:08:05.890816 np0000002687 nova-compute[98431]: no Jun 11 23:08:05.890816 np0000002687 nova-compute[98431]: Jun 11 23:08:05.890816 np0000002687 nova-compute[98431]: Jun 11 23:08:05.890816 np0000002687 nova-compute[98431]: Jun 11 23:08:05.890816 np0000002687 nova-compute[98431]: Jun 11 23:08:05.890816 np0000002687 nova-compute[98431]: Jun 11 23:08:05.890816 np0000002687 nova-compute[98431]: Jun 11 23:08:05.890816 np0000002687 nova-compute[98431]: Jun 11 23:08:05.890816 np0000002687 nova-compute[98431]: on Jun 11 23:08:05.890816 np0000002687 nova-compute[98431]: off Jun 11 23:08:05.890816 np0000002687 nova-compute[98431]: Jun 11 23:08:05.890816 np0000002687 nova-compute[98431]: Jun 11 23:08:05.890816 np0000002687 nova-compute[98431]: Jun 11 23:08:05.890816 np0000002687 nova-compute[98431]: Jun 11 23:08:05.890816 np0000002687 nova-compute[98431]: Jun 11 23:08:05.890816 np0000002687 nova-compute[98431]: Jun 11 23:08:05.890816 np0000002687 nova-compute[98431]: Jun 11 23:08:05.890816 np0000002687 nova-compute[98431]: file Jun 11 23:08:05.891775 np0000002687 nova-compute[98431]: anonymous Jun 11 23:08:05.891775 np0000002687 nova-compute[98431]: memfd Jun 11 23:08:05.891775 np0000002687 nova-compute[98431]: Jun 11 23:08:05.891775 np0000002687 nova-compute[98431]: Jun 11 23:08:05.891775 np0000002687 nova-compute[98431]: Jun 11 23:08:05.891775 np0000002687 nova-compute[98431]: Jun 11 23:08:05.891775 np0000002687 nova-compute[98431]: Jun 11 23:08:05.891775 np0000002687 nova-compute[98431]: disk Jun 11 23:08:05.891775 np0000002687 nova-compute[98431]: cdrom Jun 11 23:08:05.891775 np0000002687 nova-compute[98431]: floppy Jun 11 23:08:05.891775 np0000002687 nova-compute[98431]: lun Jun 11 23:08:05.891775 np0000002687 nova-compute[98431]: Jun 11 23:08:05.891775 np0000002687 nova-compute[98431]: Jun 11 23:08:05.891775 np0000002687 nova-compute[98431]: fdc Jun 11 23:08:05.891775 np0000002687 nova-compute[98431]: scsi Jun 11 23:08:05.891775 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.891775 np0000002687 nova-compute[98431]: usb Jun 11 23:08:05.891775 np0000002687 nova-compute[98431]: sata Jun 11 23:08:05.891775 np0000002687 nova-compute[98431]: Jun 11 23:08:05.891775 np0000002687 nova-compute[98431]: Jun 11 23:08:05.891775 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.891775 np0000002687 nova-compute[98431]: virtio-transitional Jun 11 23:08:05.891775 np0000002687 nova-compute[98431]: virtio-non-transitional Jun 11 23:08:05.891775 np0000002687 nova-compute[98431]: Jun 11 23:08:05.891775 np0000002687 nova-compute[98431]: Jun 11 23:08:05.891775 np0000002687 nova-compute[98431]: Jun 11 23:08:05.891775 np0000002687 nova-compute[98431]: Jun 11 23:08:05.891775 np0000002687 nova-compute[98431]: sdl Jun 11 23:08:05.891775 np0000002687 nova-compute[98431]: vnc Jun 11 23:08:05.891775 np0000002687 nova-compute[98431]: spice Jun 11 23:08:05.891775 np0000002687 nova-compute[98431]: egl-headless Jun 11 23:08:05.891775 np0000002687 nova-compute[98431]: dbus Jun 11 23:08:05.891775 np0000002687 nova-compute[98431]: Jun 11 23:08:05.891775 np0000002687 nova-compute[98431]: Jun 11 23:08:05.891775 np0000002687 nova-compute[98431]: Jun 11 23:08:05.891775 np0000002687 nova-compute[98431]: Jun 11 23:08:05.891775 np0000002687 nova-compute[98431]: Jun 11 23:08:05.891775 np0000002687 nova-compute[98431]: subsystem Jun 11 23:08:05.891775 np0000002687 nova-compute[98431]: Jun 11 23:08:05.891775 np0000002687 nova-compute[98431]: Jun 11 23:08:05.891775 np0000002687 nova-compute[98431]: default Jun 11 23:08:05.891775 np0000002687 nova-compute[98431]: mandatory Jun 11 23:08:05.891775 np0000002687 nova-compute[98431]: requisite Jun 11 23:08:05.891775 np0000002687 nova-compute[98431]: optional Jun 11 23:08:05.891775 np0000002687 nova-compute[98431]: Jun 11 23:08:05.891775 np0000002687 nova-compute[98431]: Jun 11 23:08:05.891775 np0000002687 nova-compute[98431]: usb Jun 11 23:08:05.891775 np0000002687 nova-compute[98431]: pci Jun 11 23:08:05.891775 np0000002687 nova-compute[98431]: scsi Jun 11 23:08:05.891775 np0000002687 nova-compute[98431]: Jun 11 23:08:05.891775 np0000002687 nova-compute[98431]: Jun 11 23:08:05.891775 np0000002687 nova-compute[98431]: Jun 11 23:08:05.891775 np0000002687 nova-compute[98431]: Jun 11 23:08:05.891775 np0000002687 nova-compute[98431]: Jun 11 23:08:05.891775 np0000002687 nova-compute[98431]: Jun 11 23:08:05.891775 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.891775 np0000002687 nova-compute[98431]: virtio-transitional Jun 11 23:08:05.891775 np0000002687 nova-compute[98431]: virtio-non-transitional Jun 11 23:08:05.891775 np0000002687 nova-compute[98431]: Jun 11 23:08:05.891775 np0000002687 nova-compute[98431]: Jun 11 23:08:05.891775 np0000002687 nova-compute[98431]: random Jun 11 23:08:05.891775 np0000002687 nova-compute[98431]: egd Jun 11 23:08:05.891775 np0000002687 nova-compute[98431]: builtin Jun 11 23:08:05.891775 np0000002687 nova-compute[98431]: Jun 11 23:08:05.891775 np0000002687 nova-compute[98431]: Jun 11 23:08:05.891775 np0000002687 nova-compute[98431]: Jun 11 23:08:05.891775 np0000002687 nova-compute[98431]: Jun 11 23:08:05.891775 np0000002687 nova-compute[98431]: path Jun 11 23:08:05.893001 np0000002687 nova-compute[98431]: handle Jun 11 23:08:05.893001 np0000002687 nova-compute[98431]: virtiofs Jun 11 23:08:05.893001 np0000002687 nova-compute[98431]: Jun 11 23:08:05.893001 np0000002687 nova-compute[98431]: Jun 11 23:08:05.893001 np0000002687 nova-compute[98431]: Jun 11 23:08:05.893001 np0000002687 nova-compute[98431]: Jun 11 23:08:05.893001 np0000002687 nova-compute[98431]: tpm-tis Jun 11 23:08:05.893001 np0000002687 nova-compute[98431]: Jun 11 23:08:05.893001 np0000002687 nova-compute[98431]: Jun 11 23:08:05.893001 np0000002687 nova-compute[98431]: passthrough Jun 11 23:08:05.893001 np0000002687 nova-compute[98431]: emulator Jun 11 23:08:05.893001 np0000002687 nova-compute[98431]: external Jun 11 23:08:05.893001 np0000002687 nova-compute[98431]: Jun 11 23:08:05.893001 np0000002687 nova-compute[98431]: Jun 11 23:08:05.893001 np0000002687 nova-compute[98431]: 1.2 Jun 11 23:08:05.893001 np0000002687 nova-compute[98431]: 2.0 Jun 11 23:08:05.893001 np0000002687 nova-compute[98431]: Jun 11 23:08:05.893001 np0000002687 nova-compute[98431]: Jun 11 23:08:05.893001 np0000002687 nova-compute[98431]: Jun 11 23:08:05.893001 np0000002687 nova-compute[98431]: Jun 11 23:08:05.893001 np0000002687 nova-compute[98431]: usb Jun 11 23:08:05.893001 np0000002687 nova-compute[98431]: Jun 11 23:08:05.893001 np0000002687 nova-compute[98431]: Jun 11 23:08:05.893001 np0000002687 nova-compute[98431]: Jun 11 23:08:05.893001 np0000002687 nova-compute[98431]: Jun 11 23:08:05.893001 np0000002687 nova-compute[98431]: pty Jun 11 23:08:05.893001 np0000002687 nova-compute[98431]: unix Jun 11 23:08:05.893001 np0000002687 nova-compute[98431]: spicevmc Jun 11 23:08:05.893001 np0000002687 nova-compute[98431]: Jun 11 23:08:05.893001 np0000002687 nova-compute[98431]: Jun 11 23:08:05.893001 np0000002687 nova-compute[98431]: Jun 11 23:08:05.893001 np0000002687 nova-compute[98431]: Jun 11 23:08:05.893001 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.893001 np0000002687 nova-compute[98431]: Jun 11 23:08:05.893001 np0000002687 nova-compute[98431]: Jun 11 23:08:05.893001 np0000002687 nova-compute[98431]: qemu Jun 11 23:08:05.893001 np0000002687 nova-compute[98431]: Jun 11 23:08:05.893001 np0000002687 nova-compute[98431]: Jun 11 23:08:05.893001 np0000002687 nova-compute[98431]: builtin Jun 11 23:08:05.893001 np0000002687 nova-compute[98431]: Jun 11 23:08:05.893001 np0000002687 nova-compute[98431]: Jun 11 23:08:05.893001 np0000002687 nova-compute[98431]: Jun 11 23:08:05.893001 np0000002687 nova-compute[98431]: Jun 11 23:08:05.893001 np0000002687 nova-compute[98431]: Jun 11 23:08:05.893001 np0000002687 nova-compute[98431]: Jun 11 23:08:05.893001 np0000002687 nova-compute[98431]: Jun 11 23:08:05.893001 np0000002687 nova-compute[98431]: Jun 11 23:08:05.893001 np0000002687 nova-compute[98431]: Jun 11 23:08:05.893001 np0000002687 nova-compute[98431]: Jun 11 23:08:05.893001 np0000002687 nova-compute[98431]: Jun 11 23:08:05.893001 np0000002687 nova-compute[98431]: Jun 11 23:08:05.893001 np0000002687 nova-compute[98431]: Jun 11 23:08:05.893001 np0000002687 nova-compute[98431]: Jun 11 23:08:05.893001 np0000002687 nova-compute[98431]: {{(pid=98431) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 11 23:08:05.893001 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=98431) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 11 23:08:05.893001 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] Libvirt host hypervisor capabilities for arch=riscv64 and machine_type=None: Jun 11 23:08:05.893001 np0000002687 nova-compute[98431]: Jun 11 23:08:05.893001 np0000002687 nova-compute[98431]: /usr/bin/qemu-system-riscv64 Jun 11 23:08:05.893001 np0000002687 nova-compute[98431]: qemu Jun 11 23:08:05.893001 np0000002687 nova-compute[98431]: virt Jun 11 23:08:05.893001 np0000002687 nova-compute[98431]: riscv64 Jun 11 23:08:05.893001 np0000002687 nova-compute[98431]: Jun 11 23:08:05.893984 np0000002687 nova-compute[98431]: Jun 11 23:08:05.893984 np0000002687 nova-compute[98431]: Jun 11 23:08:05.893984 np0000002687 nova-compute[98431]: Jun 11 23:08:05.893984 np0000002687 nova-compute[98431]: Jun 11 23:08:05.893984 np0000002687 nova-compute[98431]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 11 23:08:05.893984 np0000002687 nova-compute[98431]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 11 23:08:05.893984 np0000002687 nova-compute[98431]: Jun 11 23:08:05.893984 np0000002687 nova-compute[98431]: rom Jun 11 23:08:05.893984 np0000002687 nova-compute[98431]: pflash Jun 11 23:08:05.893984 np0000002687 nova-compute[98431]: Jun 11 23:08:05.893984 np0000002687 nova-compute[98431]: Jun 11 23:08:05.893984 np0000002687 nova-compute[98431]: yes Jun 11 23:08:05.893984 np0000002687 nova-compute[98431]: no Jun 11 23:08:05.893984 np0000002687 nova-compute[98431]: Jun 11 23:08:05.893984 np0000002687 nova-compute[98431]: Jun 11 23:08:05.893984 np0000002687 nova-compute[98431]: no Jun 11 23:08:05.893984 np0000002687 nova-compute[98431]: Jun 11 23:08:05.893984 np0000002687 nova-compute[98431]: Jun 11 23:08:05.893984 np0000002687 nova-compute[98431]: Jun 11 23:08:05.893984 np0000002687 nova-compute[98431]: Jun 11 23:08:05.893984 np0000002687 nova-compute[98431]: Jun 11 23:08:05.893984 np0000002687 nova-compute[98431]: Jun 11 23:08:05.893984 np0000002687 nova-compute[98431]: Jun 11 23:08:05.893984 np0000002687 nova-compute[98431]: on Jun 11 23:08:05.893984 np0000002687 nova-compute[98431]: off Jun 11 23:08:05.893984 np0000002687 nova-compute[98431]: Jun 11 23:08:05.893984 np0000002687 nova-compute[98431]: Jun 11 23:08:05.893984 np0000002687 nova-compute[98431]: Jun 11 23:08:05.893984 np0000002687 nova-compute[98431]: Jun 11 23:08:05.893984 np0000002687 nova-compute[98431]: rv64 Jun 11 23:08:05.893984 np0000002687 nova-compute[98431]: sifive-e51 Jun 11 23:08:05.893984 np0000002687 nova-compute[98431]: any Jun 11 23:08:05.893984 np0000002687 nova-compute[98431]: x-rv128 Jun 11 23:08:05.893984 np0000002687 nova-compute[98431]: shakti-c Jun 11 23:08:05.893984 np0000002687 nova-compute[98431]: max Jun 11 23:08:05.893984 np0000002687 nova-compute[98431]: thead-c906 Jun 11 23:08:05.893984 np0000002687 nova-compute[98431]: sifive-u54 Jun 11 23:08:05.893984 np0000002687 nova-compute[98431]: veyron-v1 Jun 11 23:08:05.893984 np0000002687 nova-compute[98431]: Jun 11 23:08:05.893984 np0000002687 nova-compute[98431]: Jun 11 23:08:05.893984 np0000002687 nova-compute[98431]: Jun 11 23:08:05.893984 np0000002687 nova-compute[98431]: Jun 11 23:08:05.893984 np0000002687 nova-compute[98431]: file Jun 11 23:08:05.893984 np0000002687 nova-compute[98431]: anonymous Jun 11 23:08:05.893984 np0000002687 nova-compute[98431]: memfd Jun 11 23:08:05.893984 np0000002687 nova-compute[98431]: Jun 11 23:08:05.893984 np0000002687 nova-compute[98431]: Jun 11 23:08:05.893984 np0000002687 nova-compute[98431]: Jun 11 23:08:05.893984 np0000002687 nova-compute[98431]: Jun 11 23:08:05.893984 np0000002687 nova-compute[98431]: Jun 11 23:08:05.893984 np0000002687 nova-compute[98431]: disk Jun 11 23:08:05.893984 np0000002687 nova-compute[98431]: cdrom Jun 11 23:08:05.893984 np0000002687 nova-compute[98431]: floppy Jun 11 23:08:05.893984 np0000002687 nova-compute[98431]: lun Jun 11 23:08:05.893984 np0000002687 nova-compute[98431]: Jun 11 23:08:05.893984 np0000002687 nova-compute[98431]: Jun 11 23:08:05.893984 np0000002687 nova-compute[98431]: fdc Jun 11 23:08:05.893984 np0000002687 nova-compute[98431]: scsi Jun 11 23:08:05.893984 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.893984 np0000002687 nova-compute[98431]: usb Jun 11 23:08:05.893984 np0000002687 nova-compute[98431]: sata Jun 11 23:08:05.893984 np0000002687 nova-compute[98431]: Jun 11 23:08:05.893984 np0000002687 nova-compute[98431]: Jun 11 23:08:05.893984 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.893984 np0000002687 nova-compute[98431]: virtio-transitional Jun 11 23:08:05.895048 np0000002687 nova-compute[98431]: virtio-non-transitional Jun 11 23:08:05.895048 np0000002687 nova-compute[98431]: Jun 11 23:08:05.895048 np0000002687 nova-compute[98431]: Jun 11 23:08:05.895048 np0000002687 nova-compute[98431]: Jun 11 23:08:05.895048 np0000002687 nova-compute[98431]: Jun 11 23:08:05.895048 np0000002687 nova-compute[98431]: sdl Jun 11 23:08:05.895048 np0000002687 nova-compute[98431]: vnc Jun 11 23:08:05.895048 np0000002687 nova-compute[98431]: spice Jun 11 23:08:05.895048 np0000002687 nova-compute[98431]: egl-headless Jun 11 23:08:05.895048 np0000002687 nova-compute[98431]: dbus Jun 11 23:08:05.895048 np0000002687 nova-compute[98431]: Jun 11 23:08:05.895048 np0000002687 nova-compute[98431]: Jun 11 23:08:05.895048 np0000002687 nova-compute[98431]: Jun 11 23:08:05.895048 np0000002687 nova-compute[98431]: Jun 11 23:08:05.895048 np0000002687 nova-compute[98431]: Jun 11 23:08:05.895048 np0000002687 nova-compute[98431]: subsystem Jun 11 23:08:05.895048 np0000002687 nova-compute[98431]: Jun 11 23:08:05.895048 np0000002687 nova-compute[98431]: Jun 11 23:08:05.895048 np0000002687 nova-compute[98431]: default Jun 11 23:08:05.895048 np0000002687 nova-compute[98431]: mandatory Jun 11 23:08:05.895048 np0000002687 nova-compute[98431]: requisite Jun 11 23:08:05.895048 np0000002687 nova-compute[98431]: optional Jun 11 23:08:05.895048 np0000002687 nova-compute[98431]: Jun 11 23:08:05.895048 np0000002687 nova-compute[98431]: Jun 11 23:08:05.895048 np0000002687 nova-compute[98431]: usb Jun 11 23:08:05.895048 np0000002687 nova-compute[98431]: pci Jun 11 23:08:05.895048 np0000002687 nova-compute[98431]: scsi Jun 11 23:08:05.895048 np0000002687 nova-compute[98431]: Jun 11 23:08:05.895048 np0000002687 nova-compute[98431]: Jun 11 23:08:05.895048 np0000002687 nova-compute[98431]: Jun 11 23:08:05.895048 np0000002687 nova-compute[98431]: Jun 11 23:08:05.895048 np0000002687 nova-compute[98431]: Jun 11 23:08:05.895048 np0000002687 nova-compute[98431]: Jun 11 23:08:05.895048 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.895048 np0000002687 nova-compute[98431]: virtio-transitional Jun 11 23:08:05.895048 np0000002687 nova-compute[98431]: virtio-non-transitional Jun 11 23:08:05.895048 np0000002687 nova-compute[98431]: Jun 11 23:08:05.895048 np0000002687 nova-compute[98431]: Jun 11 23:08:05.895048 np0000002687 nova-compute[98431]: random Jun 11 23:08:05.895048 np0000002687 nova-compute[98431]: egd Jun 11 23:08:05.895048 np0000002687 nova-compute[98431]: builtin Jun 11 23:08:05.895048 np0000002687 nova-compute[98431]: Jun 11 23:08:05.895048 np0000002687 nova-compute[98431]: Jun 11 23:08:05.895048 np0000002687 nova-compute[98431]: Jun 11 23:08:05.895048 np0000002687 nova-compute[98431]: Jun 11 23:08:05.895048 np0000002687 nova-compute[98431]: path Jun 11 23:08:05.895048 np0000002687 nova-compute[98431]: handle Jun 11 23:08:05.895048 np0000002687 nova-compute[98431]: virtiofs Jun 11 23:08:05.895048 np0000002687 nova-compute[98431]: Jun 11 23:08:05.895048 np0000002687 nova-compute[98431]: Jun 11 23:08:05.895048 np0000002687 nova-compute[98431]: Jun 11 23:08:05.895048 np0000002687 nova-compute[98431]: Jun 11 23:08:05.895048 np0000002687 nova-compute[98431]: tpm-tis Jun 11 23:08:05.895048 np0000002687 nova-compute[98431]: Jun 11 23:08:05.895048 np0000002687 nova-compute[98431]: Jun 11 23:08:05.895048 np0000002687 nova-compute[98431]: passthrough Jun 11 23:08:05.895048 np0000002687 nova-compute[98431]: emulator Jun 11 23:08:05.895048 np0000002687 nova-compute[98431]: external Jun 11 23:08:05.895048 np0000002687 nova-compute[98431]: Jun 11 23:08:05.895048 np0000002687 nova-compute[98431]: Jun 11 23:08:05.895048 np0000002687 nova-compute[98431]: 1.2 Jun 11 23:08:05.895048 np0000002687 nova-compute[98431]: 2.0 Jun 11 23:08:05.895048 np0000002687 nova-compute[98431]: Jun 11 23:08:05.895048 np0000002687 nova-compute[98431]: Jun 11 23:08:05.895048 np0000002687 nova-compute[98431]: Jun 11 23:08:05.895048 np0000002687 nova-compute[98431]: Jun 11 23:08:05.895048 np0000002687 nova-compute[98431]: usb Jun 11 23:08:05.895048 np0000002687 nova-compute[98431]: Jun 11 23:08:05.895048 np0000002687 nova-compute[98431]: Jun 11 23:08:05.896267 np0000002687 nova-compute[98431]: Jun 11 23:08:05.896267 np0000002687 nova-compute[98431]: Jun 11 23:08:05.896267 np0000002687 nova-compute[98431]: pty Jun 11 23:08:05.896267 np0000002687 nova-compute[98431]: unix Jun 11 23:08:05.896267 np0000002687 nova-compute[98431]: spicevmc Jun 11 23:08:05.896267 np0000002687 nova-compute[98431]: Jun 11 23:08:05.896267 np0000002687 nova-compute[98431]: Jun 11 23:08:05.896267 np0000002687 nova-compute[98431]: Jun 11 23:08:05.896267 np0000002687 nova-compute[98431]: Jun 11 23:08:05.896267 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.896267 np0000002687 nova-compute[98431]: Jun 11 23:08:05.896267 np0000002687 nova-compute[98431]: Jun 11 23:08:05.896267 np0000002687 nova-compute[98431]: qemu Jun 11 23:08:05.896267 np0000002687 nova-compute[98431]: Jun 11 23:08:05.896267 np0000002687 nova-compute[98431]: Jun 11 23:08:05.896267 np0000002687 nova-compute[98431]: builtin Jun 11 23:08:05.896267 np0000002687 nova-compute[98431]: Jun 11 23:08:05.896267 np0000002687 nova-compute[98431]: Jun 11 23:08:05.896267 np0000002687 nova-compute[98431]: Jun 11 23:08:05.896267 np0000002687 nova-compute[98431]: Jun 11 23:08:05.896267 np0000002687 nova-compute[98431]: Jun 11 23:08:05.896267 np0000002687 nova-compute[98431]: Jun 11 23:08:05.896267 np0000002687 nova-compute[98431]: Jun 11 23:08:05.896267 np0000002687 nova-compute[98431]: Jun 11 23:08:05.896267 np0000002687 nova-compute[98431]: Jun 11 23:08:05.896267 np0000002687 nova-compute[98431]: Jun 11 23:08:05.896267 np0000002687 nova-compute[98431]: Jun 11 23:08:05.896267 np0000002687 nova-compute[98431]: Jun 11 23:08:05.896267 np0000002687 nova-compute[98431]: Jun 11 23:08:05.896267 np0000002687 nova-compute[98431]: Jun 11 23:08:05.896267 np0000002687 nova-compute[98431]: {{(pid=98431) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 11 23:08:05.896267 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=98431) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 11 23:08:05.896267 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] Libvirt host hypervisor capabilities for arch=s390x and machine_type=s390-ccw-virtio: Jun 11 23:08:05.896267 np0000002687 nova-compute[98431]: Jun 11 23:08:05.896267 np0000002687 nova-compute[98431]: /usr/bin/qemu-system-s390x Jun 11 23:08:05.896267 np0000002687 nova-compute[98431]: qemu Jun 11 23:08:05.896267 np0000002687 nova-compute[98431]: s390-ccw-virtio-noble Jun 11 23:08:05.896267 np0000002687 nova-compute[98431]: s390x Jun 11 23:08:05.896267 np0000002687 nova-compute[98431]: Jun 11 23:08:05.896267 np0000002687 nova-compute[98431]: Jun 11 23:08:05.896267 np0000002687 nova-compute[98431]: Jun 11 23:08:05.896267 np0000002687 nova-compute[98431]: Jun 11 23:08:05.896267 np0000002687 nova-compute[98431]: Jun 11 23:08:05.896267 np0000002687 nova-compute[98431]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 11 23:08:05.896267 np0000002687 nova-compute[98431]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 11 23:08:05.896267 np0000002687 nova-compute[98431]: Jun 11 23:08:05.896267 np0000002687 nova-compute[98431]: rom Jun 11 23:08:05.896267 np0000002687 nova-compute[98431]: pflash Jun 11 23:08:05.896267 np0000002687 nova-compute[98431]: Jun 11 23:08:05.896267 np0000002687 nova-compute[98431]: Jun 11 23:08:05.896267 np0000002687 nova-compute[98431]: yes Jun 11 23:08:05.896267 np0000002687 nova-compute[98431]: no Jun 11 23:08:05.896267 np0000002687 nova-compute[98431]: Jun 11 23:08:05.896267 np0000002687 nova-compute[98431]: Jun 11 23:08:05.896267 np0000002687 nova-compute[98431]: no Jun 11 23:08:05.896267 np0000002687 nova-compute[98431]: Jun 11 23:08:05.896267 np0000002687 nova-compute[98431]: Jun 11 23:08:05.896267 np0000002687 nova-compute[98431]: Jun 11 23:08:05.896267 np0000002687 nova-compute[98431]: Jun 11 23:08:05.897406 np0000002687 nova-compute[98431]: Jun 11 23:08:05.897406 np0000002687 nova-compute[98431]: Jun 11 23:08:05.897406 np0000002687 nova-compute[98431]: Jun 11 23:08:05.897406 np0000002687 nova-compute[98431]: on Jun 11 23:08:05.897406 np0000002687 nova-compute[98431]: off Jun 11 23:08:05.897406 np0000002687 nova-compute[98431]: Jun 11 23:08:05.897406 np0000002687 nova-compute[98431]: Jun 11 23:08:05.897406 np0000002687 nova-compute[98431]: Jun 11 23:08:05.897406 np0000002687 nova-compute[98431]: Jun 11 23:08:05.897406 np0000002687 nova-compute[98431]: z13 Jun 11 23:08:05.897406 np0000002687 nova-compute[98431]: z990.3 Jun 11 23:08:05.897406 np0000002687 nova-compute[98431]: z13-base Jun 11 23:08:05.897406 np0000002687 nova-compute[98431]: z990.2 Jun 11 23:08:05.897406 np0000002687 nova-compute[98431]: z196.2-base Jun 11 23:08:05.897406 np0000002687 nova-compute[98431]: z14 Jun 11 23:08:05.897406 np0000002687 nova-compute[98431]: z14.2-base Jun 11 23:08:05.897406 np0000002687 nova-compute[98431]: z990.4 Jun 11 23:08:05.897406 np0000002687 nova-compute[98431]: z196 Jun 11 23:08:05.897406 np0000002687 nova-compute[98431]: z10BC.2-base Jun 11 23:08:05.897406 np0000002687 nova-compute[98431]: z114-base Jun 11 23:08:05.897406 np0000002687 nova-compute[98431]: gen16b Jun 11 23:08:05.897406 np0000002687 nova-compute[98431]: z890.3-base Jun 11 23:08:05.897406 np0000002687 nova-compute[98431]: gen16a Jun 11 23:08:05.897406 np0000002687 nova-compute[98431]: z990.5 Jun 11 23:08:05.897406 np0000002687 nova-compute[98431]: z196.2 Jun 11 23:08:05.897406 np0000002687 nova-compute[98431]: zEC12 Jun 11 23:08:05.897406 np0000002687 nova-compute[98431]: zEC12.2 Jun 11 23:08:05.897406 np0000002687 nova-compute[98431]: z9EC.2 Jun 11 23:08:05.897406 np0000002687 nova-compute[98431]: z9BC Jun 11 23:08:05.897406 np0000002687 nova-compute[98431]: z9EC.3-base Jun 11 23:08:05.897406 np0000002687 nova-compute[98431]: z800-base Jun 11 23:08:05.897406 np0000002687 nova-compute[98431]: z14ZR1-base Jun 11 23:08:05.897406 np0000002687 nova-compute[98431]: z890 Jun 11 23:08:05.897406 np0000002687 nova-compute[98431]: z990.4-base Jun 11 23:08:05.897406 np0000002687 nova-compute[98431]: z9EC.3 Jun 11 23:08:05.897406 np0000002687 nova-compute[98431]: z13.2 Jun 11 23:08:05.897406 np0000002687 nova-compute[98431]: z10BC.2 Jun 11 23:08:05.897406 np0000002687 nova-compute[98431]: gen15a-base Jun 11 23:08:05.897406 np0000002687 nova-compute[98431]: z14.2 Jun 11 23:08:05.897406 np0000002687 nova-compute[98431]: zBC12-base Jun 11 23:08:05.897406 np0000002687 nova-compute[98431]: gen16a-base Jun 11 23:08:05.898465 np0000002687 nova-compute[98431]: z900.3 Jun 11 23:08:05.898465 np0000002687 nova-compute[98431]: z196-base Jun 11 23:08:05.898465 np0000002687 nova-compute[98431]: z990 Jun 11 23:08:05.898465 np0000002687 nova-compute[98431]: z14-base Jun 11 23:08:05.898465 np0000002687 nova-compute[98431]: z900.2 Jun 11 23:08:05.898465 np0000002687 nova-compute[98431]: z800 Jun 11 23:08:05.898465 np0000002687 nova-compute[98431]: z10EC Jun 11 23:08:05.898465 np0000002687 nova-compute[98431]: z14ZR1 Jun 11 23:08:05.898465 np0000002687 nova-compute[98431]: z900 Jun 11 23:08:05.898465 np0000002687 nova-compute[98431]: z10EC.2 Jun 11 23:08:05.898465 np0000002687 nova-compute[98431]: z10EC.2-base Jun 11 23:08:05.898465 np0000002687 nova-compute[98431]: z900.2-base Jun 11 23:08:05.898465 np0000002687 nova-compute[98431]: z900-base Jun 11 23:08:05.898465 np0000002687 nova-compute[98431]: z10EC.3 Jun 11 23:08:05.898465 np0000002687 nova-compute[98431]: z990.5-base Jun 11 23:08:05.898465 np0000002687 nova-compute[98431]: max Jun 11 23:08:05.898465 np0000002687 nova-compute[98431]: gen15b Jun 11 23:08:05.898465 np0000002687 nova-compute[98431]: z9BC.2-base Jun 11 23:08:05.898465 np0000002687 nova-compute[98431]: gen15a Jun 11 23:08:05.898465 np0000002687 nova-compute[98431]: z990.2-base Jun 11 23:08:05.898465 np0000002687 nova-compute[98431]: z10EC-base Jun 11 23:08:05.898465 np0000002687 nova-compute[98431]: gen16b-base Jun 11 23:08:05.898465 np0000002687 nova-compute[98431]: z114 Jun 11 23:08:05.898465 np0000002687 nova-compute[98431]: z9EC-base Jun 11 23:08:05.898465 np0000002687 nova-compute[98431]: z13s Jun 11 23:08:05.898465 np0000002687 nova-compute[98431]: qemu Jun 11 23:08:05.898465 np0000002687 nova-compute[98431]: gen15b-base Jun 11 23:08:05.898465 np0000002687 nova-compute[98431]: zEC12-base Jun 11 23:08:05.898465 np0000002687 nova-compute[98431]: z890.3 Jun 11 23:08:05.898465 np0000002687 nova-compute[98431]: z10EC.3-base Jun 11 23:08:05.898465 np0000002687 nova-compute[98431]: z890.2-base Jun 11 23:08:05.898465 np0000002687 nova-compute[98431]: z890.2 Jun 11 23:08:05.898465 np0000002687 nova-compute[98431]: z10BC-base Jun 11 23:08:05.898465 np0000002687 nova-compute[98431]: zEC12.2-base Jun 11 23:08:05.898465 np0000002687 nova-compute[98431]: z890-base Jun 11 23:08:05.898465 np0000002687 nova-compute[98431]: z9BC-base Jun 11 23:08:05.898465 np0000002687 nova-compute[98431]: z10BC Jun 11 23:08:05.899278 np0000002687 nova-compute[98431]: z9EC Jun 11 23:08:05.899278 np0000002687 nova-compute[98431]: z9EC.2-base Jun 11 23:08:05.899278 np0000002687 nova-compute[98431]: z13.2-base Jun 11 23:08:05.899278 np0000002687 nova-compute[98431]: z900.3-base Jun 11 23:08:05.899278 np0000002687 nova-compute[98431]: z990.3-base Jun 11 23:08:05.899278 np0000002687 nova-compute[98431]: z13s-base Jun 11 23:08:05.899278 np0000002687 nova-compute[98431]: zBC12 Jun 11 23:08:05.899278 np0000002687 nova-compute[98431]: z990-base Jun 11 23:08:05.899278 np0000002687 nova-compute[98431]: z9BC.2 Jun 11 23:08:05.899278 np0000002687 nova-compute[98431]: Jun 11 23:08:05.899278 np0000002687 nova-compute[98431]: Jun 11 23:08:05.899278 np0000002687 nova-compute[98431]: Jun 11 23:08:05.899278 np0000002687 nova-compute[98431]: Jun 11 23:08:05.899278 np0000002687 nova-compute[98431]: file Jun 11 23:08:05.899278 np0000002687 nova-compute[98431]: anonymous Jun 11 23:08:05.899278 np0000002687 nova-compute[98431]: memfd Jun 11 23:08:05.899278 np0000002687 nova-compute[98431]: Jun 11 23:08:05.899278 np0000002687 nova-compute[98431]: Jun 11 23:08:05.899278 np0000002687 nova-compute[98431]: Jun 11 23:08:05.899278 np0000002687 nova-compute[98431]: Jun 11 23:08:05.899278 np0000002687 nova-compute[98431]: Jun 11 23:08:05.899278 np0000002687 nova-compute[98431]: disk Jun 11 23:08:05.899278 np0000002687 nova-compute[98431]: cdrom Jun 11 23:08:05.899278 np0000002687 nova-compute[98431]: floppy Jun 11 23:08:05.899278 np0000002687 nova-compute[98431]: lun Jun 11 23:08:05.899278 np0000002687 nova-compute[98431]: Jun 11 23:08:05.899278 np0000002687 nova-compute[98431]: Jun 11 23:08:05.899278 np0000002687 nova-compute[98431]: fdc Jun 11 23:08:05.899278 np0000002687 nova-compute[98431]: scsi Jun 11 23:08:05.899278 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.899278 np0000002687 nova-compute[98431]: usb Jun 11 23:08:05.899278 np0000002687 nova-compute[98431]: Jun 11 23:08:05.899278 np0000002687 nova-compute[98431]: Jun 11 23:08:05.899278 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.899278 np0000002687 nova-compute[98431]: virtio-transitional Jun 11 23:08:05.899278 np0000002687 nova-compute[98431]: virtio-non-transitional Jun 11 23:08:05.899278 np0000002687 nova-compute[98431]: Jun 11 23:08:05.899278 np0000002687 nova-compute[98431]: Jun 11 23:08:05.899278 np0000002687 nova-compute[98431]: Jun 11 23:08:05.899278 np0000002687 nova-compute[98431]: Jun 11 23:08:05.899278 np0000002687 nova-compute[98431]: sdl Jun 11 23:08:05.899278 np0000002687 nova-compute[98431]: vnc Jun 11 23:08:05.899278 np0000002687 nova-compute[98431]: spice Jun 11 23:08:05.899278 np0000002687 nova-compute[98431]: egl-headless Jun 11 23:08:05.899278 np0000002687 nova-compute[98431]: dbus Jun 11 23:08:05.899278 np0000002687 nova-compute[98431]: Jun 11 23:08:05.899278 np0000002687 nova-compute[98431]: Jun 11 23:08:05.899278 np0000002687 nova-compute[98431]: Jun 11 23:08:05.899278 np0000002687 nova-compute[98431]: Jun 11 23:08:05.899278 np0000002687 nova-compute[98431]: Jun 11 23:08:05.899278 np0000002687 nova-compute[98431]: subsystem Jun 11 23:08:05.899278 np0000002687 nova-compute[98431]: Jun 11 23:08:05.899278 np0000002687 nova-compute[98431]: Jun 11 23:08:05.899278 np0000002687 nova-compute[98431]: default Jun 11 23:08:05.899278 np0000002687 nova-compute[98431]: mandatory Jun 11 23:08:05.899278 np0000002687 nova-compute[98431]: requisite Jun 11 23:08:05.899278 np0000002687 nova-compute[98431]: optional Jun 11 23:08:05.899278 np0000002687 nova-compute[98431]: Jun 11 23:08:05.899278 np0000002687 nova-compute[98431]: Jun 11 23:08:05.899278 np0000002687 nova-compute[98431]: usb Jun 11 23:08:05.899278 np0000002687 nova-compute[98431]: pci Jun 11 23:08:05.899278 np0000002687 nova-compute[98431]: scsi Jun 11 23:08:05.899278 np0000002687 nova-compute[98431]: Jun 11 23:08:05.899278 np0000002687 nova-compute[98431]: Jun 11 23:08:05.900444 np0000002687 nova-compute[98431]: Jun 11 23:08:05.900444 np0000002687 nova-compute[98431]: Jun 11 23:08:05.900444 np0000002687 nova-compute[98431]: Jun 11 23:08:05.900444 np0000002687 nova-compute[98431]: Jun 11 23:08:05.900444 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.900444 np0000002687 nova-compute[98431]: virtio-transitional Jun 11 23:08:05.900444 np0000002687 nova-compute[98431]: virtio-non-transitional Jun 11 23:08:05.900444 np0000002687 nova-compute[98431]: Jun 11 23:08:05.900444 np0000002687 nova-compute[98431]: Jun 11 23:08:05.900444 np0000002687 nova-compute[98431]: random Jun 11 23:08:05.900444 np0000002687 nova-compute[98431]: egd Jun 11 23:08:05.900444 np0000002687 nova-compute[98431]: builtin Jun 11 23:08:05.900444 np0000002687 nova-compute[98431]: Jun 11 23:08:05.900444 np0000002687 nova-compute[98431]: Jun 11 23:08:05.900444 np0000002687 nova-compute[98431]: Jun 11 23:08:05.900444 np0000002687 nova-compute[98431]: Jun 11 23:08:05.900444 np0000002687 nova-compute[98431]: path Jun 11 23:08:05.900444 np0000002687 nova-compute[98431]: handle Jun 11 23:08:05.900444 np0000002687 nova-compute[98431]: virtiofs Jun 11 23:08:05.900444 np0000002687 nova-compute[98431]: Jun 11 23:08:05.900444 np0000002687 nova-compute[98431]: Jun 11 23:08:05.900444 np0000002687 nova-compute[98431]: Jun 11 23:08:05.900444 np0000002687 nova-compute[98431]: Jun 11 23:08:05.900444 np0000002687 nova-compute[98431]: Jun 11 23:08:05.900444 np0000002687 nova-compute[98431]: usb Jun 11 23:08:05.900444 np0000002687 nova-compute[98431]: Jun 11 23:08:05.900444 np0000002687 nova-compute[98431]: Jun 11 23:08:05.900444 np0000002687 nova-compute[98431]: Jun 11 23:08:05.900444 np0000002687 nova-compute[98431]: Jun 11 23:08:05.900444 np0000002687 nova-compute[98431]: pty Jun 11 23:08:05.900444 np0000002687 nova-compute[98431]: unix Jun 11 23:08:05.900444 np0000002687 nova-compute[98431]: spicevmc Jun 11 23:08:05.900444 np0000002687 nova-compute[98431]: Jun 11 23:08:05.900444 np0000002687 nova-compute[98431]: Jun 11 23:08:05.900444 np0000002687 nova-compute[98431]: Jun 11 23:08:05.900444 np0000002687 nova-compute[98431]: Jun 11 23:08:05.900444 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.900444 np0000002687 nova-compute[98431]: Jun 11 23:08:05.900444 np0000002687 nova-compute[98431]: Jun 11 23:08:05.900444 np0000002687 nova-compute[98431]: qemu Jun 11 23:08:05.900444 np0000002687 nova-compute[98431]: Jun 11 23:08:05.900444 np0000002687 nova-compute[98431]: Jun 11 23:08:05.900444 np0000002687 nova-compute[98431]: builtin Jun 11 23:08:05.900444 np0000002687 nova-compute[98431]: Jun 11 23:08:05.900444 np0000002687 nova-compute[98431]: Jun 11 23:08:05.900444 np0000002687 nova-compute[98431]: Jun 11 23:08:05.900444 np0000002687 nova-compute[98431]: Jun 11 23:08:05.900444 np0000002687 nova-compute[98431]: Jun 11 23:08:05.900444 np0000002687 nova-compute[98431]: Jun 11 23:08:05.900444 np0000002687 nova-compute[98431]: Jun 11 23:08:05.900444 np0000002687 nova-compute[98431]: Jun 11 23:08:05.900444 np0000002687 nova-compute[98431]: Jun 11 23:08:05.900444 np0000002687 nova-compute[98431]: Jun 11 23:08:05.900444 np0000002687 nova-compute[98431]: Jun 11 23:08:05.900444 np0000002687 nova-compute[98431]: Jun 11 23:08:05.900444 np0000002687 nova-compute[98431]: Jun 11 23:08:05.900444 np0000002687 nova-compute[98431]: Jun 11 23:08:05.900444 np0000002687 nova-compute[98431]: Jun 11 23:08:05.900444 np0000002687 nova-compute[98431]: {{(pid=98431) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 11 23:08:05.900444 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=98431) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 11 23:08:05.900444 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] Libvirt host hypervisor capabilities for arch=sh4 and machine_type=None: Jun 11 23:08:05.901617 np0000002687 nova-compute[98431]: Jun 11 23:08:05.901617 np0000002687 nova-compute[98431]: /usr/bin/qemu-system-sh4 Jun 11 23:08:05.901617 np0000002687 nova-compute[98431]: qemu Jun 11 23:08:05.901617 np0000002687 nova-compute[98431]: shix Jun 11 23:08:05.901617 np0000002687 nova-compute[98431]: sh4 Jun 11 23:08:05.901617 np0000002687 nova-compute[98431]: Jun 11 23:08:05.901617 np0000002687 nova-compute[98431]: Jun 11 23:08:05.901617 np0000002687 nova-compute[98431]: Jun 11 23:08:05.901617 np0000002687 nova-compute[98431]: Jun 11 23:08:05.901617 np0000002687 nova-compute[98431]: Jun 11 23:08:05.901617 np0000002687 nova-compute[98431]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 11 23:08:05.901617 np0000002687 nova-compute[98431]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 11 23:08:05.901617 np0000002687 nova-compute[98431]: Jun 11 23:08:05.901617 np0000002687 nova-compute[98431]: rom Jun 11 23:08:05.901617 np0000002687 nova-compute[98431]: pflash Jun 11 23:08:05.901617 np0000002687 nova-compute[98431]: Jun 11 23:08:05.901617 np0000002687 nova-compute[98431]: Jun 11 23:08:05.901617 np0000002687 nova-compute[98431]: yes Jun 11 23:08:05.901617 np0000002687 nova-compute[98431]: no Jun 11 23:08:05.901617 np0000002687 nova-compute[98431]: Jun 11 23:08:05.901617 np0000002687 nova-compute[98431]: Jun 11 23:08:05.901617 np0000002687 nova-compute[98431]: no Jun 11 23:08:05.901617 np0000002687 nova-compute[98431]: Jun 11 23:08:05.901617 np0000002687 nova-compute[98431]: Jun 11 23:08:05.901617 np0000002687 nova-compute[98431]: Jun 11 23:08:05.901617 np0000002687 nova-compute[98431]: Jun 11 23:08:05.901617 np0000002687 nova-compute[98431]: Jun 11 23:08:05.901617 np0000002687 nova-compute[98431]: Jun 11 23:08:05.901617 np0000002687 nova-compute[98431]: Jun 11 23:08:05.901617 np0000002687 nova-compute[98431]: Jun 11 23:08:05.901617 np0000002687 nova-compute[98431]: Jun 11 23:08:05.901617 np0000002687 nova-compute[98431]: Jun 11 23:08:05.901617 np0000002687 nova-compute[98431]: Jun 11 23:08:05.901617 np0000002687 nova-compute[98431]: file Jun 11 23:08:05.901617 np0000002687 nova-compute[98431]: anonymous Jun 11 23:08:05.901617 np0000002687 nova-compute[98431]: memfd Jun 11 23:08:05.901617 np0000002687 nova-compute[98431]: Jun 11 23:08:05.901617 np0000002687 nova-compute[98431]: Jun 11 23:08:05.901617 np0000002687 nova-compute[98431]: Jun 11 23:08:05.901617 np0000002687 nova-compute[98431]: Jun 11 23:08:05.901617 np0000002687 nova-compute[98431]: Jun 11 23:08:05.901617 np0000002687 nova-compute[98431]: disk Jun 11 23:08:05.901617 np0000002687 nova-compute[98431]: cdrom Jun 11 23:08:05.901617 np0000002687 nova-compute[98431]: floppy Jun 11 23:08:05.901617 np0000002687 nova-compute[98431]: lun Jun 11 23:08:05.901617 np0000002687 nova-compute[98431]: Jun 11 23:08:05.901617 np0000002687 nova-compute[98431]: Jun 11 23:08:05.901617 np0000002687 nova-compute[98431]: fdc Jun 11 23:08:05.901617 np0000002687 nova-compute[98431]: scsi Jun 11 23:08:05.901617 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.901617 np0000002687 nova-compute[98431]: usb Jun 11 23:08:05.901617 np0000002687 nova-compute[98431]: sata Jun 11 23:08:05.901617 np0000002687 nova-compute[98431]: Jun 11 23:08:05.901617 np0000002687 nova-compute[98431]: Jun 11 23:08:05.901617 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.901617 np0000002687 nova-compute[98431]: virtio-transitional Jun 11 23:08:05.901617 np0000002687 nova-compute[98431]: virtio-non-transitional Jun 11 23:08:05.901617 np0000002687 nova-compute[98431]: Jun 11 23:08:05.901617 np0000002687 nova-compute[98431]: Jun 11 23:08:05.901617 np0000002687 nova-compute[98431]: Jun 11 23:08:05.901617 np0000002687 nova-compute[98431]: Jun 11 23:08:05.901617 np0000002687 nova-compute[98431]: sdl Jun 11 23:08:05.901617 np0000002687 nova-compute[98431]: vnc Jun 11 23:08:05.901617 np0000002687 nova-compute[98431]: spice Jun 11 23:08:05.901617 np0000002687 nova-compute[98431]: egl-headless Jun 11 23:08:05.901617 np0000002687 nova-compute[98431]: dbus Jun 11 23:08:05.901617 np0000002687 nova-compute[98431]: Jun 11 23:08:05.901617 np0000002687 nova-compute[98431]: Jun 11 23:08:05.901617 np0000002687 nova-compute[98431]: Jun 11 23:08:05.902849 np0000002687 nova-compute[98431]: Jun 11 23:08:05.902849 np0000002687 nova-compute[98431]: Jun 11 23:08:05.902849 np0000002687 nova-compute[98431]: subsystem Jun 11 23:08:05.902849 np0000002687 nova-compute[98431]: Jun 11 23:08:05.902849 np0000002687 nova-compute[98431]: Jun 11 23:08:05.902849 np0000002687 nova-compute[98431]: default Jun 11 23:08:05.902849 np0000002687 nova-compute[98431]: mandatory Jun 11 23:08:05.902849 np0000002687 nova-compute[98431]: requisite Jun 11 23:08:05.902849 np0000002687 nova-compute[98431]: optional Jun 11 23:08:05.902849 np0000002687 nova-compute[98431]: Jun 11 23:08:05.902849 np0000002687 nova-compute[98431]: Jun 11 23:08:05.902849 np0000002687 nova-compute[98431]: usb Jun 11 23:08:05.902849 np0000002687 nova-compute[98431]: pci Jun 11 23:08:05.902849 np0000002687 nova-compute[98431]: scsi Jun 11 23:08:05.902849 np0000002687 nova-compute[98431]: Jun 11 23:08:05.902849 np0000002687 nova-compute[98431]: Jun 11 23:08:05.902849 np0000002687 nova-compute[98431]: Jun 11 23:08:05.902849 np0000002687 nova-compute[98431]: Jun 11 23:08:05.902849 np0000002687 nova-compute[98431]: Jun 11 23:08:05.902849 np0000002687 nova-compute[98431]: Jun 11 23:08:05.902849 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.902849 np0000002687 nova-compute[98431]: virtio-transitional Jun 11 23:08:05.902849 np0000002687 nova-compute[98431]: virtio-non-transitional Jun 11 23:08:05.902849 np0000002687 nova-compute[98431]: Jun 11 23:08:05.902849 np0000002687 nova-compute[98431]: Jun 11 23:08:05.902849 np0000002687 nova-compute[98431]: random Jun 11 23:08:05.902849 np0000002687 nova-compute[98431]: egd Jun 11 23:08:05.902849 np0000002687 nova-compute[98431]: builtin Jun 11 23:08:05.902849 np0000002687 nova-compute[98431]: Jun 11 23:08:05.902849 np0000002687 nova-compute[98431]: Jun 11 23:08:05.902849 np0000002687 nova-compute[98431]: Jun 11 23:08:05.902849 np0000002687 nova-compute[98431]: Jun 11 23:08:05.902849 np0000002687 nova-compute[98431]: path Jun 11 23:08:05.902849 np0000002687 nova-compute[98431]: handle Jun 11 23:08:05.902849 np0000002687 nova-compute[98431]: virtiofs Jun 11 23:08:05.902849 np0000002687 nova-compute[98431]: Jun 11 23:08:05.902849 np0000002687 nova-compute[98431]: Jun 11 23:08:05.902849 np0000002687 nova-compute[98431]: Jun 11 23:08:05.902849 np0000002687 nova-compute[98431]: Jun 11 23:08:05.902849 np0000002687 nova-compute[98431]: Jun 11 23:08:05.902849 np0000002687 nova-compute[98431]: usb Jun 11 23:08:05.902849 np0000002687 nova-compute[98431]: Jun 11 23:08:05.902849 np0000002687 nova-compute[98431]: Jun 11 23:08:05.902849 np0000002687 nova-compute[98431]: Jun 11 23:08:05.902849 np0000002687 nova-compute[98431]: Jun 11 23:08:05.902849 np0000002687 nova-compute[98431]: pty Jun 11 23:08:05.902849 np0000002687 nova-compute[98431]: unix Jun 11 23:08:05.902849 np0000002687 nova-compute[98431]: spicevmc Jun 11 23:08:05.902849 np0000002687 nova-compute[98431]: Jun 11 23:08:05.902849 np0000002687 nova-compute[98431]: Jun 11 23:08:05.902849 np0000002687 nova-compute[98431]: Jun 11 23:08:05.902849 np0000002687 nova-compute[98431]: Jun 11 23:08:05.902849 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.902849 np0000002687 nova-compute[98431]: Jun 11 23:08:05.902849 np0000002687 nova-compute[98431]: Jun 11 23:08:05.902849 np0000002687 nova-compute[98431]: qemu Jun 11 23:08:05.902849 np0000002687 nova-compute[98431]: Jun 11 23:08:05.902849 np0000002687 nova-compute[98431]: Jun 11 23:08:05.902849 np0000002687 nova-compute[98431]: builtin Jun 11 23:08:05.902849 np0000002687 nova-compute[98431]: Jun 11 23:08:05.902849 np0000002687 nova-compute[98431]: Jun 11 23:08:05.902849 np0000002687 nova-compute[98431]: Jun 11 23:08:05.902849 np0000002687 nova-compute[98431]: Jun 11 23:08:05.902849 np0000002687 nova-compute[98431]: Jun 11 23:08:05.902849 np0000002687 nova-compute[98431]: Jun 11 23:08:05.902849 np0000002687 nova-compute[98431]: Jun 11 23:08:05.902849 np0000002687 nova-compute[98431]: Jun 11 23:08:05.902849 np0000002687 nova-compute[98431]: Jun 11 23:08:05.902849 np0000002687 nova-compute[98431]: Jun 11 23:08:05.902849 np0000002687 nova-compute[98431]: Jun 11 23:08:05.902849 np0000002687 nova-compute[98431]: Jun 11 23:08:05.902849 np0000002687 nova-compute[98431]: Jun 11 23:08:05.902849 np0000002687 nova-compute[98431]: Jun 11 23:08:05.902849 np0000002687 nova-compute[98431]: {{(pid=98431) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 11 23:08:05.904146 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=98431) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 11 23:08:05.904146 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] Libvirt host hypervisor capabilities for arch=sh4eb and machine_type=None: Jun 11 23:08:05.904146 np0000002687 nova-compute[98431]: Jun 11 23:08:05.904146 np0000002687 nova-compute[98431]: /usr/bin/qemu-system-sh4eb Jun 11 23:08:05.904146 np0000002687 nova-compute[98431]: qemu Jun 11 23:08:05.904146 np0000002687 nova-compute[98431]: shix Jun 11 23:08:05.904146 np0000002687 nova-compute[98431]: sh4eb Jun 11 23:08:05.904146 np0000002687 nova-compute[98431]: Jun 11 23:08:05.904146 np0000002687 nova-compute[98431]: Jun 11 23:08:05.904146 np0000002687 nova-compute[98431]: Jun 11 23:08:05.904146 np0000002687 nova-compute[98431]: Jun 11 23:08:05.904146 np0000002687 nova-compute[98431]: Jun 11 23:08:05.904146 np0000002687 nova-compute[98431]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 11 23:08:05.904146 np0000002687 nova-compute[98431]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 11 23:08:05.904146 np0000002687 nova-compute[98431]: Jun 11 23:08:05.904146 np0000002687 nova-compute[98431]: rom Jun 11 23:08:05.904146 np0000002687 nova-compute[98431]: pflash Jun 11 23:08:05.904146 np0000002687 nova-compute[98431]: Jun 11 23:08:05.904146 np0000002687 nova-compute[98431]: Jun 11 23:08:05.904146 np0000002687 nova-compute[98431]: yes Jun 11 23:08:05.904146 np0000002687 nova-compute[98431]: no Jun 11 23:08:05.904146 np0000002687 nova-compute[98431]: Jun 11 23:08:05.904146 np0000002687 nova-compute[98431]: Jun 11 23:08:05.904146 np0000002687 nova-compute[98431]: no Jun 11 23:08:05.904146 np0000002687 nova-compute[98431]: Jun 11 23:08:05.904146 np0000002687 nova-compute[98431]: Jun 11 23:08:05.904146 np0000002687 nova-compute[98431]: Jun 11 23:08:05.904146 np0000002687 nova-compute[98431]: Jun 11 23:08:05.904146 np0000002687 nova-compute[98431]: Jun 11 23:08:05.904146 np0000002687 nova-compute[98431]: Jun 11 23:08:05.904146 np0000002687 nova-compute[98431]: Jun 11 23:08:05.904146 np0000002687 nova-compute[98431]: Jun 11 23:08:05.904146 np0000002687 nova-compute[98431]: Jun 11 23:08:05.904146 np0000002687 nova-compute[98431]: Jun 11 23:08:05.904146 np0000002687 nova-compute[98431]: Jun 11 23:08:05.904146 np0000002687 nova-compute[98431]: file Jun 11 23:08:05.904146 np0000002687 nova-compute[98431]: anonymous Jun 11 23:08:05.904146 np0000002687 nova-compute[98431]: memfd Jun 11 23:08:05.904146 np0000002687 nova-compute[98431]: Jun 11 23:08:05.904146 np0000002687 nova-compute[98431]: Jun 11 23:08:05.904146 np0000002687 nova-compute[98431]: Jun 11 23:08:05.904146 np0000002687 nova-compute[98431]: Jun 11 23:08:05.904146 np0000002687 nova-compute[98431]: Jun 11 23:08:05.904146 np0000002687 nova-compute[98431]: disk Jun 11 23:08:05.904146 np0000002687 nova-compute[98431]: cdrom Jun 11 23:08:05.904146 np0000002687 nova-compute[98431]: floppy Jun 11 23:08:05.904146 np0000002687 nova-compute[98431]: lun Jun 11 23:08:05.904146 np0000002687 nova-compute[98431]: Jun 11 23:08:05.904146 np0000002687 nova-compute[98431]: Jun 11 23:08:05.904146 np0000002687 nova-compute[98431]: fdc Jun 11 23:08:05.904146 np0000002687 nova-compute[98431]: scsi Jun 11 23:08:05.904146 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.904146 np0000002687 nova-compute[98431]: usb Jun 11 23:08:05.904146 np0000002687 nova-compute[98431]: sata Jun 11 23:08:05.904146 np0000002687 nova-compute[98431]: Jun 11 23:08:05.904146 np0000002687 nova-compute[98431]: Jun 11 23:08:05.904146 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.904146 np0000002687 nova-compute[98431]: virtio-transitional Jun 11 23:08:05.904146 np0000002687 nova-compute[98431]: virtio-non-transitional Jun 11 23:08:05.904146 np0000002687 nova-compute[98431]: Jun 11 23:08:05.904146 np0000002687 nova-compute[98431]: Jun 11 23:08:05.905122 np0000002687 nova-compute[98431]: Jun 11 23:08:05.905122 np0000002687 nova-compute[98431]: Jun 11 23:08:05.905122 np0000002687 nova-compute[98431]: sdl Jun 11 23:08:05.905122 np0000002687 nova-compute[98431]: vnc Jun 11 23:08:05.905122 np0000002687 nova-compute[98431]: spice Jun 11 23:08:05.905122 np0000002687 nova-compute[98431]: egl-headless Jun 11 23:08:05.905122 np0000002687 nova-compute[98431]: dbus Jun 11 23:08:05.905122 np0000002687 nova-compute[98431]: Jun 11 23:08:05.905122 np0000002687 nova-compute[98431]: Jun 11 23:08:05.905122 np0000002687 nova-compute[98431]: Jun 11 23:08:05.905122 np0000002687 nova-compute[98431]: Jun 11 23:08:05.905122 np0000002687 nova-compute[98431]: Jun 11 23:08:05.905122 np0000002687 nova-compute[98431]: subsystem Jun 11 23:08:05.905122 np0000002687 nova-compute[98431]: Jun 11 23:08:05.905122 np0000002687 nova-compute[98431]: Jun 11 23:08:05.905122 np0000002687 nova-compute[98431]: default Jun 11 23:08:05.905122 np0000002687 nova-compute[98431]: mandatory Jun 11 23:08:05.905122 np0000002687 nova-compute[98431]: requisite Jun 11 23:08:05.905122 np0000002687 nova-compute[98431]: optional Jun 11 23:08:05.905122 np0000002687 nova-compute[98431]: Jun 11 23:08:05.905122 np0000002687 nova-compute[98431]: Jun 11 23:08:05.905122 np0000002687 nova-compute[98431]: usb Jun 11 23:08:05.905122 np0000002687 nova-compute[98431]: pci Jun 11 23:08:05.905122 np0000002687 nova-compute[98431]: scsi Jun 11 23:08:05.905122 np0000002687 nova-compute[98431]: Jun 11 23:08:05.905122 np0000002687 nova-compute[98431]: Jun 11 23:08:05.905122 np0000002687 nova-compute[98431]: Jun 11 23:08:05.905122 np0000002687 nova-compute[98431]: Jun 11 23:08:05.905122 np0000002687 nova-compute[98431]: Jun 11 23:08:05.905122 np0000002687 nova-compute[98431]: Jun 11 23:08:05.905122 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.905122 np0000002687 nova-compute[98431]: virtio-transitional Jun 11 23:08:05.905122 np0000002687 nova-compute[98431]: virtio-non-transitional Jun 11 23:08:05.905122 np0000002687 nova-compute[98431]: Jun 11 23:08:05.905122 np0000002687 nova-compute[98431]: Jun 11 23:08:05.905122 np0000002687 nova-compute[98431]: random Jun 11 23:08:05.905122 np0000002687 nova-compute[98431]: egd Jun 11 23:08:05.905122 np0000002687 nova-compute[98431]: builtin Jun 11 23:08:05.905122 np0000002687 nova-compute[98431]: Jun 11 23:08:05.905122 np0000002687 nova-compute[98431]: Jun 11 23:08:05.905122 np0000002687 nova-compute[98431]: Jun 11 23:08:05.905122 np0000002687 nova-compute[98431]: Jun 11 23:08:05.905122 np0000002687 nova-compute[98431]: path Jun 11 23:08:05.905122 np0000002687 nova-compute[98431]: handle Jun 11 23:08:05.905122 np0000002687 nova-compute[98431]: virtiofs Jun 11 23:08:05.905122 np0000002687 nova-compute[98431]: Jun 11 23:08:05.905122 np0000002687 nova-compute[98431]: Jun 11 23:08:05.905122 np0000002687 nova-compute[98431]: Jun 11 23:08:05.905122 np0000002687 nova-compute[98431]: Jun 11 23:08:05.905122 np0000002687 nova-compute[98431]: Jun 11 23:08:05.905122 np0000002687 nova-compute[98431]: usb Jun 11 23:08:05.905122 np0000002687 nova-compute[98431]: Jun 11 23:08:05.905122 np0000002687 nova-compute[98431]: Jun 11 23:08:05.905122 np0000002687 nova-compute[98431]: Jun 11 23:08:05.905122 np0000002687 nova-compute[98431]: Jun 11 23:08:05.905122 np0000002687 nova-compute[98431]: pty Jun 11 23:08:05.905122 np0000002687 nova-compute[98431]: unix Jun 11 23:08:05.905122 np0000002687 nova-compute[98431]: spicevmc Jun 11 23:08:05.905122 np0000002687 nova-compute[98431]: Jun 11 23:08:05.905122 np0000002687 nova-compute[98431]: Jun 11 23:08:05.905122 np0000002687 nova-compute[98431]: Jun 11 23:08:05.905122 np0000002687 nova-compute[98431]: Jun 11 23:08:05.905122 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.905122 np0000002687 nova-compute[98431]: Jun 11 23:08:05.905122 np0000002687 nova-compute[98431]: Jun 11 23:08:05.905122 np0000002687 nova-compute[98431]: qemu Jun 11 23:08:05.905122 np0000002687 nova-compute[98431]: Jun 11 23:08:05.905122 np0000002687 nova-compute[98431]: Jun 11 23:08:05.905122 np0000002687 nova-compute[98431]: builtin Jun 11 23:08:05.905122 np0000002687 nova-compute[98431]: Jun 11 23:08:05.905122 np0000002687 nova-compute[98431]: Jun 11 23:08:05.905122 np0000002687 nova-compute[98431]: Jun 11 23:08:05.906446 np0000002687 nova-compute[98431]: Jun 11 23:08:05.906446 np0000002687 nova-compute[98431]: Jun 11 23:08:05.906446 np0000002687 nova-compute[98431]: Jun 11 23:08:05.906446 np0000002687 nova-compute[98431]: Jun 11 23:08:05.906446 np0000002687 nova-compute[98431]: Jun 11 23:08:05.906446 np0000002687 nova-compute[98431]: Jun 11 23:08:05.906446 np0000002687 nova-compute[98431]: Jun 11 23:08:05.906446 np0000002687 nova-compute[98431]: Jun 11 23:08:05.906446 np0000002687 nova-compute[98431]: Jun 11 23:08:05.906446 np0000002687 nova-compute[98431]: Jun 11 23:08:05.906446 np0000002687 nova-compute[98431]: Jun 11 23:08:05.906446 np0000002687 nova-compute[98431]: {{(pid=98431) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 11 23:08:05.906446 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=98431) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 11 23:08:05.906446 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] Libvirt host hypervisor capabilities for arch=sparc and machine_type=None: Jun 11 23:08:05.906446 np0000002687 nova-compute[98431]: Jun 11 23:08:05.906446 np0000002687 nova-compute[98431]: /usr/bin/qemu-system-sparc Jun 11 23:08:05.906446 np0000002687 nova-compute[98431]: qemu Jun 11 23:08:05.906446 np0000002687 nova-compute[98431]: SS-5 Jun 11 23:08:05.906446 np0000002687 nova-compute[98431]: sparc Jun 11 23:08:05.906446 np0000002687 nova-compute[98431]: Jun 11 23:08:05.906446 np0000002687 nova-compute[98431]: Jun 11 23:08:05.906446 np0000002687 nova-compute[98431]: Jun 11 23:08:05.906446 np0000002687 nova-compute[98431]: Jun 11 23:08:05.906446 np0000002687 nova-compute[98431]: Jun 11 23:08:05.906446 np0000002687 nova-compute[98431]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 11 23:08:05.906446 np0000002687 nova-compute[98431]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 11 23:08:05.906446 np0000002687 nova-compute[98431]: Jun 11 23:08:05.906446 np0000002687 nova-compute[98431]: rom Jun 11 23:08:05.906446 np0000002687 nova-compute[98431]: pflash Jun 11 23:08:05.906446 np0000002687 nova-compute[98431]: Jun 11 23:08:05.906446 np0000002687 nova-compute[98431]: Jun 11 23:08:05.906446 np0000002687 nova-compute[98431]: yes Jun 11 23:08:05.906446 np0000002687 nova-compute[98431]: no Jun 11 23:08:05.906446 np0000002687 nova-compute[98431]: Jun 11 23:08:05.906446 np0000002687 nova-compute[98431]: Jun 11 23:08:05.906446 np0000002687 nova-compute[98431]: no Jun 11 23:08:05.906446 np0000002687 nova-compute[98431]: Jun 11 23:08:05.906446 np0000002687 nova-compute[98431]: Jun 11 23:08:05.906446 np0000002687 nova-compute[98431]: Jun 11 23:08:05.906446 np0000002687 nova-compute[98431]: Jun 11 23:08:05.906446 np0000002687 nova-compute[98431]: Jun 11 23:08:05.906446 np0000002687 nova-compute[98431]: Jun 11 23:08:05.906446 np0000002687 nova-compute[98431]: Jun 11 23:08:05.906446 np0000002687 nova-compute[98431]: Jun 11 23:08:05.906446 np0000002687 nova-compute[98431]: Jun 11 23:08:05.906446 np0000002687 nova-compute[98431]: Jun 11 23:08:05.906446 np0000002687 nova-compute[98431]: Jun 11 23:08:05.906446 np0000002687 nova-compute[98431]: file Jun 11 23:08:05.906446 np0000002687 nova-compute[98431]: anonymous Jun 11 23:08:05.906446 np0000002687 nova-compute[98431]: memfd Jun 11 23:08:05.906446 np0000002687 nova-compute[98431]: Jun 11 23:08:05.906446 np0000002687 nova-compute[98431]: Jun 11 23:08:05.906446 np0000002687 nova-compute[98431]: Jun 11 23:08:05.906446 np0000002687 nova-compute[98431]: Jun 11 23:08:05.906446 np0000002687 nova-compute[98431]: Jun 11 23:08:05.906446 np0000002687 nova-compute[98431]: disk Jun 11 23:08:05.906446 np0000002687 nova-compute[98431]: cdrom Jun 11 23:08:05.906446 np0000002687 nova-compute[98431]: floppy Jun 11 23:08:05.907499 np0000002687 nova-compute[98431]: lun Jun 11 23:08:05.907499 np0000002687 nova-compute[98431]: Jun 11 23:08:05.907499 np0000002687 nova-compute[98431]: Jun 11 23:08:05.907499 np0000002687 nova-compute[98431]: fdc Jun 11 23:08:05.907499 np0000002687 nova-compute[98431]: scsi Jun 11 23:08:05.907499 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.907499 np0000002687 nova-compute[98431]: Jun 11 23:08:05.907499 np0000002687 nova-compute[98431]: Jun 11 23:08:05.907499 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.907499 np0000002687 nova-compute[98431]: Jun 11 23:08:05.907499 np0000002687 nova-compute[98431]: Jun 11 23:08:05.907499 np0000002687 nova-compute[98431]: Jun 11 23:08:05.907499 np0000002687 nova-compute[98431]: Jun 11 23:08:05.907499 np0000002687 nova-compute[98431]: sdl Jun 11 23:08:05.907499 np0000002687 nova-compute[98431]: vnc Jun 11 23:08:05.907499 np0000002687 nova-compute[98431]: spice Jun 11 23:08:05.907499 np0000002687 nova-compute[98431]: egl-headless Jun 11 23:08:05.907499 np0000002687 nova-compute[98431]: dbus Jun 11 23:08:05.907499 np0000002687 nova-compute[98431]: Jun 11 23:08:05.907499 np0000002687 nova-compute[98431]: Jun 11 23:08:05.907499 np0000002687 nova-compute[98431]: Jun 11 23:08:05.907499 np0000002687 nova-compute[98431]: Jun 11 23:08:05.907499 np0000002687 nova-compute[98431]: Jun 11 23:08:05.907499 np0000002687 nova-compute[98431]: subsystem Jun 11 23:08:05.907499 np0000002687 nova-compute[98431]: Jun 11 23:08:05.907499 np0000002687 nova-compute[98431]: Jun 11 23:08:05.907499 np0000002687 nova-compute[98431]: default Jun 11 23:08:05.907499 np0000002687 nova-compute[98431]: mandatory Jun 11 23:08:05.907499 np0000002687 nova-compute[98431]: requisite Jun 11 23:08:05.907499 np0000002687 nova-compute[98431]: optional Jun 11 23:08:05.907499 np0000002687 nova-compute[98431]: Jun 11 23:08:05.907499 np0000002687 nova-compute[98431]: Jun 11 23:08:05.907499 np0000002687 nova-compute[98431]: pci Jun 11 23:08:05.907499 np0000002687 nova-compute[98431]: scsi Jun 11 23:08:05.907499 np0000002687 nova-compute[98431]: Jun 11 23:08:05.907499 np0000002687 nova-compute[98431]: Jun 11 23:08:05.907499 np0000002687 nova-compute[98431]: Jun 11 23:08:05.907499 np0000002687 nova-compute[98431]: Jun 11 23:08:05.907499 np0000002687 nova-compute[98431]: Jun 11 23:08:05.907499 np0000002687 nova-compute[98431]: Jun 11 23:08:05.907499 np0000002687 nova-compute[98431]: Jun 11 23:08:05.907499 np0000002687 nova-compute[98431]: random Jun 11 23:08:05.907499 np0000002687 nova-compute[98431]: egd Jun 11 23:08:05.907499 np0000002687 nova-compute[98431]: builtin Jun 11 23:08:05.907499 np0000002687 nova-compute[98431]: Jun 11 23:08:05.907499 np0000002687 nova-compute[98431]: Jun 11 23:08:05.907499 np0000002687 nova-compute[98431]: Jun 11 23:08:05.907499 np0000002687 nova-compute[98431]: Jun 11 23:08:05.907499 np0000002687 nova-compute[98431]: path Jun 11 23:08:05.907499 np0000002687 nova-compute[98431]: handle Jun 11 23:08:05.907499 np0000002687 nova-compute[98431]: Jun 11 23:08:05.907499 np0000002687 nova-compute[98431]: Jun 11 23:08:05.907499 np0000002687 nova-compute[98431]: Jun 11 23:08:05.907499 np0000002687 nova-compute[98431]: Jun 11 23:08:05.907499 np0000002687 nova-compute[98431]: Jun 11 23:08:05.907499 np0000002687 nova-compute[98431]: Jun 11 23:08:05.907499 np0000002687 nova-compute[98431]: pty Jun 11 23:08:05.907499 np0000002687 nova-compute[98431]: unix Jun 11 23:08:05.907499 np0000002687 nova-compute[98431]: spicevmc Jun 11 23:08:05.907499 np0000002687 nova-compute[98431]: Jun 11 23:08:05.907499 np0000002687 nova-compute[98431]: Jun 11 23:08:05.907499 np0000002687 nova-compute[98431]: Jun 11 23:08:05.907499 np0000002687 nova-compute[98431]: Jun 11 23:08:05.907499 np0000002687 nova-compute[98431]: Jun 11 23:08:05.907499 np0000002687 nova-compute[98431]: qemu Jun 11 23:08:05.907499 np0000002687 nova-compute[98431]: Jun 11 23:08:05.907499 np0000002687 nova-compute[98431]: Jun 11 23:08:05.907499 np0000002687 nova-compute[98431]: builtin Jun 11 23:08:05.907499 np0000002687 nova-compute[98431]: Jun 11 23:08:05.907499 np0000002687 nova-compute[98431]: Jun 11 23:08:05.907499 np0000002687 nova-compute[98431]: Jun 11 23:08:05.907499 np0000002687 nova-compute[98431]: Jun 11 23:08:05.907499 np0000002687 nova-compute[98431]: Jun 11 23:08:05.907499 np0000002687 nova-compute[98431]: Jun 11 23:08:05.907499 np0000002687 nova-compute[98431]: Jun 11 23:08:05.907499 np0000002687 nova-compute[98431]: Jun 11 23:08:05.907499 np0000002687 nova-compute[98431]: Jun 11 23:08:05.908972 np0000002687 nova-compute[98431]: Jun 11 23:08:05.908972 np0000002687 nova-compute[98431]: Jun 11 23:08:05.908972 np0000002687 nova-compute[98431]: Jun 11 23:08:05.908972 np0000002687 nova-compute[98431]: Jun 11 23:08:05.908972 np0000002687 nova-compute[98431]: Jun 11 23:08:05.908972 np0000002687 nova-compute[98431]: {{(pid=98431) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 11 23:08:05.908972 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=98431) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 11 23:08:05.908972 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] Libvirt host hypervisor capabilities for arch=sparc64 and machine_type=None: Jun 11 23:08:05.908972 np0000002687 nova-compute[98431]: Jun 11 23:08:05.908972 np0000002687 nova-compute[98431]: /usr/bin/qemu-system-sparc64 Jun 11 23:08:05.908972 np0000002687 nova-compute[98431]: qemu Jun 11 23:08:05.908972 np0000002687 nova-compute[98431]: sun4u Jun 11 23:08:05.908972 np0000002687 nova-compute[98431]: sparc64 Jun 11 23:08:05.908972 np0000002687 nova-compute[98431]: Jun 11 23:08:05.908972 np0000002687 nova-compute[98431]: Jun 11 23:08:05.908972 np0000002687 nova-compute[98431]: Jun 11 23:08:05.908972 np0000002687 nova-compute[98431]: Jun 11 23:08:05.908972 np0000002687 nova-compute[98431]: Jun 11 23:08:05.908972 np0000002687 nova-compute[98431]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 11 23:08:05.908972 np0000002687 nova-compute[98431]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 11 23:08:05.908972 np0000002687 nova-compute[98431]: Jun 11 23:08:05.908972 np0000002687 nova-compute[98431]: rom Jun 11 23:08:05.908972 np0000002687 nova-compute[98431]: pflash Jun 11 23:08:05.908972 np0000002687 nova-compute[98431]: Jun 11 23:08:05.908972 np0000002687 nova-compute[98431]: Jun 11 23:08:05.908972 np0000002687 nova-compute[98431]: yes Jun 11 23:08:05.908972 np0000002687 nova-compute[98431]: no Jun 11 23:08:05.908972 np0000002687 nova-compute[98431]: Jun 11 23:08:05.908972 np0000002687 nova-compute[98431]: Jun 11 23:08:05.908972 np0000002687 nova-compute[98431]: no Jun 11 23:08:05.908972 np0000002687 nova-compute[98431]: Jun 11 23:08:05.908972 np0000002687 nova-compute[98431]: Jun 11 23:08:05.908972 np0000002687 nova-compute[98431]: Jun 11 23:08:05.908972 np0000002687 nova-compute[98431]: Jun 11 23:08:05.908972 np0000002687 nova-compute[98431]: Jun 11 23:08:05.908972 np0000002687 nova-compute[98431]: Jun 11 23:08:05.908972 np0000002687 nova-compute[98431]: Jun 11 23:08:05.908972 np0000002687 nova-compute[98431]: Jun 11 23:08:05.908972 np0000002687 nova-compute[98431]: Jun 11 23:08:05.908972 np0000002687 nova-compute[98431]: Jun 11 23:08:05.908972 np0000002687 nova-compute[98431]: Jun 11 23:08:05.908972 np0000002687 nova-compute[98431]: file Jun 11 23:08:05.908972 np0000002687 nova-compute[98431]: anonymous Jun 11 23:08:05.908972 np0000002687 nova-compute[98431]: memfd Jun 11 23:08:05.908972 np0000002687 nova-compute[98431]: Jun 11 23:08:05.908972 np0000002687 nova-compute[98431]: Jun 11 23:08:05.908972 np0000002687 nova-compute[98431]: Jun 11 23:08:05.908972 np0000002687 nova-compute[98431]: Jun 11 23:08:05.908972 np0000002687 nova-compute[98431]: Jun 11 23:08:05.908972 np0000002687 nova-compute[98431]: disk Jun 11 23:08:05.908972 np0000002687 nova-compute[98431]: cdrom Jun 11 23:08:05.908972 np0000002687 nova-compute[98431]: floppy Jun 11 23:08:05.908972 np0000002687 nova-compute[98431]: lun Jun 11 23:08:05.908972 np0000002687 nova-compute[98431]: Jun 11 23:08:05.908972 np0000002687 nova-compute[98431]: Jun 11 23:08:05.908972 np0000002687 nova-compute[98431]: ide Jun 11 23:08:05.908972 np0000002687 nova-compute[98431]: fdc Jun 11 23:08:05.908972 np0000002687 nova-compute[98431]: scsi Jun 11 23:08:05.909858 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.909858 np0000002687 nova-compute[98431]: usb Jun 11 23:08:05.909858 np0000002687 nova-compute[98431]: sata Jun 11 23:08:05.909858 np0000002687 nova-compute[98431]: Jun 11 23:08:05.909858 np0000002687 nova-compute[98431]: Jun 11 23:08:05.909858 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.909858 np0000002687 nova-compute[98431]: virtio-transitional Jun 11 23:08:05.909858 np0000002687 nova-compute[98431]: virtio-non-transitional Jun 11 23:08:05.909858 np0000002687 nova-compute[98431]: Jun 11 23:08:05.909858 np0000002687 nova-compute[98431]: Jun 11 23:08:05.909858 np0000002687 nova-compute[98431]: Jun 11 23:08:05.909858 np0000002687 nova-compute[98431]: Jun 11 23:08:05.909858 np0000002687 nova-compute[98431]: sdl Jun 11 23:08:05.909858 np0000002687 nova-compute[98431]: vnc Jun 11 23:08:05.909858 np0000002687 nova-compute[98431]: spice Jun 11 23:08:05.909858 np0000002687 nova-compute[98431]: egl-headless Jun 11 23:08:05.909858 np0000002687 nova-compute[98431]: dbus Jun 11 23:08:05.909858 np0000002687 nova-compute[98431]: Jun 11 23:08:05.909858 np0000002687 nova-compute[98431]: Jun 11 23:08:05.909858 np0000002687 nova-compute[98431]: Jun 11 23:08:05.909858 np0000002687 nova-compute[98431]: Jun 11 23:08:05.909858 np0000002687 nova-compute[98431]: Jun 11 23:08:05.909858 np0000002687 nova-compute[98431]: subsystem Jun 11 23:08:05.909858 np0000002687 nova-compute[98431]: Jun 11 23:08:05.909858 np0000002687 nova-compute[98431]: Jun 11 23:08:05.909858 np0000002687 nova-compute[98431]: default Jun 11 23:08:05.909858 np0000002687 nova-compute[98431]: mandatory Jun 11 23:08:05.909858 np0000002687 nova-compute[98431]: requisite Jun 11 23:08:05.909858 np0000002687 nova-compute[98431]: optional Jun 11 23:08:05.909858 np0000002687 nova-compute[98431]: Jun 11 23:08:05.909858 np0000002687 nova-compute[98431]: Jun 11 23:08:05.909858 np0000002687 nova-compute[98431]: usb Jun 11 23:08:05.909858 np0000002687 nova-compute[98431]: pci Jun 11 23:08:05.909858 np0000002687 nova-compute[98431]: scsi Jun 11 23:08:05.909858 np0000002687 nova-compute[98431]: Jun 11 23:08:05.909858 np0000002687 nova-compute[98431]: Jun 11 23:08:05.909858 np0000002687 nova-compute[98431]: Jun 11 23:08:05.909858 np0000002687 nova-compute[98431]: Jun 11 23:08:05.909858 np0000002687 nova-compute[98431]: Jun 11 23:08:05.909858 np0000002687 nova-compute[98431]: Jun 11 23:08:05.909858 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.909858 np0000002687 nova-compute[98431]: virtio-transitional Jun 11 23:08:05.909858 np0000002687 nova-compute[98431]: virtio-non-transitional Jun 11 23:08:05.909858 np0000002687 nova-compute[98431]: Jun 11 23:08:05.909858 np0000002687 nova-compute[98431]: Jun 11 23:08:05.909858 np0000002687 nova-compute[98431]: random Jun 11 23:08:05.909858 np0000002687 nova-compute[98431]: egd Jun 11 23:08:05.909858 np0000002687 nova-compute[98431]: builtin Jun 11 23:08:05.909858 np0000002687 nova-compute[98431]: Jun 11 23:08:05.909858 np0000002687 nova-compute[98431]: Jun 11 23:08:05.909858 np0000002687 nova-compute[98431]: Jun 11 23:08:05.909858 np0000002687 nova-compute[98431]: Jun 11 23:08:05.909858 np0000002687 nova-compute[98431]: path Jun 11 23:08:05.909858 np0000002687 nova-compute[98431]: handle Jun 11 23:08:05.909858 np0000002687 nova-compute[98431]: virtiofs Jun 11 23:08:05.909858 np0000002687 nova-compute[98431]: Jun 11 23:08:05.909858 np0000002687 nova-compute[98431]: Jun 11 23:08:05.909858 np0000002687 nova-compute[98431]: Jun 11 23:08:05.909858 np0000002687 nova-compute[98431]: Jun 11 23:08:05.909858 np0000002687 nova-compute[98431]: Jun 11 23:08:05.909858 np0000002687 nova-compute[98431]: usb Jun 11 23:08:05.909858 np0000002687 nova-compute[98431]: Jun 11 23:08:05.909858 np0000002687 nova-compute[98431]: Jun 11 23:08:05.909858 np0000002687 nova-compute[98431]: Jun 11 23:08:05.909858 np0000002687 nova-compute[98431]: Jun 11 23:08:05.909858 np0000002687 nova-compute[98431]: pty Jun 11 23:08:05.909858 np0000002687 nova-compute[98431]: unix Jun 11 23:08:05.909858 np0000002687 nova-compute[98431]: spicevmc Jun 11 23:08:05.909858 np0000002687 nova-compute[98431]: Jun 11 23:08:05.909858 np0000002687 nova-compute[98431]: Jun 11 23:08:05.911089 np0000002687 nova-compute[98431]: Jun 11 23:08:05.911089 np0000002687 nova-compute[98431]: Jun 11 23:08:05.911089 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.911089 np0000002687 nova-compute[98431]: Jun 11 23:08:05.911089 np0000002687 nova-compute[98431]: Jun 11 23:08:05.911089 np0000002687 nova-compute[98431]: qemu Jun 11 23:08:05.911089 np0000002687 nova-compute[98431]: Jun 11 23:08:05.911089 np0000002687 nova-compute[98431]: Jun 11 23:08:05.911089 np0000002687 nova-compute[98431]: builtin Jun 11 23:08:05.911089 np0000002687 nova-compute[98431]: Jun 11 23:08:05.911089 np0000002687 nova-compute[98431]: Jun 11 23:08:05.911089 np0000002687 nova-compute[98431]: Jun 11 23:08:05.911089 np0000002687 nova-compute[98431]: Jun 11 23:08:05.911089 np0000002687 nova-compute[98431]: Jun 11 23:08:05.911089 np0000002687 nova-compute[98431]: Jun 11 23:08:05.911089 np0000002687 nova-compute[98431]: Jun 11 23:08:05.911089 np0000002687 nova-compute[98431]: Jun 11 23:08:05.911089 np0000002687 nova-compute[98431]: Jun 11 23:08:05.911089 np0000002687 nova-compute[98431]: Jun 11 23:08:05.911089 np0000002687 nova-compute[98431]: Jun 11 23:08:05.911089 np0000002687 nova-compute[98431]: Jun 11 23:08:05.911089 np0000002687 nova-compute[98431]: Jun 11 23:08:05.911089 np0000002687 nova-compute[98431]: Jun 11 23:08:05.911089 np0000002687 nova-compute[98431]: {{(pid=98431) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 11 23:08:05.911089 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] Getting domain capabilities for x86_64 via machine types: {'pc', 'ubuntu', 'ubuntu-q35', 'q35'} {{(pid=98431) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 11 23:08:05.911089 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc: Jun 11 23:08:05.911089 np0000002687 nova-compute[98431]: Jun 11 23:08:05.911089 np0000002687 nova-compute[98431]: /usr/bin/qemu-system-x86_64 Jun 11 23:08:05.911089 np0000002687 nova-compute[98431]: qemu Jun 11 23:08:05.911089 np0000002687 nova-compute[98431]: pc-i440fx-noble Jun 11 23:08:05.911089 np0000002687 nova-compute[98431]: x86_64 Jun 11 23:08:05.911089 np0000002687 nova-compute[98431]: Jun 11 23:08:05.911089 np0000002687 nova-compute[98431]: Jun 11 23:08:05.911089 np0000002687 nova-compute[98431]: Jun 11 23:08:05.911089 np0000002687 nova-compute[98431]: Jun 11 23:08:05.911089 np0000002687 nova-compute[98431]: efi Jun 11 23:08:05.911089 np0000002687 nova-compute[98431]: Jun 11 23:08:05.911089 np0000002687 nova-compute[98431]: Jun 11 23:08:05.911089 np0000002687 nova-compute[98431]: /usr/share/OVMF/OVMF_CODE_4M.fd Jun 11 23:08:05.911089 np0000002687 nova-compute[98431]: Jun 11 23:08:05.911089 np0000002687 nova-compute[98431]: rom Jun 11 23:08:05.911089 np0000002687 nova-compute[98431]: pflash Jun 11 23:08:05.911089 np0000002687 nova-compute[98431]: Jun 11 23:08:05.911089 np0000002687 nova-compute[98431]: Jun 11 23:08:05.911089 np0000002687 nova-compute[98431]: yes Jun 11 23:08:05.911089 np0000002687 nova-compute[98431]: no Jun 11 23:08:05.911089 np0000002687 nova-compute[98431]: Jun 11 23:08:05.911089 np0000002687 nova-compute[98431]: Jun 11 23:08:05.911089 np0000002687 nova-compute[98431]: no Jun 11 23:08:05.911089 np0000002687 nova-compute[98431]: Jun 11 23:08:05.911089 np0000002687 nova-compute[98431]: Jun 11 23:08:05.911089 np0000002687 nova-compute[98431]: Jun 11 23:08:05.911089 np0000002687 nova-compute[98431]: Jun 11 23:08:05.911089 np0000002687 nova-compute[98431]: Jun 11 23:08:05.911089 np0000002687 nova-compute[98431]: Jun 11 23:08:05.911089 np0000002687 nova-compute[98431]: Jun 11 23:08:05.911089 np0000002687 nova-compute[98431]: on Jun 11 23:08:05.911089 np0000002687 nova-compute[98431]: off Jun 11 23:08:05.911089 np0000002687 nova-compute[98431]: Jun 11 23:08:05.911089 np0000002687 nova-compute[98431]: Jun 11 23:08:05.912538 np0000002687 nova-compute[98431]: Jun 11 23:08:05.912538 np0000002687 nova-compute[98431]: EPYC Jun 11 23:08:05.912538 np0000002687 nova-compute[98431]: AMD Jun 11 23:08:05.912538 np0000002687 nova-compute[98431]: Jun 11 23:08:05.912538 np0000002687 nova-compute[98431]: Jun 11 23:08:05.912538 np0000002687 nova-compute[98431]: Jun 11 23:08:05.912538 np0000002687 nova-compute[98431]: Jun 11 23:08:05.912538 np0000002687 nova-compute[98431]: Jun 11 23:08:05.912538 np0000002687 nova-compute[98431]: Jun 11 23:08:05.912538 np0000002687 nova-compute[98431]: Jun 11 23:08:05.912538 np0000002687 nova-compute[98431]: Jun 11 23:08:05.912538 np0000002687 nova-compute[98431]: Jun 11 23:08:05.912538 np0000002687 nova-compute[98431]: Jun 11 23:08:05.912538 np0000002687 nova-compute[98431]: Jun 11 23:08:05.912538 np0000002687 nova-compute[98431]: Jun 11 23:08:05.912538 np0000002687 nova-compute[98431]: Jun 11 23:08:05.912538 np0000002687 nova-compute[98431]: Jun 11 23:08:05.912538 np0000002687 nova-compute[98431]: Jun 11 23:08:05.912538 np0000002687 nova-compute[98431]: Jun 11 23:08:05.912538 np0000002687 nova-compute[98431]: Jun 11 23:08:05.912538 np0000002687 nova-compute[98431]: Jun 11 23:08:05.912538 np0000002687 nova-compute[98431]: Jun 11 23:08:05.912538 np0000002687 nova-compute[98431]: Jun 11 23:08:05.912538 np0000002687 nova-compute[98431]: Jun 11 23:08:05.912538 np0000002687 nova-compute[98431]: Jun 11 23:08:05.912538 np0000002687 nova-compute[98431]: Jun 11 23:08:05.912538 np0000002687 nova-compute[98431]: Jun 11 23:08:05.912538 np0000002687 nova-compute[98431]: Jun 11 23:08:05.912538 np0000002687 nova-compute[98431]: Jun 11 23:08:05.912538 np0000002687 nova-compute[98431]: Jun 11 23:08:05.912538 np0000002687 nova-compute[98431]: Jun 11 23:08:05.912538 np0000002687 nova-compute[98431]: Jun 11 23:08:05.912538 np0000002687 nova-compute[98431]: Jun 11 23:08:05.912538 np0000002687 nova-compute[98431]: Jun 11 23:08:05.912538 np0000002687 nova-compute[98431]: Jun 11 23:08:05.912538 np0000002687 nova-compute[98431]: Jun 11 23:08:05.912538 np0000002687 nova-compute[98431]: Jun 11 23:08:05.912538 np0000002687 nova-compute[98431]: qemu64 Jun 11 23:08:05.912538 np0000002687 nova-compute[98431]: qemu32 Jun 11 23:08:05.912538 np0000002687 nova-compute[98431]: phenom Jun 11 23:08:05.912538 np0000002687 nova-compute[98431]: pentium3 Jun 11 23:08:05.912538 np0000002687 nova-compute[98431]: pentium2 Jun 11 23:08:05.912538 np0000002687 nova-compute[98431]: pentium Jun 11 23:08:05.913396 np0000002687 nova-compute[98431]: n270 Jun 11 23:08:05.913396 np0000002687 nova-compute[98431]: kvm64 Jun 11 23:08:05.913396 np0000002687 nova-compute[98431]: kvm32 Jun 11 23:08:05.913396 np0000002687 nova-compute[98431]: coreduo Jun 11 23:08:05.913396 np0000002687 nova-compute[98431]: core2duo Jun 11 23:08:05.913396 np0000002687 nova-compute[98431]: athlon Jun 11 23:08:05.913396 np0000002687 nova-compute[98431]: Westmere-IBRS Jun 11 23:08:05.913396 np0000002687 nova-compute[98431]: Westmere Jun 11 23:08:05.913396 np0000002687 nova-compute[98431]: Snowridge Jun 11 23:08:05.913396 np0000002687 nova-compute[98431]: Skylake-Server-noTSX-IBRS Jun 11 23:08:05.913396 np0000002687 nova-compute[98431]: Skylake-Server-IBRS Jun 11 23:08:05.913396 np0000002687 nova-compute[98431]: Skylake-Server Jun 11 23:08:05.913396 np0000002687 nova-compute[98431]: Skylake-Client-noTSX-IBRS Jun 11 23:08:05.913396 np0000002687 nova-compute[98431]: Skylake-Client-IBRS Jun 11 23:08:05.913396 np0000002687 nova-compute[98431]: Skylake-Client Jun 11 23:08:05.913396 np0000002687 nova-compute[98431]: SapphireRapids Jun 11 23:08:05.913396 np0000002687 nova-compute[98431]: SandyBridge-IBRS Jun 11 23:08:05.913396 np0000002687 nova-compute[98431]: SandyBridge Jun 11 23:08:05.913396 np0000002687 nova-compute[98431]: Penryn Jun 11 23:08:05.913396 np0000002687 nova-compute[98431]: Opteron_G5 Jun 11 23:08:05.913396 np0000002687 nova-compute[98431]: Opteron_G4 Jun 11 23:08:05.913396 np0000002687 nova-compute[98431]: Opteron_G3 Jun 11 23:08:05.913396 np0000002687 nova-compute[98431]: Opteron_G2 Jun 11 23:08:05.913396 np0000002687 nova-compute[98431]: Opteron_G1 Jun 11 23:08:05.913396 np0000002687 nova-compute[98431]: Nehalem-IBRS Jun 11 23:08:05.913396 np0000002687 nova-compute[98431]: Nehalem Jun 11 23:08:05.913396 np0000002687 nova-compute[98431]: IvyBridge-IBRS Jun 11 23:08:05.913396 np0000002687 nova-compute[98431]: IvyBridge Jun 11 23:08:05.913396 np0000002687 nova-compute[98431]: Icelake-Server-noTSX Jun 11 23:08:05.913396 np0000002687 nova-compute[98431]: Icelake-Server Jun 11 23:08:05.913396 np0000002687 nova-compute[98431]: Haswell-noTSX-IBRS Jun 11 23:08:05.913396 np0000002687 nova-compute[98431]: Haswell-noTSX Jun 11 23:08:05.913396 np0000002687 nova-compute[98431]: Haswell-IBRS Jun 11 23:08:05.914111 np0000002687 nova-compute[98431]: Haswell Jun 11 23:08:05.914111 np0000002687 nova-compute[98431]: EPYC-Rome Jun 11 23:08:05.914111 np0000002687 nova-compute[98431]: EPYC-Milan Jun 11 23:08:05.914111 np0000002687 nova-compute[98431]: EPYC-IBPB Jun 11 23:08:05.914111 np0000002687 nova-compute[98431]: EPYC-Genoa Jun 11 23:08:05.914111 np0000002687 nova-compute[98431]: EPYC Jun 11 23:08:05.914111 np0000002687 nova-compute[98431]: Dhyana Jun 11 23:08:05.914111 np0000002687 nova-compute[98431]: Cooperlake Jun 11 23:08:05.914111 np0000002687 nova-compute[98431]: Conroe Jun 11 23:08:05.914111 np0000002687 nova-compute[98431]: Cascadelake-Server-noTSX Jun 11 23:08:05.914111 np0000002687 nova-compute[98431]: Cascadelake-Server Jun 11 23:08:05.914111 np0000002687 nova-compute[98431]: Broadwell-noTSX-IBRS Jun 11 23:08:05.914111 np0000002687 nova-compute[98431]: Broadwell-noTSX Jun 11 23:08:05.914111 np0000002687 nova-compute[98431]: Broadwell-IBRS Jun 11 23:08:05.914111 np0000002687 nova-compute[98431]: Broadwell Jun 11 23:08:05.914111 np0000002687 nova-compute[98431]: 486 Jun 11 23:08:05.914111 np0000002687 nova-compute[98431]: Jun 11 23:08:05.914111 np0000002687 nova-compute[98431]: Jun 11 23:08:05.914111 np0000002687 nova-compute[98431]: Jun 11 23:08:05.914111 np0000002687 nova-compute[98431]: Jun 11 23:08:05.914111 np0000002687 nova-compute[98431]: file Jun 11 23:08:05.914111 np0000002687 nova-compute[98431]: anonymous Jun 11 23:08:05.914111 np0000002687 nova-compute[98431]: memfd Jun 11 23:08:05.914111 np0000002687 nova-compute[98431]: Jun 11 23:08:05.914111 np0000002687 nova-compute[98431]: Jun 11 23:08:05.914111 np0000002687 nova-compute[98431]: Jun 11 23:08:05.914111 np0000002687 nova-compute[98431]: Jun 11 23:08:05.914111 np0000002687 nova-compute[98431]: Jun 11 23:08:05.914111 np0000002687 nova-compute[98431]: disk Jun 11 23:08:05.914111 np0000002687 nova-compute[98431]: cdrom Jun 11 23:08:05.914111 np0000002687 nova-compute[98431]: floppy Jun 11 23:08:05.914111 np0000002687 nova-compute[98431]: lun Jun 11 23:08:05.914111 np0000002687 nova-compute[98431]: Jun 11 23:08:05.914111 np0000002687 nova-compute[98431]: Jun 11 23:08:05.914111 np0000002687 nova-compute[98431]: ide Jun 11 23:08:05.914111 np0000002687 nova-compute[98431]: fdc Jun 11 23:08:05.914111 np0000002687 nova-compute[98431]: scsi Jun 11 23:08:05.914111 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.914111 np0000002687 nova-compute[98431]: usb Jun 11 23:08:05.914111 np0000002687 nova-compute[98431]: sata Jun 11 23:08:05.914111 np0000002687 nova-compute[98431]: Jun 11 23:08:05.914111 np0000002687 nova-compute[98431]: Jun 11 23:08:05.914111 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.914111 np0000002687 nova-compute[98431]: virtio-transitional Jun 11 23:08:05.914111 np0000002687 nova-compute[98431]: virtio-non-transitional Jun 11 23:08:05.914111 np0000002687 nova-compute[98431]: Jun 11 23:08:05.914111 np0000002687 nova-compute[98431]: Jun 11 23:08:05.914111 np0000002687 nova-compute[98431]: Jun 11 23:08:05.914111 np0000002687 nova-compute[98431]: Jun 11 23:08:05.914111 np0000002687 nova-compute[98431]: sdl Jun 11 23:08:05.914111 np0000002687 nova-compute[98431]: vnc Jun 11 23:08:05.914111 np0000002687 nova-compute[98431]: spice Jun 11 23:08:05.914111 np0000002687 nova-compute[98431]: egl-headless Jun 11 23:08:05.914111 np0000002687 nova-compute[98431]: dbus Jun 11 23:08:05.914111 np0000002687 nova-compute[98431]: Jun 11 23:08:05.914111 np0000002687 nova-compute[98431]: Jun 11 23:08:05.914111 np0000002687 nova-compute[98431]: Jun 11 23:08:05.915392 np0000002687 nova-compute[98431]: Jun 11 23:08:05.915392 np0000002687 nova-compute[98431]: Jun 11 23:08:05.915392 np0000002687 nova-compute[98431]: subsystem Jun 11 23:08:05.915392 np0000002687 nova-compute[98431]: Jun 11 23:08:05.915392 np0000002687 nova-compute[98431]: Jun 11 23:08:05.915392 np0000002687 nova-compute[98431]: default Jun 11 23:08:05.915392 np0000002687 nova-compute[98431]: mandatory Jun 11 23:08:05.915392 np0000002687 nova-compute[98431]: requisite Jun 11 23:08:05.915392 np0000002687 nova-compute[98431]: optional Jun 11 23:08:05.915392 np0000002687 nova-compute[98431]: Jun 11 23:08:05.915392 np0000002687 nova-compute[98431]: Jun 11 23:08:05.915392 np0000002687 nova-compute[98431]: usb Jun 11 23:08:05.915392 np0000002687 nova-compute[98431]: pci Jun 11 23:08:05.915392 np0000002687 nova-compute[98431]: scsi Jun 11 23:08:05.915392 np0000002687 nova-compute[98431]: Jun 11 23:08:05.915392 np0000002687 nova-compute[98431]: Jun 11 23:08:05.915392 np0000002687 nova-compute[98431]: Jun 11 23:08:05.915392 np0000002687 nova-compute[98431]: Jun 11 23:08:05.915392 np0000002687 nova-compute[98431]: Jun 11 23:08:05.915392 np0000002687 nova-compute[98431]: Jun 11 23:08:05.915392 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.915392 np0000002687 nova-compute[98431]: virtio-transitional Jun 11 23:08:05.915392 np0000002687 nova-compute[98431]: virtio-non-transitional Jun 11 23:08:05.915392 np0000002687 nova-compute[98431]: Jun 11 23:08:05.915392 np0000002687 nova-compute[98431]: Jun 11 23:08:05.915392 np0000002687 nova-compute[98431]: random Jun 11 23:08:05.915392 np0000002687 nova-compute[98431]: egd Jun 11 23:08:05.915392 np0000002687 nova-compute[98431]: builtin Jun 11 23:08:05.915392 np0000002687 nova-compute[98431]: Jun 11 23:08:05.915392 np0000002687 nova-compute[98431]: Jun 11 23:08:05.915392 np0000002687 nova-compute[98431]: Jun 11 23:08:05.915392 np0000002687 nova-compute[98431]: Jun 11 23:08:05.915392 np0000002687 nova-compute[98431]: path Jun 11 23:08:05.915392 np0000002687 nova-compute[98431]: handle Jun 11 23:08:05.915392 np0000002687 nova-compute[98431]: virtiofs Jun 11 23:08:05.915392 np0000002687 nova-compute[98431]: Jun 11 23:08:05.915392 np0000002687 nova-compute[98431]: Jun 11 23:08:05.915392 np0000002687 nova-compute[98431]: Jun 11 23:08:05.915392 np0000002687 nova-compute[98431]: Jun 11 23:08:05.915392 np0000002687 nova-compute[98431]: tpm-tis Jun 11 23:08:05.915392 np0000002687 nova-compute[98431]: tpm-crb Jun 11 23:08:05.915392 np0000002687 nova-compute[98431]: Jun 11 23:08:05.915392 np0000002687 nova-compute[98431]: Jun 11 23:08:05.915392 np0000002687 nova-compute[98431]: passthrough Jun 11 23:08:05.915392 np0000002687 nova-compute[98431]: emulator Jun 11 23:08:05.915392 np0000002687 nova-compute[98431]: external Jun 11 23:08:05.915392 np0000002687 nova-compute[98431]: Jun 11 23:08:05.915392 np0000002687 nova-compute[98431]: Jun 11 23:08:05.915392 np0000002687 nova-compute[98431]: 1.2 Jun 11 23:08:05.915392 np0000002687 nova-compute[98431]: 2.0 Jun 11 23:08:05.915392 np0000002687 nova-compute[98431]: Jun 11 23:08:05.915392 np0000002687 nova-compute[98431]: Jun 11 23:08:05.915392 np0000002687 nova-compute[98431]: Jun 11 23:08:05.915392 np0000002687 nova-compute[98431]: Jun 11 23:08:05.915392 np0000002687 nova-compute[98431]: usb Jun 11 23:08:05.915392 np0000002687 nova-compute[98431]: Jun 11 23:08:05.915392 np0000002687 nova-compute[98431]: Jun 11 23:08:05.915392 np0000002687 nova-compute[98431]: Jun 11 23:08:05.915392 np0000002687 nova-compute[98431]: Jun 11 23:08:05.915392 np0000002687 nova-compute[98431]: pty Jun 11 23:08:05.915392 np0000002687 nova-compute[98431]: unix Jun 11 23:08:05.915392 np0000002687 nova-compute[98431]: spicevmc Jun 11 23:08:05.915392 np0000002687 nova-compute[98431]: Jun 11 23:08:05.915392 np0000002687 nova-compute[98431]: Jun 11 23:08:05.915392 np0000002687 nova-compute[98431]: Jun 11 23:08:05.915392 np0000002687 nova-compute[98431]: Jun 11 23:08:05.915392 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.915392 np0000002687 nova-compute[98431]: Jun 11 23:08:05.915392 np0000002687 nova-compute[98431]: Jun 11 23:08:05.915392 np0000002687 nova-compute[98431]: qemu Jun 11 23:08:05.916789 np0000002687 nova-compute[98431]: Jun 11 23:08:05.916789 np0000002687 nova-compute[98431]: Jun 11 23:08:05.916789 np0000002687 nova-compute[98431]: builtin Jun 11 23:08:05.916789 np0000002687 nova-compute[98431]: Jun 11 23:08:05.916789 np0000002687 nova-compute[98431]: Jun 11 23:08:05.916789 np0000002687 nova-compute[98431]: Jun 11 23:08:05.916789 np0000002687 nova-compute[98431]: Jun 11 23:08:05.916789 np0000002687 nova-compute[98431]: Jun 11 23:08:05.916789 np0000002687 nova-compute[98431]: Jun 11 23:08:05.916789 np0000002687 nova-compute[98431]: Jun 11 23:08:05.916789 np0000002687 nova-compute[98431]: Jun 11 23:08:05.916789 np0000002687 nova-compute[98431]: Jun 11 23:08:05.916789 np0000002687 nova-compute[98431]: Jun 11 23:08:05.916789 np0000002687 nova-compute[98431]: Jun 11 23:08:05.916789 np0000002687 nova-compute[98431]: Jun 11 23:08:05.916789 np0000002687 nova-compute[98431]: Jun 11 23:08:05.916789 np0000002687 nova-compute[98431]: Jun 11 23:08:05.916789 np0000002687 nova-compute[98431]: relaxed Jun 11 23:08:05.916789 np0000002687 nova-compute[98431]: vapic Jun 11 23:08:05.916789 np0000002687 nova-compute[98431]: spinlocks Jun 11 23:08:05.916789 np0000002687 nova-compute[98431]: vpindex Jun 11 23:08:05.916789 np0000002687 nova-compute[98431]: runtime Jun 11 23:08:05.916789 np0000002687 nova-compute[98431]: synic Jun 11 23:08:05.916789 np0000002687 nova-compute[98431]: stimer Jun 11 23:08:05.916789 np0000002687 nova-compute[98431]: reset Jun 11 23:08:05.916789 np0000002687 nova-compute[98431]: vendor_id Jun 11 23:08:05.916789 np0000002687 nova-compute[98431]: frequencies Jun 11 23:08:05.916789 np0000002687 nova-compute[98431]: reenlightenment Jun 11 23:08:05.916789 np0000002687 nova-compute[98431]: tlbflush Jun 11 23:08:05.916789 np0000002687 nova-compute[98431]: ipi Jun 11 23:08:05.916789 np0000002687 nova-compute[98431]: avic Jun 11 23:08:05.916789 np0000002687 nova-compute[98431]: Jun 11 23:08:05.916789 np0000002687 nova-compute[98431]: Jun 11 23:08:05.916789 np0000002687 nova-compute[98431]: Jun 11 23:08:05.916789 np0000002687 nova-compute[98431]: Jun 11 23:08:05.916789 np0000002687 nova-compute[98431]: {{(pid=98431) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 11 23:08:05.916789 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu: Jun 11 23:08:05.916789 np0000002687 nova-compute[98431]: Jun 11 23:08:05.916789 np0000002687 nova-compute[98431]: /usr/bin/qemu-system-x86_64 Jun 11 23:08:05.916789 np0000002687 nova-compute[98431]: qemu Jun 11 23:08:05.916789 np0000002687 nova-compute[98431]: pc-i440fx-noble-v2 Jun 11 23:08:05.916789 np0000002687 nova-compute[98431]: x86_64 Jun 11 23:08:05.916789 np0000002687 nova-compute[98431]: Jun 11 23:08:05.916789 np0000002687 nova-compute[98431]: Jun 11 23:08:05.916789 np0000002687 nova-compute[98431]: Jun 11 23:08:05.916789 np0000002687 nova-compute[98431]: Jun 11 23:08:05.916789 np0000002687 nova-compute[98431]: efi Jun 11 23:08:05.916789 np0000002687 nova-compute[98431]: Jun 11 23:08:05.916789 np0000002687 nova-compute[98431]: Jun 11 23:08:05.916789 np0000002687 nova-compute[98431]: /usr/share/OVMF/OVMF_CODE_4M.fd Jun 11 23:08:05.916789 np0000002687 nova-compute[98431]: Jun 11 23:08:05.916789 np0000002687 nova-compute[98431]: rom Jun 11 23:08:05.916789 np0000002687 nova-compute[98431]: pflash Jun 11 23:08:05.916789 np0000002687 nova-compute[98431]: Jun 11 23:08:05.916789 np0000002687 nova-compute[98431]: Jun 11 23:08:05.916789 np0000002687 nova-compute[98431]: yes Jun 11 23:08:05.916789 np0000002687 nova-compute[98431]: no Jun 11 23:08:05.916789 np0000002687 nova-compute[98431]: Jun 11 23:08:05.916789 np0000002687 nova-compute[98431]: Jun 11 23:08:05.916789 np0000002687 nova-compute[98431]: no Jun 11 23:08:05.916789 np0000002687 nova-compute[98431]: Jun 11 23:08:05.916789 np0000002687 nova-compute[98431]: Jun 11 23:08:05.916789 np0000002687 nova-compute[98431]: Jun 11 23:08:05.916789 np0000002687 nova-compute[98431]: Jun 11 23:08:05.916789 np0000002687 nova-compute[98431]: Jun 11 23:08:05.916789 np0000002687 nova-compute[98431]: Jun 11 23:08:05.916789 np0000002687 nova-compute[98431]: Jun 11 23:08:05.916789 np0000002687 nova-compute[98431]: on Jun 11 23:08:05.918063 np0000002687 nova-compute[98431]: off Jun 11 23:08:05.918063 np0000002687 nova-compute[98431]: Jun 11 23:08:05.918063 np0000002687 nova-compute[98431]: Jun 11 23:08:05.918063 np0000002687 nova-compute[98431]: Jun 11 23:08:05.918063 np0000002687 nova-compute[98431]: EPYC Jun 11 23:08:05.918063 np0000002687 nova-compute[98431]: AMD Jun 11 23:08:05.918063 np0000002687 nova-compute[98431]: Jun 11 23:08:05.918063 np0000002687 nova-compute[98431]: Jun 11 23:08:05.918063 np0000002687 nova-compute[98431]: Jun 11 23:08:05.918063 np0000002687 nova-compute[98431]: Jun 11 23:08:05.918063 np0000002687 nova-compute[98431]: Jun 11 23:08:05.918063 np0000002687 nova-compute[98431]: Jun 11 23:08:05.918063 np0000002687 nova-compute[98431]: Jun 11 23:08:05.918063 np0000002687 nova-compute[98431]: Jun 11 23:08:05.918063 np0000002687 nova-compute[98431]: Jun 11 23:08:05.918063 np0000002687 nova-compute[98431]: Jun 11 23:08:05.918063 np0000002687 nova-compute[98431]: Jun 11 23:08:05.918063 np0000002687 nova-compute[98431]: Jun 11 23:08:05.918063 np0000002687 nova-compute[98431]: Jun 11 23:08:05.918063 np0000002687 nova-compute[98431]: Jun 11 23:08:05.918063 np0000002687 nova-compute[98431]: Jun 11 23:08:05.918063 np0000002687 nova-compute[98431]: Jun 11 23:08:05.918063 np0000002687 nova-compute[98431]: Jun 11 23:08:05.918063 np0000002687 nova-compute[98431]: Jun 11 23:08:05.918063 np0000002687 nova-compute[98431]: Jun 11 23:08:05.918063 np0000002687 nova-compute[98431]: Jun 11 23:08:05.918063 np0000002687 nova-compute[98431]: Jun 11 23:08:05.918063 np0000002687 nova-compute[98431]: Jun 11 23:08:05.918063 np0000002687 nova-compute[98431]: Jun 11 23:08:05.918063 np0000002687 nova-compute[98431]: Jun 11 23:08:05.918063 np0000002687 nova-compute[98431]: Jun 11 23:08:05.918063 np0000002687 nova-compute[98431]: Jun 11 23:08:05.918063 np0000002687 nova-compute[98431]: Jun 11 23:08:05.918063 np0000002687 nova-compute[98431]: Jun 11 23:08:05.918063 np0000002687 nova-compute[98431]: Jun 11 23:08:05.918063 np0000002687 nova-compute[98431]: Jun 11 23:08:05.918063 np0000002687 nova-compute[98431]: Jun 11 23:08:05.918063 np0000002687 nova-compute[98431]: Jun 11 23:08:05.918063 np0000002687 nova-compute[98431]: Jun 11 23:08:05.918063 np0000002687 nova-compute[98431]: Jun 11 23:08:05.918063 np0000002687 nova-compute[98431]: qemu64 Jun 11 23:08:05.918063 np0000002687 nova-compute[98431]: qemu32 Jun 11 23:08:05.918063 np0000002687 nova-compute[98431]: phenom Jun 11 23:08:05.918063 np0000002687 nova-compute[98431]: pentium3 Jun 11 23:08:05.918063 np0000002687 nova-compute[98431]: pentium2 Jun 11 23:08:05.918840 np0000002687 nova-compute[98431]: pentium Jun 11 23:08:05.918840 np0000002687 nova-compute[98431]: n270 Jun 11 23:08:05.918840 np0000002687 nova-compute[98431]: kvm64 Jun 11 23:08:05.918840 np0000002687 nova-compute[98431]: kvm32 Jun 11 23:08:05.918840 np0000002687 nova-compute[98431]: coreduo Jun 11 23:08:05.918840 np0000002687 nova-compute[98431]: core2duo Jun 11 23:08:05.918840 np0000002687 nova-compute[98431]: athlon Jun 11 23:08:05.918840 np0000002687 nova-compute[98431]: Westmere-IBRS Jun 11 23:08:05.918840 np0000002687 nova-compute[98431]: Westmere Jun 11 23:08:05.918840 np0000002687 nova-compute[98431]: Snowridge Jun 11 23:08:05.918840 np0000002687 nova-compute[98431]: Skylake-Server-noTSX-IBRS Jun 11 23:08:05.918840 np0000002687 nova-compute[98431]: Skylake-Server-IBRS Jun 11 23:08:05.918840 np0000002687 nova-compute[98431]: Skylake-Server Jun 11 23:08:05.918840 np0000002687 nova-compute[98431]: Skylake-Client-noTSX-IBRS Jun 11 23:08:05.918840 np0000002687 nova-compute[98431]: Skylake-Client-IBRS Jun 11 23:08:05.918840 np0000002687 nova-compute[98431]: Skylake-Client Jun 11 23:08:05.918840 np0000002687 nova-compute[98431]: SapphireRapids Jun 11 23:08:05.918840 np0000002687 nova-compute[98431]: SandyBridge-IBRS Jun 11 23:08:05.918840 np0000002687 nova-compute[98431]: SandyBridge Jun 11 23:08:05.918840 np0000002687 nova-compute[98431]: Penryn Jun 11 23:08:05.918840 np0000002687 nova-compute[98431]: Opteron_G5 Jun 11 23:08:05.918840 np0000002687 nova-compute[98431]: Opteron_G4 Jun 11 23:08:05.918840 np0000002687 nova-compute[98431]: Opteron_G3 Jun 11 23:08:05.918840 np0000002687 nova-compute[98431]: Opteron_G2 Jun 11 23:08:05.918840 np0000002687 nova-compute[98431]: Opteron_G1 Jun 11 23:08:05.918840 np0000002687 nova-compute[98431]: Nehalem-IBRS Jun 11 23:08:05.918840 np0000002687 nova-compute[98431]: Nehalem Jun 11 23:08:05.918840 np0000002687 nova-compute[98431]: IvyBridge-IBRS Jun 11 23:08:05.918840 np0000002687 nova-compute[98431]: IvyBridge Jun 11 23:08:05.918840 np0000002687 nova-compute[98431]: Icelake-Server-noTSX Jun 11 23:08:05.918840 np0000002687 nova-compute[98431]: Icelake-Server Jun 11 23:08:05.918840 np0000002687 nova-compute[98431]: Haswell-noTSX-IBRS Jun 11 23:08:05.918840 np0000002687 nova-compute[98431]: Haswell-noTSX Jun 11 23:08:05.919499 np0000002687 nova-compute[98431]: Haswell-IBRS Jun 11 23:08:05.919499 np0000002687 nova-compute[98431]: Haswell Jun 11 23:08:05.919499 np0000002687 nova-compute[98431]: EPYC-Rome Jun 11 23:08:05.919499 np0000002687 nova-compute[98431]: EPYC-Milan Jun 11 23:08:05.919499 np0000002687 nova-compute[98431]: EPYC-IBPB Jun 11 23:08:05.919499 np0000002687 nova-compute[98431]: EPYC-Genoa Jun 11 23:08:05.919499 np0000002687 nova-compute[98431]: EPYC Jun 11 23:08:05.919499 np0000002687 nova-compute[98431]: Dhyana Jun 11 23:08:05.919499 np0000002687 nova-compute[98431]: Cooperlake Jun 11 23:08:05.919499 np0000002687 nova-compute[98431]: Conroe Jun 11 23:08:05.919499 np0000002687 nova-compute[98431]: Cascadelake-Server-noTSX Jun 11 23:08:05.919499 np0000002687 nova-compute[98431]: Cascadelake-Server Jun 11 23:08:05.919499 np0000002687 nova-compute[98431]: Broadwell-noTSX-IBRS Jun 11 23:08:05.919499 np0000002687 nova-compute[98431]: Broadwell-noTSX Jun 11 23:08:05.919499 np0000002687 nova-compute[98431]: Broadwell-IBRS Jun 11 23:08:05.919499 np0000002687 nova-compute[98431]: Broadwell Jun 11 23:08:05.919499 np0000002687 nova-compute[98431]: 486 Jun 11 23:08:05.919499 np0000002687 nova-compute[98431]: Jun 11 23:08:05.919499 np0000002687 nova-compute[98431]: Jun 11 23:08:05.919499 np0000002687 nova-compute[98431]: Jun 11 23:08:05.919499 np0000002687 nova-compute[98431]: Jun 11 23:08:05.919499 np0000002687 nova-compute[98431]: file Jun 11 23:08:05.919499 np0000002687 nova-compute[98431]: anonymous Jun 11 23:08:05.919499 np0000002687 nova-compute[98431]: memfd Jun 11 23:08:05.919499 np0000002687 nova-compute[98431]: Jun 11 23:08:05.919499 np0000002687 nova-compute[98431]: Jun 11 23:08:05.919499 np0000002687 nova-compute[98431]: Jun 11 23:08:05.919499 np0000002687 nova-compute[98431]: Jun 11 23:08:05.919499 np0000002687 nova-compute[98431]: Jun 11 23:08:05.919499 np0000002687 nova-compute[98431]: disk Jun 11 23:08:05.919499 np0000002687 nova-compute[98431]: cdrom Jun 11 23:08:05.919499 np0000002687 nova-compute[98431]: floppy Jun 11 23:08:05.919499 np0000002687 nova-compute[98431]: lun Jun 11 23:08:05.919499 np0000002687 nova-compute[98431]: Jun 11 23:08:05.919499 np0000002687 nova-compute[98431]: Jun 11 23:08:05.919499 np0000002687 nova-compute[98431]: ide Jun 11 23:08:05.919499 np0000002687 nova-compute[98431]: fdc Jun 11 23:08:05.919499 np0000002687 nova-compute[98431]: scsi Jun 11 23:08:05.919499 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.919499 np0000002687 nova-compute[98431]: usb Jun 11 23:08:05.919499 np0000002687 nova-compute[98431]: sata Jun 11 23:08:05.919499 np0000002687 nova-compute[98431]: Jun 11 23:08:05.919499 np0000002687 nova-compute[98431]: Jun 11 23:08:05.919499 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.919499 np0000002687 nova-compute[98431]: virtio-transitional Jun 11 23:08:05.919499 np0000002687 nova-compute[98431]: virtio-non-transitional Jun 11 23:08:05.919499 np0000002687 nova-compute[98431]: Jun 11 23:08:05.919499 np0000002687 nova-compute[98431]: Jun 11 23:08:05.919499 np0000002687 nova-compute[98431]: Jun 11 23:08:05.919499 np0000002687 nova-compute[98431]: Jun 11 23:08:05.919499 np0000002687 nova-compute[98431]: sdl Jun 11 23:08:05.919499 np0000002687 nova-compute[98431]: vnc Jun 11 23:08:05.919499 np0000002687 nova-compute[98431]: spice Jun 11 23:08:05.919499 np0000002687 nova-compute[98431]: egl-headless Jun 11 23:08:05.919499 np0000002687 nova-compute[98431]: dbus Jun 11 23:08:05.919499 np0000002687 nova-compute[98431]: Jun 11 23:08:05.919499 np0000002687 nova-compute[98431]: Jun 11 23:08:05.919499 np0000002687 nova-compute[98431]: Jun 11 23:08:05.920586 np0000002687 nova-compute[98431]: Jun 11 23:08:05.920586 np0000002687 nova-compute[98431]: Jun 11 23:08:05.920586 np0000002687 nova-compute[98431]: subsystem Jun 11 23:08:05.920586 np0000002687 nova-compute[98431]: Jun 11 23:08:05.920586 np0000002687 nova-compute[98431]: Jun 11 23:08:05.920586 np0000002687 nova-compute[98431]: default Jun 11 23:08:05.920586 np0000002687 nova-compute[98431]: mandatory Jun 11 23:08:05.920586 np0000002687 nova-compute[98431]: requisite Jun 11 23:08:05.920586 np0000002687 nova-compute[98431]: optional Jun 11 23:08:05.920586 np0000002687 nova-compute[98431]: Jun 11 23:08:05.920586 np0000002687 nova-compute[98431]: Jun 11 23:08:05.920586 np0000002687 nova-compute[98431]: usb Jun 11 23:08:05.920586 np0000002687 nova-compute[98431]: pci Jun 11 23:08:05.920586 np0000002687 nova-compute[98431]: scsi Jun 11 23:08:05.920586 np0000002687 nova-compute[98431]: Jun 11 23:08:05.920586 np0000002687 nova-compute[98431]: Jun 11 23:08:05.920586 np0000002687 nova-compute[98431]: Jun 11 23:08:05.920586 np0000002687 nova-compute[98431]: Jun 11 23:08:05.920586 np0000002687 nova-compute[98431]: Jun 11 23:08:05.920586 np0000002687 nova-compute[98431]: Jun 11 23:08:05.920586 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.920586 np0000002687 nova-compute[98431]: virtio-transitional Jun 11 23:08:05.920586 np0000002687 nova-compute[98431]: virtio-non-transitional Jun 11 23:08:05.920586 np0000002687 nova-compute[98431]: Jun 11 23:08:05.920586 np0000002687 nova-compute[98431]: Jun 11 23:08:05.920586 np0000002687 nova-compute[98431]: random Jun 11 23:08:05.920586 np0000002687 nova-compute[98431]: egd Jun 11 23:08:05.920586 np0000002687 nova-compute[98431]: builtin Jun 11 23:08:05.920586 np0000002687 nova-compute[98431]: Jun 11 23:08:05.920586 np0000002687 nova-compute[98431]: Jun 11 23:08:05.920586 np0000002687 nova-compute[98431]: Jun 11 23:08:05.920586 np0000002687 nova-compute[98431]: Jun 11 23:08:05.920586 np0000002687 nova-compute[98431]: path Jun 11 23:08:05.920586 np0000002687 nova-compute[98431]: handle Jun 11 23:08:05.920586 np0000002687 nova-compute[98431]: virtiofs Jun 11 23:08:05.920586 np0000002687 nova-compute[98431]: Jun 11 23:08:05.920586 np0000002687 nova-compute[98431]: Jun 11 23:08:05.920586 np0000002687 nova-compute[98431]: Jun 11 23:08:05.920586 np0000002687 nova-compute[98431]: Jun 11 23:08:05.920586 np0000002687 nova-compute[98431]: tpm-tis Jun 11 23:08:05.920586 np0000002687 nova-compute[98431]: tpm-crb Jun 11 23:08:05.920586 np0000002687 nova-compute[98431]: Jun 11 23:08:05.920586 np0000002687 nova-compute[98431]: Jun 11 23:08:05.920586 np0000002687 nova-compute[98431]: passthrough Jun 11 23:08:05.920586 np0000002687 nova-compute[98431]: emulator Jun 11 23:08:05.920586 np0000002687 nova-compute[98431]: external Jun 11 23:08:05.920586 np0000002687 nova-compute[98431]: Jun 11 23:08:05.920586 np0000002687 nova-compute[98431]: Jun 11 23:08:05.920586 np0000002687 nova-compute[98431]: 1.2 Jun 11 23:08:05.920586 np0000002687 nova-compute[98431]: 2.0 Jun 11 23:08:05.920586 np0000002687 nova-compute[98431]: Jun 11 23:08:05.920586 np0000002687 nova-compute[98431]: Jun 11 23:08:05.920586 np0000002687 nova-compute[98431]: Jun 11 23:08:05.920586 np0000002687 nova-compute[98431]: Jun 11 23:08:05.920586 np0000002687 nova-compute[98431]: usb Jun 11 23:08:05.920586 np0000002687 nova-compute[98431]: Jun 11 23:08:05.920586 np0000002687 nova-compute[98431]: Jun 11 23:08:05.920586 np0000002687 nova-compute[98431]: Jun 11 23:08:05.920586 np0000002687 nova-compute[98431]: Jun 11 23:08:05.920586 np0000002687 nova-compute[98431]: pty Jun 11 23:08:05.920586 np0000002687 nova-compute[98431]: unix Jun 11 23:08:05.920586 np0000002687 nova-compute[98431]: spicevmc Jun 11 23:08:05.920586 np0000002687 nova-compute[98431]: Jun 11 23:08:05.920586 np0000002687 nova-compute[98431]: Jun 11 23:08:05.920586 np0000002687 nova-compute[98431]: Jun 11 23:08:05.920586 np0000002687 nova-compute[98431]: Jun 11 23:08:05.920586 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.922110 np0000002687 nova-compute[98431]: Jun 11 23:08:05.922110 np0000002687 nova-compute[98431]: Jun 11 23:08:05.922110 np0000002687 nova-compute[98431]: qemu Jun 11 23:08:05.922110 np0000002687 nova-compute[98431]: Jun 11 23:08:05.922110 np0000002687 nova-compute[98431]: Jun 11 23:08:05.922110 np0000002687 nova-compute[98431]: builtin Jun 11 23:08:05.922110 np0000002687 nova-compute[98431]: Jun 11 23:08:05.922110 np0000002687 nova-compute[98431]: Jun 11 23:08:05.922110 np0000002687 nova-compute[98431]: Jun 11 23:08:05.922110 np0000002687 nova-compute[98431]: Jun 11 23:08:05.922110 np0000002687 nova-compute[98431]: Jun 11 23:08:05.922110 np0000002687 nova-compute[98431]: Jun 11 23:08:05.922110 np0000002687 nova-compute[98431]: Jun 11 23:08:05.922110 np0000002687 nova-compute[98431]: Jun 11 23:08:05.922110 np0000002687 nova-compute[98431]: Jun 11 23:08:05.922110 np0000002687 nova-compute[98431]: Jun 11 23:08:05.922110 np0000002687 nova-compute[98431]: Jun 11 23:08:05.922110 np0000002687 nova-compute[98431]: Jun 11 23:08:05.922110 np0000002687 nova-compute[98431]: Jun 11 23:08:05.922110 np0000002687 nova-compute[98431]: Jun 11 23:08:05.922110 np0000002687 nova-compute[98431]: relaxed Jun 11 23:08:05.922110 np0000002687 nova-compute[98431]: vapic Jun 11 23:08:05.922110 np0000002687 nova-compute[98431]: spinlocks Jun 11 23:08:05.922110 np0000002687 nova-compute[98431]: vpindex Jun 11 23:08:05.922110 np0000002687 nova-compute[98431]: runtime Jun 11 23:08:05.922110 np0000002687 nova-compute[98431]: synic Jun 11 23:08:05.922110 np0000002687 nova-compute[98431]: stimer Jun 11 23:08:05.922110 np0000002687 nova-compute[98431]: reset Jun 11 23:08:05.922110 np0000002687 nova-compute[98431]: vendor_id Jun 11 23:08:05.922110 np0000002687 nova-compute[98431]: frequencies Jun 11 23:08:05.922110 np0000002687 nova-compute[98431]: reenlightenment Jun 11 23:08:05.922110 np0000002687 nova-compute[98431]: tlbflush Jun 11 23:08:05.922110 np0000002687 nova-compute[98431]: ipi Jun 11 23:08:05.922110 np0000002687 nova-compute[98431]: avic Jun 11 23:08:05.922110 np0000002687 nova-compute[98431]: Jun 11 23:08:05.922110 np0000002687 nova-compute[98431]: Jun 11 23:08:05.922110 np0000002687 nova-compute[98431]: Jun 11 23:08:05.922110 np0000002687 nova-compute[98431]: Jun 11 23:08:05.922110 np0000002687 nova-compute[98431]: {{(pid=98431) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 11 23:08:05.922110 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35: Jun 11 23:08:05.922110 np0000002687 nova-compute[98431]: Jun 11 23:08:05.922110 np0000002687 nova-compute[98431]: /usr/bin/qemu-system-x86_64 Jun 11 23:08:05.922110 np0000002687 nova-compute[98431]: qemu Jun 11 23:08:05.922110 np0000002687 nova-compute[98431]: pc-q35-noble-v2 Jun 11 23:08:05.922110 np0000002687 nova-compute[98431]: x86_64 Jun 11 23:08:05.922110 np0000002687 nova-compute[98431]: Jun 11 23:08:05.922110 np0000002687 nova-compute[98431]: Jun 11 23:08:05.922110 np0000002687 nova-compute[98431]: Jun 11 23:08:05.922110 np0000002687 nova-compute[98431]: Jun 11 23:08:05.922110 np0000002687 nova-compute[98431]: efi Jun 11 23:08:05.922110 np0000002687 nova-compute[98431]: Jun 11 23:08:05.922110 np0000002687 nova-compute[98431]: Jun 11 23:08:05.922110 np0000002687 nova-compute[98431]: /usr/share/OVMF/OVMF_CODE_4M.ms.fd Jun 11 23:08:05.922110 np0000002687 nova-compute[98431]: /usr/share/OVMF/OVMF_CODE_4M.secboot.fd Jun 11 23:08:05.922110 np0000002687 nova-compute[98431]: /usr/share/ovmf/OVMF.amdsev.fd Jun 11 23:08:05.922110 np0000002687 nova-compute[98431]: /usr/share/OVMF/OVMF_CODE_4M.fd Jun 11 23:08:05.922110 np0000002687 nova-compute[98431]: Jun 11 23:08:05.922110 np0000002687 nova-compute[98431]: rom Jun 11 23:08:05.922110 np0000002687 nova-compute[98431]: pflash Jun 11 23:08:05.922110 np0000002687 nova-compute[98431]: Jun 11 23:08:05.922110 np0000002687 nova-compute[98431]: Jun 11 23:08:05.922110 np0000002687 nova-compute[98431]: yes Jun 11 23:08:05.922110 np0000002687 nova-compute[98431]: no Jun 11 23:08:05.922110 np0000002687 nova-compute[98431]: Jun 11 23:08:05.923275 np0000002687 nova-compute[98431]: Jun 11 23:08:05.923275 np0000002687 nova-compute[98431]: yes Jun 11 23:08:05.923275 np0000002687 nova-compute[98431]: no Jun 11 23:08:05.923275 np0000002687 nova-compute[98431]: Jun 11 23:08:05.923275 np0000002687 nova-compute[98431]: Jun 11 23:08:05.923275 np0000002687 nova-compute[98431]: Jun 11 23:08:05.923275 np0000002687 nova-compute[98431]: Jun 11 23:08:05.923275 np0000002687 nova-compute[98431]: Jun 11 23:08:05.923275 np0000002687 nova-compute[98431]: Jun 11 23:08:05.923275 np0000002687 nova-compute[98431]: Jun 11 23:08:05.923275 np0000002687 nova-compute[98431]: on Jun 11 23:08:05.923275 np0000002687 nova-compute[98431]: off Jun 11 23:08:05.923275 np0000002687 nova-compute[98431]: Jun 11 23:08:05.923275 np0000002687 nova-compute[98431]: Jun 11 23:08:05.923275 np0000002687 nova-compute[98431]: Jun 11 23:08:05.923275 np0000002687 nova-compute[98431]: EPYC Jun 11 23:08:05.923275 np0000002687 nova-compute[98431]: AMD Jun 11 23:08:05.923275 np0000002687 nova-compute[98431]: Jun 11 23:08:05.923275 np0000002687 nova-compute[98431]: Jun 11 23:08:05.923275 np0000002687 nova-compute[98431]: Jun 11 23:08:05.923275 np0000002687 nova-compute[98431]: Jun 11 23:08:05.923275 np0000002687 nova-compute[98431]: Jun 11 23:08:05.923275 np0000002687 nova-compute[98431]: Jun 11 23:08:05.923275 np0000002687 nova-compute[98431]: Jun 11 23:08:05.923275 np0000002687 nova-compute[98431]: Jun 11 23:08:05.923275 np0000002687 nova-compute[98431]: Jun 11 23:08:05.923275 np0000002687 nova-compute[98431]: Jun 11 23:08:05.923275 np0000002687 nova-compute[98431]: Jun 11 23:08:05.923275 np0000002687 nova-compute[98431]: Jun 11 23:08:05.923275 np0000002687 nova-compute[98431]: Jun 11 23:08:05.923275 np0000002687 nova-compute[98431]: Jun 11 23:08:05.923275 np0000002687 nova-compute[98431]: Jun 11 23:08:05.923275 np0000002687 nova-compute[98431]: Jun 11 23:08:05.923275 np0000002687 nova-compute[98431]: Jun 11 23:08:05.923275 np0000002687 nova-compute[98431]: Jun 11 23:08:05.923275 np0000002687 nova-compute[98431]: Jun 11 23:08:05.923275 np0000002687 nova-compute[98431]: Jun 11 23:08:05.923275 np0000002687 nova-compute[98431]: Jun 11 23:08:05.923275 np0000002687 nova-compute[98431]: Jun 11 23:08:05.923275 np0000002687 nova-compute[98431]: Jun 11 23:08:05.923275 np0000002687 nova-compute[98431]: Jun 11 23:08:05.923275 np0000002687 nova-compute[98431]: Jun 11 23:08:05.923275 np0000002687 nova-compute[98431]: Jun 11 23:08:05.923275 np0000002687 nova-compute[98431]: Jun 11 23:08:05.923275 np0000002687 nova-compute[98431]: Jun 11 23:08:05.923275 np0000002687 nova-compute[98431]: Jun 11 23:08:05.923275 np0000002687 nova-compute[98431]: Jun 11 23:08:05.923275 np0000002687 nova-compute[98431]: Jun 11 23:08:05.923275 np0000002687 nova-compute[98431]: Jun 11 23:08:05.923275 np0000002687 nova-compute[98431]: Jun 11 23:08:05.923275 np0000002687 nova-compute[98431]: Jun 11 23:08:05.924155 np0000002687 nova-compute[98431]: qemu64 Jun 11 23:08:05.924155 np0000002687 nova-compute[98431]: qemu32 Jun 11 23:08:05.924155 np0000002687 nova-compute[98431]: phenom Jun 11 23:08:05.924155 np0000002687 nova-compute[98431]: pentium3 Jun 11 23:08:05.924155 np0000002687 nova-compute[98431]: pentium2 Jun 11 23:08:05.924155 np0000002687 nova-compute[98431]: pentium Jun 11 23:08:05.924155 np0000002687 nova-compute[98431]: n270 Jun 11 23:08:05.924155 np0000002687 nova-compute[98431]: kvm64 Jun 11 23:08:05.924155 np0000002687 nova-compute[98431]: kvm32 Jun 11 23:08:05.924155 np0000002687 nova-compute[98431]: coreduo Jun 11 23:08:05.924155 np0000002687 nova-compute[98431]: core2duo Jun 11 23:08:05.924155 np0000002687 nova-compute[98431]: athlon Jun 11 23:08:05.924155 np0000002687 nova-compute[98431]: Westmere-IBRS Jun 11 23:08:05.924155 np0000002687 nova-compute[98431]: Westmere Jun 11 23:08:05.924155 np0000002687 nova-compute[98431]: Snowridge Jun 11 23:08:05.924155 np0000002687 nova-compute[98431]: Skylake-Server-noTSX-IBRS Jun 11 23:08:05.924155 np0000002687 nova-compute[98431]: Skylake-Server-IBRS Jun 11 23:08:05.924155 np0000002687 nova-compute[98431]: Skylake-Server Jun 11 23:08:05.924155 np0000002687 nova-compute[98431]: Skylake-Client-noTSX-IBRS Jun 11 23:08:05.924155 np0000002687 nova-compute[98431]: Skylake-Client-IBRS Jun 11 23:08:05.924155 np0000002687 nova-compute[98431]: Skylake-Client Jun 11 23:08:05.924155 np0000002687 nova-compute[98431]: SapphireRapids Jun 11 23:08:05.924155 np0000002687 nova-compute[98431]: SandyBridge-IBRS Jun 11 23:08:05.924155 np0000002687 nova-compute[98431]: SandyBridge Jun 11 23:08:05.924155 np0000002687 nova-compute[98431]: Penryn Jun 11 23:08:05.924155 np0000002687 nova-compute[98431]: Opteron_G5 Jun 11 23:08:05.924155 np0000002687 nova-compute[98431]: Opteron_G4 Jun 11 23:08:05.924155 np0000002687 nova-compute[98431]: Opteron_G3 Jun 11 23:08:05.924155 np0000002687 nova-compute[98431]: Opteron_G2 Jun 11 23:08:05.924155 np0000002687 nova-compute[98431]: Opteron_G1 Jun 11 23:08:05.924155 np0000002687 nova-compute[98431]: Nehalem-IBRS Jun 11 23:08:05.924155 np0000002687 nova-compute[98431]: Nehalem Jun 11 23:08:05.924155 np0000002687 nova-compute[98431]: IvyBridge-IBRS Jun 11 23:08:05.924155 np0000002687 nova-compute[98431]: IvyBridge Jun 11 23:08:05.924900 np0000002687 nova-compute[98431]: Icelake-Server-noTSX Jun 11 23:08:05.924900 np0000002687 nova-compute[98431]: Icelake-Server Jun 11 23:08:05.924900 np0000002687 nova-compute[98431]: Haswell-noTSX-IBRS Jun 11 23:08:05.924900 np0000002687 nova-compute[98431]: Haswell-noTSX Jun 11 23:08:05.924900 np0000002687 nova-compute[98431]: Haswell-IBRS Jun 11 23:08:05.924900 np0000002687 nova-compute[98431]: Haswell Jun 11 23:08:05.924900 np0000002687 nova-compute[98431]: EPYC-Rome Jun 11 23:08:05.924900 np0000002687 nova-compute[98431]: EPYC-Milan Jun 11 23:08:05.924900 np0000002687 nova-compute[98431]: EPYC-IBPB Jun 11 23:08:05.924900 np0000002687 nova-compute[98431]: EPYC-Genoa Jun 11 23:08:05.924900 np0000002687 nova-compute[98431]: EPYC Jun 11 23:08:05.924900 np0000002687 nova-compute[98431]: Dhyana Jun 11 23:08:05.924900 np0000002687 nova-compute[98431]: Cooperlake Jun 11 23:08:05.924900 np0000002687 nova-compute[98431]: Conroe Jun 11 23:08:05.924900 np0000002687 nova-compute[98431]: Cascadelake-Server-noTSX Jun 11 23:08:05.924900 np0000002687 nova-compute[98431]: Cascadelake-Server Jun 11 23:08:05.924900 np0000002687 nova-compute[98431]: Broadwell-noTSX-IBRS Jun 11 23:08:05.924900 np0000002687 nova-compute[98431]: Broadwell-noTSX Jun 11 23:08:05.924900 np0000002687 nova-compute[98431]: Broadwell-IBRS Jun 11 23:08:05.924900 np0000002687 nova-compute[98431]: Broadwell Jun 11 23:08:05.924900 np0000002687 nova-compute[98431]: 486 Jun 11 23:08:05.924900 np0000002687 nova-compute[98431]: Jun 11 23:08:05.924900 np0000002687 nova-compute[98431]: Jun 11 23:08:05.924900 np0000002687 nova-compute[98431]: Jun 11 23:08:05.924900 np0000002687 nova-compute[98431]: Jun 11 23:08:05.924900 np0000002687 nova-compute[98431]: file Jun 11 23:08:05.924900 np0000002687 nova-compute[98431]: anonymous Jun 11 23:08:05.924900 np0000002687 nova-compute[98431]: memfd Jun 11 23:08:05.924900 np0000002687 nova-compute[98431]: Jun 11 23:08:05.924900 np0000002687 nova-compute[98431]: Jun 11 23:08:05.924900 np0000002687 nova-compute[98431]: Jun 11 23:08:05.924900 np0000002687 nova-compute[98431]: Jun 11 23:08:05.924900 np0000002687 nova-compute[98431]: Jun 11 23:08:05.924900 np0000002687 nova-compute[98431]: disk Jun 11 23:08:05.924900 np0000002687 nova-compute[98431]: cdrom Jun 11 23:08:05.924900 np0000002687 nova-compute[98431]: floppy Jun 11 23:08:05.924900 np0000002687 nova-compute[98431]: lun Jun 11 23:08:05.924900 np0000002687 nova-compute[98431]: Jun 11 23:08:05.924900 np0000002687 nova-compute[98431]: Jun 11 23:08:05.924900 np0000002687 nova-compute[98431]: fdc Jun 11 23:08:05.924900 np0000002687 nova-compute[98431]: scsi Jun 11 23:08:05.924900 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.924900 np0000002687 nova-compute[98431]: usb Jun 11 23:08:05.924900 np0000002687 nova-compute[98431]: sata Jun 11 23:08:05.924900 np0000002687 nova-compute[98431]: Jun 11 23:08:05.924900 np0000002687 nova-compute[98431]: Jun 11 23:08:05.924900 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.924900 np0000002687 nova-compute[98431]: virtio-transitional Jun 11 23:08:05.924900 np0000002687 nova-compute[98431]: virtio-non-transitional Jun 11 23:08:05.924900 np0000002687 nova-compute[98431]: Jun 11 23:08:05.924900 np0000002687 nova-compute[98431]: Jun 11 23:08:05.924900 np0000002687 nova-compute[98431]: Jun 11 23:08:05.925934 np0000002687 nova-compute[98431]: Jun 11 23:08:05.925934 np0000002687 nova-compute[98431]: sdl Jun 11 23:08:05.925934 np0000002687 nova-compute[98431]: vnc Jun 11 23:08:05.925934 np0000002687 nova-compute[98431]: spice Jun 11 23:08:05.925934 np0000002687 nova-compute[98431]: egl-headless Jun 11 23:08:05.925934 np0000002687 nova-compute[98431]: dbus Jun 11 23:08:05.925934 np0000002687 nova-compute[98431]: Jun 11 23:08:05.925934 np0000002687 nova-compute[98431]: Jun 11 23:08:05.925934 np0000002687 nova-compute[98431]: Jun 11 23:08:05.925934 np0000002687 nova-compute[98431]: Jun 11 23:08:05.925934 np0000002687 nova-compute[98431]: Jun 11 23:08:05.925934 np0000002687 nova-compute[98431]: subsystem Jun 11 23:08:05.925934 np0000002687 nova-compute[98431]: Jun 11 23:08:05.925934 np0000002687 nova-compute[98431]: Jun 11 23:08:05.925934 np0000002687 nova-compute[98431]: default Jun 11 23:08:05.925934 np0000002687 nova-compute[98431]: mandatory Jun 11 23:08:05.925934 np0000002687 nova-compute[98431]: requisite Jun 11 23:08:05.925934 np0000002687 nova-compute[98431]: optional Jun 11 23:08:05.925934 np0000002687 nova-compute[98431]: Jun 11 23:08:05.925934 np0000002687 nova-compute[98431]: Jun 11 23:08:05.925934 np0000002687 nova-compute[98431]: usb Jun 11 23:08:05.925934 np0000002687 nova-compute[98431]: pci Jun 11 23:08:05.925934 np0000002687 nova-compute[98431]: scsi Jun 11 23:08:05.925934 np0000002687 nova-compute[98431]: Jun 11 23:08:05.925934 np0000002687 nova-compute[98431]: Jun 11 23:08:05.925934 np0000002687 nova-compute[98431]: Jun 11 23:08:05.925934 np0000002687 nova-compute[98431]: Jun 11 23:08:05.925934 np0000002687 nova-compute[98431]: Jun 11 23:08:05.925934 np0000002687 nova-compute[98431]: Jun 11 23:08:05.925934 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.925934 np0000002687 nova-compute[98431]: virtio-transitional Jun 11 23:08:05.925934 np0000002687 nova-compute[98431]: virtio-non-transitional Jun 11 23:08:05.925934 np0000002687 nova-compute[98431]: Jun 11 23:08:05.925934 np0000002687 nova-compute[98431]: Jun 11 23:08:05.925934 np0000002687 nova-compute[98431]: random Jun 11 23:08:05.925934 np0000002687 nova-compute[98431]: egd Jun 11 23:08:05.925934 np0000002687 nova-compute[98431]: builtin Jun 11 23:08:05.925934 np0000002687 nova-compute[98431]: Jun 11 23:08:05.925934 np0000002687 nova-compute[98431]: Jun 11 23:08:05.925934 np0000002687 nova-compute[98431]: Jun 11 23:08:05.925934 np0000002687 nova-compute[98431]: Jun 11 23:08:05.925934 np0000002687 nova-compute[98431]: path Jun 11 23:08:05.925934 np0000002687 nova-compute[98431]: handle Jun 11 23:08:05.925934 np0000002687 nova-compute[98431]: virtiofs Jun 11 23:08:05.925934 np0000002687 nova-compute[98431]: Jun 11 23:08:05.925934 np0000002687 nova-compute[98431]: Jun 11 23:08:05.925934 np0000002687 nova-compute[98431]: Jun 11 23:08:05.925934 np0000002687 nova-compute[98431]: Jun 11 23:08:05.925934 np0000002687 nova-compute[98431]: tpm-tis Jun 11 23:08:05.925934 np0000002687 nova-compute[98431]: tpm-crb Jun 11 23:08:05.925934 np0000002687 nova-compute[98431]: Jun 11 23:08:05.925934 np0000002687 nova-compute[98431]: Jun 11 23:08:05.925934 np0000002687 nova-compute[98431]: passthrough Jun 11 23:08:05.925934 np0000002687 nova-compute[98431]: emulator Jun 11 23:08:05.925934 np0000002687 nova-compute[98431]: external Jun 11 23:08:05.925934 np0000002687 nova-compute[98431]: Jun 11 23:08:05.925934 np0000002687 nova-compute[98431]: Jun 11 23:08:05.925934 np0000002687 nova-compute[98431]: 1.2 Jun 11 23:08:05.925934 np0000002687 nova-compute[98431]: 2.0 Jun 11 23:08:05.925934 np0000002687 nova-compute[98431]: Jun 11 23:08:05.925934 np0000002687 nova-compute[98431]: Jun 11 23:08:05.925934 np0000002687 nova-compute[98431]: Jun 11 23:08:05.925934 np0000002687 nova-compute[98431]: Jun 11 23:08:05.925934 np0000002687 nova-compute[98431]: usb Jun 11 23:08:05.925934 np0000002687 nova-compute[98431]: Jun 11 23:08:05.925934 np0000002687 nova-compute[98431]: Jun 11 23:08:05.925934 np0000002687 nova-compute[98431]: Jun 11 23:08:05.927314 np0000002687 nova-compute[98431]: Jun 11 23:08:05.927314 np0000002687 nova-compute[98431]: pty Jun 11 23:08:05.927314 np0000002687 nova-compute[98431]: unix Jun 11 23:08:05.927314 np0000002687 nova-compute[98431]: spicevmc Jun 11 23:08:05.927314 np0000002687 nova-compute[98431]: Jun 11 23:08:05.927314 np0000002687 nova-compute[98431]: Jun 11 23:08:05.927314 np0000002687 nova-compute[98431]: Jun 11 23:08:05.927314 np0000002687 nova-compute[98431]: Jun 11 23:08:05.927314 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.927314 np0000002687 nova-compute[98431]: Jun 11 23:08:05.927314 np0000002687 nova-compute[98431]: Jun 11 23:08:05.927314 np0000002687 nova-compute[98431]: qemu Jun 11 23:08:05.927314 np0000002687 nova-compute[98431]: Jun 11 23:08:05.927314 np0000002687 nova-compute[98431]: Jun 11 23:08:05.927314 np0000002687 nova-compute[98431]: builtin Jun 11 23:08:05.927314 np0000002687 nova-compute[98431]: Jun 11 23:08:05.927314 np0000002687 nova-compute[98431]: Jun 11 23:08:05.927314 np0000002687 nova-compute[98431]: Jun 11 23:08:05.927314 np0000002687 nova-compute[98431]: Jun 11 23:08:05.927314 np0000002687 nova-compute[98431]: Jun 11 23:08:05.927314 np0000002687 nova-compute[98431]: Jun 11 23:08:05.927314 np0000002687 nova-compute[98431]: Jun 11 23:08:05.927314 np0000002687 nova-compute[98431]: Jun 11 23:08:05.927314 np0000002687 nova-compute[98431]: Jun 11 23:08:05.927314 np0000002687 nova-compute[98431]: Jun 11 23:08:05.927314 np0000002687 nova-compute[98431]: Jun 11 23:08:05.927314 np0000002687 nova-compute[98431]: Jun 11 23:08:05.927314 np0000002687 nova-compute[98431]: Jun 11 23:08:05.927314 np0000002687 nova-compute[98431]: Jun 11 23:08:05.927314 np0000002687 nova-compute[98431]: relaxed Jun 11 23:08:05.927314 np0000002687 nova-compute[98431]: vapic Jun 11 23:08:05.927314 np0000002687 nova-compute[98431]: spinlocks Jun 11 23:08:05.927314 np0000002687 nova-compute[98431]: vpindex Jun 11 23:08:05.927314 np0000002687 nova-compute[98431]: runtime Jun 11 23:08:05.927314 np0000002687 nova-compute[98431]: synic Jun 11 23:08:05.927314 np0000002687 nova-compute[98431]: stimer Jun 11 23:08:05.927314 np0000002687 nova-compute[98431]: reset Jun 11 23:08:05.927314 np0000002687 nova-compute[98431]: vendor_id Jun 11 23:08:05.927314 np0000002687 nova-compute[98431]: frequencies Jun 11 23:08:05.927314 np0000002687 nova-compute[98431]: reenlightenment Jun 11 23:08:05.927314 np0000002687 nova-compute[98431]: tlbflush Jun 11 23:08:05.927314 np0000002687 nova-compute[98431]: ipi Jun 11 23:08:05.927314 np0000002687 nova-compute[98431]: avic Jun 11 23:08:05.927314 np0000002687 nova-compute[98431]: Jun 11 23:08:05.927314 np0000002687 nova-compute[98431]: Jun 11 23:08:05.927314 np0000002687 nova-compute[98431]: Jun 11 23:08:05.927314 np0000002687 nova-compute[98431]: Jun 11 23:08:05.927314 np0000002687 nova-compute[98431]: {{(pid=98431) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 11 23:08:05.927314 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35: Jun 11 23:08:05.927314 np0000002687 nova-compute[98431]: Jun 11 23:08:05.927314 np0000002687 nova-compute[98431]: /usr/bin/qemu-system-x86_64 Jun 11 23:08:05.927314 np0000002687 nova-compute[98431]: qemu Jun 11 23:08:05.927314 np0000002687 nova-compute[98431]: pc-q35-noble Jun 11 23:08:05.927314 np0000002687 nova-compute[98431]: x86_64 Jun 11 23:08:05.927314 np0000002687 nova-compute[98431]: Jun 11 23:08:05.927314 np0000002687 nova-compute[98431]: Jun 11 23:08:05.927314 np0000002687 nova-compute[98431]: Jun 11 23:08:05.927314 np0000002687 nova-compute[98431]: Jun 11 23:08:05.927314 np0000002687 nova-compute[98431]: efi Jun 11 23:08:05.927314 np0000002687 nova-compute[98431]: Jun 11 23:08:05.927314 np0000002687 nova-compute[98431]: Jun 11 23:08:05.927314 np0000002687 nova-compute[98431]: /usr/share/OVMF/OVMF_CODE_4M.ms.fd Jun 11 23:08:05.927314 np0000002687 nova-compute[98431]: /usr/share/OVMF/OVMF_CODE_4M.secboot.fd Jun 11 23:08:05.927314 np0000002687 nova-compute[98431]: /usr/share/ovmf/OVMF.amdsev.fd Jun 11 23:08:05.928427 np0000002687 nova-compute[98431]: /usr/share/OVMF/OVMF_CODE_4M.fd Jun 11 23:08:05.928427 np0000002687 nova-compute[98431]: Jun 11 23:08:05.928427 np0000002687 nova-compute[98431]: rom Jun 11 23:08:05.928427 np0000002687 nova-compute[98431]: pflash Jun 11 23:08:05.928427 np0000002687 nova-compute[98431]: Jun 11 23:08:05.928427 np0000002687 nova-compute[98431]: Jun 11 23:08:05.928427 np0000002687 nova-compute[98431]: yes Jun 11 23:08:05.928427 np0000002687 nova-compute[98431]: no Jun 11 23:08:05.928427 np0000002687 nova-compute[98431]: Jun 11 23:08:05.928427 np0000002687 nova-compute[98431]: Jun 11 23:08:05.928427 np0000002687 nova-compute[98431]: yes Jun 11 23:08:05.928427 np0000002687 nova-compute[98431]: no Jun 11 23:08:05.928427 np0000002687 nova-compute[98431]: Jun 11 23:08:05.928427 np0000002687 nova-compute[98431]: Jun 11 23:08:05.928427 np0000002687 nova-compute[98431]: Jun 11 23:08:05.928427 np0000002687 nova-compute[98431]: Jun 11 23:08:05.928427 np0000002687 nova-compute[98431]: Jun 11 23:08:05.928427 np0000002687 nova-compute[98431]: Jun 11 23:08:05.928427 np0000002687 nova-compute[98431]: Jun 11 23:08:05.928427 np0000002687 nova-compute[98431]: on Jun 11 23:08:05.928427 np0000002687 nova-compute[98431]: off Jun 11 23:08:05.928427 np0000002687 nova-compute[98431]: Jun 11 23:08:05.928427 np0000002687 nova-compute[98431]: Jun 11 23:08:05.928427 np0000002687 nova-compute[98431]: Jun 11 23:08:05.928427 np0000002687 nova-compute[98431]: EPYC Jun 11 23:08:05.928427 np0000002687 nova-compute[98431]: AMD Jun 11 23:08:05.928427 np0000002687 nova-compute[98431]: Jun 11 23:08:05.928427 np0000002687 nova-compute[98431]: Jun 11 23:08:05.928427 np0000002687 nova-compute[98431]: Jun 11 23:08:05.928427 np0000002687 nova-compute[98431]: Jun 11 23:08:05.928427 np0000002687 nova-compute[98431]: Jun 11 23:08:05.928427 np0000002687 nova-compute[98431]: Jun 11 23:08:05.928427 np0000002687 nova-compute[98431]: Jun 11 23:08:05.928427 np0000002687 nova-compute[98431]: Jun 11 23:08:05.928427 np0000002687 nova-compute[98431]: Jun 11 23:08:05.928427 np0000002687 nova-compute[98431]: Jun 11 23:08:05.928427 np0000002687 nova-compute[98431]: Jun 11 23:08:05.928427 np0000002687 nova-compute[98431]: Jun 11 23:08:05.928427 np0000002687 nova-compute[98431]: Jun 11 23:08:05.928427 np0000002687 nova-compute[98431]: Jun 11 23:08:05.928427 np0000002687 nova-compute[98431]: Jun 11 23:08:05.928427 np0000002687 nova-compute[98431]: Jun 11 23:08:05.928427 np0000002687 nova-compute[98431]: Jun 11 23:08:05.928427 np0000002687 nova-compute[98431]: Jun 11 23:08:05.928427 np0000002687 nova-compute[98431]: Jun 11 23:08:05.928427 np0000002687 nova-compute[98431]: Jun 11 23:08:05.928427 np0000002687 nova-compute[98431]: Jun 11 23:08:05.928427 np0000002687 nova-compute[98431]: Jun 11 23:08:05.928427 np0000002687 nova-compute[98431]: Jun 11 23:08:05.928427 np0000002687 nova-compute[98431]: Jun 11 23:08:05.928427 np0000002687 nova-compute[98431]: Jun 11 23:08:05.928427 np0000002687 nova-compute[98431]: Jun 11 23:08:05.928427 np0000002687 nova-compute[98431]: Jun 11 23:08:05.928427 np0000002687 nova-compute[98431]: Jun 11 23:08:05.929487 np0000002687 nova-compute[98431]: Jun 11 23:08:05.929487 np0000002687 nova-compute[98431]: Jun 11 23:08:05.929487 np0000002687 nova-compute[98431]: Jun 11 23:08:05.929487 np0000002687 nova-compute[98431]: Jun 11 23:08:05.929487 np0000002687 nova-compute[98431]: Jun 11 23:08:05.929487 np0000002687 nova-compute[98431]: Jun 11 23:08:05.929487 np0000002687 nova-compute[98431]: qemu64 Jun 11 23:08:05.929487 np0000002687 nova-compute[98431]: qemu32 Jun 11 23:08:05.929487 np0000002687 nova-compute[98431]: phenom Jun 11 23:08:05.929487 np0000002687 nova-compute[98431]: pentium3 Jun 11 23:08:05.929487 np0000002687 nova-compute[98431]: pentium2 Jun 11 23:08:05.929487 np0000002687 nova-compute[98431]: pentium Jun 11 23:08:05.929487 np0000002687 nova-compute[98431]: n270 Jun 11 23:08:05.929487 np0000002687 nova-compute[98431]: kvm64 Jun 11 23:08:05.929487 np0000002687 nova-compute[98431]: kvm32 Jun 11 23:08:05.929487 np0000002687 nova-compute[98431]: coreduo Jun 11 23:08:05.929487 np0000002687 nova-compute[98431]: core2duo Jun 11 23:08:05.929487 np0000002687 nova-compute[98431]: athlon Jun 11 23:08:05.929487 np0000002687 nova-compute[98431]: Westmere-IBRS Jun 11 23:08:05.929487 np0000002687 nova-compute[98431]: Westmere Jun 11 23:08:05.929487 np0000002687 nova-compute[98431]: Snowridge Jun 11 23:08:05.929487 np0000002687 nova-compute[98431]: Skylake-Server-noTSX-IBRS Jun 11 23:08:05.929487 np0000002687 nova-compute[98431]: Skylake-Server-IBRS Jun 11 23:08:05.929487 np0000002687 nova-compute[98431]: Skylake-Server Jun 11 23:08:05.929487 np0000002687 nova-compute[98431]: Skylake-Client-noTSX-IBRS Jun 11 23:08:05.929487 np0000002687 nova-compute[98431]: Skylake-Client-IBRS Jun 11 23:08:05.929487 np0000002687 nova-compute[98431]: Skylake-Client Jun 11 23:08:05.929487 np0000002687 nova-compute[98431]: SapphireRapids Jun 11 23:08:05.929487 np0000002687 nova-compute[98431]: SandyBridge-IBRS Jun 11 23:08:05.929487 np0000002687 nova-compute[98431]: SandyBridge Jun 11 23:08:05.929487 np0000002687 nova-compute[98431]: Penryn Jun 11 23:08:05.929487 np0000002687 nova-compute[98431]: Opteron_G5 Jun 11 23:08:05.929487 np0000002687 nova-compute[98431]: Opteron_G4 Jun 11 23:08:05.929487 np0000002687 nova-compute[98431]: Opteron_G3 Jun 11 23:08:05.929487 np0000002687 nova-compute[98431]: Opteron_G2 Jun 11 23:08:05.930168 np0000002687 nova-compute[98431]: Opteron_G1 Jun 11 23:08:05.930168 np0000002687 nova-compute[98431]: Nehalem-IBRS Jun 11 23:08:05.930168 np0000002687 nova-compute[98431]: Nehalem Jun 11 23:08:05.930168 np0000002687 nova-compute[98431]: IvyBridge-IBRS Jun 11 23:08:05.930168 np0000002687 nova-compute[98431]: IvyBridge Jun 11 23:08:05.930168 np0000002687 nova-compute[98431]: Icelake-Server-noTSX Jun 11 23:08:05.930168 np0000002687 nova-compute[98431]: Icelake-Server Jun 11 23:08:05.930168 np0000002687 nova-compute[98431]: Haswell-noTSX-IBRS Jun 11 23:08:05.930168 np0000002687 nova-compute[98431]: Haswell-noTSX Jun 11 23:08:05.930168 np0000002687 nova-compute[98431]: Haswell-IBRS Jun 11 23:08:05.930168 np0000002687 nova-compute[98431]: Haswell Jun 11 23:08:05.930168 np0000002687 nova-compute[98431]: EPYC-Rome Jun 11 23:08:05.930168 np0000002687 nova-compute[98431]: EPYC-Milan Jun 11 23:08:05.930168 np0000002687 nova-compute[98431]: EPYC-IBPB Jun 11 23:08:05.930168 np0000002687 nova-compute[98431]: EPYC-Genoa Jun 11 23:08:05.930168 np0000002687 nova-compute[98431]: EPYC Jun 11 23:08:05.930168 np0000002687 nova-compute[98431]: Dhyana Jun 11 23:08:05.930168 np0000002687 nova-compute[98431]: Cooperlake Jun 11 23:08:05.930168 np0000002687 nova-compute[98431]: Conroe Jun 11 23:08:05.930168 np0000002687 nova-compute[98431]: Cascadelake-Server-noTSX Jun 11 23:08:05.930168 np0000002687 nova-compute[98431]: Cascadelake-Server Jun 11 23:08:05.930168 np0000002687 nova-compute[98431]: Broadwell-noTSX-IBRS Jun 11 23:08:05.930168 np0000002687 nova-compute[98431]: Broadwell-noTSX Jun 11 23:08:05.930168 np0000002687 nova-compute[98431]: Broadwell-IBRS Jun 11 23:08:05.930168 np0000002687 nova-compute[98431]: Broadwell Jun 11 23:08:05.930168 np0000002687 nova-compute[98431]: 486 Jun 11 23:08:05.930168 np0000002687 nova-compute[98431]: Jun 11 23:08:05.930168 np0000002687 nova-compute[98431]: Jun 11 23:08:05.930168 np0000002687 nova-compute[98431]: Jun 11 23:08:05.930168 np0000002687 nova-compute[98431]: Jun 11 23:08:05.930168 np0000002687 nova-compute[98431]: file Jun 11 23:08:05.930168 np0000002687 nova-compute[98431]: anonymous Jun 11 23:08:05.930168 np0000002687 nova-compute[98431]: memfd Jun 11 23:08:05.930168 np0000002687 nova-compute[98431]: Jun 11 23:08:05.930168 np0000002687 nova-compute[98431]: Jun 11 23:08:05.930168 np0000002687 nova-compute[98431]: Jun 11 23:08:05.930168 np0000002687 nova-compute[98431]: Jun 11 23:08:05.930168 np0000002687 nova-compute[98431]: Jun 11 23:08:05.930168 np0000002687 nova-compute[98431]: disk Jun 11 23:08:05.930168 np0000002687 nova-compute[98431]: cdrom Jun 11 23:08:05.930168 np0000002687 nova-compute[98431]: floppy Jun 11 23:08:05.930168 np0000002687 nova-compute[98431]: lun Jun 11 23:08:05.930168 np0000002687 nova-compute[98431]: Jun 11 23:08:05.930168 np0000002687 nova-compute[98431]: Jun 11 23:08:05.930168 np0000002687 nova-compute[98431]: fdc Jun 11 23:08:05.930168 np0000002687 nova-compute[98431]: scsi Jun 11 23:08:05.931008 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.931008 np0000002687 nova-compute[98431]: usb Jun 11 23:08:05.931008 np0000002687 nova-compute[98431]: sata Jun 11 23:08:05.931008 np0000002687 nova-compute[98431]: Jun 11 23:08:05.931008 np0000002687 nova-compute[98431]: Jun 11 23:08:05.931008 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.931008 np0000002687 nova-compute[98431]: virtio-transitional Jun 11 23:08:05.931008 np0000002687 nova-compute[98431]: virtio-non-transitional Jun 11 23:08:05.931008 np0000002687 nova-compute[98431]: Jun 11 23:08:05.931008 np0000002687 nova-compute[98431]: Jun 11 23:08:05.931008 np0000002687 nova-compute[98431]: Jun 11 23:08:05.931008 np0000002687 nova-compute[98431]: Jun 11 23:08:05.931008 np0000002687 nova-compute[98431]: sdl Jun 11 23:08:05.931008 np0000002687 nova-compute[98431]: vnc Jun 11 23:08:05.931008 np0000002687 nova-compute[98431]: spice Jun 11 23:08:05.931008 np0000002687 nova-compute[98431]: egl-headless Jun 11 23:08:05.931008 np0000002687 nova-compute[98431]: dbus Jun 11 23:08:05.931008 np0000002687 nova-compute[98431]: Jun 11 23:08:05.931008 np0000002687 nova-compute[98431]: Jun 11 23:08:05.931008 np0000002687 nova-compute[98431]: Jun 11 23:08:05.931008 np0000002687 nova-compute[98431]: Jun 11 23:08:05.931008 np0000002687 nova-compute[98431]: Jun 11 23:08:05.931008 np0000002687 nova-compute[98431]: subsystem Jun 11 23:08:05.931008 np0000002687 nova-compute[98431]: Jun 11 23:08:05.931008 np0000002687 nova-compute[98431]: Jun 11 23:08:05.931008 np0000002687 nova-compute[98431]: default Jun 11 23:08:05.931008 np0000002687 nova-compute[98431]: mandatory Jun 11 23:08:05.931008 np0000002687 nova-compute[98431]: requisite Jun 11 23:08:05.931008 np0000002687 nova-compute[98431]: optional Jun 11 23:08:05.931008 np0000002687 nova-compute[98431]: Jun 11 23:08:05.931008 np0000002687 nova-compute[98431]: Jun 11 23:08:05.931008 np0000002687 nova-compute[98431]: usb Jun 11 23:08:05.931008 np0000002687 nova-compute[98431]: pci Jun 11 23:08:05.931008 np0000002687 nova-compute[98431]: scsi Jun 11 23:08:05.931008 np0000002687 nova-compute[98431]: Jun 11 23:08:05.931008 np0000002687 nova-compute[98431]: Jun 11 23:08:05.931008 np0000002687 nova-compute[98431]: Jun 11 23:08:05.931008 np0000002687 nova-compute[98431]: Jun 11 23:08:05.931008 np0000002687 nova-compute[98431]: Jun 11 23:08:05.931008 np0000002687 nova-compute[98431]: Jun 11 23:08:05.931008 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.931008 np0000002687 nova-compute[98431]: virtio-transitional Jun 11 23:08:05.931008 np0000002687 nova-compute[98431]: virtio-non-transitional Jun 11 23:08:05.931008 np0000002687 nova-compute[98431]: Jun 11 23:08:05.931008 np0000002687 nova-compute[98431]: Jun 11 23:08:05.931008 np0000002687 nova-compute[98431]: random Jun 11 23:08:05.931008 np0000002687 nova-compute[98431]: egd Jun 11 23:08:05.931008 np0000002687 nova-compute[98431]: builtin Jun 11 23:08:05.931008 np0000002687 nova-compute[98431]: Jun 11 23:08:05.931008 np0000002687 nova-compute[98431]: Jun 11 23:08:05.931008 np0000002687 nova-compute[98431]: Jun 11 23:08:05.931008 np0000002687 nova-compute[98431]: Jun 11 23:08:05.931008 np0000002687 nova-compute[98431]: path Jun 11 23:08:05.931008 np0000002687 nova-compute[98431]: handle Jun 11 23:08:05.931008 np0000002687 nova-compute[98431]: virtiofs Jun 11 23:08:05.931008 np0000002687 nova-compute[98431]: Jun 11 23:08:05.931008 np0000002687 nova-compute[98431]: Jun 11 23:08:05.931008 np0000002687 nova-compute[98431]: Jun 11 23:08:05.931008 np0000002687 nova-compute[98431]: Jun 11 23:08:05.931008 np0000002687 nova-compute[98431]: tpm-tis Jun 11 23:08:05.931008 np0000002687 nova-compute[98431]: tpm-crb Jun 11 23:08:05.931008 np0000002687 nova-compute[98431]: Jun 11 23:08:05.931008 np0000002687 nova-compute[98431]: Jun 11 23:08:05.931008 np0000002687 nova-compute[98431]: passthrough Jun 11 23:08:05.931008 np0000002687 nova-compute[98431]: emulator Jun 11 23:08:05.932417 np0000002687 nova-compute[98431]: external Jun 11 23:08:05.932417 np0000002687 nova-compute[98431]: Jun 11 23:08:05.932417 np0000002687 nova-compute[98431]: Jun 11 23:08:05.932417 np0000002687 nova-compute[98431]: 1.2 Jun 11 23:08:05.932417 np0000002687 nova-compute[98431]: 2.0 Jun 11 23:08:05.932417 np0000002687 nova-compute[98431]: Jun 11 23:08:05.932417 np0000002687 nova-compute[98431]: Jun 11 23:08:05.932417 np0000002687 nova-compute[98431]: Jun 11 23:08:05.932417 np0000002687 nova-compute[98431]: Jun 11 23:08:05.932417 np0000002687 nova-compute[98431]: usb Jun 11 23:08:05.932417 np0000002687 nova-compute[98431]: Jun 11 23:08:05.932417 np0000002687 nova-compute[98431]: Jun 11 23:08:05.932417 np0000002687 nova-compute[98431]: Jun 11 23:08:05.932417 np0000002687 nova-compute[98431]: Jun 11 23:08:05.932417 np0000002687 nova-compute[98431]: pty Jun 11 23:08:05.932417 np0000002687 nova-compute[98431]: unix Jun 11 23:08:05.932417 np0000002687 nova-compute[98431]: spicevmc Jun 11 23:08:05.932417 np0000002687 nova-compute[98431]: Jun 11 23:08:05.932417 np0000002687 nova-compute[98431]: Jun 11 23:08:05.932417 np0000002687 nova-compute[98431]: Jun 11 23:08:05.932417 np0000002687 nova-compute[98431]: Jun 11 23:08:05.932417 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.932417 np0000002687 nova-compute[98431]: Jun 11 23:08:05.932417 np0000002687 nova-compute[98431]: Jun 11 23:08:05.932417 np0000002687 nova-compute[98431]: qemu Jun 11 23:08:05.932417 np0000002687 nova-compute[98431]: Jun 11 23:08:05.932417 np0000002687 nova-compute[98431]: Jun 11 23:08:05.932417 np0000002687 nova-compute[98431]: builtin Jun 11 23:08:05.932417 np0000002687 nova-compute[98431]: Jun 11 23:08:05.932417 np0000002687 nova-compute[98431]: Jun 11 23:08:05.932417 np0000002687 nova-compute[98431]: Jun 11 23:08:05.932417 np0000002687 nova-compute[98431]: Jun 11 23:08:05.932417 np0000002687 nova-compute[98431]: Jun 11 23:08:05.932417 np0000002687 nova-compute[98431]: Jun 11 23:08:05.932417 np0000002687 nova-compute[98431]: Jun 11 23:08:05.932417 np0000002687 nova-compute[98431]: Jun 11 23:08:05.932417 np0000002687 nova-compute[98431]: Jun 11 23:08:05.932417 np0000002687 nova-compute[98431]: Jun 11 23:08:05.932417 np0000002687 nova-compute[98431]: Jun 11 23:08:05.932417 np0000002687 nova-compute[98431]: Jun 11 23:08:05.932417 np0000002687 nova-compute[98431]: Jun 11 23:08:05.932417 np0000002687 nova-compute[98431]: Jun 11 23:08:05.932417 np0000002687 nova-compute[98431]: relaxed Jun 11 23:08:05.932417 np0000002687 nova-compute[98431]: vapic Jun 11 23:08:05.932417 np0000002687 nova-compute[98431]: spinlocks Jun 11 23:08:05.932417 np0000002687 nova-compute[98431]: vpindex Jun 11 23:08:05.932417 np0000002687 nova-compute[98431]: runtime Jun 11 23:08:05.932417 np0000002687 nova-compute[98431]: synic Jun 11 23:08:05.932417 np0000002687 nova-compute[98431]: stimer Jun 11 23:08:05.932417 np0000002687 nova-compute[98431]: reset Jun 11 23:08:05.932417 np0000002687 nova-compute[98431]: vendor_id Jun 11 23:08:05.932417 np0000002687 nova-compute[98431]: frequencies Jun 11 23:08:05.932417 np0000002687 nova-compute[98431]: reenlightenment Jun 11 23:08:05.932417 np0000002687 nova-compute[98431]: tlbflush Jun 11 23:08:05.932417 np0000002687 nova-compute[98431]: ipi Jun 11 23:08:05.932417 np0000002687 nova-compute[98431]: avic Jun 11 23:08:05.932417 np0000002687 nova-compute[98431]: Jun 11 23:08:05.932417 np0000002687 nova-compute[98431]: Jun 11 23:08:05.932417 np0000002687 nova-compute[98431]: Jun 11 23:08:05.932417 np0000002687 nova-compute[98431]: Jun 11 23:08:05.932417 np0000002687 nova-compute[98431]: {{(pid=98431) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 11 23:08:05.932417 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=98431) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 11 23:08:05.933715 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] Libvirt host hypervisor capabilities for arch=xtensa and machine_type=None: Jun 11 23:08:05.933715 np0000002687 nova-compute[98431]: Jun 11 23:08:05.933715 np0000002687 nova-compute[98431]: /usr/bin/qemu-system-xtensa Jun 11 23:08:05.933715 np0000002687 nova-compute[98431]: qemu Jun 11 23:08:05.933715 np0000002687 nova-compute[98431]: sim Jun 11 23:08:05.933715 np0000002687 nova-compute[98431]: xtensa Jun 11 23:08:05.933715 np0000002687 nova-compute[98431]: Jun 11 23:08:05.933715 np0000002687 nova-compute[98431]: Jun 11 23:08:05.933715 np0000002687 nova-compute[98431]: Jun 11 23:08:05.933715 np0000002687 nova-compute[98431]: Jun 11 23:08:05.933715 np0000002687 nova-compute[98431]: Jun 11 23:08:05.933715 np0000002687 nova-compute[98431]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 11 23:08:05.933715 np0000002687 nova-compute[98431]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 11 23:08:05.933715 np0000002687 nova-compute[98431]: Jun 11 23:08:05.933715 np0000002687 nova-compute[98431]: rom Jun 11 23:08:05.933715 np0000002687 nova-compute[98431]: pflash Jun 11 23:08:05.933715 np0000002687 nova-compute[98431]: Jun 11 23:08:05.933715 np0000002687 nova-compute[98431]: Jun 11 23:08:05.933715 np0000002687 nova-compute[98431]: yes Jun 11 23:08:05.933715 np0000002687 nova-compute[98431]: no Jun 11 23:08:05.933715 np0000002687 nova-compute[98431]: Jun 11 23:08:05.933715 np0000002687 nova-compute[98431]: Jun 11 23:08:05.933715 np0000002687 nova-compute[98431]: no Jun 11 23:08:05.933715 np0000002687 nova-compute[98431]: Jun 11 23:08:05.933715 np0000002687 nova-compute[98431]: Jun 11 23:08:05.933715 np0000002687 nova-compute[98431]: Jun 11 23:08:05.933715 np0000002687 nova-compute[98431]: Jun 11 23:08:05.933715 np0000002687 nova-compute[98431]: Jun 11 23:08:05.933715 np0000002687 nova-compute[98431]: Jun 11 23:08:05.933715 np0000002687 nova-compute[98431]: Jun 11 23:08:05.933715 np0000002687 nova-compute[98431]: Jun 11 23:08:05.933715 np0000002687 nova-compute[98431]: Jun 11 23:08:05.933715 np0000002687 nova-compute[98431]: Jun 11 23:08:05.933715 np0000002687 nova-compute[98431]: Jun 11 23:08:05.933715 np0000002687 nova-compute[98431]: file Jun 11 23:08:05.933715 np0000002687 nova-compute[98431]: anonymous Jun 11 23:08:05.933715 np0000002687 nova-compute[98431]: memfd Jun 11 23:08:05.933715 np0000002687 nova-compute[98431]: Jun 11 23:08:05.933715 np0000002687 nova-compute[98431]: Jun 11 23:08:05.933715 np0000002687 nova-compute[98431]: Jun 11 23:08:05.933715 np0000002687 nova-compute[98431]: Jun 11 23:08:05.933715 np0000002687 nova-compute[98431]: Jun 11 23:08:05.933715 np0000002687 nova-compute[98431]: disk Jun 11 23:08:05.933715 np0000002687 nova-compute[98431]: cdrom Jun 11 23:08:05.933715 np0000002687 nova-compute[98431]: floppy Jun 11 23:08:05.933715 np0000002687 nova-compute[98431]: lun Jun 11 23:08:05.933715 np0000002687 nova-compute[98431]: Jun 11 23:08:05.933715 np0000002687 nova-compute[98431]: Jun 11 23:08:05.933715 np0000002687 nova-compute[98431]: fdc Jun 11 23:08:05.933715 np0000002687 nova-compute[98431]: scsi Jun 11 23:08:05.933715 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.933715 np0000002687 nova-compute[98431]: usb Jun 11 23:08:05.933715 np0000002687 nova-compute[98431]: sata Jun 11 23:08:05.933715 np0000002687 nova-compute[98431]: Jun 11 23:08:05.933715 np0000002687 nova-compute[98431]: Jun 11 23:08:05.933715 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.933715 np0000002687 nova-compute[98431]: virtio-transitional Jun 11 23:08:05.933715 np0000002687 nova-compute[98431]: virtio-non-transitional Jun 11 23:08:05.933715 np0000002687 nova-compute[98431]: Jun 11 23:08:05.933715 np0000002687 nova-compute[98431]: Jun 11 23:08:05.933715 np0000002687 nova-compute[98431]: Jun 11 23:08:05.933715 np0000002687 nova-compute[98431]: Jun 11 23:08:05.933715 np0000002687 nova-compute[98431]: sdl Jun 11 23:08:05.933715 np0000002687 nova-compute[98431]: vnc Jun 11 23:08:05.933715 np0000002687 nova-compute[98431]: spice Jun 11 23:08:05.933715 np0000002687 nova-compute[98431]: egl-headless Jun 11 23:08:05.933715 np0000002687 nova-compute[98431]: dbus Jun 11 23:08:05.933715 np0000002687 nova-compute[98431]: Jun 11 23:08:05.933715 np0000002687 nova-compute[98431]: Jun 11 23:08:05.933715 np0000002687 nova-compute[98431]: Jun 11 23:08:05.935410 np0000002687 nova-compute[98431]: Jun 11 23:08:05.935410 np0000002687 nova-compute[98431]: Jun 11 23:08:05.935410 np0000002687 nova-compute[98431]: subsystem Jun 11 23:08:05.935410 np0000002687 nova-compute[98431]: Jun 11 23:08:05.935410 np0000002687 nova-compute[98431]: Jun 11 23:08:05.935410 np0000002687 nova-compute[98431]: default Jun 11 23:08:05.935410 np0000002687 nova-compute[98431]: mandatory Jun 11 23:08:05.935410 np0000002687 nova-compute[98431]: requisite Jun 11 23:08:05.935410 np0000002687 nova-compute[98431]: optional Jun 11 23:08:05.935410 np0000002687 nova-compute[98431]: Jun 11 23:08:05.935410 np0000002687 nova-compute[98431]: Jun 11 23:08:05.935410 np0000002687 nova-compute[98431]: usb Jun 11 23:08:05.935410 np0000002687 nova-compute[98431]: pci Jun 11 23:08:05.935410 np0000002687 nova-compute[98431]: scsi Jun 11 23:08:05.935410 np0000002687 nova-compute[98431]: Jun 11 23:08:05.935410 np0000002687 nova-compute[98431]: Jun 11 23:08:05.935410 np0000002687 nova-compute[98431]: Jun 11 23:08:05.935410 np0000002687 nova-compute[98431]: Jun 11 23:08:05.935410 np0000002687 nova-compute[98431]: Jun 11 23:08:05.935410 np0000002687 nova-compute[98431]: Jun 11 23:08:05.935410 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.935410 np0000002687 nova-compute[98431]: virtio-transitional Jun 11 23:08:05.935410 np0000002687 nova-compute[98431]: virtio-non-transitional Jun 11 23:08:05.935410 np0000002687 nova-compute[98431]: Jun 11 23:08:05.935410 np0000002687 nova-compute[98431]: Jun 11 23:08:05.935410 np0000002687 nova-compute[98431]: random Jun 11 23:08:05.935410 np0000002687 nova-compute[98431]: egd Jun 11 23:08:05.935410 np0000002687 nova-compute[98431]: builtin Jun 11 23:08:05.935410 np0000002687 nova-compute[98431]: Jun 11 23:08:05.935410 np0000002687 nova-compute[98431]: Jun 11 23:08:05.935410 np0000002687 nova-compute[98431]: Jun 11 23:08:05.935410 np0000002687 nova-compute[98431]: Jun 11 23:08:05.935410 np0000002687 nova-compute[98431]: path Jun 11 23:08:05.935410 np0000002687 nova-compute[98431]: handle Jun 11 23:08:05.935410 np0000002687 nova-compute[98431]: virtiofs Jun 11 23:08:05.935410 np0000002687 nova-compute[98431]: Jun 11 23:08:05.935410 np0000002687 nova-compute[98431]: Jun 11 23:08:05.935410 np0000002687 nova-compute[98431]: Jun 11 23:08:05.935410 np0000002687 nova-compute[98431]: Jun 11 23:08:05.935410 np0000002687 nova-compute[98431]: Jun 11 23:08:05.935410 np0000002687 nova-compute[98431]: usb Jun 11 23:08:05.935410 np0000002687 nova-compute[98431]: Jun 11 23:08:05.935410 np0000002687 nova-compute[98431]: Jun 11 23:08:05.935410 np0000002687 nova-compute[98431]: Jun 11 23:08:05.935410 np0000002687 nova-compute[98431]: Jun 11 23:08:05.935410 np0000002687 nova-compute[98431]: pty Jun 11 23:08:05.935410 np0000002687 nova-compute[98431]: unix Jun 11 23:08:05.935410 np0000002687 nova-compute[98431]: spicevmc Jun 11 23:08:05.935410 np0000002687 nova-compute[98431]: Jun 11 23:08:05.935410 np0000002687 nova-compute[98431]: Jun 11 23:08:05.935410 np0000002687 nova-compute[98431]: Jun 11 23:08:05.935410 np0000002687 nova-compute[98431]: Jun 11 23:08:05.935410 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.935410 np0000002687 nova-compute[98431]: Jun 11 23:08:05.935410 np0000002687 nova-compute[98431]: Jun 11 23:08:05.935410 np0000002687 nova-compute[98431]: qemu Jun 11 23:08:05.935410 np0000002687 nova-compute[98431]: Jun 11 23:08:05.935410 np0000002687 nova-compute[98431]: Jun 11 23:08:05.935410 np0000002687 nova-compute[98431]: builtin Jun 11 23:08:05.935410 np0000002687 nova-compute[98431]: Jun 11 23:08:05.935410 np0000002687 nova-compute[98431]: Jun 11 23:08:05.935410 np0000002687 nova-compute[98431]: Jun 11 23:08:05.935410 np0000002687 nova-compute[98431]: Jun 11 23:08:05.935410 np0000002687 nova-compute[98431]: Jun 11 23:08:05.935410 np0000002687 nova-compute[98431]: Jun 11 23:08:05.935410 np0000002687 nova-compute[98431]: Jun 11 23:08:05.935410 np0000002687 nova-compute[98431]: Jun 11 23:08:05.935410 np0000002687 nova-compute[98431]: Jun 11 23:08:05.935410 np0000002687 nova-compute[98431]: Jun 11 23:08:05.935410 np0000002687 nova-compute[98431]: Jun 11 23:08:05.935410 np0000002687 nova-compute[98431]: Jun 11 23:08:05.935410 np0000002687 nova-compute[98431]: Jun 11 23:08:05.935410 np0000002687 nova-compute[98431]: Jun 11 23:08:05.936858 np0000002687 nova-compute[98431]: {{(pid=98431) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 11 23:08:05.936858 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=98431) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 11 23:08:05.936858 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] Libvirt host hypervisor capabilities for arch=xtensaeb and machine_type=None: Jun 11 23:08:05.936858 np0000002687 nova-compute[98431]: Jun 11 23:08:05.936858 np0000002687 nova-compute[98431]: /usr/bin/qemu-system-xtensaeb Jun 11 23:08:05.936858 np0000002687 nova-compute[98431]: qemu Jun 11 23:08:05.936858 np0000002687 nova-compute[98431]: sim Jun 11 23:08:05.936858 np0000002687 nova-compute[98431]: xtensaeb Jun 11 23:08:05.936858 np0000002687 nova-compute[98431]: Jun 11 23:08:05.936858 np0000002687 nova-compute[98431]: Jun 11 23:08:05.936858 np0000002687 nova-compute[98431]: Jun 11 23:08:05.936858 np0000002687 nova-compute[98431]: Jun 11 23:08:05.936858 np0000002687 nova-compute[98431]: Jun 11 23:08:05.936858 np0000002687 nova-compute[98431]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 11 23:08:05.936858 np0000002687 nova-compute[98431]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 11 23:08:05.936858 np0000002687 nova-compute[98431]: Jun 11 23:08:05.936858 np0000002687 nova-compute[98431]: rom Jun 11 23:08:05.936858 np0000002687 nova-compute[98431]: pflash Jun 11 23:08:05.936858 np0000002687 nova-compute[98431]: Jun 11 23:08:05.936858 np0000002687 nova-compute[98431]: Jun 11 23:08:05.936858 np0000002687 nova-compute[98431]: yes Jun 11 23:08:05.936858 np0000002687 nova-compute[98431]: no Jun 11 23:08:05.936858 np0000002687 nova-compute[98431]: Jun 11 23:08:05.936858 np0000002687 nova-compute[98431]: Jun 11 23:08:05.936858 np0000002687 nova-compute[98431]: no Jun 11 23:08:05.936858 np0000002687 nova-compute[98431]: Jun 11 23:08:05.936858 np0000002687 nova-compute[98431]: Jun 11 23:08:05.936858 np0000002687 nova-compute[98431]: Jun 11 23:08:05.936858 np0000002687 nova-compute[98431]: Jun 11 23:08:05.936858 np0000002687 nova-compute[98431]: Jun 11 23:08:05.936858 np0000002687 nova-compute[98431]: Jun 11 23:08:05.936858 np0000002687 nova-compute[98431]: Jun 11 23:08:05.936858 np0000002687 nova-compute[98431]: Jun 11 23:08:05.936858 np0000002687 nova-compute[98431]: Jun 11 23:08:05.936858 np0000002687 nova-compute[98431]: Jun 11 23:08:05.936858 np0000002687 nova-compute[98431]: Jun 11 23:08:05.936858 np0000002687 nova-compute[98431]: file Jun 11 23:08:05.936858 np0000002687 nova-compute[98431]: anonymous Jun 11 23:08:05.936858 np0000002687 nova-compute[98431]: memfd Jun 11 23:08:05.936858 np0000002687 nova-compute[98431]: Jun 11 23:08:05.936858 np0000002687 nova-compute[98431]: Jun 11 23:08:05.936858 np0000002687 nova-compute[98431]: Jun 11 23:08:05.936858 np0000002687 nova-compute[98431]: Jun 11 23:08:05.936858 np0000002687 nova-compute[98431]: Jun 11 23:08:05.936858 np0000002687 nova-compute[98431]: disk Jun 11 23:08:05.936858 np0000002687 nova-compute[98431]: cdrom Jun 11 23:08:05.936858 np0000002687 nova-compute[98431]: floppy Jun 11 23:08:05.936858 np0000002687 nova-compute[98431]: lun Jun 11 23:08:05.936858 np0000002687 nova-compute[98431]: Jun 11 23:08:05.936858 np0000002687 nova-compute[98431]: Jun 11 23:08:05.936858 np0000002687 nova-compute[98431]: fdc Jun 11 23:08:05.936858 np0000002687 nova-compute[98431]: scsi Jun 11 23:08:05.936858 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.936858 np0000002687 nova-compute[98431]: usb Jun 11 23:08:05.936858 np0000002687 nova-compute[98431]: sata Jun 11 23:08:05.936858 np0000002687 nova-compute[98431]: Jun 11 23:08:05.936858 np0000002687 nova-compute[98431]: Jun 11 23:08:05.936858 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.937912 np0000002687 nova-compute[98431]: virtio-transitional Jun 11 23:08:05.937912 np0000002687 nova-compute[98431]: virtio-non-transitional Jun 11 23:08:05.937912 np0000002687 nova-compute[98431]: Jun 11 23:08:05.937912 np0000002687 nova-compute[98431]: Jun 11 23:08:05.937912 np0000002687 nova-compute[98431]: Jun 11 23:08:05.937912 np0000002687 nova-compute[98431]: Jun 11 23:08:05.937912 np0000002687 nova-compute[98431]: sdl Jun 11 23:08:05.937912 np0000002687 nova-compute[98431]: vnc Jun 11 23:08:05.937912 np0000002687 nova-compute[98431]: spice Jun 11 23:08:05.937912 np0000002687 nova-compute[98431]: egl-headless Jun 11 23:08:05.937912 np0000002687 nova-compute[98431]: dbus Jun 11 23:08:05.937912 np0000002687 nova-compute[98431]: Jun 11 23:08:05.937912 np0000002687 nova-compute[98431]: Jun 11 23:08:05.937912 np0000002687 nova-compute[98431]: Jun 11 23:08:05.937912 np0000002687 nova-compute[98431]: Jun 11 23:08:05.937912 np0000002687 nova-compute[98431]: Jun 11 23:08:05.937912 np0000002687 nova-compute[98431]: subsystem Jun 11 23:08:05.937912 np0000002687 nova-compute[98431]: Jun 11 23:08:05.937912 np0000002687 nova-compute[98431]: Jun 11 23:08:05.937912 np0000002687 nova-compute[98431]: default Jun 11 23:08:05.937912 np0000002687 nova-compute[98431]: mandatory Jun 11 23:08:05.937912 np0000002687 nova-compute[98431]: requisite Jun 11 23:08:05.937912 np0000002687 nova-compute[98431]: optional Jun 11 23:08:05.937912 np0000002687 nova-compute[98431]: Jun 11 23:08:05.937912 np0000002687 nova-compute[98431]: Jun 11 23:08:05.937912 np0000002687 nova-compute[98431]: usb Jun 11 23:08:05.937912 np0000002687 nova-compute[98431]: pci Jun 11 23:08:05.937912 np0000002687 nova-compute[98431]: scsi Jun 11 23:08:05.937912 np0000002687 nova-compute[98431]: Jun 11 23:08:05.937912 np0000002687 nova-compute[98431]: Jun 11 23:08:05.937912 np0000002687 nova-compute[98431]: Jun 11 23:08:05.937912 np0000002687 nova-compute[98431]: Jun 11 23:08:05.937912 np0000002687 nova-compute[98431]: Jun 11 23:08:05.937912 np0000002687 nova-compute[98431]: Jun 11 23:08:05.937912 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.937912 np0000002687 nova-compute[98431]: virtio-transitional Jun 11 23:08:05.937912 np0000002687 nova-compute[98431]: virtio-non-transitional Jun 11 23:08:05.937912 np0000002687 nova-compute[98431]: Jun 11 23:08:05.937912 np0000002687 nova-compute[98431]: Jun 11 23:08:05.937912 np0000002687 nova-compute[98431]: random Jun 11 23:08:05.937912 np0000002687 nova-compute[98431]: egd Jun 11 23:08:05.937912 np0000002687 nova-compute[98431]: builtin Jun 11 23:08:05.937912 np0000002687 nova-compute[98431]: Jun 11 23:08:05.937912 np0000002687 nova-compute[98431]: Jun 11 23:08:05.937912 np0000002687 nova-compute[98431]: Jun 11 23:08:05.937912 np0000002687 nova-compute[98431]: Jun 11 23:08:05.937912 np0000002687 nova-compute[98431]: path Jun 11 23:08:05.937912 np0000002687 nova-compute[98431]: handle Jun 11 23:08:05.937912 np0000002687 nova-compute[98431]: virtiofs Jun 11 23:08:05.937912 np0000002687 nova-compute[98431]: Jun 11 23:08:05.937912 np0000002687 nova-compute[98431]: Jun 11 23:08:05.937912 np0000002687 nova-compute[98431]: Jun 11 23:08:05.937912 np0000002687 nova-compute[98431]: Jun 11 23:08:05.937912 np0000002687 nova-compute[98431]: Jun 11 23:08:05.937912 np0000002687 nova-compute[98431]: usb Jun 11 23:08:05.937912 np0000002687 nova-compute[98431]: Jun 11 23:08:05.937912 np0000002687 nova-compute[98431]: Jun 11 23:08:05.937912 np0000002687 nova-compute[98431]: Jun 11 23:08:05.937912 np0000002687 nova-compute[98431]: Jun 11 23:08:05.937912 np0000002687 nova-compute[98431]: pty Jun 11 23:08:05.937912 np0000002687 nova-compute[98431]: unix Jun 11 23:08:05.937912 np0000002687 nova-compute[98431]: spicevmc Jun 11 23:08:05.937912 np0000002687 nova-compute[98431]: Jun 11 23:08:05.937912 np0000002687 nova-compute[98431]: Jun 11 23:08:05.937912 np0000002687 nova-compute[98431]: Jun 11 23:08:05.937912 np0000002687 nova-compute[98431]: Jun 11 23:08:05.937912 np0000002687 nova-compute[98431]: virtio Jun 11 23:08:05.937912 np0000002687 nova-compute[98431]: Jun 11 23:08:05.937912 np0000002687 nova-compute[98431]: Jun 11 23:08:05.937912 np0000002687 nova-compute[98431]: qemu Jun 11 23:08:05.937912 np0000002687 nova-compute[98431]: Jun 11 23:08:05.939631 np0000002687 nova-compute[98431]: Jun 11 23:08:05.939631 np0000002687 nova-compute[98431]: builtin Jun 11 23:08:05.939631 np0000002687 nova-compute[98431]: Jun 11 23:08:05.939631 np0000002687 nova-compute[98431]: Jun 11 23:08:05.939631 np0000002687 nova-compute[98431]: Jun 11 23:08:05.939631 np0000002687 nova-compute[98431]: Jun 11 23:08:05.939631 np0000002687 nova-compute[98431]: Jun 11 23:08:05.939631 np0000002687 nova-compute[98431]: Jun 11 23:08:05.939631 np0000002687 nova-compute[98431]: Jun 11 23:08:05.939631 np0000002687 nova-compute[98431]: Jun 11 23:08:05.939631 np0000002687 nova-compute[98431]: Jun 11 23:08:05.939631 np0000002687 nova-compute[98431]: Jun 11 23:08:05.939631 np0000002687 nova-compute[98431]: Jun 11 23:08:05.939631 np0000002687 nova-compute[98431]: Jun 11 23:08:05.939631 np0000002687 nova-compute[98431]: Jun 11 23:08:05.939631 np0000002687 nova-compute[98431]: Jun 11 23:08:05.939631 np0000002687 nova-compute[98431]: {{(pid=98431) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 11 23:08:05.939631 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] Checking secure boot support for host arch (x86_64) {{(pid=98431) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1961}} Jun 11 23:08:05.939631 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] Checking secure boot support for host arch (x86_64) {{(pid=98431) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1961}} Jun 11 23:08:05.939631 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] Checking secure boot support for host arch (x86_64) {{(pid=98431) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1961}} Jun 11 23:08:05.939631 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] Checking secure boot support for host arch (x86_64) {{(pid=98431) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1961}} Jun 11 23:08:05.939631 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] Checking secure boot support for host arch (x86_64) {{(pid=98431) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1961}} Jun 11 23:08:05.939631 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.host [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] Secure Boot support detected Jun 11 23:08:06.410016 np0000002687 nova-compute[98431]: INFO nova.virt.node [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] Generated node identity e3e65fe2-9de9-4821-8b4a-ccae37c66e25 Jun 11 23:08:06.410196 np0000002687 nova-compute[98431]: INFO nova.virt.node [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] Wrote node identity e3e65fe2-9de9-4821-8b4a-ccae37c66e25 to /opt/stack/data/nova/compute_id Jun 11 23:08:06.912340 np0000002687 nova-compute[98431]: WARNING nova.compute.manager [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] Compute nodes ['e3e65fe2-9de9-4821-8b4a-ccae37c66e25'] for host np0000002687 were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning. Jun 11 23:08:07.915990 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host Jun 11 23:08:08.920825 np0000002687 nova-compute[98431]: WARNING nova.compute.manager [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] No compute node record found for host np0000002687. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host np0000002687 could not be found. Jun 11 23:08:08.921278 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:08:08.921278 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:08:08.921278 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:08:08.921384 np0000002687 nova-compute[98431]: DEBUG nova.compute.resource_tracker [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] Auditing locally available compute resources for np0000002687 (node: np0000002687) {{(pid=98431) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}} Jun 11 23:08:08.980153 np0000002687 nova-compute[98431]: WARNING nova.virt.libvirt.driver [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 11 23:08:08.981003 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:08:08.996451 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] CMD "env LANG=C uptime" returned: 0 in 0.015s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:08:08.996791 np0000002687 nova-compute[98431]: DEBUG nova.compute.resource_tracker [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] Hypervisor/Node resource view: name=np0000002687 free_ram=16643MB free_disk=75.14078521728516GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}] {{(pid=98431) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}} Jun 11 23:08:08.996951 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:08:08.997185 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:08:09.500046 np0000002687 nova-compute[98431]: WARNING nova.compute.resource_tracker [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] No compute node record for np0000002687:e3e65fe2-9de9-4821-8b4a-ccae37c66e25: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host e3e65fe2-9de9-4821-8b4a-ccae37c66e25 could not be found. Jun 11 23:08:10.004313 np0000002687 nova-compute[98431]: INFO nova.compute.resource_tracker [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] Compute node record created for np0000002687:np0000002687 with uuid: e3e65fe2-9de9-4821-8b4a-ccae37c66e25 Jun 11 23:08:11.510751 np0000002687 nova-compute[98431]: DEBUG nova.compute.resource_tracker [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=98431) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}} Jun 11 23:08:11.511275 np0000002687 nova-compute[98431]: DEBUG nova.compute.resource_tracker [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] Final resource view: name=np0000002687 phys_ram=24030MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 23:08:08 up 23 min, 2 users, load average: 3.21, 1.77, 0.87\n'} {{(pid=98431) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}} Jun 11 23:08:11.937258 np0000002687 nova-compute[98431]: INFO nova.scheduler.client.report [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] [req-5fd01f01-1d97-4613-9893-1b9b5dda7908] Created resource provider record via placement API for resource provider with UUID e3e65fe2-9de9-4821-8b4a-ccae37c66e25 and name np0000002687. Jun 11 23:08:11.984006 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] /sys/module/kvm_amd/parameters/sev contains [N Jun 11 23:08:11.984006 np0000002687 nova-compute[98431]: ] {{(pid=98431) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:2037}} Jun 11 23:08:11.984142 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.host [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] kernel doesn't support AMD SEV Jun 11 23:08:11.984295 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98431) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 11 23:08:11.984464 np0000002687 nova-compute[98431]: DEBUG nova.compute.provider_tree [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] Updating inventory in ProviderTree for provider e3e65fe2-9de9-4821-8b4a-ccae37c66e25 with inventory: {'MEMORY_MB': {'total': 24030, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 95, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=98431) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}} Jun 11 23:08:11.984709 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98431) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 11 23:08:11.988487 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] Libvirt baseline CPU Jun 11 23:08:11.988487 np0000002687 nova-compute[98431]: x86_64 Jun 11 23:08:11.988487 np0000002687 nova-compute[98431]: Nehalem Jun 11 23:08:11.988487 np0000002687 nova-compute[98431]: AMD Jun 11 23:08:11.988487 np0000002687 nova-compute[98431]: Jun 11 23:08:11.988487 np0000002687 nova-compute[98431]: Jun 11 23:08:11.988487 np0000002687 nova-compute[98431]: Jun 11 23:08:11.988487 np0000002687 nova-compute[98431]: {{(pid=98431) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:13756}} Jun 11 23:08:12.549662 np0000002687 nova-compute[98431]: DEBUG nova.scheduler.client.report [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] Updated inventory for provider e3e65fe2-9de9-4821-8b4a-ccae37c66e25 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 24030, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 95, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=98431) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:975}} Jun 11 23:08:12.550157 np0000002687 nova-compute[98431]: DEBUG nova.compute.provider_tree [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] Updating resource provider e3e65fe2-9de9-4821-8b4a-ccae37c66e25 generation from 0 to 1 during operation: update_inventory {{(pid=98431) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}} Jun 11 23:08:12.550157 np0000002687 nova-compute[98431]: DEBUG nova.compute.provider_tree [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] Updating inventory in ProviderTree for provider e3e65fe2-9de9-4821-8b4a-ccae37c66e25 with inventory: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98431) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}} Jun 11 23:08:12.705714 np0000002687 nova-compute[98431]: DEBUG nova.compute.provider_tree [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] Updating resource provider e3e65fe2-9de9-4821-8b4a-ccae37c66e25 generation from 1 to 2 during operation: update_traits {{(pid=98431) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}} Jun 11 23:08:13.213389 np0000002687 nova-compute[98431]: DEBUG nova.compute.resource_tracker [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] Compute_service record updated for np0000002687:np0000002687 {{(pid=98431) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}} Jun 11 23:08:13.213600 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 4.216s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:08:13.213735 np0000002687 nova-compute[98431]: DEBUG nova.service [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] Creating RPC server for service: nova-compute on topic: compute {{(pid=98431) start /opt/stack/nova/nova/service.py:196}} Jun 11 23:08:13.227727 np0000002687 nova-compute[98431]: DEBUG nova.service [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] Creating 2nd RPC server for service: nova-compute on topic: compute-alt {{(pid=98431) start /opt/stack/nova/nova/service.py:212}} Jun 11 23:08:13.243217 np0000002687 nova-compute[98431]: DEBUG nova.service [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] Join ServiceGroup membership for this service compute {{(pid=98431) start /opt/stack/nova/nova/service.py:222}} Jun 11 23:08:13.243928 np0000002687 nova-compute[98431]: DEBUG nova.servicegroup.drivers.db [None req-783dbe4a-1345-462d-8417-aac3f14b2ce8 None None] DB_Driver: join new ServiceGroup member np0000002687 to the compute group, service = {{(pid=98431) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}} Jun 11 23:08:18.746860 np0000002687 nova-compute[98431]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98431) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jun 11 23:08:19.245330 np0000002687 nova-compute[98431]: DEBUG oslo_service.periodic_task [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running periodic task ComputeManager._sync_power_states {{(pid=98431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 11 23:08:19.748750 np0000002687 nova-compute[98431]: DEBUG oslo_service.periodic_task [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=98431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 11 23:08:19.749738 np0000002687 nova-compute[98431]: DEBUG oslo.service.backend._threading.loopingcall [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 33.27 seconds {{(pid=98431) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jun 11 23:08:53.025095 np0000002687 nova-compute[98431]: DEBUG oslo_service.periodic_task [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 11 23:08:53.025579 np0000002687 nova-compute[98431]: DEBUG oslo_service.periodic_task [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 11 23:08:53.025579 np0000002687 nova-compute[98431]: DEBUG oslo_service.periodic_task [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 11 23:08:53.025718 np0000002687 nova-compute[98431]: DEBUG oslo_service.periodic_task [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 11 23:08:53.025923 np0000002687 nova-compute[98431]: DEBUG oslo_service.periodic_task [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 11 23:08:53.026109 np0000002687 nova-compute[98431]: DEBUG oslo_service.periodic_task [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 11 23:08:53.026292 np0000002687 nova-compute[98431]: DEBUG oslo_service.periodic_task [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 11 23:08:53.026435 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98431) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}} Jun 11 23:08:53.026587 np0000002687 nova-compute[98431]: DEBUG oslo_service.periodic_task [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running periodic task ComputeManager.update_available_resource {{(pid=98431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 11 23:08:53.529565 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:08:53.529744 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:08:53.529824 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:08:53.529939 np0000002687 nova-compute[98431]: DEBUG nova.compute.resource_tracker [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Auditing locally available compute resources for np0000002687 (node: np0000002687) {{(pid=98431) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}} Jun 11 23:08:53.537366 np0000002687 nova-compute[98431]: WARNING nova.virt.libvirt.driver [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 11 23:08:53.538023 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:08:53.550586 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] CMD "env LANG=C uptime" returned: 0 in 0.012s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:08:53.551252 np0000002687 nova-compute[98431]: DEBUG nova.compute.resource_tracker [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Hypervisor/Node resource view: name=np0000002687 free_ram=16417MB free_disk=75.01182556152344GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}] {{(pid=98431) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}} Jun 11 23:08:53.551899 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:08:53.552187 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:08:54.605822 np0000002687 nova-compute[98431]: DEBUG nova.compute.resource_tracker [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=98431) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}} Jun 11 23:08:54.605822 np0000002687 nova-compute[98431]: DEBUG nova.compute.resource_tracker [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Final resource view: name=np0000002687 phys_ram=24030MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 23:08:53 up 23 min, 2 users, load average: 2.10, 1.67, 0.88\n'} {{(pid=98431) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}} Jun 11 23:08:54.646685 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98431) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 11 23:08:54.647101 np0000002687 nova-compute[98431]: DEBUG nova.compute.provider_tree [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Inventory has not changed in ProviderTree for provider: e3e65fe2-9de9-4821-8b4a-ccae37c66e25 {{(pid=98431) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 11 23:08:55.151823 np0000002687 nova-compute[98431]: DEBUG nova.scheduler.client.report [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Inventory has not changed for provider e3e65fe2-9de9-4821-8b4a-ccae37c66e25 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98431) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 11 23:08:55.656127 np0000002687 nova-compute[98431]: DEBUG nova.compute.resource_tracker [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Compute_service record updated for np0000002687:np0000002687 {{(pid=98431) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}} Jun 11 23:08:55.656127 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.104s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:08:55.656930 np0000002687 nova-compute[98431]: DEBUG oslo.service.backend._threading.loopingcall [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 59.99 seconds {{(pid=98431) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jun 11 23:09:55.650543 np0000002687 nova-compute[98431]: DEBUG oslo_service.periodic_task [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 11 23:09:55.651074 np0000002687 nova-compute[98431]: DEBUG oslo_service.periodic_task [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 11 23:09:55.651074 np0000002687 nova-compute[98431]: DEBUG oslo_service.periodic_task [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 11 23:09:55.651187 np0000002687 nova-compute[98431]: DEBUG oslo_service.periodic_task [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 11 23:09:55.651264 np0000002687 nova-compute[98431]: DEBUG oslo_service.periodic_task [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 11 23:09:55.651429 np0000002687 nova-compute[98431]: DEBUG oslo_service.periodic_task [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 11 23:09:55.651585 np0000002687 nova-compute[98431]: DEBUG oslo_service.periodic_task [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 11 23:09:55.651747 np0000002687 nova-compute[98431]: DEBUG oslo_service.periodic_task [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 11 23:09:55.651873 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98431) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}} Jun 11 23:09:55.652025 np0000002687 nova-compute[98431]: DEBUG oslo_service.periodic_task [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running periodic task ComputeManager.update_available_resource {{(pid=98431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 11 23:09:56.155004 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:09:56.155192 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:09:56.155385 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:09:56.155519 np0000002687 nova-compute[98431]: DEBUG nova.compute.resource_tracker [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Auditing locally available compute resources for np0000002687 (node: np0000002687) {{(pid=98431) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}} Jun 11 23:09:56.162859 np0000002687 nova-compute[98431]: WARNING nova.virt.libvirt.driver [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 11 23:09:56.163617 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:09:56.176939 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] CMD "env LANG=C uptime" returned: 0 in 0.013s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:09:56.177388 np0000002687 nova-compute[98431]: DEBUG nova.compute.resource_tracker [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Hypervisor/Node resource view: name=np0000002687 free_ram=16550MB free_disk=74.79875564575195GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}] {{(pid=98431) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}} Jun 11 23:09:56.177570 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:09:56.177885 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:09:57.222837 np0000002687 nova-compute[98431]: DEBUG nova.compute.resource_tracker [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=98431) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}} Jun 11 23:09:57.222837 np0000002687 nova-compute[98431]: DEBUG nova.compute.resource_tracker [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Final resource view: name=np0000002687 phys_ram=24030MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 23:09:56 up 24 min, 2 users, load average: 1.29, 1.52, 0.89\n'} {{(pid=98431) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}} Jun 11 23:09:57.262433 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98431) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 11 23:09:57.262619 np0000002687 nova-compute[98431]: DEBUG nova.compute.provider_tree [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Inventory has not changed in ProviderTree for provider: e3e65fe2-9de9-4821-8b4a-ccae37c66e25 {{(pid=98431) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 11 23:09:57.765069 np0000002687 nova-compute[98431]: DEBUG nova.scheduler.client.report [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Inventory has not changed for provider e3e65fe2-9de9-4821-8b4a-ccae37c66e25 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98431) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 11 23:09:58.270999 np0000002687 nova-compute[98431]: DEBUG nova.compute.resource_tracker [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Compute_service record updated for np0000002687:np0000002687 {{(pid=98431) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}} Jun 11 23:09:58.271380 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.093s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:09:58.271413 np0000002687 nova-compute[98431]: DEBUG oslo.service.backend._threading.loopingcall [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 60.00 seconds {{(pid=98431) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jun 11 23:10:18.751559 np0000002687 nova-compute[98431]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98431) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jun 11 23:10:28.180941 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Acquiring lock "8aec3cea-109d-43f8-983c-1d5ee2f71181" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:10:28.181534 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lock "8aec3cea-109d-43f8-983c-1d5ee2f71181" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:10:28.684395 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 8aec3cea-109d-43f8-983c-1d5ee2f71181] Starting instance... {{(pid=98431) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 11 23:10:29.259663 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:10:29.260045 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:10:29.262881 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98431) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 11 23:10:29.263083 np0000002687 nova-compute[98431]: INFO nova.compute.claims [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 8aec3cea-109d-43f8-983c-1d5ee2f71181] Claim successful on node np0000002687 Jun 11 23:10:30.366726 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98431) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 11 23:10:30.367123 np0000002687 nova-compute[98431]: DEBUG nova.compute.provider_tree [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Inventory has not changed in ProviderTree for provider: e3e65fe2-9de9-4821-8b4a-ccae37c66e25 {{(pid=98431) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 11 23:10:30.870935 np0000002687 nova-compute[98431]: DEBUG nova.scheduler.client.report [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Inventory has not changed for provider e3e65fe2-9de9-4821-8b4a-ccae37c66e25 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98431) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 11 23:10:31.379662 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.120s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:10:31.380250 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 8aec3cea-109d-43f8-983c-1d5ee2f71181] Start building networks asynchronously for instance. {{(pid=98431) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 11 23:10:31.535507 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-ac70a8b6-6e47-48a8-bc39-40773397e5b3 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Acquiring lock "689e510d-e0a4-4d6a-958e-9acfaebedc87" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:10:31.535840 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-ac70a8b6-6e47-48a8-bc39-40773397e5b3 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Lock "689e510d-e0a4-4d6a-958e-9acfaebedc87" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:10:31.888051 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 8aec3cea-109d-43f8-983c-1d5ee2f71181] Allocating IP information in the background. {{(pid=98431) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 11 23:10:31.888307 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 8aec3cea-109d-43f8-983c-1d5ee2f71181] allocate_for_instance() {{(pid=98431) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 11 23:10:31.889333 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:10:31.890550 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:10:31.921960 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-6a2a9908-fc7f-49fd-ba64-85c281bbf910 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Acquiring lock "cb63f66c-b69e-42b0-805c-be6fe9b3aee3" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:10:31.922146 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-6a2a9908-fc7f-49fd-ba64-85c281bbf910 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Lock "cb63f66c-b69e-42b0-805c-be6fe9b3aee3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:10:32.038944 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-ac70a8b6-6e47-48a8-bc39-40773397e5b3 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] [instance: 689e510d-e0a4-4d6a-958e-9acfaebedc87] Starting instance... {{(pid=98431) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 11 23:10:32.392555 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 8aec3cea-109d-43f8-983c-1d5ee2f71181] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 11 23:10:32.424339 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-6a2a9908-fc7f-49fd-ba64-85c281bbf910 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Starting instance... {{(pid=98431) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 11 23:10:32.448365 np0000002687 nova-compute[98431]: DEBUG nova.policy [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '72b6dac5eb744cfba6299636227aa59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaf744af828a4a5eba1e98da63373b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98431) authorize /opt/stack/nova/nova/policy.py:192}} Jun 11 23:10:32.618245 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-ac70a8b6-6e47-48a8-bc39-40773397e5b3 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:10:32.619596 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-ac70a8b6-6e47-48a8-bc39-40773397e5b3 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:10:32.624843 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-ac70a8b6-6e47-48a8-bc39-40773397e5b3 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98431) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 11 23:10:32.625081 np0000002687 nova-compute[98431]: INFO nova.compute.claims [None req-ac70a8b6-6e47-48a8-bc39-40773397e5b3 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] [instance: 689e510d-e0a4-4d6a-958e-9acfaebedc87] Claim successful on node np0000002687 Jun 11 23:10:32.898825 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 8aec3cea-109d-43f8-983c-1d5ee2f71181] Start building block device mappings for instance. {{(pid=98431) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 11 23:10:32.981417 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-6a2a9908-fc7f-49fd-ba64-85c281bbf910 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:10:33.373824 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 8aec3cea-109d-43f8-983c-1d5ee2f71181] Successfully created port: 6d2a143c-c69d-424d-8c91-e8553a8166a9 {{(pid=98431) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 11 23:10:33.864070 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-ac70a8b6-6e47-48a8-bc39-40773397e5b3 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98431) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 11 23:10:33.864513 np0000002687 nova-compute[98431]: DEBUG nova.compute.provider_tree [None req-ac70a8b6-6e47-48a8-bc39-40773397e5b3 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Inventory has not changed in ProviderTree for provider: e3e65fe2-9de9-4821-8b4a-ccae37c66e25 {{(pid=98431) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 11 23:10:33.908775 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 8aec3cea-109d-43f8-983c-1d5ee2f71181] Start spawning the instance on the hypervisor. {{(pid=98431) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 11 23:10:33.911749 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 8aec3cea-109d-43f8-983c-1d5ee2f71181] Creating instance directory {{(pid=98431) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}} Jun 11 23:10:33.914820 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 8aec3cea-109d-43f8-983c-1d5ee2f71181] Creating image(s) Jun 11 23:10:33.914820 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Acquiring lock "/opt/stack/data/nova/instances/8aec3cea-109d-43f8-983c-1d5ee2f71181/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:10:33.914820 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lock "/opt/stack/data/nova/instances/8aec3cea-109d-43f8-983c-1d5ee2f71181/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:10:33.914820 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lock "/opt/stack/data/nova/instances/8aec3cea-109d-43f8-983c-1d5ee2f71181/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:10:33.914820 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Acquiring lock "d2c441059b2992961b5de03c05b32d04aff77cb1" by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:10:33.914820 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lock "d2c441059b2992961b5de03c05b32d04aff77cb1" acquired by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:10:34.256680 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:10:34.259063 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:10:34.259461 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1.part --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:10:34.335154 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1.part --force-share --output=json" returned: 0 in 0.075s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:10:34.336060 np0000002687 nova-compute[98431]: DEBUG nova.virt.images [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] f30640f8-7aca-4300-a085-4706a5209a79 was qcow2, converting to raw {{(pid=98431) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}} Jun 11 23:10:34.336898 np0000002687 nova-compute[98431]: DEBUG nova.privsep.utils [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98431) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}} Jun 11 23:10:34.337343 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1.part /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1.converted {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:10:34.368356 np0000002687 nova-compute[98431]: DEBUG nova.scheduler.client.report [None req-ac70a8b6-6e47-48a8-bc39-40773397e5b3 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Inventory has not changed for provider e3e65fe2-9de9-4821-8b4a-ccae37c66e25 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98431) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 11 23:10:34.531821 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1.part /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1.converted" returned: 0 in 0.194s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:10:34.537908 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1.converted --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:10:34.613314 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1.converted --force-share --output=json" returned: 0 in 0.075s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:10:34.613971 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lock "d2c441059b2992961b5de03c05b32d04aff77cb1" "released" by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" :: held 0.700s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:10:34.616149 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:10:34.618854 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:10:34.619848 np0000002687 nova-compute[98431]: INFO oslo.privsep.daemon [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp3103gzr0/privsep.sock'] Jun 11 23:10:34.628317 np0000002687 sudo[109950]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp3103gzr0/privsep.sock Jun 11 23:10:34.629003 np0000002687 sudo[109950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jun 11 23:10:34.875859 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-ac70a8b6-6e47-48a8-bc39-40773397e5b3 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.257s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:10:34.876431 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-ac70a8b6-6e47-48a8-bc39-40773397e5b3 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] [instance: 689e510d-e0a4-4d6a-958e-9acfaebedc87] Start building networks asynchronously for instance. {{(pid=98431) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 11 23:10:34.882826 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-6a2a9908-fc7f-49fd-ba64-85c281bbf910 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.899s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:10:34.885866 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-6a2a9908-fc7f-49fd-ba64-85c281bbf910 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98431) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 11 23:10:34.886077 np0000002687 nova-compute[98431]: INFO nova.compute.claims [None req-6a2a9908-fc7f-49fd-ba64-85c281bbf910 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Claim successful on node np0000002687 Jun 11 23:10:34.898238 np0000002687 nova-compute[98431]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jun 11 23:10:34.898325 np0000002687 nova-compute[98431]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 11 23:10:34.898325 np0000002687 nova-compute[98431]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jun 11 23:10:34.898577 np0000002687 nova-compute[98431]: WARNING oslo.privsep.daemon [-] privsep log: Jun 11 23:10:34.898577 np0000002687 nova-compute[98431]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jun 11 23:10:34.901418 np0000002687 nova-compute[98431]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jun 11 23:10:34.901518 np0000002687 nova-compute[98431]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 11 23:10:34.901662 np0000002687 nova-compute[98431]: WARNING oslo.privsep.daemon [-] privsep log: Jun 11 23:10:34.901771 np0000002687 nova-compute[98431]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jun 11 23:10:35.105528 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 8aec3cea-109d-43f8-983c-1d5ee2f71181] Successfully updated port: 6d2a143c-c69d-424d-8c91-e8553a8166a9 {{(pid=98431) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 11 23:10:35.257938 np0000002687 nova-compute[98431]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jun 11 23:10:35.258047 np0000002687 nova-compute[98431]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 11 23:10:35.258118 np0000002687 nova-compute[98431]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jun 11 23:10:35.258187 np0000002687 nova-compute[98431]: WARNING oslo.privsep.daemon [-] privsep log: Jun 11 23:10:35.258269 np0000002687 nova-compute[98431]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jun 11 23:10:35.258342 np0000002687 nova-compute[98431]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jun 11 23:10:35.258393 np0000002687 nova-compute[98431]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 11 23:10:35.258481 np0000002687 nova-compute[98431]: WARNING oslo.privsep.daemon [-] privsep log: Jun 11 23:10:35.258622 np0000002687 nova-compute[98431]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jun 11 23:10:35.385901 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-ac70a8b6-6e47-48a8-bc39-40773397e5b3 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] [instance: 689e510d-e0a4-4d6a-958e-9acfaebedc87] Allocating IP information in the background. {{(pid=98431) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 11 23:10:35.386463 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-ac70a8b6-6e47-48a8-bc39-40773397e5b3 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] [instance: 689e510d-e0a4-4d6a-958e-9acfaebedc87] allocate_for_instance() {{(pid=98431) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 11 23:10:35.387286 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-ac70a8b6-6e47-48a8-bc39-40773397e5b3 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:10:35.387523 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-ac70a8b6-6e47-48a8-bc39-40773397e5b3 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:10:35.526204 np0000002687 sudo[109950]: pam_unix(sudo:session): session closed for user root Jun 11 23:10:35.532486 np0000002687 nova-compute[98431]: DEBUG nova.policy [None req-ac70a8b6-6e47-48a8-bc39-40773397e5b3 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3d47d776b5de49189b8790124ba4bd14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78539cb9b504ed0908d5bfe6745a628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98431) authorize /opt/stack/nova/nova/policy.py:192}} Jun 11 23:10:35.533973 np0000002687 nova-compute[98431]: INFO oslo.privsep.daemon [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Spawned new privsep daemon via rootwrap Jun 11 23:10:35.535228 np0000002687 nova-compute[98431]: INFO oslo.privsep.daemon [-] privsep daemon starting Jun 11 23:10:35.535327 np0000002687 nova-compute[98431]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jun 11 23:10:35.535448 np0000002687 nova-compute[98431]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jun 11 23:10:35.535498 np0000002687 nova-compute[98431]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 109957 Jun 11 23:10:35.610721 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Acquiring lock "refresh_cache-8aec3cea-109d-43f8-983c-1d5ee2f71181" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 11 23:10:35.610894 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Acquired lock "refresh_cache-8aec3cea-109d-43f8-983c-1d5ee2f71181" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 11 23:10:35.611070 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 8aec3cea-109d-43f8-983c-1d5ee2f71181] Building network info cache for instance {{(pid=98431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 11 23:10:35.619048 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:10:35.683456 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json" returned: 0 in 0.064s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:10:35.684401 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Acquiring lock "d2c441059b2992961b5de03c05b32d04aff77cb1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:10:35.685124 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lock "d2c441059b2992961b5de03c05b32d04aff77cb1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:10:35.685314 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:10:35.688582 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:10:35.689343 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:10:35.753023 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json" returned: 0 in 0.064s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:10:35.753461 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1,backing_fmt=raw /opt/stack/data/nova/instances/8aec3cea-109d-43f8-983c-1d5ee2f71181/disk 1073741824 {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:10:35.779618 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1,backing_fmt=raw /opt/stack/data/nova/instances/8aec3cea-109d-43f8-983c-1d5ee2f71181/disk 1073741824" returned: 0 in 0.026s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:10:35.780101 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lock "d2c441059b2992961b5de03c05b32d04aff77cb1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.095s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:10:35.780446 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:10:35.851015 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json" returned: 0 in 0.070s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:10:35.851624 np0000002687 nova-compute[98431]: DEBUG nova.virt.disk.api [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8aec3cea-109d-43f8-983c-1d5ee2f71181/disk. size=1073741824 {{(pid=98431) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 11 23:10:35.852005 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8aec3cea-109d-43f8-983c-1d5ee2f71181/disk --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:10:35.892088 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-ac70a8b6-6e47-48a8-bc39-40773397e5b3 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] [instance: 689e510d-e0a4-4d6a-958e-9acfaebedc87] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 11 23:10:35.922208 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8aec3cea-109d-43f8-983c-1d5ee2f71181/disk --force-share --output=json" returned: 0 in 0.070s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:10:35.922677 np0000002687 nova-compute[98431]: DEBUG nova.virt.disk.api [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Cannot resize image /opt/stack/data/nova/instances/8aec3cea-109d-43f8-983c-1d5ee2f71181/disk to a smaller size. {{(pid=98431) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 11 23:10:35.924695 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 8aec3cea-109d-43f8-983c-1d5ee2f71181] Created local disks {{(pid=98431) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}} Jun 11 23:10:35.924963 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 8aec3cea-109d-43f8-983c-1d5ee2f71181] Ensure instance console log exists: /opt/stack/data/nova/instances/8aec3cea-109d-43f8-983c-1d5ee2f71181/console.log {{(pid=98431) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}} Jun 11 23:10:35.925686 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:10:35.925926 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:10:35.926106 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:10:36.132310 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-6a2a9908-fc7f-49fd-ba64-85c281bbf910 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98431) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 11 23:10:36.132474 np0000002687 nova-compute[98431]: DEBUG nova.compute.provider_tree [None req-6a2a9908-fc7f-49fd-ba64-85c281bbf910 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Inventory has not changed in ProviderTree for provider: e3e65fe2-9de9-4821-8b4a-ccae37c66e25 {{(pid=98431) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 11 23:10:36.224258 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 8aec3cea-109d-43f8-983c-1d5ee2f71181] Instance cache missing network info. {{(pid=98431) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 11 23:10:36.231591 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-ac70a8b6-6e47-48a8-bc39-40773397e5b3 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] [instance: 689e510d-e0a4-4d6a-958e-9acfaebedc87] Successfully created port: 65f7170b-ae97-4cd6-93a1-7dd5111b7978 {{(pid=98431) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 11 23:10:36.404302 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-ac70a8b6-6e47-48a8-bc39-40773397e5b3 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] [instance: 689e510d-e0a4-4d6a-958e-9acfaebedc87] Start building block device mappings for instance. {{(pid=98431) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 11 23:10:36.500619 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:10:36.635206 np0000002687 nova-compute[98431]: DEBUG nova.scheduler.client.report [None req-6a2a9908-fc7f-49fd-ba64-85c281bbf910 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Inventory has not changed for provider e3e65fe2-9de9-4821-8b4a-ccae37c66e25 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98431) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 11 23:10:36.764534 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 8aec3cea-109d-43f8-983c-1d5ee2f71181] Updating instance_info_cache with network_info: [{"id": "6d2a143c-c69d-424d-8c91-e8553a8166a9", "address": "fa:16:3e:6c:eb:30", "network": {"id": "2a770c99-2ec6-4fa2-945b-32830a59e7a7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-137493671-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aaf744af828a4a5eba1e98da63373b2b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d2a143c-c6", "ovs_interfaceid": "6d2a143c-c69d-424d-8c91-e8553a8166a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:10:36.978075 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Acquiring lock "de4372a4-a0cc-4541-a5a2-87be3152c50e" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:10:36.978075 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "de4372a4-a0cc-4541-a5a2-87be3152c50e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:10:37.149610 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-6a2a9908-fc7f-49fd-ba64-85c281bbf910 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.270s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:10:37.149916 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-6a2a9908-fc7f-49fd-ba64-85c281bbf910 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Start building networks asynchronously for instance. {{(pid=98431) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 11 23:10:37.253439 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-c9c299f6-efa8-48c0-acc1-7088b0dc3f9b req-7fb2203f-3f07-4e7f-a948-3c205aabe222 service nova] [instance: 8aec3cea-109d-43f8-983c-1d5ee2f71181] Received event network-changed-6d2a143c-c69d-424d-8c91-e8553a8166a9 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:10:37.253793 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-c9c299f6-efa8-48c0-acc1-7088b0dc3f9b req-7fb2203f-3f07-4e7f-a948-3c205aabe222 service nova] [instance: 8aec3cea-109d-43f8-983c-1d5ee2f71181] Refreshing instance network info cache due to event network-changed-6d2a143c-c69d-424d-8c91-e8553a8166a9. {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 11 23:10:37.253999 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-c9c299f6-efa8-48c0-acc1-7088b0dc3f9b req-7fb2203f-3f07-4e7f-a948-3c205aabe222 service nova] Acquiring lock "refresh_cache-8aec3cea-109d-43f8-983c-1d5ee2f71181" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 11 23:10:37.267219 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Releasing lock "refresh_cache-8aec3cea-109d-43f8-983c-1d5ee2f71181" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 11 23:10:37.267449 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 8aec3cea-109d-43f8-983c-1d5ee2f71181] Instance network_info: |[{"id": "6d2a143c-c69d-424d-8c91-e8553a8166a9", "address": "fa:16:3e:6c:eb:30", "network": {"id": "2a770c99-2ec6-4fa2-945b-32830a59e7a7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-137493671-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aaf744af828a4a5eba1e98da63373b2b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d2a143c-c6", "ovs_interfaceid": "6d2a143c-c69d-424d-8c91-e8553a8166a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98431) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 11 23:10:37.268416 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-c9c299f6-efa8-48c0-acc1-7088b0dc3f9b req-7fb2203f-3f07-4e7f-a948-3c205aabe222 service nova] Acquired lock "refresh_cache-8aec3cea-109d-43f8-983c-1d5ee2f71181" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 11 23:10:37.268634 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-c9c299f6-efa8-48c0-acc1-7088b0dc3f9b req-7fb2203f-3f07-4e7f-a948-3c205aabe222 service nova] [instance: 8aec3cea-109d-43f8-983c-1d5ee2f71181] Refreshing network info cache for port 6d2a143c-c69d-424d-8c91-e8553a8166a9 {{(pid=98431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 11 23:10:37.271288 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 8aec3cea-109d-43f8-983c-1d5ee2f71181] Start _get_guest_xml network_info=[{"id": "6d2a143c-c69d-424d-8c91-e8553a8166a9", "address": "fa:16:3e:6c:eb:30", "network": {"id": "2a770c99-2ec6-4fa2-945b-32830a59e7a7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-137493671-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aaf744af828a4a5eba1e98da63373b2b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d2a143c-c6", "ovs_interfaceid": "6d2a143c-c69d-424d-8c91-e8553a8166a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-11T23:08:20Z,direct_url=,disk_format='qcow2',id=f30640f8-7aca-4300-a085-4706a5209a79,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ce012f9fabdb4ee5a73e212437f59d97',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-11T23:08:23Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'image_id': 'f30640f8-7aca-4300-a085-4706a5209a79'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98431) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 11 23:10:37.276204 np0000002687 nova-compute[98431]: WARNING nova.virt.libvirt.driver [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 11 23:10:37.276464 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='f30640f8-7aca-4300-a085-4706a5209a79', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-969621487', uuid='8aec3cea-109d-43f8-983c-1d5ee2f71181'), owner=OwnerMeta(userid='72b6dac5eb744cfba6299636227aa59b', username='tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member', projectid='aaf744af828a4a5eba1e98da63373b2b', projectname='tempest-ServerBootFromVolumeStableRescueTest-539499192'), image=ImageMeta(id='f30640f8-7aca-4300-a085-4706a5209a79', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "6d2a143c-c69d-424d-8c91-e8553a8166a9", "address": "fa:16:3e:6c:eb:30", "network": {"id": "2a770c99-2ec6-4fa2-945b-32830a59e7a7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-137493671-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aaf744af828a4a5eba1e98da63373b2b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d2a143c-c6", "ovs_interfaceid": "6d2a143c-c69d-424d-8c91-e8553a8166a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1781219437.2757108) {{(pid=98431) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 11 23:10:37.279603 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Searching host: 'np0000002687' for CPU controller through CGroups V1... {{(pid=98431) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 11 23:10:37.280031 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] CPU controller missing on host. {{(pid=98431) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 11 23:10:37.280791 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Searching host: 'np0000002687' for CPU controller through CGroups V2... {{(pid=98431) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 11 23:10:37.281058 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] CPU controller found on host. {{(pid=98431) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 11 23:10:37.282587 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98431) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 11 23:10:37.283041 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-11T23:08:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-11T23:08:20Z,direct_url=,disk_format='qcow2',id=f30640f8-7aca-4300-a085-4706a5209a79,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ce012f9fabdb4ee5a73e212437f59d97',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-11T23:08:23Z,virtual_size=,visibility=), allow threads: True {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 11 23:10:37.283284 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Flavor limits 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 11 23:10:37.283428 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Image limits 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 11 23:10:37.283657 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Flavor pref 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 11 23:10:37.283817 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Image pref 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 11 23:10:37.283951 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 11 23:10:37.284115 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 11 23:10:37.284265 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98431) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 11 23:10:37.284974 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Got 1 possible topologies {{(pid=98431) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 11 23:10:37.285112 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 11 23:10:37.285295 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 11 23:10:37.303037 np0000002687 nova-compute[98431]: DEBUG nova.privsep.utils [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98431) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}} Jun 11 23:10:37.304168 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-11T23:10:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-969621487',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='tempest-serverbootfromvolumestablerescuetest-server-969621487',id=1,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aaf744af828a4a5eba1e98da63373b2b',ramdisk_id='',reservation_id='r-232rbmf3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-539499192',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-11T23:10:33Z,user_data=None,user_id='72b6dac5eb744cfba6299636227aa59b',uuid=8aec3cea-109d-43f8-983c-1d5ee2f71181,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6d2a143c-c69d-424d-8c91-e8553a8166a9", "address": "fa:16:3e:6c:eb:30", "network": {"id": "2a770c99-2ec6-4fa2-945b-32830a59e7a7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-137493671-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aaf744af828a4a5eba1e98da63373b2b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d2a143c-c6", "ovs_interfaceid": "6d2a143c-c69d-424d-8c91-e8553a8166a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98431) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 11 23:10:37.304425 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Converting VIF {"id": "6d2a143c-c69d-424d-8c91-e8553a8166a9", "address": "fa:16:3e:6c:eb:30", "network": {"id": "2a770c99-2ec6-4fa2-945b-32830a59e7a7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-137493671-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aaf744af828a4a5eba1e98da63373b2b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d2a143c-c6", "ovs_interfaceid": "6d2a143c-c69d-424d-8c91-e8553a8166a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:10:37.305582 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:eb:30,bridge_name='br-int',has_traffic_filtering=True,id=6d2a143c-c69d-424d-8c91-e8553a8166a9,network=Network(2a770c99-2ec6-4fa2-945b-32830a59e7a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d2a143c-c6') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:10:37.307018 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lazy-loading 'pci_devices' on Instance uuid 8aec3cea-109d-43f8-983c-1d5ee2f71181 {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:10:37.394438 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-ac70a8b6-6e47-48a8-bc39-40773397e5b3 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] [instance: 689e510d-e0a4-4d6a-958e-9acfaebedc87] Successfully updated port: 65f7170b-ae97-4cd6-93a1-7dd5111b7978 {{(pid=98431) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 11 23:10:37.414333 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-ac70a8b6-6e47-48a8-bc39-40773397e5b3 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] [instance: 689e510d-e0a4-4d6a-958e-9acfaebedc87] Start spawning the instance on the hypervisor. {{(pid=98431) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 11 23:10:37.415680 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-ac70a8b6-6e47-48a8-bc39-40773397e5b3 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] [instance: 689e510d-e0a4-4d6a-958e-9acfaebedc87] Creating instance directory {{(pid=98431) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}} Jun 11 23:10:37.415680 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-ac70a8b6-6e47-48a8-bc39-40773397e5b3 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] [instance: 689e510d-e0a4-4d6a-958e-9acfaebedc87] Creating image(s) Jun 11 23:10:37.416615 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-ac70a8b6-6e47-48a8-bc39-40773397e5b3 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Acquiring lock "/opt/stack/data/nova/instances/689e510d-e0a4-4d6a-958e-9acfaebedc87/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:10:37.416615 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-ac70a8b6-6e47-48a8-bc39-40773397e5b3 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Lock "/opt/stack/data/nova/instances/689e510d-e0a4-4d6a-958e-9acfaebedc87/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:10:37.416957 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-ac70a8b6-6e47-48a8-bc39-40773397e5b3 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Lock "/opt/stack/data/nova/instances/689e510d-e0a4-4d6a-958e-9acfaebedc87/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:10:37.417580 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-ac70a8b6-6e47-48a8-bc39-40773397e5b3 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:10:37.420112 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-ac70a8b6-6e47-48a8-bc39-40773397e5b3 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:10:37.421293 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-ac70a8b6-6e47-48a8-bc39-40773397e5b3 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:10:37.483099 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: de4372a4-a0cc-4541-a5a2-87be3152c50e] Starting instance... {{(pid=98431) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 11 23:10:37.492280 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-ac70a8b6-6e47-48a8-bc39-40773397e5b3 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json" returned: 0 in 0.071s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:10:37.492643 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-ac70a8b6-6e47-48a8-bc39-40773397e5b3 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Acquiring lock "d2c441059b2992961b5de03c05b32d04aff77cb1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:10:37.493230 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-ac70a8b6-6e47-48a8-bc39-40773397e5b3 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Lock "d2c441059b2992961b5de03c05b32d04aff77cb1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:10:37.493656 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-ac70a8b6-6e47-48a8-bc39-40773397e5b3 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:10:37.497586 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-ac70a8b6-6e47-48a8-bc39-40773397e5b3 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:10:37.498018 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-ac70a8b6-6e47-48a8-bc39-40773397e5b3 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:10:37.565248 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-ac70a8b6-6e47-48a8-bc39-40773397e5b3 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json" returned: 0 in 0.067s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:10:37.565761 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-ac70a8b6-6e47-48a8-bc39-40773397e5b3 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1,backing_fmt=raw /opt/stack/data/nova/instances/689e510d-e0a4-4d6a-958e-9acfaebedc87/disk 1073741824 {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:10:37.597062 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-ac70a8b6-6e47-48a8-bc39-40773397e5b3 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1,backing_fmt=raw /opt/stack/data/nova/instances/689e510d-e0a4-4d6a-958e-9acfaebedc87/disk 1073741824" returned: 0 in 0.030s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:10:37.597595 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-ac70a8b6-6e47-48a8-bc39-40773397e5b3 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Lock "d2c441059b2992961b5de03c05b32d04aff77cb1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.104s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:10:37.598214 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-ac70a8b6-6e47-48a8-bc39-40773397e5b3 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:10:37.660839 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-6a2a9908-fc7f-49fd-ba64-85c281bbf910 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Allocating IP information in the background. {{(pid=98431) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 11 23:10:37.660839 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-6a2a9908-fc7f-49fd-ba64-85c281bbf910 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] allocate_for_instance() {{(pid=98431) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 11 23:10:37.660839 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-6a2a9908-fc7f-49fd-ba64-85c281bbf910 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:10:37.660839 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-6a2a9908-fc7f-49fd-ba64-85c281bbf910 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:10:37.667202 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-ac70a8b6-6e47-48a8-bc39-40773397e5b3 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json" returned: 0 in 0.069s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:10:37.667776 np0000002687 nova-compute[98431]: DEBUG nova.virt.disk.api [None req-ac70a8b6-6e47-48a8-bc39-40773397e5b3 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Checking if we can resize image /opt/stack/data/nova/instances/689e510d-e0a4-4d6a-958e-9acfaebedc87/disk. size=1073741824 {{(pid=98431) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 11 23:10:37.668156 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-ac70a8b6-6e47-48a8-bc39-40773397e5b3 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/689e510d-e0a4-4d6a-958e-9acfaebedc87/disk --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:10:37.743097 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-ac70a8b6-6e47-48a8-bc39-40773397e5b3 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/689e510d-e0a4-4d6a-958e-9acfaebedc87/disk --force-share --output=json" returned: 0 in 0.075s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:10:37.745318 np0000002687 nova-compute[98431]: DEBUG nova.virt.disk.api [None req-ac70a8b6-6e47-48a8-bc39-40773397e5b3 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Cannot resize image /opt/stack/data/nova/instances/689e510d-e0a4-4d6a-958e-9acfaebedc87/disk to a smaller size. {{(pid=98431) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 11 23:10:37.745744 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-ac70a8b6-6e47-48a8-bc39-40773397e5b3 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] [instance: 689e510d-e0a4-4d6a-958e-9acfaebedc87] Created local disks {{(pid=98431) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}} Jun 11 23:10:37.747545 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-ac70a8b6-6e47-48a8-bc39-40773397e5b3 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] [instance: 689e510d-e0a4-4d6a-958e-9acfaebedc87] Ensure instance console log exists: /opt/stack/data/nova/instances/689e510d-e0a4-4d6a-958e-9acfaebedc87/console.log {{(pid=98431) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}} Jun 11 23:10:37.747545 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-ac70a8b6-6e47-48a8-bc39-40773397e5b3 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:10:37.747545 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-ac70a8b6-6e47-48a8-bc39-40773397e5b3 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:10:37.747545 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-ac70a8b6-6e47-48a8-bc39-40773397e5b3 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:10:37.774051 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [req-c9c299f6-efa8-48c0-acc1-7088b0dc3f9b req-7fb2203f-3f07-4e7f-a948-3c205aabe222 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:10:37.814633 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 8aec3cea-109d-43f8-983c-1d5ee2f71181] End _get_guest_xml xml= Jun 11 23:10:37.814633 np0000002687 nova-compute[98431]: 8aec3cea-109d-43f8-983c-1d5ee2f71181 Jun 11 23:10:37.814633 np0000002687 nova-compute[98431]: instance-00000001 Jun 11 23:10:37.814633 np0000002687 nova-compute[98431]: 196608 Jun 11 23:10:37.814633 np0000002687 nova-compute[98431]: 1 Jun 11 23:10:37.814633 np0000002687 nova-compute[98431]: Jun 11 23:10:37.814633 np0000002687 nova-compute[98431]: Jun 11 23:10:37.814633 np0000002687 nova-compute[98431]: Jun 11 23:10:37.814633 np0000002687 nova-compute[98431]: tempest-ServerBootFromVolumeStableRescueTest-server-969621487 Jun 11 23:10:37.814633 np0000002687 nova-compute[98431]: 2026-06-11 23:10:37 Jun 11 23:10:37.814633 np0000002687 nova-compute[98431]: Jun 11 23:10:37.814633 np0000002687 nova-compute[98431]: 192 Jun 11 23:10:37.814633 np0000002687 nova-compute[98431]: 1 Jun 11 23:10:37.814633 np0000002687 nova-compute[98431]: 0 Jun 11 23:10:37.814633 np0000002687 nova-compute[98431]: 0 Jun 11 23:10:37.814633 np0000002687 nova-compute[98431]: 1 Jun 11 23:10:37.814633 np0000002687 nova-compute[98431]: Jun 11 23:10:37.814633 np0000002687 nova-compute[98431]: True Jun 11 23:10:37.814633 np0000002687 nova-compute[98431]: Jun 11 23:10:37.814633 np0000002687 nova-compute[98431]: Jun 11 23:10:37.814633 np0000002687 nova-compute[98431]: Jun 11 23:10:37.814633 np0000002687 nova-compute[98431]: bare Jun 11 23:10:37.814633 np0000002687 nova-compute[98431]: qcow2 Jun 11 23:10:37.814633 np0000002687 nova-compute[98431]: 1 Jun 11 23:10:37.814633 np0000002687 nova-compute[98431]: 0 Jun 11 23:10:37.814633 np0000002687 nova-compute[98431]: Jun 11 23:10:37.814633 np0000002687 nova-compute[98431]: virtio Jun 11 23:10:37.814633 np0000002687 nova-compute[98431]: Jun 11 23:10:37.814633 np0000002687 nova-compute[98431]: Jun 11 23:10:37.814633 np0000002687 nova-compute[98431]: Jun 11 23:10:37.814633 np0000002687 nova-compute[98431]: tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member Jun 11 23:10:37.814633 np0000002687 nova-compute[98431]: tempest-ServerBootFromVolumeStableRescueTest-539499192 Jun 11 23:10:37.814633 np0000002687 nova-compute[98431]: Jun 11 23:10:37.814633 np0000002687 nova-compute[98431]: Jun 11 23:10:37.814633 np0000002687 nova-compute[98431]: Jun 11 23:10:37.814633 np0000002687 nova-compute[98431]: Jun 11 23:10:37.814633 np0000002687 nova-compute[98431]: Jun 11 23:10:37.814633 np0000002687 nova-compute[98431]: Jun 11 23:10:37.814633 np0000002687 nova-compute[98431]: Jun 11 23:10:37.814633 np0000002687 nova-compute[98431]: Jun 11 23:10:37.814633 np0000002687 nova-compute[98431]: Jun 11 23:10:37.814633 np0000002687 nova-compute[98431]: Jun 11 23:10:37.814633 np0000002687 nova-compute[98431]: Jun 11 23:10:37.814633 np0000002687 nova-compute[98431]: OpenStack Foundation Jun 11 23:10:37.814633 np0000002687 nova-compute[98431]: OpenStack Nova Jun 11 23:10:37.814633 np0000002687 nova-compute[98431]: 33.1.0 Jun 11 23:10:37.814633 np0000002687 nova-compute[98431]: 8aec3cea-109d-43f8-983c-1d5ee2f71181 Jun 11 23:10:37.814633 np0000002687 nova-compute[98431]: 8aec3cea-109d-43f8-983c-1d5ee2f71181 Jun 11 23:10:37.814633 np0000002687 nova-compute[98431]: Virtual Machine Jun 11 23:10:37.814633 np0000002687 nova-compute[98431]: Jun 11 23:10:37.814633 np0000002687 nova-compute[98431]: Jun 11 23:10:37.814633 np0000002687 nova-compute[98431]: Jun 11 23:10:37.814633 np0000002687 nova-compute[98431]: hvm Jun 11 23:10:37.814633 np0000002687 nova-compute[98431]: Jun 11 23:10:37.814633 np0000002687 nova-compute[98431]: Jun 11 23:10:37.814633 np0000002687 nova-compute[98431]: Jun 11 23:10:37.814633 np0000002687 nova-compute[98431]: Jun 11 23:10:37.814633 np0000002687 nova-compute[98431]: Jun 11 23:10:37.814633 np0000002687 nova-compute[98431]: Jun 11 23:10:37.814633 np0000002687 nova-compute[98431]: 128 Jun 11 23:10:37.814633 np0000002687 nova-compute[98431]: Jun 11 23:10:37.814633 np0000002687 nova-compute[98431]: Jun 11 23:10:37.814633 np0000002687 nova-compute[98431]: Jun 11 23:10:37.814633 np0000002687 nova-compute[98431]: 1 Jun 11 23:10:37.814633 np0000002687 nova-compute[98431]: Jun 11 23:10:37.814633 np0000002687 nova-compute[98431]: Jun 11 23:10:37.814633 np0000002687 nova-compute[98431]: Nehalem Jun 11 23:10:37.814633 np0000002687 nova-compute[98431]: Jun 11 23:10:37.814633 np0000002687 nova-compute[98431]: Jun 11 23:10:37.814633 np0000002687 nova-compute[98431]: Jun 11 23:10:37.814633 np0000002687 nova-compute[98431]: Jun 11 23:10:37.814633 np0000002687 nova-compute[98431]: Jun 11 23:10:37.814633 np0000002687 nova-compute[98431]: Jun 11 23:10:37.814633 np0000002687 nova-compute[98431]: Jun 11 23:10:37.814633 np0000002687 nova-compute[98431]: Jun 11 23:10:37.814633 np0000002687 nova-compute[98431]: Jun 11 23:10:37.814633 np0000002687 nova-compute[98431]: Jun 11 23:10:37.814633 np0000002687 nova-compute[98431]: Jun 11 23:10:37.814633 np0000002687 nova-compute[98431]: Jun 11 23:10:37.814633 np0000002687 nova-compute[98431]: Jun 11 23:10:37.814633 np0000002687 nova-compute[98431]: Jun 11 23:10:37.814633 np0000002687 nova-compute[98431]: Jun 11 23:10:37.814633 np0000002687 nova-compute[98431]: Jun 11 23:10:37.814633 np0000002687 nova-compute[98431]: Jun 11 23:10:37.814633 np0000002687 nova-compute[98431]: Jun 11 23:10:37.814633 np0000002687 nova-compute[98431]: Jun 11 23:10:37.814633 np0000002687 nova-compute[98431]: Jun 11 23:10:37.814633 np0000002687 nova-compute[98431]: Jun 11 23:10:37.814633 np0000002687 nova-compute[98431]: Jun 11 23:10:37.814633 np0000002687 nova-compute[98431]: Jun 11 23:10:37.814633 np0000002687 nova-compute[98431]: Jun 11 23:10:37.814633 np0000002687 nova-compute[98431]: Jun 11 23:10:37.814633 np0000002687 nova-compute[98431]: Jun 11 23:10:37.814633 np0000002687 nova-compute[98431]: /dev/urandom Jun 11 23:10:37.814633 np0000002687 nova-compute[98431]: Jun 11 23:10:37.814633 np0000002687 nova-compute[98431]: Jun 11 23:10:37.814633 np0000002687 nova-compute[98431]: Jun 11 23:10:37.814633 np0000002687 nova-compute[98431]: Jun 11 23:10:37.814633 np0000002687 nova-compute[98431]: Jun 11 23:10:37.814633 np0000002687 nova-compute[98431]: Jun 11 23:10:37.814633 np0000002687 nova-compute[98431]: Jun 11 23:10:37.814633 np0000002687 nova-compute[98431]: {{(pid=98431) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 11 23:10:37.817259 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 8aec3cea-109d-43f8-983c-1d5ee2f71181] Preparing to wait for external event network-vif-plugged-6d2a143c-c69d-424d-8c91-e8553a8166a9 {{(pid=98431) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 11 23:10:37.817259 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Acquiring lock "8aec3cea-109d-43f8-983c-1d5ee2f71181-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:10:37.817259 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lock "8aec3cea-109d-43f8-983c-1d5ee2f71181-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:10:37.817259 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lock "8aec3cea-109d-43f8-983c-1d5ee2f71181-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:10:37.818064 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-11T23:10:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-969621487',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='tempest-serverbootfromvolumestablerescuetest-server-969621487',id=1,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aaf744af828a4a5eba1e98da63373b2b',ramdisk_id='',reservation_id='r-232rbmf3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-539499192',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-11T23:10:33Z,user_data=None,user_id='72b6dac5eb744cfba6299636227aa59b',uuid=8aec3cea-109d-43f8-983c-1d5ee2f71181,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6d2a143c-c69d-424d-8c91-e8553a8166a9", "address": "fa:16:3e:6c:eb:30", "network": {"id": "2a770c99-2ec6-4fa2-945b-32830a59e7a7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-137493671-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aaf744af828a4a5eba1e98da63373b2b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d2a143c-c6", "ovs_interfaceid": "6d2a143c-c69d-424d-8c91-e8553a8166a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 11 23:10:37.818226 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Converting VIF {"id": "6d2a143c-c69d-424d-8c91-e8553a8166a9", "address": "fa:16:3e:6c:eb:30", "network": {"id": "2a770c99-2ec6-4fa2-945b-32830a59e7a7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-137493671-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aaf744af828a4a5eba1e98da63373b2b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d2a143c-c6", "ovs_interfaceid": "6d2a143c-c69d-424d-8c91-e8553a8166a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:10:37.821592 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:eb:30,bridge_name='br-int',has_traffic_filtering=True,id=6d2a143c-c69d-424d-8c91-e8553a8166a9,network=Network(2a770c99-2ec6-4fa2-945b-32830a59e7a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d2a143c-c6') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:10:37.822205 np0000002687 nova-compute[98431]: DEBUG os_vif [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:eb:30,bridge_name='br-int',has_traffic_filtering=True,id=6d2a143c-c69d-424d-8c91-e8553a8166a9,network=Network(2a770c99-2ec6-4fa2-945b-32830a59e7a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d2a143c-c6') {{(pid=98431) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 11 23:10:37.833264 np0000002687 nova-compute[98431]: DEBUG nova.policy [None req-6a2a9908-fc7f-49fd-ba64-85c281bbf910 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '549767ad83a94efbb0bbd85d08fdc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d62cddce233457caf7eb43be819e513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98431) authorize /opt/stack/nova/nova/policy.py:192}} Jun 11 23:10:37.875218 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Created schema index Interface.name {{(pid=98431) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} Jun 11 23:10:37.875218 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Created schema index Port.name {{(pid=98431) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} Jun 11 23:10:37.875218 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Created schema index Bridge.name {{(pid=98431) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} Jun 11 23:10:37.875440 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=98431) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}} Jun 11 23:10:37.875616 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [POLLOUT] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:37.875748 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98431) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}} Jun 11 23:10:37.887173 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:37.888592 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:37.903666 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-ac70a8b6-6e47-48a8-bc39-40773397e5b3 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Acquiring lock "refresh_cache-689e510d-e0a4-4d6a-958e-9acfaebedc87" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 11 23:10:37.903666 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-ac70a8b6-6e47-48a8-bc39-40773397e5b3 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Acquired lock "refresh_cache-689e510d-e0a4-4d6a-958e-9acfaebedc87" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 11 23:10:37.903666 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-ac70a8b6-6e47-48a8-bc39-40773397e5b3 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] [instance: 689e510d-e0a4-4d6a-958e-9acfaebedc87] Building network info cache for instance {{(pid=98431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 11 23:10:37.908185 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:37.930154 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:37.930464 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:10:37.930712 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 11 23:10:37.933160 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:37.933395 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cf3a6a4a-8e4a-5afd-8d5c-351522cb20a8', '_type': 'linux-noop'}}, row=False) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:10:37.935702 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:37.936610 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:37.938170 np0000002687 nova-compute[98431]: INFO oslo.privsep.daemon [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmp8t81wktd/privsep.sock'] Jun 11 23:10:37.950122 np0000002687 sudo[110046]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmp8t81wktd/privsep.sock Jun 11 23:10:37.950780 np0000002687 sudo[110046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jun 11 23:10:38.055140 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:10:38.055622 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:10:38.058504 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98431) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 11 23:10:38.058635 np0000002687 nova-compute[98431]: INFO nova.compute.claims [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: de4372a4-a0cc-4541-a5a2-87be3152c50e] Claim successful on node np0000002687 Jun 11 23:10:38.164941 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-6a2a9908-fc7f-49fd-ba64-85c281bbf910 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 11 23:10:38.229904 np0000002687 nova-compute[98431]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jun 11 23:10:38.230096 np0000002687 nova-compute[98431]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 11 23:10:38.230145 np0000002687 nova-compute[98431]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jun 11 23:10:38.230256 np0000002687 nova-compute[98431]: WARNING oslo.privsep.daemon [-] privsep log: Jun 11 23:10:38.230335 np0000002687 nova-compute[98431]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jun 11 23:10:38.230400 np0000002687 nova-compute[98431]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jun 11 23:10:38.230463 np0000002687 nova-compute[98431]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 11 23:10:38.230523 np0000002687 nova-compute[98431]: WARNING oslo.privsep.daemon [-] privsep log: Jun 11 23:10:38.230589 np0000002687 nova-compute[98431]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jun 11 23:10:38.370492 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-ea720c9c-b300-4dde-b69b-97e902f0f80b req-7e5ee1b5-05cc-4ddf-9de3-bfe19b57c23c service nova] [instance: 689e510d-e0a4-4d6a-958e-9acfaebedc87] Received event network-changed-65f7170b-ae97-4cd6-93a1-7dd5111b7978 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:10:38.370492 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-ea720c9c-b300-4dde-b69b-97e902f0f80b req-7e5ee1b5-05cc-4ddf-9de3-bfe19b57c23c service nova] [instance: 689e510d-e0a4-4d6a-958e-9acfaebedc87] Refreshing instance network info cache due to event network-changed-65f7170b-ae97-4cd6-93a1-7dd5111b7978. {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 11 23:10:38.370492 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-ea720c9c-b300-4dde-b69b-97e902f0f80b req-7e5ee1b5-05cc-4ddf-9de3-bfe19b57c23c service nova] Acquiring lock "refresh_cache-689e510d-e0a4-4d6a-958e-9acfaebedc87" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 11 23:10:38.571828 np0000002687 nova-compute[98431]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jun 11 23:10:38.571828 np0000002687 nova-compute[98431]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 11 23:10:38.571828 np0000002687 nova-compute[98431]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jun 11 23:10:38.571828 np0000002687 nova-compute[98431]: WARNING oslo.privsep.daemon [-] privsep log: Jun 11 23:10:38.571828 np0000002687 nova-compute[98431]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jun 11 23:10:38.571828 np0000002687 nova-compute[98431]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jun 11 23:10:38.571828 np0000002687 nova-compute[98431]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 11 23:10:38.571828 np0000002687 nova-compute[98431]: WARNING oslo.privsep.daemon [-] privsep log: Jun 11 23:10:38.571828 np0000002687 nova-compute[98431]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jun 11 23:10:38.668131 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-6a2a9908-fc7f-49fd-ba64-85c281bbf910 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Start building block device mappings for instance. {{(pid=98431) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 11 23:10:38.777882 np0000002687 sudo[110046]: pam_unix(sudo:session): session closed for user root Jun 11 23:10:38.779270 np0000002687 nova-compute[98431]: INFO oslo.privsep.daemon [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Spawned new privsep daemon via rootwrap Jun 11 23:10:38.780542 np0000002687 nova-compute[98431]: INFO oslo.privsep.daemon [-] privsep daemon starting Jun 11 23:10:38.780542 np0000002687 nova-compute[98431]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jun 11 23:10:38.780542 np0000002687 nova-compute[98431]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none Jun 11 23:10:38.780542 np0000002687 nova-compute[98431]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 110066 Jun 11 23:10:38.932962 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-6a2a9908-fc7f-49fd-ba64-85c281bbf910 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Successfully created port: 2d6dd8b9-e3ff-462f-92cf-8c3a62bc27d1 {{(pid=98431) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 11 23:10:38.983819 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-ac70a8b6-6e47-48a8-bc39-40773397e5b3 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] [instance: 689e510d-e0a4-4d6a-958e-9acfaebedc87] Instance cache missing network info. {{(pid=98431) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 11 23:10:39.067456 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:39.067876 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6d2a143c-c6, may_exist=True, interface_attrs={}) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:10:39.067876 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6d2a143c-c6, col_values=(('qos', UUID('e1e31cdf-458c-48f2-a198-24a894412141')),), if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:10:39.069072 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6d2a143c-c6, col_values=(('external_ids', {'iface-id': '6d2a143c-c69d-424d-8c91-e8553a8166a9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6c:eb:30', 'vm-uuid': '8aec3cea-109d-43f8-983c-1d5ee2f71181'}),), if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:10:39.070320 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:39.072167 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:10:39.077336 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:39.078092 np0000002687 nova-compute[98431]: INFO os_vif [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:eb:30,bridge_name='br-int',has_traffic_filtering=True,id=6d2a143c-c69d-424d-8c91-e8553a8166a9,network=Network(2a770c99-2ec6-4fa2-945b-32830a59e7a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d2a143c-c6') Jun 11 23:10:39.327500 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98431) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 11 23:10:39.327768 np0000002687 nova-compute[98431]: DEBUG nova.compute.provider_tree [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Inventory has not changed in ProviderTree for provider: e3e65fe2-9de9-4821-8b4a-ccae37c66e25 {{(pid=98431) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 11 23:10:39.652882 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-6a2a9908-fc7f-49fd-ba64-85c281bbf910 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Successfully updated port: 2d6dd8b9-e3ff-462f-92cf-8c3a62bc27d1 {{(pid=98431) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 11 23:10:39.678423 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-6a2a9908-fc7f-49fd-ba64-85c281bbf910 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Start spawning the instance on the hypervisor. {{(pid=98431) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 11 23:10:39.679668 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-6a2a9908-fc7f-49fd-ba64-85c281bbf910 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Creating instance directory {{(pid=98431) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}} Jun 11 23:10:39.679935 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-6a2a9908-fc7f-49fd-ba64-85c281bbf910 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Creating image(s) Jun 11 23:10:39.680360 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-6a2a9908-fc7f-49fd-ba64-85c281bbf910 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Acquiring lock "/opt/stack/data/nova/instances/cb63f66c-b69e-42b0-805c-be6fe9b3aee3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:10:39.680502 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-6a2a9908-fc7f-49fd-ba64-85c281bbf910 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Lock "/opt/stack/data/nova/instances/cb63f66c-b69e-42b0-805c-be6fe9b3aee3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:10:39.680953 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-6a2a9908-fc7f-49fd-ba64-85c281bbf910 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Lock "/opt/stack/data/nova/instances/cb63f66c-b69e-42b0-805c-be6fe9b3aee3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:10:39.681482 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-6a2a9908-fc7f-49fd-ba64-85c281bbf910 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:10:39.684205 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-6a2a9908-fc7f-49fd-ba64-85c281bbf910 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:10:39.686003 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-6a2a9908-fc7f-49fd-ba64-85c281bbf910 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:10:39.755692 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-6a2a9908-fc7f-49fd-ba64-85c281bbf910 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json" returned: 0 in 0.069s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:10:39.756228 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-6a2a9908-fc7f-49fd-ba64-85c281bbf910 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Acquiring lock "d2c441059b2992961b5de03c05b32d04aff77cb1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:10:39.756793 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-6a2a9908-fc7f-49fd-ba64-85c281bbf910 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Lock "d2c441059b2992961b5de03c05b32d04aff77cb1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:10:39.757423 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-6a2a9908-fc7f-49fd-ba64-85c281bbf910 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:10:39.761696 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-6a2a9908-fc7f-49fd-ba64-85c281bbf910 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:10:39.762143 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-6a2a9908-fc7f-49fd-ba64-85c281bbf910 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:10:39.830963 np0000002687 nova-compute[98431]: DEBUG nova.scheduler.client.report [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Inventory has not changed for provider e3e65fe2-9de9-4821-8b4a-ccae37c66e25 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98431) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 11 23:10:39.835997 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-6a2a9908-fc7f-49fd-ba64-85c281bbf910 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json" returned: 0 in 0.074s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:10:39.836439 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-6a2a9908-fc7f-49fd-ba64-85c281bbf910 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1,backing_fmt=raw /opt/stack/data/nova/instances/cb63f66c-b69e-42b0-805c-be6fe9b3aee3/disk 1073741824 {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:10:39.862074 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [req-c9c299f6-efa8-48c0-acc1-7088b0dc3f9b req-7fb2203f-3f07-4e7f-a948-3c205aabe222 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:10:39.865987 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-6a2a9908-fc7f-49fd-ba64-85c281bbf910 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1,backing_fmt=raw /opt/stack/data/nova/instances/cb63f66c-b69e-42b0-805c-be6fe9b3aee3/disk 1073741824" returned: 0 in 0.029s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:10:39.867445 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-6a2a9908-fc7f-49fd-ba64-85c281bbf910 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Lock "d2c441059b2992961b5de03c05b32d04aff77cb1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.111s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:10:39.867739 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-6a2a9908-fc7f-49fd-ba64-85c281bbf910 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:10:39.932235 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-6a2a9908-fc7f-49fd-ba64-85c281bbf910 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json" returned: 0 in 0.064s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:10:39.932575 np0000002687 nova-compute[98431]: DEBUG nova.virt.disk.api [None req-6a2a9908-fc7f-49fd-ba64-85c281bbf910 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cb63f66c-b69e-42b0-805c-be6fe9b3aee3/disk. size=1073741824 {{(pid=98431) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 11 23:10:39.932778 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-6a2a9908-fc7f-49fd-ba64-85c281bbf910 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb63f66c-b69e-42b0-805c-be6fe9b3aee3/disk --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:10:40.003058 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-6a2a9908-fc7f-49fd-ba64-85c281bbf910 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb63f66c-b69e-42b0-805c-be6fe9b3aee3/disk --force-share --output=json" returned: 0 in 0.069s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:10:40.003227 np0000002687 nova-compute[98431]: DEBUG nova.virt.disk.api [None req-6a2a9908-fc7f-49fd-ba64-85c281bbf910 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Cannot resize image /opt/stack/data/nova/instances/cb63f66c-b69e-42b0-805c-be6fe9b3aee3/disk to a smaller size. {{(pid=98431) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 11 23:10:40.003587 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-6a2a9908-fc7f-49fd-ba64-85c281bbf910 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Created local disks {{(pid=98431) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}} Jun 11 23:10:40.003813 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-6a2a9908-fc7f-49fd-ba64-85c281bbf910 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Ensure instance console log exists: /opt/stack/data/nova/instances/cb63f66c-b69e-42b0-805c-be6fe9b3aee3/console.log {{(pid=98431) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}} Jun 11 23:10:40.004169 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-6a2a9908-fc7f-49fd-ba64-85c281bbf910 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:10:40.004463 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-6a2a9908-fc7f-49fd-ba64-85c281bbf910 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:10:40.004603 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-6a2a9908-fc7f-49fd-ba64-85c281bbf910 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:10:40.154791 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-6a2a9908-fc7f-49fd-ba64-85c281bbf910 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Acquiring lock "refresh_cache-cb63f66c-b69e-42b0-805c-be6fe9b3aee3" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 11 23:10:40.155776 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-6a2a9908-fc7f-49fd-ba64-85c281bbf910 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Acquired lock "refresh_cache-cb63f66c-b69e-42b0-805c-be6fe9b3aee3" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 11 23:10:40.156028 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-6a2a9908-fc7f-49fd-ba64-85c281bbf910 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Building network info cache for instance {{(pid=98431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 11 23:10:40.203766 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:40.270741 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-ac70a8b6-6e47-48a8-bc39-40773397e5b3 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:10:40.339063 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.283s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:10:40.339063 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: de4372a4-a0cc-4541-a5a2-87be3152c50e] Start building networks asynchronously for instance. {{(pid=98431) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 11 23:10:40.390822 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-c9c299f6-efa8-48c0-acc1-7088b0dc3f9b req-7fb2203f-3f07-4e7f-a948-3c205aabe222 service nova] [instance: 8aec3cea-109d-43f8-983c-1d5ee2f71181] Updated VIF entry in instance network info cache for port 6d2a143c-c69d-424d-8c91-e8553a8166a9. {{(pid=98431) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 11 23:10:40.391209 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-c9c299f6-efa8-48c0-acc1-7088b0dc3f9b req-7fb2203f-3f07-4e7f-a948-3c205aabe222 service nova] [instance: 8aec3cea-109d-43f8-983c-1d5ee2f71181] Updating instance_info_cache with network_info: [{"id": "6d2a143c-c69d-424d-8c91-e8553a8166a9", "address": "fa:16:3e:6c:eb:30", "network": {"id": "2a770c99-2ec6-4fa2-945b-32830a59e7a7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-137493671-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aaf744af828a4a5eba1e98da63373b2b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d2a143c-c6", "ovs_interfaceid": "6d2a143c-c69d-424d-8c91-e8553a8166a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:10:40.511502 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-ac70a8b6-6e47-48a8-bc39-40773397e5b3 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] [instance: 689e510d-e0a4-4d6a-958e-9acfaebedc87] Updating instance_info_cache with network_info: [{"id": "65f7170b-ae97-4cd6-93a1-7dd5111b7978", "address": "fa:16:3e:12:58:8f", "network": {"id": "7433cdeb-8dc1-430a-aade-959bf6c26aa4", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1384636967-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d78539cb9b504ed0908d5bfe6745a628", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap65f7170b-ae", "ovs_interfaceid": "65f7170b-ae97-4cd6-93a1-7dd5111b7978", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:10:40.597846 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] No BDM found with device name vda, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:10:40.598051 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] No BDM found with device name hda, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:10:40.598185 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] No VIF found with MAC fa:16:3e:6c:eb:30, not building metadata {{(pid=98431) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13199}} Jun 11 23:10:40.598826 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 8aec3cea-109d-43f8-983c-1d5ee2f71181] Using config drive Jun 11 23:10:40.628060 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-a310c70e-c776-4fab-bf69-2d0c0172e309 req-5c971cc1-a196-4d6a-84dd-c08d2311a1eb service nova] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Received event network-changed-2d6dd8b9-e3ff-462f-92cf-8c3a62bc27d1 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:10:40.628243 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-a310c70e-c776-4fab-bf69-2d0c0172e309 req-5c971cc1-a196-4d6a-84dd-c08d2311a1eb service nova] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Refreshing instance network info cache due to event network-changed-2d6dd8b9-e3ff-462f-92cf-8c3a62bc27d1. {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 11 23:10:40.629210 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-a310c70e-c776-4fab-bf69-2d0c0172e309 req-5c971cc1-a196-4d6a-84dd-c08d2311a1eb service nova] Acquiring lock "refresh_cache-cb63f66c-b69e-42b0-805c-be6fe9b3aee3" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 11 23:10:40.755003 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-6a2a9908-fc7f-49fd-ba64-85c281bbf910 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Instance cache missing network info. {{(pid=98431) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 11 23:10:40.850690 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: de4372a4-a0cc-4541-a5a2-87be3152c50e] Allocating IP information in the background. {{(pid=98431) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 11 23:10:40.850690 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: de4372a4-a0cc-4541-a5a2-87be3152c50e] allocate_for_instance() {{(pid=98431) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 11 23:10:40.850690 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:10:40.850690 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:10:40.894334 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-c9c299f6-efa8-48c0-acc1-7088b0dc3f9b req-7fb2203f-3f07-4e7f-a948-3c205aabe222 service nova] Releasing lock "refresh_cache-8aec3cea-109d-43f8-983c-1d5ee2f71181" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 11 23:10:40.964463 np0000002687 nova-compute[98431]: DEBUG nova.policy [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c17e84202f404c3c8e73292bb59d7b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fd45f475a04e5c8e9bd9deb7ad4c1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98431) authorize /opt/stack/nova/nova/policy.py:192}} Jun 11 23:10:40.993667 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-6a2a9908-fc7f-49fd-ba64-85c281bbf910 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:10:41.015485 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-ac70a8b6-6e47-48a8-bc39-40773397e5b3 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Releasing lock "refresh_cache-689e510d-e0a4-4d6a-958e-9acfaebedc87" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 11 23:10:41.015485 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-ac70a8b6-6e47-48a8-bc39-40773397e5b3 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] [instance: 689e510d-e0a4-4d6a-958e-9acfaebedc87] Instance network_info: |[{"id": "65f7170b-ae97-4cd6-93a1-7dd5111b7978", "address": "fa:16:3e:12:58:8f", "network": {"id": "7433cdeb-8dc1-430a-aade-959bf6c26aa4", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1384636967-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d78539cb9b504ed0908d5bfe6745a628", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap65f7170b-ae", "ovs_interfaceid": "65f7170b-ae97-4cd6-93a1-7dd5111b7978", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98431) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 11 23:10:41.017110 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-ac70a8b6-6e47-48a8-bc39-40773397e5b3 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] [instance: 689e510d-e0a4-4d6a-958e-9acfaebedc87] Start _get_guest_xml network_info=[{"id": "65f7170b-ae97-4cd6-93a1-7dd5111b7978", "address": "fa:16:3e:12:58:8f", "network": {"id": "7433cdeb-8dc1-430a-aade-959bf6c26aa4", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1384636967-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d78539cb9b504ed0908d5bfe6745a628", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap65f7170b-ae", "ovs_interfaceid": "65f7170b-ae97-4cd6-93a1-7dd5111b7978", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-11T23:08:20Z,direct_url=,disk_format='qcow2',id=f30640f8-7aca-4300-a085-4706a5209a79,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ce012f9fabdb4ee5a73e212437f59d97',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-11T23:08:23Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'image_id': 'f30640f8-7aca-4300-a085-4706a5209a79'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98431) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 11 23:10:41.018727 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-ea720c9c-b300-4dde-b69b-97e902f0f80b req-7e5ee1b5-05cc-4ddf-9de3-bfe19b57c23c service nova] Acquired lock "refresh_cache-689e510d-e0a4-4d6a-958e-9acfaebedc87" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 11 23:10:41.018727 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-ea720c9c-b300-4dde-b69b-97e902f0f80b req-7e5ee1b5-05cc-4ddf-9de3-bfe19b57c23c service nova] [instance: 689e510d-e0a4-4d6a-958e-9acfaebedc87] Refreshing network info cache for port 65f7170b-ae97-4cd6-93a1-7dd5111b7978 {{(pid=98431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 11 23:10:41.020563 np0000002687 nova-compute[98431]: WARNING nova.virt.libvirt.driver [None req-ac70a8b6-6e47-48a8-bc39-40773397e5b3 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 11 23:10:41.021604 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-ac70a8b6-6e47-48a8-bc39-40773397e5b3 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='f30640f8-7aca-4300-a085-4706a5209a79', instance_meta=NovaInstanceMeta(name='tempest-DeleteServersTestJSON-server-1500808158', uuid='689e510d-e0a4-4d6a-958e-9acfaebedc87'), owner=OwnerMeta(userid='3d47d776b5de49189b8790124ba4bd14', username='tempest-DeleteServersTestJSON-807627983-project-member', projectid='d78539cb9b504ed0908d5bfe6745a628', projectname='tempest-DeleteServersTestJSON-807627983'), image=ImageMeta(id='f30640f8-7aca-4300-a085-4706a5209a79', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "65f7170b-ae97-4cd6-93a1-7dd5111b7978", "address": "fa:16:3e:12:58:8f", "network": {"id": "7433cdeb-8dc1-430a-aade-959bf6c26aa4", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1384636967-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d78539cb9b504ed0908d5bfe6745a628", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap65f7170b-ae", "ovs_interfaceid": "65f7170b-ae97-4cd6-93a1-7dd5111b7978", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1781219441.021232) {{(pid=98431) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 11 23:10:41.026566 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-ac70a8b6-6e47-48a8-bc39-40773397e5b3 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Searching host: 'np0000002687' for CPU controller through CGroups V1... {{(pid=98431) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 11 23:10:41.027030 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-ac70a8b6-6e47-48a8-bc39-40773397e5b3 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] CPU controller missing on host. {{(pid=98431) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 11 23:10:41.029263 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-ac70a8b6-6e47-48a8-bc39-40773397e5b3 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Searching host: 'np0000002687' for CPU controller through CGroups V2... {{(pid=98431) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 11 23:10:41.029440 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-ac70a8b6-6e47-48a8-bc39-40773397e5b3 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] CPU controller found on host. {{(pid=98431) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 11 23:10:41.030484 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-ac70a8b6-6e47-48a8-bc39-40773397e5b3 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98431) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 11 23:10:41.030761 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-ac70a8b6-6e47-48a8-bc39-40773397e5b3 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-11T23:08:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-11T23:08:20Z,direct_url=,disk_format='qcow2',id=f30640f8-7aca-4300-a085-4706a5209a79,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ce012f9fabdb4ee5a73e212437f59d97',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-11T23:08:23Z,virtual_size=,visibility=), allow threads: True {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 11 23:10:41.030949 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-ac70a8b6-6e47-48a8-bc39-40773397e5b3 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Flavor limits 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 11 23:10:41.031006 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-ac70a8b6-6e47-48a8-bc39-40773397e5b3 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Image limits 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 11 23:10:41.031182 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-ac70a8b6-6e47-48a8-bc39-40773397e5b3 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Flavor pref 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 11 23:10:41.031271 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-ac70a8b6-6e47-48a8-bc39-40773397e5b3 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Image pref 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 11 23:10:41.031328 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-ac70a8b6-6e47-48a8-bc39-40773397e5b3 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 11 23:10:41.031449 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-ac70a8b6-6e47-48a8-bc39-40773397e5b3 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 11 23:10:41.031557 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-ac70a8b6-6e47-48a8-bc39-40773397e5b3 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98431) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 11 23:10:41.031682 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-ac70a8b6-6e47-48a8-bc39-40773397e5b3 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Got 1 possible topologies {{(pid=98431) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 11 23:10:41.031814 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-ac70a8b6-6e47-48a8-bc39-40773397e5b3 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 11 23:10:41.032042 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-ac70a8b6-6e47-48a8-bc39-40773397e5b3 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 11 23:10:41.045166 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-ac70a8b6-6e47-48a8-bc39-40773397e5b3 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-11T23:10:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1500808158',display_name='tempest-DeleteServersTestJSON-server-1500808158',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='tempest-deleteserverstestjson-server-1500808158',id=2,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d78539cb9b504ed0908d5bfe6745a628',ramdisk_id='',reservation_id='r-0l3u61cz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-807627983',owner_user_name='tempest-DeleteServersTestJSON-807627983-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-11T23:10:36Z,user_data=None,user_id='3d47d776b5de49189b8790124ba4bd14',uuid=689e510d-e0a4-4d6a-958e-9acfaebedc87,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "65f7170b-ae97-4cd6-93a1-7dd5111b7978", "address": "fa:16:3e:12:58:8f", "network": {"id": "7433cdeb-8dc1-430a-aade-959bf6c26aa4", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1384636967-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d78539cb9b504ed0908d5bfe6745a628", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap65f7170b-ae", "ovs_interfaceid": "65f7170b-ae97-4cd6-93a1-7dd5111b7978", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98431) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 11 23:10:41.045393 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-ac70a8b6-6e47-48a8-bc39-40773397e5b3 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Converting VIF {"id": "65f7170b-ae97-4cd6-93a1-7dd5111b7978", "address": "fa:16:3e:12:58:8f", "network": {"id": "7433cdeb-8dc1-430a-aade-959bf6c26aa4", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1384636967-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d78539cb9b504ed0908d5bfe6745a628", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap65f7170b-ae", "ovs_interfaceid": "65f7170b-ae97-4cd6-93a1-7dd5111b7978", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:10:41.046273 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-ac70a8b6-6e47-48a8-bc39-40773397e5b3 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:58:8f,bridge_name='br-int',has_traffic_filtering=True,id=65f7170b-ae97-4cd6-93a1-7dd5111b7978,network=Network(7433cdeb-8dc1-430a-aade-959bf6c26aa4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65f7170b-ae') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:10:41.047169 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-ac70a8b6-6e47-48a8-bc39-40773397e5b3 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Lazy-loading 'pci_devices' on Instance uuid 689e510d-e0a4-4d6a-958e-9acfaebedc87 {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:10:41.109339 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:10:41.338300 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-6a2a9908-fc7f-49fd-ba64-85c281bbf910 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Updating instance_info_cache with network_info: [{"id": "2d6dd8b9-e3ff-462f-92cf-8c3a62bc27d1", "address": "fa:16:3e:b5:6f:fd", "network": {"id": "b1a1d33f-f9b6-48cf-86a1-0260d53f3bb0", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1779972098-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2d62cddce233457caf7eb43be819e513", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d6dd8b9-e3", "ovs_interfaceid": "2d6dd8b9-e3ff-462f-92cf-8c3a62bc27d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:10:41.352340 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: de4372a4-a0cc-4541-a5a2-87be3152c50e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 11 23:10:41.521199 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [req-ea720c9c-b300-4dde-b69b-97e902f0f80b req-7e5ee1b5-05cc-4ddf-9de3-bfe19b57c23c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:10:41.549662 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-ac70a8b6-6e47-48a8-bc39-40773397e5b3 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] [instance: 689e510d-e0a4-4d6a-958e-9acfaebedc87] End _get_guest_xml xml= Jun 11 23:10:41.549662 np0000002687 nova-compute[98431]: 689e510d-e0a4-4d6a-958e-9acfaebedc87 Jun 11 23:10:41.549662 np0000002687 nova-compute[98431]: instance-00000002 Jun 11 23:10:41.549662 np0000002687 nova-compute[98431]: 196608 Jun 11 23:10:41.549662 np0000002687 nova-compute[98431]: 1 Jun 11 23:10:41.549662 np0000002687 nova-compute[98431]: Jun 11 23:10:41.549662 np0000002687 nova-compute[98431]: Jun 11 23:10:41.549662 np0000002687 nova-compute[98431]: Jun 11 23:10:41.549662 np0000002687 nova-compute[98431]: tempest-DeleteServersTestJSON-server-1500808158 Jun 11 23:10:41.549662 np0000002687 nova-compute[98431]: 2026-06-11 23:10:41 Jun 11 23:10:41.549662 np0000002687 nova-compute[98431]: Jun 11 23:10:41.549662 np0000002687 nova-compute[98431]: 192 Jun 11 23:10:41.549662 np0000002687 nova-compute[98431]: 1 Jun 11 23:10:41.549662 np0000002687 nova-compute[98431]: 0 Jun 11 23:10:41.549662 np0000002687 nova-compute[98431]: 0 Jun 11 23:10:41.549662 np0000002687 nova-compute[98431]: 1 Jun 11 23:10:41.549662 np0000002687 nova-compute[98431]: Jun 11 23:10:41.549662 np0000002687 nova-compute[98431]: True Jun 11 23:10:41.549662 np0000002687 nova-compute[98431]: Jun 11 23:10:41.549662 np0000002687 nova-compute[98431]: Jun 11 23:10:41.549662 np0000002687 nova-compute[98431]: Jun 11 23:10:41.549662 np0000002687 nova-compute[98431]: bare Jun 11 23:10:41.549662 np0000002687 nova-compute[98431]: qcow2 Jun 11 23:10:41.549662 np0000002687 nova-compute[98431]: 1 Jun 11 23:10:41.549662 np0000002687 nova-compute[98431]: 0 Jun 11 23:10:41.549662 np0000002687 nova-compute[98431]: Jun 11 23:10:41.549662 np0000002687 nova-compute[98431]: virtio Jun 11 23:10:41.549662 np0000002687 nova-compute[98431]: Jun 11 23:10:41.549662 np0000002687 nova-compute[98431]: Jun 11 23:10:41.549662 np0000002687 nova-compute[98431]: Jun 11 23:10:41.549662 np0000002687 nova-compute[98431]: tempest-DeleteServersTestJSON-807627983-project-member Jun 11 23:10:41.549662 np0000002687 nova-compute[98431]: tempest-DeleteServersTestJSON-807627983 Jun 11 23:10:41.549662 np0000002687 nova-compute[98431]: Jun 11 23:10:41.549662 np0000002687 nova-compute[98431]: Jun 11 23:10:41.549662 np0000002687 nova-compute[98431]: Jun 11 23:10:41.549662 np0000002687 nova-compute[98431]: Jun 11 23:10:41.549662 np0000002687 nova-compute[98431]: Jun 11 23:10:41.549662 np0000002687 nova-compute[98431]: Jun 11 23:10:41.549662 np0000002687 nova-compute[98431]: Jun 11 23:10:41.549662 np0000002687 nova-compute[98431]: Jun 11 23:10:41.549662 np0000002687 nova-compute[98431]: Jun 11 23:10:41.549662 np0000002687 nova-compute[98431]: Jun 11 23:10:41.549662 np0000002687 nova-compute[98431]: Jun 11 23:10:41.549662 np0000002687 nova-compute[98431]: OpenStack Foundation Jun 11 23:10:41.549662 np0000002687 nova-compute[98431]: OpenStack Nova Jun 11 23:10:41.549662 np0000002687 nova-compute[98431]: 33.1.0 Jun 11 23:10:41.549662 np0000002687 nova-compute[98431]: 689e510d-e0a4-4d6a-958e-9acfaebedc87 Jun 11 23:10:41.549662 np0000002687 nova-compute[98431]: 689e510d-e0a4-4d6a-958e-9acfaebedc87 Jun 11 23:10:41.549662 np0000002687 nova-compute[98431]: Virtual Machine Jun 11 23:10:41.549662 np0000002687 nova-compute[98431]: Jun 11 23:10:41.549662 np0000002687 nova-compute[98431]: Jun 11 23:10:41.549662 np0000002687 nova-compute[98431]: Jun 11 23:10:41.549662 np0000002687 nova-compute[98431]: hvm Jun 11 23:10:41.549662 np0000002687 nova-compute[98431]: Jun 11 23:10:41.549662 np0000002687 nova-compute[98431]: Jun 11 23:10:41.549662 np0000002687 nova-compute[98431]: Jun 11 23:10:41.549662 np0000002687 nova-compute[98431]: Jun 11 23:10:41.549662 np0000002687 nova-compute[98431]: Jun 11 23:10:41.549662 np0000002687 nova-compute[98431]: Jun 11 23:10:41.549662 np0000002687 nova-compute[98431]: 128 Jun 11 23:10:41.549662 np0000002687 nova-compute[98431]: Jun 11 23:10:41.549662 np0000002687 nova-compute[98431]: Jun 11 23:10:41.549662 np0000002687 nova-compute[98431]: Jun 11 23:10:41.549662 np0000002687 nova-compute[98431]: 1 Jun 11 23:10:41.549662 np0000002687 nova-compute[98431]: Jun 11 23:10:41.549662 np0000002687 nova-compute[98431]: Jun 11 23:10:41.549662 np0000002687 nova-compute[98431]: Nehalem Jun 11 23:10:41.549662 np0000002687 nova-compute[98431]: Jun 11 23:10:41.549662 np0000002687 nova-compute[98431]: Jun 11 23:10:41.549662 np0000002687 nova-compute[98431]: Jun 11 23:10:41.549662 np0000002687 nova-compute[98431]: Jun 11 23:10:41.549662 np0000002687 nova-compute[98431]: Jun 11 23:10:41.549662 np0000002687 nova-compute[98431]: Jun 11 23:10:41.549662 np0000002687 nova-compute[98431]: Jun 11 23:10:41.549662 np0000002687 nova-compute[98431]: Jun 11 23:10:41.549662 np0000002687 nova-compute[98431]: Jun 11 23:10:41.549662 np0000002687 nova-compute[98431]: Jun 11 23:10:41.549662 np0000002687 nova-compute[98431]: Jun 11 23:10:41.549662 np0000002687 nova-compute[98431]: Jun 11 23:10:41.549662 np0000002687 nova-compute[98431]: Jun 11 23:10:41.549662 np0000002687 nova-compute[98431]: Jun 11 23:10:41.549662 np0000002687 nova-compute[98431]: Jun 11 23:10:41.549662 np0000002687 nova-compute[98431]: Jun 11 23:10:41.549662 np0000002687 nova-compute[98431]: Jun 11 23:10:41.549662 np0000002687 nova-compute[98431]: Jun 11 23:10:41.549662 np0000002687 nova-compute[98431]: Jun 11 23:10:41.549662 np0000002687 nova-compute[98431]: Jun 11 23:10:41.549662 np0000002687 nova-compute[98431]: Jun 11 23:10:41.549662 np0000002687 nova-compute[98431]: Jun 11 23:10:41.549662 np0000002687 nova-compute[98431]: Jun 11 23:10:41.549662 np0000002687 nova-compute[98431]: Jun 11 23:10:41.549662 np0000002687 nova-compute[98431]: Jun 11 23:10:41.549662 np0000002687 nova-compute[98431]: Jun 11 23:10:41.549662 np0000002687 nova-compute[98431]: /dev/urandom Jun 11 23:10:41.549662 np0000002687 nova-compute[98431]: Jun 11 23:10:41.549662 np0000002687 nova-compute[98431]: Jun 11 23:10:41.549662 np0000002687 nova-compute[98431]: Jun 11 23:10:41.549662 np0000002687 nova-compute[98431]: Jun 11 23:10:41.549662 np0000002687 nova-compute[98431]: Jun 11 23:10:41.549662 np0000002687 nova-compute[98431]: Jun 11 23:10:41.549662 np0000002687 nova-compute[98431]: Jun 11 23:10:41.549662 np0000002687 nova-compute[98431]: {{(pid=98431) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 11 23:10:41.555386 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-ac70a8b6-6e47-48a8-bc39-40773397e5b3 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] [instance: 689e510d-e0a4-4d6a-958e-9acfaebedc87] Preparing to wait for external event network-vif-plugged-65f7170b-ae97-4cd6-93a1-7dd5111b7978 {{(pid=98431) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 11 23:10:41.555386 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-ac70a8b6-6e47-48a8-bc39-40773397e5b3 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Acquiring lock "689e510d-e0a4-4d6a-958e-9acfaebedc87-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:10:41.555386 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-ac70a8b6-6e47-48a8-bc39-40773397e5b3 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Lock "689e510d-e0a4-4d6a-958e-9acfaebedc87-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:10:41.555386 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-ac70a8b6-6e47-48a8-bc39-40773397e5b3 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Lock "689e510d-e0a4-4d6a-958e-9acfaebedc87-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:10:41.555386 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-ac70a8b6-6e47-48a8-bc39-40773397e5b3 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-11T23:10:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1500808158',display_name='tempest-DeleteServersTestJSON-server-1500808158',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='tempest-deleteserverstestjson-server-1500808158',id=2,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d78539cb9b504ed0908d5bfe6745a628',ramdisk_id='',reservation_id='r-0l3u61cz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-807627983',owner_user_name='tempest-DeleteServersTestJSON-807627983-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-11T23:10:36Z,user_data=None,user_id='3d47d776b5de49189b8790124ba4bd14',uuid=689e510d-e0a4-4d6a-958e-9acfaebedc87,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "65f7170b-ae97-4cd6-93a1-7dd5111b7978", "address": "fa:16:3e:12:58:8f", "network": {"id": "7433cdeb-8dc1-430a-aade-959bf6c26aa4", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1384636967-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d78539cb9b504ed0908d5bfe6745a628", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap65f7170b-ae", "ovs_interfaceid": "65f7170b-ae97-4cd6-93a1-7dd5111b7978", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 11 23:10:41.556217 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-ac70a8b6-6e47-48a8-bc39-40773397e5b3 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Converting VIF {"id": "65f7170b-ae97-4cd6-93a1-7dd5111b7978", "address": "fa:16:3e:12:58:8f", "network": {"id": "7433cdeb-8dc1-430a-aade-959bf6c26aa4", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1384636967-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d78539cb9b504ed0908d5bfe6745a628", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap65f7170b-ae", "ovs_interfaceid": "65f7170b-ae97-4cd6-93a1-7dd5111b7978", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:10:41.556217 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-ac70a8b6-6e47-48a8-bc39-40773397e5b3 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:58:8f,bridge_name='br-int',has_traffic_filtering=True,id=65f7170b-ae97-4cd6-93a1-7dd5111b7978,network=Network(7433cdeb-8dc1-430a-aade-959bf6c26aa4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65f7170b-ae') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:10:41.556217 np0000002687 nova-compute[98431]: DEBUG os_vif [None req-ac70a8b6-6e47-48a8-bc39-40773397e5b3 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:58:8f,bridge_name='br-int',has_traffic_filtering=True,id=65f7170b-ae97-4cd6-93a1-7dd5111b7978,network=Network(7433cdeb-8dc1-430a-aade-959bf6c26aa4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65f7170b-ae') {{(pid=98431) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 11 23:10:41.556217 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:41.556217 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:10:41.556217 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 11 23:10:41.556217 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:41.556774 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f1c9594f-6cd4-5f14-a73a-bc9dbc262c24', '_type': 'linux-noop'}}, row=False) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:10:41.557680 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:41.558576 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:10:41.564751 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:41.568121 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:41.568282 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap65f7170b-ae, may_exist=True, interface_attrs={}) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:10:41.568727 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap65f7170b-ae, col_values=(('qos', UUID('a75ba5d7-239f-4665-a038-aa1bc08f7cfa')),), if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:10:41.568811 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap65f7170b-ae, col_values=(('external_ids', {'iface-id': '65f7170b-ae97-4cd6-93a1-7dd5111b7978', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:12:58:8f', 'vm-uuid': '689e510d-e0a4-4d6a-958e-9acfaebedc87'}),), if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:10:41.569695 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:41.571073 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:10:41.581925 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:41.583729 np0000002687 nova-compute[98431]: INFO os_vif [None req-ac70a8b6-6e47-48a8-bc39-40773397e5b3 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:58:8f,bridge_name='br-int',has_traffic_filtering=True,id=65f7170b-ae97-4cd6-93a1-7dd5111b7978,network=Network(7433cdeb-8dc1-430a-aade-959bf6c26aa4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65f7170b-ae') Jun 11 23:10:41.611179 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 8aec3cea-109d-43f8-983c-1d5ee2f71181] Creating config drive at /opt/stack/data/nova/instances/8aec3cea-109d-43f8-983c-1d5ee2f71181/disk.config Jun 11 23:10:41.617858 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/8aec3cea-109d-43f8-983c-1d5ee2f71181/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpfmgk21xk {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:10:41.651360 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/8aec3cea-109d-43f8-983c-1d5ee2f71181/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpfmgk21xk" returned: 0 in 0.033s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:10:41.709926 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Acquiring lock "36688d94-68d3-4ae3-989a-b391d7ee4ad9" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:10:41.711524 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Lock "36688d94-68d3-4ae3-989a-b391d7ee4ad9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:10:41.769128 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: de4372a4-a0cc-4541-a5a2-87be3152c50e] Successfully created port: 54aaea68-1159-4201-967a-c8074f08eadb {{(pid=98431) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 11 23:10:41.841681 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-6a2a9908-fc7f-49fd-ba64-85c281bbf910 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Releasing lock "refresh_cache-cb63f66c-b69e-42b0-805c-be6fe9b3aee3" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 11 23:10:41.841786 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-6a2a9908-fc7f-49fd-ba64-85c281bbf910 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Instance network_info: |[{"id": "2d6dd8b9-e3ff-462f-92cf-8c3a62bc27d1", "address": "fa:16:3e:b5:6f:fd", "network": {"id": "b1a1d33f-f9b6-48cf-86a1-0260d53f3bb0", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1779972098-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2d62cddce233457caf7eb43be819e513", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d6dd8b9-e3", "ovs_interfaceid": "2d6dd8b9-e3ff-462f-92cf-8c3a62bc27d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98431) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 11 23:10:41.842496 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-a310c70e-c776-4fab-bf69-2d0c0172e309 req-5c971cc1-a196-4d6a-84dd-c08d2311a1eb service nova] Acquired lock "refresh_cache-cb63f66c-b69e-42b0-805c-be6fe9b3aee3" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 11 23:10:41.842674 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-a310c70e-c776-4fab-bf69-2d0c0172e309 req-5c971cc1-a196-4d6a-84dd-c08d2311a1eb service nova] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Refreshing network info cache for port 2d6dd8b9-e3ff-462f-92cf-8c3a62bc27d1 {{(pid=98431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 11 23:10:41.845440 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-6a2a9908-fc7f-49fd-ba64-85c281bbf910 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Start _get_guest_xml network_info=[{"id": "2d6dd8b9-e3ff-462f-92cf-8c3a62bc27d1", "address": "fa:16:3e:b5:6f:fd", "network": {"id": "b1a1d33f-f9b6-48cf-86a1-0260d53f3bb0", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1779972098-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2d62cddce233457caf7eb43be819e513", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d6dd8b9-e3", "ovs_interfaceid": "2d6dd8b9-e3ff-462f-92cf-8c3a62bc27d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-11T23:08:20Z,direct_url=,disk_format='qcow2',id=f30640f8-7aca-4300-a085-4706a5209a79,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ce012f9fabdb4ee5a73e212437f59d97',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-11T23:08:23Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'image_id': 'f30640f8-7aca-4300-a085-4706a5209a79'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98431) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 11 23:10:41.849643 np0000002687 nova-compute[98431]: WARNING nova.virt.libvirt.driver [None req-6a2a9908-fc7f-49fd-ba64-85c281bbf910 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 11 23:10:41.851990 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-6a2a9908-fc7f-49fd-ba64-85c281bbf910 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='f30640f8-7aca-4300-a085-4706a5209a79', instance_meta=NovaInstanceMeta(name='tempest-ServerStableDeviceRescueTest-server-2137494624', uuid='cb63f66c-b69e-42b0-805c-be6fe9b3aee3'), owner=OwnerMeta(userid='549767ad83a94efbb0bbd85d08fdc78a', username='tempest-ServerStableDeviceRescueTest-67974016-project-member', projectid='2d62cddce233457caf7eb43be819e513', projectname='tempest-ServerStableDeviceRescueTest-67974016'), image=ImageMeta(id='f30640f8-7aca-4300-a085-4706a5209a79', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "2d6dd8b9-e3ff-462f-92cf-8c3a62bc27d1", "address": "fa:16:3e:b5:6f:fd", "network": {"id": "b1a1d33f-f9b6-48cf-86a1-0260d53f3bb0", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1779972098-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2d62cddce233457caf7eb43be819e513", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d6dd8b9-e3", "ovs_interfaceid": "2d6dd8b9-e3ff-462f-92cf-8c3a62bc27d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1781219441.851081) {{(pid=98431) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 11 23:10:41.860346 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: de4372a4-a0cc-4541-a5a2-87be3152c50e] Start building block device mappings for instance. {{(pid=98431) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 11 23:10:41.868234 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-6a2a9908-fc7f-49fd-ba64-85c281bbf910 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Searching host: 'np0000002687' for CPU controller through CGroups V1... {{(pid=98431) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 11 23:10:41.868609 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-6a2a9908-fc7f-49fd-ba64-85c281bbf910 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] CPU controller missing on host. {{(pid=98431) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 11 23:10:41.870784 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-6a2a9908-fc7f-49fd-ba64-85c281bbf910 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Searching host: 'np0000002687' for CPU controller through CGroups V2... {{(pid=98431) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 11 23:10:41.872914 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-6a2a9908-fc7f-49fd-ba64-85c281bbf910 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] CPU controller found on host. {{(pid=98431) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 11 23:10:41.872914 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-6a2a9908-fc7f-49fd-ba64-85c281bbf910 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98431) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 11 23:10:41.872914 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-6a2a9908-fc7f-49fd-ba64-85c281bbf910 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-11T23:08:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-11T23:08:20Z,direct_url=,disk_format='qcow2',id=f30640f8-7aca-4300-a085-4706a5209a79,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ce012f9fabdb4ee5a73e212437f59d97',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-11T23:08:23Z,virtual_size=,visibility=), allow threads: True {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 11 23:10:41.873312 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-6a2a9908-fc7f-49fd-ba64-85c281bbf910 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Flavor limits 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 11 23:10:41.874287 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-6a2a9908-fc7f-49fd-ba64-85c281bbf910 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Image limits 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 11 23:10:41.874832 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-6a2a9908-fc7f-49fd-ba64-85c281bbf910 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Flavor pref 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 11 23:10:41.874921 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-6a2a9908-fc7f-49fd-ba64-85c281bbf910 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Image pref 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 11 23:10:41.875080 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-6a2a9908-fc7f-49fd-ba64-85c281bbf910 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 11 23:10:41.875417 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-6a2a9908-fc7f-49fd-ba64-85c281bbf910 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 11 23:10:41.875476 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-6a2a9908-fc7f-49fd-ba64-85c281bbf910 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98431) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 11 23:10:41.877823 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-6a2a9908-fc7f-49fd-ba64-85c281bbf910 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Got 1 possible topologies {{(pid=98431) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 11 23:10:41.877823 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-6a2a9908-fc7f-49fd-ba64-85c281bbf910 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 11 23:10:41.877823 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-6a2a9908-fc7f-49fd-ba64-85c281bbf910 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 11 23:10:41.900084 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-6a2a9908-fc7f-49fd-ba64-85c281bbf910 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-11T23:10:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-2137494624',display_name='tempest-ServerStableDeviceRescueTest-server-2137494624',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='tempest-serverstabledevicerescuetest-server-2137494624',id=3,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN1NkCgK8LSIP5pEhMIIs/Dp4mkiYJTYFTODVcSUZZtZrJeHfa+y2LovFgjleMmNFgpcKBJrcGsKOrecwTGqJCOsVvMRx1B6Ulwud9J9N+Drb0c4n+JfyZ0C/b9T67XJKQ==',key_name='tempest-keypair-560362554',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d62cddce233457caf7eb43be819e513',ramdisk_id='',reservation_id='r-5adcxr7m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-67974016',owner_user_name='tempest-ServerStableDeviceRescueTest-67974016-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-11T23:10:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='549767ad83a94efbb0bbd85d08fdc78a',uuid=cb63f66c-b69e-42b0-805c-be6fe9b3aee3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2d6dd8b9-e3ff-462f-92cf-8c3a62bc27d1", "address": "fa:16:3e:b5:6f:fd", "network": {"id": "b1a1d33f-f9b6-48cf-86a1-0260d53f3bb0", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1779972098-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2d62cddce233457caf7eb43be819e513", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d6dd8b9-e3", "ovs_interfaceid": "2d6dd8b9-e3ff-462f-92cf-8c3a62bc27d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98431) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 11 23:10:41.900084 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-6a2a9908-fc7f-49fd-ba64-85c281bbf910 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Converting VIF {"id": "2d6dd8b9-e3ff-462f-92cf-8c3a62bc27d1", "address": "fa:16:3e:b5:6f:fd", "network": {"id": "b1a1d33f-f9b6-48cf-86a1-0260d53f3bb0", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1779972098-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2d62cddce233457caf7eb43be819e513", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d6dd8b9-e3", "ovs_interfaceid": "2d6dd8b9-e3ff-462f-92cf-8c3a62bc27d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:10:41.900687 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-6a2a9908-fc7f-49fd-ba64-85c281bbf910 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:6f:fd,bridge_name='br-int',has_traffic_filtering=True,id=2d6dd8b9-e3ff-462f-92cf-8c3a62bc27d1,network=Network(b1a1d33f-f9b6-48cf-86a1-0260d53f3bb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d6dd8b9-e3') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:10:41.902059 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-6a2a9908-fc7f-49fd-ba64-85c281bbf910 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Lazy-loading 'pci_devices' on Instance uuid cb63f66c-b69e-42b0-805c-be6fe9b3aee3 {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:10:42.122290 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [req-ea720c9c-b300-4dde-b69b-97e902f0f80b req-7e5ee1b5-05cc-4ddf-9de3-bfe19b57c23c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:10:42.159210 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:42.180021 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:42.215587 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] [instance: 36688d94-68d3-4ae3-989a-b391d7ee4ad9] Starting instance... {{(pid=98431) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 11 23:10:42.286024 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:42.299581 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:42.333359 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-ea720c9c-b300-4dde-b69b-97e902f0f80b req-7e5ee1b5-05cc-4ddf-9de3-bfe19b57c23c service nova] [instance: 689e510d-e0a4-4d6a-958e-9acfaebedc87] Updated VIF entry in instance network info cache for port 65f7170b-ae97-4cd6-93a1-7dd5111b7978. {{(pid=98431) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 11 23:10:42.333623 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-ea720c9c-b300-4dde-b69b-97e902f0f80b req-7e5ee1b5-05cc-4ddf-9de3-bfe19b57c23c service nova] [instance: 689e510d-e0a4-4d6a-958e-9acfaebedc87] Updating instance_info_cache with network_info: [{"id": "65f7170b-ae97-4cd6-93a1-7dd5111b7978", "address": "fa:16:3e:12:58:8f", "network": {"id": "7433cdeb-8dc1-430a-aade-959bf6c26aa4", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1384636967-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d78539cb9b504ed0908d5bfe6745a628", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap65f7170b-ae", "ovs_interfaceid": "65f7170b-ae97-4cd6-93a1-7dd5111b7978", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:10:42.348184 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [req-a310c70e-c776-4fab-bf69-2d0c0172e309 req-5c971cc1-a196-4d6a-84dd-c08d2311a1eb service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:10:42.368522 np0000002687 nova-compute[98431]: INFO nova.virt.block_device [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: de4372a4-a0cc-4541-a5a2-87be3152c50e] Booting with volume 51510c5e-80aa-4db3-9246-3becbd15cde9 at /dev/vda Jun 11 23:10:42.408629 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-6a2a9908-fc7f-49fd-ba64-85c281bbf910 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] End _get_guest_xml xml= Jun 11 23:10:42.408629 np0000002687 nova-compute[98431]: cb63f66c-b69e-42b0-805c-be6fe9b3aee3 Jun 11 23:10:42.408629 np0000002687 nova-compute[98431]: instance-00000003 Jun 11 23:10:42.408629 np0000002687 nova-compute[98431]: 196608 Jun 11 23:10:42.408629 np0000002687 nova-compute[98431]: 1 Jun 11 23:10:42.408629 np0000002687 nova-compute[98431]: Jun 11 23:10:42.408629 np0000002687 nova-compute[98431]: Jun 11 23:10:42.408629 np0000002687 nova-compute[98431]: Jun 11 23:10:42.408629 np0000002687 nova-compute[98431]: tempest-ServerStableDeviceRescueTest-server-2137494624 Jun 11 23:10:42.408629 np0000002687 nova-compute[98431]: 2026-06-11 23:10:41 Jun 11 23:10:42.408629 np0000002687 nova-compute[98431]: Jun 11 23:10:42.408629 np0000002687 nova-compute[98431]: 192 Jun 11 23:10:42.408629 np0000002687 nova-compute[98431]: 1 Jun 11 23:10:42.408629 np0000002687 nova-compute[98431]: 0 Jun 11 23:10:42.408629 np0000002687 nova-compute[98431]: 0 Jun 11 23:10:42.408629 np0000002687 nova-compute[98431]: 1 Jun 11 23:10:42.408629 np0000002687 nova-compute[98431]: Jun 11 23:10:42.408629 np0000002687 nova-compute[98431]: True Jun 11 23:10:42.408629 np0000002687 nova-compute[98431]: Jun 11 23:10:42.408629 np0000002687 nova-compute[98431]: Jun 11 23:10:42.408629 np0000002687 nova-compute[98431]: Jun 11 23:10:42.408629 np0000002687 nova-compute[98431]: bare Jun 11 23:10:42.408629 np0000002687 nova-compute[98431]: qcow2 Jun 11 23:10:42.408629 np0000002687 nova-compute[98431]: 1 Jun 11 23:10:42.408629 np0000002687 nova-compute[98431]: 0 Jun 11 23:10:42.408629 np0000002687 nova-compute[98431]: Jun 11 23:10:42.408629 np0000002687 nova-compute[98431]: virtio Jun 11 23:10:42.408629 np0000002687 nova-compute[98431]: Jun 11 23:10:42.408629 np0000002687 nova-compute[98431]: Jun 11 23:10:42.408629 np0000002687 nova-compute[98431]: Jun 11 23:10:42.408629 np0000002687 nova-compute[98431]: tempest-ServerStableDeviceRescueTest-67974016-project-member Jun 11 23:10:42.408629 np0000002687 nova-compute[98431]: tempest-ServerStableDeviceRescueTest-67974016 Jun 11 23:10:42.408629 np0000002687 nova-compute[98431]: Jun 11 23:10:42.408629 np0000002687 nova-compute[98431]: Jun 11 23:10:42.408629 np0000002687 nova-compute[98431]: Jun 11 23:10:42.408629 np0000002687 nova-compute[98431]: Jun 11 23:10:42.408629 np0000002687 nova-compute[98431]: Jun 11 23:10:42.408629 np0000002687 nova-compute[98431]: Jun 11 23:10:42.408629 np0000002687 nova-compute[98431]: Jun 11 23:10:42.408629 np0000002687 nova-compute[98431]: Jun 11 23:10:42.408629 np0000002687 nova-compute[98431]: Jun 11 23:10:42.408629 np0000002687 nova-compute[98431]: Jun 11 23:10:42.408629 np0000002687 nova-compute[98431]: Jun 11 23:10:42.408629 np0000002687 nova-compute[98431]: OpenStack Foundation Jun 11 23:10:42.408629 np0000002687 nova-compute[98431]: OpenStack Nova Jun 11 23:10:42.408629 np0000002687 nova-compute[98431]: 33.1.0 Jun 11 23:10:42.408629 np0000002687 nova-compute[98431]: cb63f66c-b69e-42b0-805c-be6fe9b3aee3 Jun 11 23:10:42.408629 np0000002687 nova-compute[98431]: cb63f66c-b69e-42b0-805c-be6fe9b3aee3 Jun 11 23:10:42.408629 np0000002687 nova-compute[98431]: Virtual Machine Jun 11 23:10:42.408629 np0000002687 nova-compute[98431]: Jun 11 23:10:42.408629 np0000002687 nova-compute[98431]: Jun 11 23:10:42.408629 np0000002687 nova-compute[98431]: Jun 11 23:10:42.408629 np0000002687 nova-compute[98431]: hvm Jun 11 23:10:42.408629 np0000002687 nova-compute[98431]: Jun 11 23:10:42.408629 np0000002687 nova-compute[98431]: Jun 11 23:10:42.408629 np0000002687 nova-compute[98431]: Jun 11 23:10:42.408629 np0000002687 nova-compute[98431]: Jun 11 23:10:42.408629 np0000002687 nova-compute[98431]: Jun 11 23:10:42.408629 np0000002687 nova-compute[98431]: Jun 11 23:10:42.408629 np0000002687 nova-compute[98431]: 128 Jun 11 23:10:42.408629 np0000002687 nova-compute[98431]: Jun 11 23:10:42.408629 np0000002687 nova-compute[98431]: Jun 11 23:10:42.408629 np0000002687 nova-compute[98431]: Jun 11 23:10:42.408629 np0000002687 nova-compute[98431]: 1 Jun 11 23:10:42.408629 np0000002687 nova-compute[98431]: Jun 11 23:10:42.408629 np0000002687 nova-compute[98431]: Jun 11 23:10:42.408629 np0000002687 nova-compute[98431]: Nehalem Jun 11 23:10:42.408629 np0000002687 nova-compute[98431]: Jun 11 23:10:42.408629 np0000002687 nova-compute[98431]: Jun 11 23:10:42.408629 np0000002687 nova-compute[98431]: Jun 11 23:10:42.408629 np0000002687 nova-compute[98431]: Jun 11 23:10:42.408629 np0000002687 nova-compute[98431]: Jun 11 23:10:42.408629 np0000002687 nova-compute[98431]: Jun 11 23:10:42.408629 np0000002687 nova-compute[98431]: Jun 11 23:10:42.408629 np0000002687 nova-compute[98431]: Jun 11 23:10:42.408629 np0000002687 nova-compute[98431]: Jun 11 23:10:42.408629 np0000002687 nova-compute[98431]: Jun 11 23:10:42.408629 np0000002687 nova-compute[98431]: Jun 11 23:10:42.408629 np0000002687 nova-compute[98431]: Jun 11 23:10:42.408629 np0000002687 nova-compute[98431]: Jun 11 23:10:42.408629 np0000002687 nova-compute[98431]: Jun 11 23:10:42.408629 np0000002687 nova-compute[98431]: Jun 11 23:10:42.408629 np0000002687 nova-compute[98431]: Jun 11 23:10:42.408629 np0000002687 nova-compute[98431]: Jun 11 23:10:42.408629 np0000002687 nova-compute[98431]: Jun 11 23:10:42.408629 np0000002687 nova-compute[98431]: Jun 11 23:10:42.408629 np0000002687 nova-compute[98431]: Jun 11 23:10:42.408629 np0000002687 nova-compute[98431]: Jun 11 23:10:42.408629 np0000002687 nova-compute[98431]: Jun 11 23:10:42.408629 np0000002687 nova-compute[98431]: Jun 11 23:10:42.408629 np0000002687 nova-compute[98431]: Jun 11 23:10:42.408629 np0000002687 nova-compute[98431]: Jun 11 23:10:42.408629 np0000002687 nova-compute[98431]: Jun 11 23:10:42.408629 np0000002687 nova-compute[98431]: /dev/urandom Jun 11 23:10:42.408629 np0000002687 nova-compute[98431]: Jun 11 23:10:42.408629 np0000002687 nova-compute[98431]: Jun 11 23:10:42.408629 np0000002687 nova-compute[98431]: Jun 11 23:10:42.408629 np0000002687 nova-compute[98431]: Jun 11 23:10:42.408629 np0000002687 nova-compute[98431]: Jun 11 23:10:42.408629 np0000002687 nova-compute[98431]: Jun 11 23:10:42.408629 np0000002687 nova-compute[98431]: Jun 11 23:10:42.408629 np0000002687 nova-compute[98431]: {{(pid=98431) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 11 23:10:42.412688 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-6a2a9908-fc7f-49fd-ba64-85c281bbf910 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Preparing to wait for external event network-vif-plugged-2d6dd8b9-e3ff-462f-92cf-8c3a62bc27d1 {{(pid=98431) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 11 23:10:42.412688 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-6a2a9908-fc7f-49fd-ba64-85c281bbf910 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Acquiring lock "cb63f66c-b69e-42b0-805c-be6fe9b3aee3-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:10:42.412688 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-6a2a9908-fc7f-49fd-ba64-85c281bbf910 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Lock "cb63f66c-b69e-42b0-805c-be6fe9b3aee3-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:10:42.412688 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-6a2a9908-fc7f-49fd-ba64-85c281bbf910 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Lock "cb63f66c-b69e-42b0-805c-be6fe9b3aee3-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:10:42.412688 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-6a2a9908-fc7f-49fd-ba64-85c281bbf910 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-11T23:10:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-2137494624',display_name='tempest-ServerStableDeviceRescueTest-server-2137494624',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='tempest-serverstabledevicerescuetest-server-2137494624',id=3,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN1NkCgK8LSIP5pEhMIIs/Dp4mkiYJTYFTODVcSUZZtZrJeHfa+y2LovFgjleMmNFgpcKBJrcGsKOrecwTGqJCOsVvMRx1B6Ulwud9J9N+Drb0c4n+JfyZ0C/b9T67XJKQ==',key_name='tempest-keypair-560362554',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d62cddce233457caf7eb43be819e513',ramdisk_id='',reservation_id='r-5adcxr7m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-67974016',owner_user_name='tempest-ServerStableDeviceRescueTest-67974016-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-11T23:10:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='549767ad83a94efbb0bbd85d08fdc78a',uuid=cb63f66c-b69e-42b0-805c-be6fe9b3aee3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2d6dd8b9-e3ff-462f-92cf-8c3a62bc27d1", "address": "fa:16:3e:b5:6f:fd", "network": {"id": "b1a1d33f-f9b6-48cf-86a1-0260d53f3bb0", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1779972098-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2d62cddce233457caf7eb43be819e513", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d6dd8b9-e3", "ovs_interfaceid": "2d6dd8b9-e3ff-462f-92cf-8c3a62bc27d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 11 23:10:42.413117 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-6a2a9908-fc7f-49fd-ba64-85c281bbf910 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Converting VIF {"id": "2d6dd8b9-e3ff-462f-92cf-8c3a62bc27d1", "address": "fa:16:3e:b5:6f:fd", "network": {"id": "b1a1d33f-f9b6-48cf-86a1-0260d53f3bb0", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1779972098-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2d62cddce233457caf7eb43be819e513", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d6dd8b9-e3", "ovs_interfaceid": "2d6dd8b9-e3ff-462f-92cf-8c3a62bc27d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:10:42.413117 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-6a2a9908-fc7f-49fd-ba64-85c281bbf910 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:6f:fd,bridge_name='br-int',has_traffic_filtering=True,id=2d6dd8b9-e3ff-462f-92cf-8c3a62bc27d1,network=Network(b1a1d33f-f9b6-48cf-86a1-0260d53f3bb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d6dd8b9-e3') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:10:42.413117 np0000002687 nova-compute[98431]: DEBUG os_vif [None req-6a2a9908-fc7f-49fd-ba64-85c281bbf910 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:6f:fd,bridge_name='br-int',has_traffic_filtering=True,id=2d6dd8b9-e3ff-462f-92cf-8c3a62bc27d1,network=Network(b1a1d33f-f9b6-48cf-86a1-0260d53f3bb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d6dd8b9-e3') {{(pid=98431) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 11 23:10:42.413687 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:42.414026 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:10:42.414271 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 11 23:10:42.415643 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:42.416451 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '48163d46-1e49-5c7d-82f6-b343809f00ad', '_type': 'linux-noop'}}, row=False) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:10:42.420400 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:42.421822 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-dd35667d-ea77-4781-83f8-7bdecb4c5828 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] Acquiring lock "73abd331-0bbf-432e-be1c-308801a5429f" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:10:42.422957 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:10:42.423821 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-dd35667d-ea77-4781-83f8-7bdecb4c5828 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] Lock "73abd331-0bbf-432e-be1c-308801a5429f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:10:42.424756 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:42.431580 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:42.431822 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2d6dd8b9-e3, may_exist=True, interface_attrs={}) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:10:42.432185 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2d6dd8b9-e3, col_values=(('qos', UUID('42439d33-14ee-4a49-a046-425f72686fbc')),), if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:10:42.432367 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2d6dd8b9-e3, col_values=(('external_ids', {'iface-id': '2d6dd8b9-e3ff-462f-92cf-8c3a62bc27d1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b5:6f:fd', 'vm-uuid': 'cb63f66c-b69e-42b0-805c-be6fe9b3aee3'}),), if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:10:42.433437 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:42.435511 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:10:42.443980 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:42.445106 np0000002687 nova-compute[98431]: INFO os_vif [None req-6a2a9908-fc7f-49fd-ba64-85c281bbf910 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:6f:fd,bridge_name='br-int',has_traffic_filtering=True,id=2d6dd8b9-e3ff-462f-92cf-8c3a62bc27d1,network=Network(b1a1d33f-f9b6-48cf-86a1-0260d53f3bb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d6dd8b9-e3') Jun 11 23:10:42.459610 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.209', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000002687', 'execute': None}" {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 11 23:10:42.462553 np0000002687 nova-compute[98431]: INFO oslo.privsep.daemon [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmp8v6uzaat/privsep.sock'] Jun 11 23:10:42.472435 np0000002687 sudo[110273]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmp8v6uzaat/privsep.sock Jun 11 23:10:42.473387 np0000002687 sudo[110273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jun 11 23:10:42.576608 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:42.619131 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: de4372a4-a0cc-4541-a5a2-87be3152c50e] Successfully updated port: 54aaea68-1159-4201-967a-c8074f08eadb {{(pid=98431) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 11 23:10:42.721097 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-9c4a9928-3669-438a-b054-841d5730f490 req-dae3d43c-c380-41fe-a399-463bca6b4ad1 service nova] [instance: de4372a4-a0cc-4541-a5a2-87be3152c50e] Received event network-changed-54aaea68-1159-4201-967a-c8074f08eadb {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:10:42.724630 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-9c4a9928-3669-438a-b054-841d5730f490 req-dae3d43c-c380-41fe-a399-463bca6b4ad1 service nova] [instance: de4372a4-a0cc-4541-a5a2-87be3152c50e] Refreshing instance network info cache due to event network-changed-54aaea68-1159-4201-967a-c8074f08eadb. {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 11 23:10:42.725081 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-9c4a9928-3669-438a-b054-841d5730f490 req-dae3d43c-c380-41fe-a399-463bca6b4ad1 service nova] Acquiring lock "refresh_cache-de4372a4-a0cc-4541-a5a2-87be3152c50e" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 11 23:10:42.725209 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-9c4a9928-3669-438a-b054-841d5730f490 req-dae3d43c-c380-41fe-a399-463bca6b4ad1 service nova] Acquired lock "refresh_cache-de4372a4-a0cc-4541-a5a2-87be3152c50e" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 11 23:10:42.725985 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-9c4a9928-3669-438a-b054-841d5730f490 req-dae3d43c-c380-41fe-a399-463bca6b4ad1 service nova] [instance: de4372a4-a0cc-4541-a5a2-87be3152c50e] Refreshing network info cache for port 54aaea68-1159-4201-967a-c8074f08eadb {{(pid=98431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 11 23:10:42.729124 np0000002687 nova-compute[98431]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jun 11 23:10:42.729124 np0000002687 nova-compute[98431]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 11 23:10:42.729124 np0000002687 nova-compute[98431]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jun 11 23:10:42.729124 np0000002687 nova-compute[98431]: WARNING oslo.privsep.daemon [-] privsep log: Jun 11 23:10:42.729124 np0000002687 nova-compute[98431]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jun 11 23:10:42.729124 np0000002687 nova-compute[98431]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jun 11 23:10:42.729391 np0000002687 nova-compute[98431]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 11 23:10:42.729391 np0000002687 nova-compute[98431]: WARNING oslo.privsep.daemon [-] privsep log: Jun 11 23:10:42.729391 np0000002687 nova-compute[98431]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jun 11 23:10:42.791660 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:10:42.791660 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:10:42.796840 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98431) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 11 23:10:42.797024 np0000002687 nova-compute[98431]: INFO nova.compute.claims [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] [instance: 36688d94-68d3-4ae3-989a-b391d7ee4ad9] Claim successful on node np0000002687 Jun 11 23:10:42.835360 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-ea720c9c-b300-4dde-b69b-97e902f0f80b req-7e5ee1b5-05cc-4ddf-9de3-bfe19b57c23c service nova] Releasing lock "refresh_cache-689e510d-e0a4-4d6a-958e-9acfaebedc87" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 11 23:10:42.894923 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [req-a310c70e-c776-4fab-bf69-2d0c0172e309 req-5c971cc1-a196-4d6a-84dd-c08d2311a1eb service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:10:42.926067 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-dd35667d-ea77-4781-83f8-7bdecb4c5828 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] [instance: 73abd331-0bbf-432e-be1c-308801a5429f] Starting instance... {{(pid=98431) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 11 23:10:43.056075 np0000002687 nova-compute[98431]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jun 11 23:10:43.056162 np0000002687 nova-compute[98431]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 11 23:10:43.056248 np0000002687 nova-compute[98431]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jun 11 23:10:43.056329 np0000002687 nova-compute[98431]: WARNING oslo.privsep.daemon [-] privsep log: Jun 11 23:10:43.056394 np0000002687 nova-compute[98431]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jun 11 23:10:43.056520 np0000002687 nova-compute[98431]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jun 11 23:10:43.056989 np0000002687 nova-compute[98431]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 11 23:10:43.057194 np0000002687 nova-compute[98431]: WARNING oslo.privsep.daemon [-] privsep log: Jun 11 23:10:43.057594 np0000002687 nova-compute[98431]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jun 11 23:10:43.074990 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-a310c70e-c776-4fab-bf69-2d0c0172e309 req-5c971cc1-a196-4d6a-84dd-c08d2311a1eb service nova] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Updated VIF entry in instance network info cache for port 2d6dd8b9-e3ff-462f-92cf-8c3a62bc27d1. {{(pid=98431) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 11 23:10:43.076440 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-a310c70e-c776-4fab-bf69-2d0c0172e309 req-5c971cc1-a196-4d6a-84dd-c08d2311a1eb service nova] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Updating instance_info_cache with network_info: [{"id": "2d6dd8b9-e3ff-462f-92cf-8c3a62bc27d1", "address": "fa:16:3e:b5:6f:fd", "network": {"id": "b1a1d33f-f9b6-48cf-86a1-0260d53f3bb0", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1779972098-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2d62cddce233457caf7eb43be819e513", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d6dd8b9-e3", "ovs_interfaceid": "2d6dd8b9-e3ff-462f-92cf-8c3a62bc27d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:10:43.106045 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-ac70a8b6-6e47-48a8-bc39-40773397e5b3 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] No BDM found with device name vda, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:10:43.106178 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-ac70a8b6-6e47-48a8-bc39-40773397e5b3 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] No BDM found with device name hda, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:10:43.106302 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-ac70a8b6-6e47-48a8-bc39-40773397e5b3 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] No VIF found with MAC fa:16:3e:12:58:8f, not building metadata {{(pid=98431) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13199}} Jun 11 23:10:43.106875 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-ac70a8b6-6e47-48a8-bc39-40773397e5b3 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] [instance: 689e510d-e0a4-4d6a-958e-9acfaebedc87] Using config drive Jun 11 23:10:43.118642 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [-] Emitting event Started> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:10:43.118789 np0000002687 nova-compute[98431]: INFO nova.compute.manager [-] [instance: 8aec3cea-109d-43f8-983c-1d5ee2f71181] VM Started (Lifecycle Event) Jun 11 23:10:43.121831 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Acquiring lock "refresh_cache-de4372a4-a0cc-4541-a5a2-87be3152c50e" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 11 23:10:43.230769 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [req-9c4a9928-3669-438a-b054-841d5730f490 req-dae3d43c-c380-41fe-a399-463bca6b4ad1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:10:43.276609 np0000002687 sudo[110273]: pam_unix(sudo:session): session closed for user root Jun 11 23:10:43.278099 np0000002687 nova-compute[98431]: INFO oslo.privsep.daemon [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Spawned new privsep daemon via rootwrap Jun 11 23:10:43.344749 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-9c4a9928-3669-438a-b054-841d5730f490 req-dae3d43c-c380-41fe-a399-463bca6b4ad1 service nova] [instance: de4372a4-a0cc-4541-a5a2-87be3152c50e] Instance cache missing network info. {{(pid=98431) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 11 23:10:43.420244 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.scaleio [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98431) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 11 23:10:43.420642 np0000002687 nova-compute[98431]: WARNING os_brick.initiator.connectors.nvmeof [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath' Jun 11 23:10:43.439112 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Running cmd (subprocess): nvme version {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:10:43.457344 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] 'nvme version' failed. Not Retrying. {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 11 23:10:43.457811 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.nvmeof [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] nvme not present on system {{(pid=98431) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 11 23:10:43.467310 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.lightos [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98431) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 11 23:10:43.468539 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.lightos [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Current host hostNQN and IP(s) are ['10.4.3.209', 'fe80::f816:3eff:fea3:3707', '192.168.40.6', 'fe80::f816:3eff:fe06:bdab', '192.168.50.6', 'fe80::f816:3eff:fe7a:46f2', '192.168.10.6', 'fe80::f816:3eff:fe13:793b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::38fa:21ff:fe6c:3746', 'fe80::fc16:3eff:fe6c:eb30'] Jun 11 23:10:43.468702 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.lightos [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98431) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 11 23:10:43.468880 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.lightos [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] LIGHTOS: no hostnqn found. {{(pid=98431) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 11 23:10:43.469781 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] <== get_connector_properties: return (1009ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.209', 'host': 'np0000002687', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:798b370f1cc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad465dfe-0ed1-4637-98c3-ddaebebd61a4', 'nvme_native_multipath': False} {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 11 23:10:43.470072 np0000002687 nova-compute[98431]: DEBUG nova.virt.block_device [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: de4372a4-a0cc-4541-a5a2-87be3152c50e] Updating existing volume attachment record: 601e56a1-c492-47b6-893a-ceaa65743cab {{(pid=98431) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 11 23:10:43.511346 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-dd35667d-ea77-4781-83f8-7bdecb4c5828 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:10:43.554193 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-9c4a9928-3669-438a-b054-841d5730f490 req-dae3d43c-c380-41fe-a399-463bca6b4ad1 service nova] [instance: de4372a4-a0cc-4541-a5a2-87be3152c50e] Updating instance_info_cache with network_info: [] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:10:43.578782 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-a310c70e-c776-4fab-bf69-2d0c0172e309 req-5c971cc1-a196-4d6a-84dd-c08d2311a1eb service nova] Releasing lock "refresh_cache-cb63f66c-b69e-42b0-805c-be6fe9b3aee3" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 11 23:10:43.613324 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-ac70a8b6-6e47-48a8-bc39-40773397e5b3 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:10:43.624819 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 8aec3cea-109d-43f8-983c-1d5ee2f71181] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:10:43.631403 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Emitting event Paused> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:10:43.631403 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 8aec3cea-109d-43f8-983c-1d5ee2f71181] VM Paused (Lifecycle Event) Jun 11 23:10:43.837395 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-ac70a8b6-6e47-48a8-bc39-40773397e5b3 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] [instance: 689e510d-e0a4-4d6a-958e-9acfaebedc87] Creating config drive at /opt/stack/data/nova/instances/689e510d-e0a4-4d6a-958e-9acfaebedc87/disk.config Jun 11 23:10:43.843834 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-ac70a8b6-6e47-48a8-bc39-40773397e5b3 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/689e510d-e0a4-4d6a-958e-9acfaebedc87/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmphyod7wzj {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:10:43.884675 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-ac70a8b6-6e47-48a8-bc39-40773397e5b3 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/689e510d-e0a4-4d6a-958e-9acfaebedc87/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmphyod7wzj" returned: 0 in 0.042s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:10:43.969817 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-6a2a9908-fc7f-49fd-ba64-85c281bbf910 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] No BDM found with device name vda, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:10:43.969817 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-6a2a9908-fc7f-49fd-ba64-85c281bbf910 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] No BDM found with device name hda, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:10:43.969817 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-6a2a9908-fc7f-49fd-ba64-85c281bbf910 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] No VIF found with MAC fa:16:3e:b5:6f:fd, not building metadata {{(pid=98431) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13199}} Jun 11 23:10:43.969817 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-6a2a9908-fc7f-49fd-ba64-85c281bbf910 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Using config drive Jun 11 23:10:44.056951 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-9c4a9928-3669-438a-b054-841d5730f490 req-dae3d43c-c380-41fe-a399-463bca6b4ad1 service nova] Releasing lock "refresh_cache-de4372a4-a0cc-4541-a5a2-87be3152c50e" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 11 23:10:44.057376 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Acquired lock "refresh_cache-de4372a4-a0cc-4541-a5a2-87be3152c50e" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 11 23:10:44.057547 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: de4372a4-a0cc-4541-a5a2-87be3152c50e] Building network info cache for instance {{(pid=98431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 11 23:10:44.132821 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 8aec3cea-109d-43f8-983c-1d5ee2f71181] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:10:44.136514 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 8aec3cea-109d-43f8-983c-1d5ee2f71181] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98431) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 11 23:10:44.149389 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98431) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 11 23:10:44.149645 np0000002687 nova-compute[98431]: DEBUG nova.compute.provider_tree [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Inventory has not changed in ProviderTree for provider: e3e65fe2-9de9-4821-8b4a-ccae37c66e25 {{(pid=98431) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 11 23:10:44.328008 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:44.353945 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:44.442661 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:44.476232 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-6a2a9908-fc7f-49fd-ba64-85c281bbf910 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:10:44.637991 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 8aec3cea-109d-43f8-983c-1d5ee2f71181] During sync_power_state the instance has a pending task (spawning). Skip. Jun 11 23:10:44.639867 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: de4372a4-a0cc-4541-a5a2-87be3152c50e] Instance cache missing network info. {{(pid=98431) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 11 23:10:44.648275 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-6a2a9908-fc7f-49fd-ba64-85c281bbf910 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Creating config drive at /opt/stack/data/nova/instances/cb63f66c-b69e-42b0-805c-be6fe9b3aee3/disk.config Jun 11 23:10:44.652586 np0000002687 nova-compute[98431]: DEBUG nova.scheduler.client.report [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Inventory has not changed for provider e3e65fe2-9de9-4821-8b4a-ccae37c66e25 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98431) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 11 23:10:44.659251 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-6a2a9908-fc7f-49fd-ba64-85c281bbf910 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/cb63f66c-b69e-42b0-805c-be6fe9b3aee3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpdf_ogos4 {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:10:44.689860 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-6a2a9908-fc7f-49fd-ba64-85c281bbf910 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/cb63f66c-b69e-42b0-805c-be6fe9b3aee3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpdf_ogos4" returned: 0 in 0.030s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:10:44.941446 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:44.951866 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:44.966624 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:44.971537 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:45.169733 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.378s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:10:45.169733 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] [instance: 36688d94-68d3-4ae3-989a-b391d7ee4ad9] Start building networks asynchronously for instance. {{(pid=98431) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 11 23:10:45.176442 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-dd35667d-ea77-4781-83f8-7bdecb4c5828 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.665s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:10:45.182707 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-dd35667d-ea77-4781-83f8-7bdecb4c5828 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98431) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 11 23:10:45.196472 np0000002687 nova-compute[98431]: INFO nova.compute.claims [None req-dd35667d-ea77-4781-83f8-7bdecb4c5828 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] [instance: 73abd331-0bbf-432e-be1c-308801a5429f] Claim successful on node np0000002687 Jun 11 23:10:45.198453 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:45.211416 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:45.232761 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:10:45.244718 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Emitting event Started> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:10:45.244937 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 689e510d-e0a4-4d6a-958e-9acfaebedc87] VM Started (Lifecycle Event) Jun 11 23:10:45.347923 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:45.373875 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: de4372a4-a0cc-4541-a5a2-87be3152c50e] Updating instance_info_cache with network_info: [{"id": "54aaea68-1159-4201-967a-c8074f08eadb", "address": "fa:16:3e:77:48:8d", "network": {"id": "17593db3-c22d-4354-ab29-933b1c6a5c3a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1094286565-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "81fd45f475a04e5c8e9bd9deb7ad4c1e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap54aaea68-11", "ovs_interfaceid": "54aaea68-1159-4201-967a-c8074f08eadb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:10:45.619332 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:45.620528 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:45.622035 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:45.637431 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:45.637772 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:45.653518 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: de4372a4-a0cc-4541-a5a2-87be3152c50e] Start spawning the instance on the hypervisor. {{(pid=98431) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 11 23:10:45.654546 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: de4372a4-a0cc-4541-a5a2-87be3152c50e] Creating instance directory {{(pid=98431) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}} Jun 11 23:10:45.654767 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: de4372a4-a0cc-4541-a5a2-87be3152c50e] Creating image(s) Jun 11 23:10:45.655037 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: de4372a4-a0cc-4541-a5a2-87be3152c50e] Did not create local disks {{(pid=98431) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}} Jun 11 23:10:45.655166 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: de4372a4-a0cc-4541-a5a2-87be3152c50e] Ensure instance console log exists: /opt/stack/data/nova/instances/de4372a4-a0cc-4541-a5a2-87be3152c50e/console.log {{(pid=98431) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}} Jun 11 23:10:45.655369 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:10:45.655582 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:10:45.656816 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:10:45.683166 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] [instance: 36688d94-68d3-4ae3-989a-b391d7ee4ad9] Allocating IP information in the background. {{(pid=98431) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 11 23:10:45.683399 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] [instance: 36688d94-68d3-4ae3-989a-b391d7ee4ad9] allocate_for_instance() {{(pid=98431) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 11 23:10:45.683870 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:10:45.683870 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:10:45.751269 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 689e510d-e0a4-4d6a-958e-9acfaebedc87] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:10:45.754669 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Emitting event Paused> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:10:45.754765 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 689e510d-e0a4-4d6a-958e-9acfaebedc87] VM Paused (Lifecycle Event) Jun 11 23:10:45.761586 np0000002687 nova-compute[98431]: DEBUG nova.policy [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '776c0e8b8bb74ffea6010d632b9ba0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae41a1c4221b4e7483281a8b80f16ee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98431) authorize /opt/stack/nova/nova/policy.py:192}} Jun 11 23:10:45.876887 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Releasing lock "refresh_cache-de4372a4-a0cc-4541-a5a2-87be3152c50e" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 11 23:10:45.877181 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: de4372a4-a0cc-4541-a5a2-87be3152c50e] Instance network_info: |[{"id": "54aaea68-1159-4201-967a-c8074f08eadb", "address": "fa:16:3e:77:48:8d", "network": {"id": "17593db3-c22d-4354-ab29-933b1c6a5c3a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1094286565-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "81fd45f475a04e5c8e9bd9deb7ad4c1e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap54aaea68-11", "ovs_interfaceid": "54aaea68-1159-4201-967a-c8074f08eadb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98431) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 11 23:10:45.877766 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: de4372a4-a0cc-4541-a5a2-87be3152c50e] Start _get_guest_xml network_info=[{"id": "54aaea68-1159-4201-967a-c8074f08eadb", "address": "fa:16:3e:77:48:8d", "network": {"id": "17593db3-c22d-4354-ab29-933b1c6a5c3a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1094286565-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "81fd45f475a04e5c8e9bd9deb7ad4c1e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap54aaea68-11", "ovs_interfaceid": "54aaea68-1159-4201-967a-c8074f08eadb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=,container_format=,created_at=,direct_url=,disk_format=,id=,min_disk=0,min_ram=0,name=,owner=,properties=ImageMetaProps,protected=,size=1073741824,status='active',tags=,updated_at=,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'mount_device': '/dev/vda', 'attachment_id': '601e56a1-c492-47b6-893a-ceaa65743cab', 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9', 'iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '51510c5e-80aa-4db3-9246-3becbd15cde9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'de4372a4-a0cc-4541-a5a2-87be3152c50e', 'attached_at': '', 'detached_at': '', 'volume_id': '51510c5e-80aa-4db3-9246-3becbd15cde9', 'serial': '51510c5e-80aa-4db3-9246-3becbd15cde9', 'multiattach': True}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98431) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 11 23:10:45.883488 np0000002687 nova-compute[98431]: WARNING nova.virt.libvirt.driver [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 11 23:10:45.884506 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeMultiAttachTest-server-1839648806', uuid='de4372a4-a0cc-4541-a5a2-87be3152c50e'), owner=OwnerMeta(userid='c17e84202f404c3c8e73292bb59d7b27', username='tempest-AttachVolumeMultiAttachTest-1514006700-project-member', projectid='81fd45f475a04e5c8e9bd9deb7ad4c1e', projectname='tempest-AttachVolumeMultiAttachTest-1514006700'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "54aaea68-1159-4201-967a-c8074f08eadb", "address": "fa:16:3e:77:48:8d", "network": {"id": "17593db3-c22d-4354-ab29-933b1c6a5c3a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1094286565-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "81fd45f475a04e5c8e9bd9deb7ad4c1e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap54aaea68-11", "ovs_interfaceid": "54aaea68-1159-4201-967a-c8074f08eadb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1781219445.884158) {{(pid=98431) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 11 23:10:45.889576 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Searching host: 'np0000002687' for CPU controller through CGroups V1... {{(pid=98431) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 11 23:10:45.889980 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] CPU controller missing on host. {{(pid=98431) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 11 23:10:45.894169 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Searching host: 'np0000002687' for CPU controller through CGroups V2... {{(pid=98431) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 11 23:10:45.894404 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] CPU controller found on host. {{(pid=98431) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 11 23:10:45.895449 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98431) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 11 23:10:45.895747 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-11T23:08:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=,container_format=,created_at=,direct_url=,disk_format=,id=,min_disk=0,min_ram=0,name=,owner=,properties=ImageMetaProps,protected=,size=1073741824,status='active',tags=,updated_at=,virtual_size=,visibility=), allow threads: True {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 11 23:10:45.895919 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Flavor limits 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 11 23:10:45.896021 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Image limits 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 11 23:10:45.896146 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Flavor pref 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 11 23:10:45.896305 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Image pref 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 11 23:10:45.896343 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 11 23:10:45.896490 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 11 23:10:45.896605 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98431) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 11 23:10:45.896731 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Got 1 possible topologies {{(pid=98431) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 11 23:10:45.897011 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 11 23:10:45.897150 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 11 23:10:45.907999 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.._cache_volume_driver" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:10:45.908159 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.._cache_volume_driver" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:10:45.910077 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connector [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Factory for ISCSI on None {{(pid=98431) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jun 11 23:10:45.910414 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.._cache_volume_driver" :: held 0.002s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:10:45.910414 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: de4372a4-a0cc-4541-a5a2-87be3152c50e] Calling os-brick to attach iSCSI Volume {{(pid=98431) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 11 23:10:45.910757 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9', 'iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '51510c5e-80aa-4db3-9246-3becbd15cde9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 11 23:10:45.911012 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 11 23:10:45.911307 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 11 23:10:45.912926 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9', 'iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '51510c5e-80aa-4db3-9246-3becbd15cde9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98431) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 11 23:10:45.923985 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 11 23:10:45.925021 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 11 23:10:45.925611 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 11 23:10:45.926208 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 11 23:10:45.926524 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.iscsi [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 11 23:10:45.926820 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.iscsi [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 11 23:10:45.936434 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 11 23:10:45.936434 np0000002687 nova-compute[98431]: {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:10:45.940722 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 11 23:10:45.940722 np0000002687 nova-compute[98431]: {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:10:45.946727 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9] added Jun 11 23:10:45.946727 np0000002687 nova-compute[98431]: stderr=iscsiadm: Config file line 363 does not have value Jun 11 23:10:45.946727 np0000002687 nova-compute[98431]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 11 23:10:45.946727 np0000002687 nova-compute[98431]: iscsiadm: Config file line 363 does not have value Jun 11 23:10:45.946727 np0000002687 nova-compute[98431]: iscsiadm: Config file line 363 does not have value Jun 11 23:10:45.946727 np0000002687 nova-compute[98431]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 11 23:10:45.946727 np0000002687 nova-compute[98431]: {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:10:45.947765 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98431) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 11 23:10:45.947765 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0211(s), this was the 1st time calling it. {{(pid=98431) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 11 23:10:45.947765 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98431) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 11 23:10:45.953457 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9] added Jun 11 23:10:45.953457 np0000002687 nova-compute[98431]: stderr=iscsiadm: Config file line 363 does not have value Jun 11 23:10:45.953457 np0000002687 nova-compute[98431]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 11 23:10:45.953457 np0000002687 nova-compute[98431]: iscsiadm: Config file line 363 does not have value Jun 11 23:10:45.953457 np0000002687 nova-compute[98431]: iscsiadm: Config file line 363 does not have value Jun 11 23:10:45.953457 np0000002687 nova-compute[98431]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 11 23:10:45.953457 np0000002687 nova-compute[98431]: {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:10:45.953457 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98431) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 11 23:10:45.953457 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0274(s), this was the 1st time calling it. {{(pid=98431) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 11 23:10:45.953789 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98431) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 11 23:10:46.005530 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:46.007850 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:46.011351 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:46.028989 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:46.186002 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] [instance: 36688d94-68d3-4ae3-989a-b391d7ee4ad9] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names Jun 11 23:10:46.198862 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] [instance: 36688d94-68d3-4ae3-989a-b391d7ee4ad9] Successfully created port: 6075e13d-d32a-4d8f-8741-a4686059985e {{(pid=98431) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 11 23:10:46.257063 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 689e510d-e0a4-4d6a-958e-9acfaebedc87] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:10:46.258268 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 689e510d-e0a4-4d6a-958e-9acfaebedc87] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98431) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 11 23:10:46.520420 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-dd35667d-ea77-4781-83f8-7bdecb4c5828 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98431) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 11 23:10:46.520614 np0000002687 nova-compute[98431]: DEBUG nova.compute.provider_tree [None req-dd35667d-ea77-4781-83f8-7bdecb4c5828 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] Inventory has not changed in ProviderTree for provider: e3e65fe2-9de9-4821-8b4a-ccae37c66e25 {{(pid=98431) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 11 23:10:46.645647 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Acquiring lock "27ac8c84-e5db-4bd1-a148-ec5834c5b39c" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:10:46.646033 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Lock "27ac8c84-e5db-4bd1-a148-ec5834c5b39c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:10:46.681512 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Acquiring lock "14699717-b93f-4e67-b841-c67de8fff8d4" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:10:46.681707 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Lock "14699717-b93f-4e67-b841-c67de8fff8d4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:10:46.684552 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] [instance: 36688d94-68d3-4ae3-989a-b391d7ee4ad9] Successfully updated port: 6075e13d-d32a-4d8f-8741-a4686059985e {{(pid=98431) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 11 23:10:46.689279 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] [instance: 36688d94-68d3-4ae3-989a-b391d7ee4ad9] Start building block device mappings for instance. {{(pid=98431) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 11 23:10:46.733581 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-79c838d4-589b-40f6-86a1-acf0345d2f51 req-0538b258-dc14-477f-9ef3-1cc952935ef3 service nova] [instance: 36688d94-68d3-4ae3-989a-b391d7ee4ad9] Received event network-changed-6075e13d-d32a-4d8f-8741-a4686059985e {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:10:46.733742 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-79c838d4-589b-40f6-86a1-acf0345d2f51 req-0538b258-dc14-477f-9ef3-1cc952935ef3 service nova] [instance: 36688d94-68d3-4ae3-989a-b391d7ee4ad9] Refreshing instance network info cache due to event network-changed-6075e13d-d32a-4d8f-8741-a4686059985e. {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 11 23:10:46.734026 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-79c838d4-589b-40f6-86a1-acf0345d2f51 req-0538b258-dc14-477f-9ef3-1cc952935ef3 service nova] Acquiring lock "refresh_cache-36688d94-68d3-4ae3-989a-b391d7ee4ad9" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 11 23:10:46.734084 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-79c838d4-589b-40f6-86a1-acf0345d2f51 req-0538b258-dc14-477f-9ef3-1cc952935ef3 service nova] Acquired lock "refresh_cache-36688d94-68d3-4ae3-989a-b391d7ee4ad9" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 11 23:10:46.734240 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-79c838d4-589b-40f6-86a1-acf0345d2f51 req-0538b258-dc14-477f-9ef3-1cc952935ef3 service nova] [instance: 36688d94-68d3-4ae3-989a-b391d7ee4ad9] Refreshing network info cache for port 6075e13d-d32a-4d8f-8741-a4686059985e {{(pid=98431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 11 23:10:46.760692 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 689e510d-e0a4-4d6a-958e-9acfaebedc87] During sync_power_state the instance has a pending task (spawning). Skip. Jun 11 23:10:46.760974 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Emitting event Started> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:10:46.761083 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] VM Started (Lifecycle Event) Jun 11 23:10:46.948283 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.iscsi [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 11 23:10:46.954146 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.iscsi [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 11 23:10:46.960460 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 11 23:10:46.960460 np0000002687 nova-compute[98431]: node.name = iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 Jun 11 23:10:46.960460 np0000002687 nova-compute[98431]: node.tpgt = -1 Jun 11 23:10:46.960460 np0000002687 nova-compute[98431]: node.startup = manual Jun 11 23:10:46.960460 np0000002687 nova-compute[98431]: node.leading_login = No Jun 11 23:10:46.960460 np0000002687 nova-compute[98431]: iface.iscsi_ifacename = default Jun 11 23:10:46.960460 np0000002687 nova-compute[98431]: iface.net_ifacename = Jun 11 23:10:46.960460 np0000002687 nova-compute[98431]: iface.ipaddress = Jun 11 23:10:46.960460 np0000002687 nova-compute[98431]: iface.prefix_len = 0 Jun 11 23:10:46.960460 np0000002687 nova-compute[98431]: iface.hwaddress = Jun 11 23:10:46.960460 np0000002687 nova-compute[98431]: iface.transport_name = tcp Jun 11 23:10:46.960460 np0000002687 nova-compute[98431]: iface.initiatorname = Jun 11 23:10:46.960460 np0000002687 nova-compute[98431]: iface.state = Jun 11 23:10:46.960460 np0000002687 nova-compute[98431]: iface.vlan_id = 0 Jun 11 23:10:46.960460 np0000002687 nova-compute[98431]: iface.vlan_priority = 0 Jun 11 23:10:46.960460 np0000002687 nova-compute[98431]: iface.vlan_state = Jun 11 23:10:46.960460 np0000002687 nova-compute[98431]: iface.iface_num = 0 Jun 11 23:10:46.960460 np0000002687 nova-compute[98431]: iface.mtu = 0 Jun 11 23:10:46.960460 np0000002687 nova-compute[98431]: iface.port = 0 Jun 11 23:10:46.960460 np0000002687 nova-compute[98431]: iface.bootproto = Jun 11 23:10:46.960460 np0000002687 nova-compute[98431]: iface.subnet_mask = Jun 11 23:10:46.960460 np0000002687 nova-compute[98431]: iface.gateway = Jun 11 23:10:46.960460 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id_state = Jun 11 23:10:46.960460 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id = Jun 11 23:10:46.960460 np0000002687 nova-compute[98431]: iface.dhcp_dns = Jun 11 23:10:46.960460 np0000002687 nova-compute[98431]: iface.dhcp_learn_iqn = Jun 11 23:10:46.960460 np0000002687 nova-compute[98431]: iface.dhcp_req_vendor_id_state = Jun 11 23:10:46.960460 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id_state = Jun 11 23:10:46.960460 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id = Jun 11 23:10:46.960460 np0000002687 nova-compute[98431]: iface.dhcp_slp_da = Jun 11 23:10:46.960460 np0000002687 nova-compute[98431]: iface.fragmentation = Jun 11 23:10:46.960460 np0000002687 nova-compute[98431]: iface.gratuitous_arp = Jun 11 23:10:46.960460 np0000002687 nova-compute[98431]: iface.incoming_forwarding = Jun 11 23:10:46.960460 np0000002687 nova-compute[98431]: iface.tos_state = Jun 11 23:10:46.960460 np0000002687 nova-compute[98431]: iface.tos = 0 Jun 11 23:10:46.960460 np0000002687 nova-compute[98431]: iface.ttl = 0 Jun 11 23:10:46.960460 np0000002687 nova-compute[98431]: iface.delayed_ack = Jun 11 23:10:46.960460 np0000002687 nova-compute[98431]: iface.tcp_nagle = Jun 11 23:10:46.960460 np0000002687 nova-compute[98431]: iface.tcp_wsf_state = Jun 11 23:10:46.960460 np0000002687 nova-compute[98431]: iface.tcp_wsf = 0 Jun 11 23:10:46.960460 np0000002687 nova-compute[98431]: iface.tcp_timer_scale = 0 Jun 11 23:10:46.960460 np0000002687 nova-compute[98431]: iface.tcp_timestamp = Jun 11 23:10:46.960460 np0000002687 nova-compute[98431]: iface.redirect = Jun 11 23:10:46.960460 np0000002687 nova-compute[98431]: iface.def_task_mgmt_timeout = 0 Jun 11 23:10:46.960460 np0000002687 nova-compute[98431]: iface.header_digest = Jun 11 23:10:46.960460 np0000002687 nova-compute[98431]: iface.data_digest = Jun 11 23:10:46.960460 np0000002687 nova-compute[98431]: iface.immediate_data = Jun 11 23:10:46.960460 np0000002687 nova-compute[98431]: iface.initial_r2t = Jun 11 23:10:46.960460 np0000002687 nova-compute[98431]: iface.data_seq_inorder = Jun 11 23:10:46.960460 np0000002687 nova-compute[98431]: iface.data_pdu_inorder = Jun 11 23:10:46.960460 np0000002687 nova-compute[98431]: iface.erl = 0 Jun 11 23:10:46.960460 np0000002687 nova-compute[98431]: iface.max_receive_data_len = 0 Jun 11 23:10:46.960460 np0000002687 nova-compute[98431]: iface.first_burst_len = 0 Jun 11 23:10:46.960460 np0000002687 nova-compute[98431]: iface.max_outstanding_r2t = 0 Jun 11 23:10:46.960460 np0000002687 nova-compute[98431]: iface.max_burst_len = 0 Jun 11 23:10:46.960460 np0000002687 nova-compute[98431]: iface.chap_auth = Jun 11 23:10:46.960460 np0000002687 nova-compute[98431]: iface.bidi_chap = Jun 11 23:10:46.960460 np0000002687 nova-compute[98431]: iface.strict_login_compliance = Jun 11 23:10:46.960460 np0000002687 nova-compute[98431]: iface.discovery_auth = Jun 11 23:10:46.960460 np0000002687 nova-compute[98431]: iface.discovery_logout = Jun 11 23:10:46.960460 np0000002687 nova-compute[98431]: node.discovery_address = Jun 11 23:10:46.960460 np0000002687 nova-compute[98431]: node.discovery_port = 0 Jun 11 23:10:46.960460 np0000002687 nova-compute[98431]: node.discovery_type = fw Jun 11 23:10:46.960460 np0000002687 nova-compute[98431]: node.session.initial_cmdsn = 0 Jun 11 23:10:46.960460 np0000002687 nova-compute[98431]: node.session.initial_login_retry_max = 8 Jun 11 23:10:46.960460 np0000002687 nova-compute[98431]: node.session.xmit_thread_priority = 0 Jun 11 23:10:46.960460 np0000002687 nova-compute[98431]: node.session.cmds_max = 128 Jun 11 23:10:46.960460 np0000002687 nova-compute[98431]: node.session.queue_depth = 32 Jun 11 23:10:46.960460 np0000002687 nova-compute[98431]: node.session.nr_sessions = 1 Jun 11 23:10:46.960460 np0000002687 nova-compute[98431]: node.session.auth.authmethod = None Jun 11 23:10:46.960460 np0000002687 nova-compute[98431]: node.session.auth.username = Jun 11 23:10:46.960460 np0000002687 nova-compute[98431]: node.session.auth.password = *** Jun 11 23:10:46.960460 np0000002687 nova-compute[98431]: node.session.auth.username_in = Jun 11 23:10:46.960460 np0000002687 nova-compute[98431]: node.session.auth.password_in = Jun 11 23:10:46.960460 np0000002687 nova-compute[98431]: node.session.auth.chap_algs = SHA256 Jun 11 23:10:46.960460 np0000002687 nova-compute[98431]: node.session.timeo.replacement_timeout = 120 Jun 11 23:10:46.960460 np0000002687 nova-compute[98431]: node.session.err_timeo.abort_timeout = 15 Jun 11 23:10:46.960460 np0000002687 nova-compute[98431]: node.session.err_timeo.lu_reset_timeout = 30 Jun 11 23:10:46.960460 np0000002687 nova-compute[98431]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 11 23:10:46.960460 np0000002687 nova-compute[98431]: node.session.err_timeo.host_reset_timeout = 60 Jun 11 23:10:46.960460 np0000002687 nova-compute[98431]: node.session.iscsi.FastAbort = Yes Jun 11 23:10:46.960460 np0000002687 nova-compute[98431]: node.session.iscsi.InitialR2T = No Jun 11 23:10:46.960460 np0000002687 nova-compute[98431]: node.session.iscsi.ImmediateData = Yes Jun 11 23:10:46.960460 np0000002687 nova-compute[98431]: node.session.iscsi.FirstBurstLength = 262144 Jun 11 23:10:46.960460 np0000002687 nova-compute[98431]: node.session.iscsi.MaxBurstLength = 16776192 Jun 11 23:10:46.960460 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Retain = 0 Jun 11 23:10:46.960460 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Wait = 2 Jun 11 23:10:46.960460 np0000002687 nova-compute[98431]: node.session.iscsi.MaxConnections = 1 Jun 11 23:10:46.960460 np0000002687 nova-compute[98431]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 11 23:10:46.960460 np0000002687 nova-compute[98431]: node.session.iscsi.ERL = 0 Jun 11 23:10:46.960460 np0000002687 nova-compute[98431]: node.session.scan = auto Jun 11 23:10:46.960460 np0000002687 nova-compute[98431]: node.session.reopen_max = 0 Jun 11 23:10:46.960460 np0000002687 nova-compute[98431]: node.conn[0].address = 192.168.50.100 Jun 11 23:10:46.960460 np0000002687 nova-compute[98431]: node.conn[0].port = 3260 Jun 11 23:10:46.960460 np0000002687 nova-compute[98431]: node.conn[0].startup = manual Jun 11 23:10:46.960460 np0000002687 nova-compute[98431]: node.conn[0].tcp.window_size = 524288 Jun 11 23:10:46.960460 np0000002687 nova-compute[98431]: node.conn[0].tcp.type_of_service = 0 Jun 11 23:10:46.960460 np0000002687 nova-compute[98431]: node.conn[0].timeo.logout_timeout = 15 Jun 11 23:10:46.960460 np0000002687 nova-compute[98431]: node.conn[0].timeo.login_timeout = 15 Jun 11 23:10:46.960460 np0000002687 nova-compute[98431]: node.conn[0].timeo.auth_timeout = 45 Jun 11 23:10:46.960460 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_interval = 5 Jun 11 23:10:46.960460 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_timeout = 5 Jun 11 23:10:46.960460 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 11 23:10:46.960460 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 11 23:10:46.960460 np0000002687 nova-compute[98431]: node.conn[0].iscsi.HeaderDigest = None Jun 11 23:10:46.960460 np0000002687 nova-compute[98431]: node.conn[0].iscsi.DataDigest = None Jun 11 23:10:46.960460 np0000002687 nova-compute[98431]: node.conn[0].iscsi.IFMarker = No Jun 11 23:10:46.960460 np0000002687 nova-compute[98431]: node.conn[0].iscsi.OFMarker = No Jun 11 23:10:46.960460 np0000002687 nova-compute[98431]: # END RECORD Jun 11 23:10:46.960460 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:10:46.965373 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 11 23:10:46.965373 np0000002687 nova-compute[98431]: node.name = iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 Jun 11 23:10:46.965373 np0000002687 nova-compute[98431]: node.tpgt = -1 Jun 11 23:10:46.965373 np0000002687 nova-compute[98431]: node.startup = manual Jun 11 23:10:46.965373 np0000002687 nova-compute[98431]: node.leading_login = No Jun 11 23:10:46.965373 np0000002687 nova-compute[98431]: iface.iscsi_ifacename = default Jun 11 23:10:46.965373 np0000002687 nova-compute[98431]: iface.net_ifacename = Jun 11 23:10:46.965373 np0000002687 nova-compute[98431]: iface.ipaddress = Jun 11 23:10:46.965373 np0000002687 nova-compute[98431]: iface.prefix_len = 0 Jun 11 23:10:46.965373 np0000002687 nova-compute[98431]: iface.hwaddress = Jun 11 23:10:46.965373 np0000002687 nova-compute[98431]: iface.transport_name = tcp Jun 11 23:10:46.965373 np0000002687 nova-compute[98431]: iface.initiatorname = Jun 11 23:10:46.965373 np0000002687 nova-compute[98431]: iface.state = Jun 11 23:10:46.965373 np0000002687 nova-compute[98431]: iface.vlan_id = 0 Jun 11 23:10:46.965373 np0000002687 nova-compute[98431]: iface.vlan_priority = 0 Jun 11 23:10:46.965373 np0000002687 nova-compute[98431]: iface.vlan_state = Jun 11 23:10:46.965373 np0000002687 nova-compute[98431]: iface.iface_num = 0 Jun 11 23:10:46.965373 np0000002687 nova-compute[98431]: iface.mtu = 0 Jun 11 23:10:46.965373 np0000002687 nova-compute[98431]: iface.port = 0 Jun 11 23:10:46.965373 np0000002687 nova-compute[98431]: iface.bootproto = Jun 11 23:10:46.965373 np0000002687 nova-compute[98431]: iface.subnet_mask = Jun 11 23:10:46.965373 np0000002687 nova-compute[98431]: iface.gateway = Jun 11 23:10:46.965373 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id_state = Jun 11 23:10:46.965373 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id = Jun 11 23:10:46.965373 np0000002687 nova-compute[98431]: iface.dhcp_dns = Jun 11 23:10:46.965373 np0000002687 nova-compute[98431]: iface.dhcp_learn_iqn = Jun 11 23:10:46.965373 np0000002687 nova-compute[98431]: iface.dhcp_req_vendor_id_state = Jun 11 23:10:46.965373 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id_state = Jun 11 23:10:46.965373 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id = Jun 11 23:10:46.965373 np0000002687 nova-compute[98431]: iface.dhcp_slp_da = Jun 11 23:10:46.965373 np0000002687 nova-compute[98431]: iface.fragmentation = Jun 11 23:10:46.965373 np0000002687 nova-compute[98431]: iface.gratuitous_arp = Jun 11 23:10:46.965373 np0000002687 nova-compute[98431]: iface.incoming_forwarding = Jun 11 23:10:46.965373 np0000002687 nova-compute[98431]: iface.tos_state = Jun 11 23:10:46.965373 np0000002687 nova-compute[98431]: iface.tos = 0 Jun 11 23:10:46.965373 np0000002687 nova-compute[98431]: iface.ttl = 0 Jun 11 23:10:46.965373 np0000002687 nova-compute[98431]: iface.delayed_ack = Jun 11 23:10:46.965373 np0000002687 nova-compute[98431]: iface.tcp_nagle = Jun 11 23:10:46.965373 np0000002687 nova-compute[98431]: iface.tcp_wsf_state = Jun 11 23:10:46.965373 np0000002687 nova-compute[98431]: iface.tcp_wsf = 0 Jun 11 23:10:46.965373 np0000002687 nova-compute[98431]: iface.tcp_timer_scale = 0 Jun 11 23:10:46.965373 np0000002687 nova-compute[98431]: iface.tcp_timestamp = Jun 11 23:10:46.965373 np0000002687 nova-compute[98431]: iface.redirect = Jun 11 23:10:46.965373 np0000002687 nova-compute[98431]: iface.def_task_mgmt_timeout = 0 Jun 11 23:10:46.965373 np0000002687 nova-compute[98431]: iface.header_digest = Jun 11 23:10:46.965373 np0000002687 nova-compute[98431]: iface.data_digest = Jun 11 23:10:46.965373 np0000002687 nova-compute[98431]: iface.immediate_data = Jun 11 23:10:46.965373 np0000002687 nova-compute[98431]: iface.initial_r2t = Jun 11 23:10:46.965373 np0000002687 nova-compute[98431]: iface.data_seq_inorder = Jun 11 23:10:46.965373 np0000002687 nova-compute[98431]: iface.data_pdu_inorder = Jun 11 23:10:46.965373 np0000002687 nova-compute[98431]: iface.erl = 0 Jun 11 23:10:46.965373 np0000002687 nova-compute[98431]: iface.max_receive_data_len = 0 Jun 11 23:10:46.965373 np0000002687 nova-compute[98431]: iface.first_burst_len = 0 Jun 11 23:10:46.965373 np0000002687 nova-compute[98431]: iface.max_outstanding_r2t = 0 Jun 11 23:10:46.965373 np0000002687 nova-compute[98431]: iface.max_burst_len = 0 Jun 11 23:10:46.965373 np0000002687 nova-compute[98431]: iface.chap_auth = Jun 11 23:10:46.965373 np0000002687 nova-compute[98431]: iface.bidi_chap = Jun 11 23:10:46.965373 np0000002687 nova-compute[98431]: iface.strict_login_compliance = Jun 11 23:10:46.965373 np0000002687 nova-compute[98431]: iface.discovery_auth = Jun 11 23:10:46.965373 np0000002687 nova-compute[98431]: iface.discovery_logout = Jun 11 23:10:46.965373 np0000002687 nova-compute[98431]: node.discovery_address = Jun 11 23:10:46.965373 np0000002687 nova-compute[98431]: node.discovery_port = 0 Jun 11 23:10:46.965373 np0000002687 nova-compute[98431]: node.discovery_type = fw Jun 11 23:10:46.965373 np0000002687 nova-compute[98431]: node.session.initial_cmdsn = 0 Jun 11 23:10:46.965373 np0000002687 nova-compute[98431]: node.session.initial_login_retry_max = 8 Jun 11 23:10:46.965373 np0000002687 nova-compute[98431]: node.session.xmit_thread_priority = 0 Jun 11 23:10:46.965373 np0000002687 nova-compute[98431]: node.session.cmds_max = 128 Jun 11 23:10:46.965373 np0000002687 nova-compute[98431]: node.session.queue_depth = 32 Jun 11 23:10:46.965373 np0000002687 nova-compute[98431]: node.session.nr_sessions = 1 Jun 11 23:10:46.965373 np0000002687 nova-compute[98431]: node.session.auth.authmethod = None Jun 11 23:10:46.965373 np0000002687 nova-compute[98431]: node.session.auth.username = Jun 11 23:10:46.965373 np0000002687 nova-compute[98431]: node.session.auth.password = *** Jun 11 23:10:46.965373 np0000002687 nova-compute[98431]: node.session.auth.username_in = Jun 11 23:10:46.965373 np0000002687 nova-compute[98431]: node.session.auth.password_in = Jun 11 23:10:46.965373 np0000002687 nova-compute[98431]: node.session.auth.chap_algs = SHA256 Jun 11 23:10:46.965373 np0000002687 nova-compute[98431]: node.session.timeo.replacement_timeout = 120 Jun 11 23:10:46.965373 np0000002687 nova-compute[98431]: node.session.err_timeo.abort_timeout = 15 Jun 11 23:10:46.965373 np0000002687 nova-compute[98431]: node.session.err_timeo.lu_reset_timeout = 30 Jun 11 23:10:46.965373 np0000002687 nova-compute[98431]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 11 23:10:46.965373 np0000002687 nova-compute[98431]: node.session.err_timeo.host_reset_timeout = 60 Jun 11 23:10:46.965373 np0000002687 nova-compute[98431]: node.session.iscsi.FastAbort = Yes Jun 11 23:10:46.965373 np0000002687 nova-compute[98431]: node.session.iscsi.InitialR2T = No Jun 11 23:10:46.965373 np0000002687 nova-compute[98431]: node.session.iscsi.ImmediateData = Yes Jun 11 23:10:46.965373 np0000002687 nova-compute[98431]: node.session.iscsi.FirstBurstLength = 262144 Jun 11 23:10:46.965373 np0000002687 nova-compute[98431]: node.session.iscsi.MaxBurstLength = 16776192 Jun 11 23:10:46.965373 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Retain = 0 Jun 11 23:10:46.965373 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Wait = 2 Jun 11 23:10:46.965373 np0000002687 nova-compute[98431]: node.session.iscsi.MaxConnections = 1 Jun 11 23:10:46.965373 np0000002687 nova-compute[98431]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 11 23:10:46.965373 np0000002687 nova-compute[98431]: node.session.iscsi.ERL = 0 Jun 11 23:10:46.965373 np0000002687 nova-compute[98431]: node.session.scan = auto Jun 11 23:10:46.965373 np0000002687 nova-compute[98431]: node.session.reopen_max = 0 Jun 11 23:10:46.965373 np0000002687 nova-compute[98431]: node.conn[0].address = 192.168.40.100 Jun 11 23:10:46.965373 np0000002687 nova-compute[98431]: node.conn[0].port = 3260 Jun 11 23:10:46.965373 np0000002687 nova-compute[98431]: node.conn[0].startup = manual Jun 11 23:10:46.965373 np0000002687 nova-compute[98431]: node.conn[0].tcp.window_size = 524288 Jun 11 23:10:46.965373 np0000002687 nova-compute[98431]: node.conn[0].tcp.type_of_service = 0 Jun 11 23:10:46.965373 np0000002687 nova-compute[98431]: node.conn[0].timeo.logout_timeout = 15 Jun 11 23:10:46.965373 np0000002687 nova-compute[98431]: node.conn[0].timeo.login_timeout = 15 Jun 11 23:10:46.965373 np0000002687 nova-compute[98431]: node.conn[0].timeo.auth_timeout = 45 Jun 11 23:10:46.965373 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_interval = 5 Jun 11 23:10:46.965373 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_timeout = 5 Jun 11 23:10:46.965373 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 11 23:10:46.965373 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 11 23:10:46.965373 np0000002687 nova-compute[98431]: node.conn[0].iscsi.HeaderDigest = None Jun 11 23:10:46.965373 np0000002687 nova-compute[98431]: node.conn[0].iscsi.DataDigest = None Jun 11 23:10:46.965373 np0000002687 nova-compute[98431]: node.conn[0].iscsi.IFMarker = No Jun 11 23:10:46.965373 np0000002687 nova-compute[98431]: node.conn[0].iscsi.OFMarker = No Jun 11 23:10:46.965373 np0000002687 nova-compute[98431]: # END RECORD Jun 11 23:10:46.965373 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:10:46.970555 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:10:46.976355 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:10:46.980891 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions. Jun 11 23:10:46.980891 np0000002687 nova-compute[98431]: {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:10:46.980891 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions. Jun 11 23:10:46.980891 np0000002687 nova-compute[98431]: {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:10:46.981101 np0000002687 nova-compute[98431]: WARNING os_brick.initiator.connectors.iscsi [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions. Jun 11 23:10:46.981101 np0000002687 nova-compute[98431]: Jun 11 23:10:46.985619 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions. Jun 11 23:10:46.985619 np0000002687 nova-compute[98431]: {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:10:46.985702 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions. Jun 11 23:10:46.985702 np0000002687 nova-compute[98431]: {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:10:46.985810 np0000002687 nova-compute[98431]: WARNING os_brick.initiator.connectors.iscsi [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions. Jun 11 23:10:46.985810 np0000002687 nova-compute[98431]: Jun 11 23:10:47.023077 np0000002687 nova-compute[98431]: DEBUG nova.scheduler.client.report [None req-dd35667d-ea77-4781-83f8-7bdecb4c5828 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] Inventory has not changed for provider e3e65fe2-9de9-4821-8b4a-ccae37c66e25 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98431) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 11 23:10:47.148580 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] [instance: 27ac8c84-e5db-4bd1-a148-ec5834c5b39c] Starting instance... {{(pid=98431) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 11 23:10:47.186681 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] [instance: 14699717-b93f-4e67-b841-c67de8fff8d4] Starting instance... {{(pid=98431) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 11 23:10:47.199349 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Acquiring lock "refresh_cache-36688d94-68d3-4ae3-989a-b391d7ee4ad9" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 11 23:10:47.236297 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [req-79c838d4-589b-40f6-86a1-acf0345d2f51 req-0538b258-dc14-477f-9ef3-1cc952935ef3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:10:47.263129 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:10:47.264490 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Emitting event Paused> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:10:47.264618 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] VM Paused (Lifecycle Event) Jun 11 23:10:47.292840 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-79c838d4-589b-40f6-86a1-acf0345d2f51 req-0538b258-dc14-477f-9ef3-1cc952935ef3 service nova] [instance: 36688d94-68d3-4ae3-989a-b391d7ee4ad9] Instance cache missing network info. {{(pid=98431) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 11 23:10:47.421910 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-79c838d4-589b-40f6-86a1-acf0345d2f51 req-0538b258-dc14-477f-9ef3-1cc952935ef3 service nova] [instance: 36688d94-68d3-4ae3-989a-b391d7ee4ad9] Updating instance_info_cache with network_info: [] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:10:47.434246 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:47.528912 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-dd35667d-ea77-4781-83f8-7bdecb4c5828 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.353s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:10:47.529241 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-dd35667d-ea77-4781-83f8-7bdecb4c5828 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] [instance: 73abd331-0bbf-432e-be1c-308801a5429f] Start building networks asynchronously for instance. {{(pid=98431) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 11 23:10:47.578214 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:47.587200 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Acquiring lock "49a042ba-28ba-4401-9bdf-92f96da8f80e" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:10:47.587378 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Lock "49a042ba-28ba-4401-9bdf-92f96da8f80e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:10:47.693327 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:10:47.693666 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:10:47.697038 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98431) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 11 23:10:47.697155 np0000002687 nova-compute[98431]: INFO nova.compute.claims [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] [instance: 27ac8c84-e5db-4bd1-a148-ec5834c5b39c] Claim successful on node np0000002687 Jun 11 23:10:47.699917 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] [instance: 36688d94-68d3-4ae3-989a-b391d7ee4ad9] Start spawning the instance on the hypervisor. {{(pid=98431) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 11 23:10:47.701157 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] [instance: 36688d94-68d3-4ae3-989a-b391d7ee4ad9] Creating instance directory {{(pid=98431) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}} Jun 11 23:10:47.701478 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] [instance: 36688d94-68d3-4ae3-989a-b391d7ee4ad9] Creating image(s) Jun 11 23:10:47.702194 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Acquiring lock "/opt/stack/data/nova/instances/36688d94-68d3-4ae3-989a-b391d7ee4ad9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:10:47.702514 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Lock "/opt/stack/data/nova/instances/36688d94-68d3-4ae3-989a-b391d7ee4ad9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:10:47.702838 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Lock "/opt/stack/data/nova/instances/36688d94-68d3-4ae3-989a-b391d7ee4ad9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:10:47.703151 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Acquiring lock "d21589f501ef49652e775218cd6081501e5a0d9a" by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:10:47.703649 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Lock "d21589f501ef49652e775218cd6081501e5a0d9a" acquired by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:10:47.760190 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:10:47.766738 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:10:47.768509 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98431) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 11 23:10:47.923693 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-79c838d4-589b-40f6-86a1-acf0345d2f51 req-0538b258-dc14-477f-9ef3-1cc952935ef3 service nova] Releasing lock "refresh_cache-36688d94-68d3-4ae3-989a-b391d7ee4ad9" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 11 23:10:47.924187 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Acquired lock "refresh_cache-36688d94-68d3-4ae3-989a-b391d7ee4ad9" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 11 23:10:47.924361 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] [instance: 36688d94-68d3-4ae3-989a-b391d7ee4ad9] Building network info cache for instance {{(pid=98431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 11 23:10:48.015342 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9, portal: 192.168.50.100,3260] Jun 11 23:10:48.015342 np0000002687 nova-compute[98431]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9, portal: 192.168.50.100,3260] successful. Jun 11 23:10:48.015342 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:10:48.020142 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9, portal: 192.168.40.100,3260] Jun 11 23:10:48.020142 np0000002687 nova-compute[98431]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9, portal: 192.168.40.100,3260] successful. Jun 11 23:10:48.020142 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:10:48.024971 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:10:48.035184 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-dd35667d-ea77-4781-83f8-7bdecb4c5828 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] [instance: 73abd331-0bbf-432e-be1c-308801a5429f] Allocating IP information in the background. {{(pid=98431) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 11 23:10:48.035391 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-dd35667d-ea77-4781-83f8-7bdecb4c5828 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] [instance: 73abd331-0bbf-432e-be1c-308801a5429f] allocate_for_instance() {{(pid=98431) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 11 23:10:48.035731 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-dd35667d-ea77-4781-83f8-7bdecb4c5828 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:10:48.037571 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:10:48.037990 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-dd35667d-ea77-4781-83f8-7bdecb4c5828 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:10:48.040745 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:10:48.040745 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:10:48.040745 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:10:48.040910 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:10:48.040910 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:10:48.040910 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:10:48.041247 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.115s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 11 23:10:48.041573 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Connected to 192.168.50.100:3260 {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 11 23:10:48.042432 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] HCTL ('7', '-', '-', 0) found on session 3 with lun 0 {{(pid=98431) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 11 23:10:48.042602 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98431) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 11 23:10:48.051264 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:10:48.051264 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:10:48.051264 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:10:48.051443 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:10:48.051443 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:10:48.051443 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:10:48.051715 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.126s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 11 23:10:48.052010 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Connected to 192.168.40.100:3260 {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 11 23:10:48.052919 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] HCTL ('8', '-', '-', 0) found on session 4 with lun 0 {{(pid=98431) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 11 23:10:48.053041 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98431) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 11 23:10:48.063938 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Searching for a device in session 3 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98431) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 11 23:10:48.064126 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '51510c5e-80aa-4db3-9246-3becbd15cde9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 11 23:10:48.070545 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Searching for a device in session 4 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98431) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 11 23:10:48.070545 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '51510c5e-80aa-4db3-9246-3becbd15cde9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 11 23:10:48.089490 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Starting instance... {{(pid=98431) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 11 23:10:48.186602 np0000002687 nova-compute[98431]: DEBUG nova.policy [None req-dd35667d-ea77-4781-83f8-7bdecb4c5828 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fe97a7ae092d47588d6656d03aace2d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bddeb2fac9c34c65996201c81b5c77e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98431) authorize /opt/stack/nova/nova/policy.py:192}} Jun 11 23:10:48.271168 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] During sync_power_state the instance has a pending task (spawning). Skip. Jun 11 23:10:48.515985 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] [instance: 36688d94-68d3-4ae3-989a-b391d7ee4ad9] Instance cache missing network info. {{(pid=98431) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 11 23:10:48.537352 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-dd35667d-ea77-4781-83f8-7bdecb4c5828 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] [instance: 73abd331-0bbf-432e-be1c-308801a5429f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 11 23:10:48.551923 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:10:48.556955 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:10:48.557668 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d21589f501ef49652e775218cd6081501e5a0d9a.part --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:10:48.578045 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-c725202a-357a-4eda-bcfc-174ed5551358 req-f19d0d2b-9346-4f77-9889-54b471efbdb4 service nova] [instance: 689e510d-e0a4-4d6a-958e-9acfaebedc87] Received event network-vif-unplugged-65f7170b-ae97-4cd6-93a1-7dd5111b7978 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:10:48.578362 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-c725202a-357a-4eda-bcfc-174ed5551358 req-f19d0d2b-9346-4f77-9889-54b471efbdb4 service nova] Acquiring lock "689e510d-e0a4-4d6a-958e-9acfaebedc87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:10:48.578557 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-c725202a-357a-4eda-bcfc-174ed5551358 req-f19d0d2b-9346-4f77-9889-54b471efbdb4 service nova] Lock "689e510d-e0a4-4d6a-958e-9acfaebedc87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:10:48.578688 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-c725202a-357a-4eda-bcfc-174ed5551358 req-f19d0d2b-9346-4f77-9889-54b471efbdb4 service nova] Lock "689e510d-e0a4-4d6a-958e-9acfaebedc87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:10:48.578849 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-c725202a-357a-4eda-bcfc-174ed5551358 req-f19d0d2b-9346-4f77-9889-54b471efbdb4 service nova] [instance: 689e510d-e0a4-4d6a-958e-9acfaebedc87] No event matching network-vif-unplugged-65f7170b-ae97-4cd6-93a1-7dd5111b7978 in dict_keys([('network-vif-plugged', '65f7170b-ae97-4cd6-93a1-7dd5111b7978')]) {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jun 11 23:10:48.579571 np0000002687 nova-compute[98431]: WARNING nova.compute.manager [req-c725202a-357a-4eda-bcfc-174ed5551358 req-f19d0d2b-9346-4f77-9889-54b471efbdb4 service nova] [instance: 689e510d-e0a4-4d6a-958e-9acfaebedc87] Received unexpected event network-vif-unplugged-65f7170b-ae97-4cd6-93a1-7dd5111b7978 for instance with vm_state building and task_state spawning. Jun 11 23:10:48.628335 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d21589f501ef49652e775218cd6081501e5a0d9a.part --force-share --output=json" returned: 0 in 0.071s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:10:48.628894 np0000002687 nova-compute[98431]: DEBUG nova.virt.images [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] 65e91f66-f375-4f5e-9b57-399258d96eca was qcow2, converting to raw {{(pid=98431) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}} Jun 11 23:10:48.629587 np0000002687 nova-compute[98431]: DEBUG nova.privsep.utils [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98431) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}} Jun 11 23:10:48.630198 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d21589f501ef49652e775218cd6081501e5a0d9a.part /opt/stack/data/nova/instances/_base/d21589f501ef49652e775218cd6081501e5a0d9a.converted {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:10:48.663540 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:10:48.785644 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-dd35667d-ea77-4781-83f8-7bdecb4c5828 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] [instance: 73abd331-0bbf-432e-be1c-308801a5429f] Successfully created port: d1203b92-b9d5-4d1c-bc39-326783c31294 {{(pid=98431) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 11 23:10:48.807047 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d21589f501ef49652e775218cd6081501e5a0d9a.part /opt/stack/data/nova/instances/_base/d21589f501ef49652e775218cd6081501e5a0d9a.converted" returned: 0 in 0.177s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:10:48.813664 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d21589f501ef49652e775218cd6081501e5a0d9a.converted --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:10:48.896545 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:10:48.898547 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d21589f501ef49652e775218cd6081501e5a0d9a.converted --force-share --output=json" returned: 0 in 0.085s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:10:48.899289 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Lock "d21589f501ef49652e775218cd6081501e5a0d9a" "released" by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" :: held 1.196s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:10:48.899693 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:10:48.902427 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:10:48.903473 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d21589f501ef49652e775218cd6081501e5a0d9a --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:10:48.927415 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98431) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 11 23:10:48.973157 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d21589f501ef49652e775218cd6081501e5a0d9a --force-share --output=json" returned: 0 in 0.069s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:10:48.973553 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Acquiring lock "d21589f501ef49652e775218cd6081501e5a0d9a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:10:48.974036 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Lock "d21589f501ef49652e775218cd6081501e5a0d9a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:10:48.974464 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:10:48.977194 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:10:48.977592 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d21589f501ef49652e775218cd6081501e5a0d9a --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:10:49.037002 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d21589f501ef49652e775218cd6081501e5a0d9a --force-share --output=json" returned: 0 in 0.059s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:10:49.037344 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d21589f501ef49652e775218cd6081501e5a0d9a,backing_fmt=raw /opt/stack/data/nova/instances/36688d94-68d3-4ae3-989a-b391d7ee4ad9/disk 1073741824 {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:10:49.047403 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-dd35667d-ea77-4781-83f8-7bdecb4c5828 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] [instance: 73abd331-0bbf-432e-be1c-308801a5429f] Start building block device mappings for instance. {{(pid=98431) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 11 23:10:49.066601 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d21589f501ef49652e775218cd6081501e5a0d9a,backing_fmt=raw /opt/stack/data/nova/instances/36688d94-68d3-4ae3-989a-b391d7ee4ad9/disk 1073741824" returned: 0 in 0.029s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:10:49.067333 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Lock "d21589f501ef49652e775218cd6081501e5a0d9a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.093s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:10:49.067333 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d21589f501ef49652e775218cd6081501e5a0d9a --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:10:49.086152 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] [instance: 36688d94-68d3-4ae3-989a-b391d7ee4ad9] Updating instance_info_cache with network_info: [{"id": "6075e13d-d32a-4d8f-8741-a4686059985e", "address": "fa:16:3e:8e:89:22", "network": {"id": "e87d6560-c7a9-4b70-83f1-b0863de32387", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1405293341-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ae41a1c4221b4e7483281a8b80f16ee6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6075e13d-d3", "ovs_interfaceid": "6075e13d-d32a-4d8f-8741-a4686059985e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:10:49.128298 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d21589f501ef49652e775218cd6081501e5a0d9a --force-share --output=json" returned: 0 in 0.061s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:10:49.129710 np0000002687 nova-compute[98431]: DEBUG nova.virt.disk.api [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Checking if we can resize image /opt/stack/data/nova/instances/36688d94-68d3-4ae3-989a-b391d7ee4ad9/disk. size=1073741824 {{(pid=98431) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 11 23:10:49.129710 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36688d94-68d3-4ae3-989a-b391d7ee4ad9/disk --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:10:49.194233 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36688d94-68d3-4ae3-989a-b391d7ee4ad9/disk --force-share --output=json" returned: 0 in 0.065s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:10:49.194591 np0000002687 nova-compute[98431]: DEBUG nova.virt.disk.api [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Cannot resize image /opt/stack/data/nova/instances/36688d94-68d3-4ae3-989a-b391d7ee4ad9/disk to a smaller size. {{(pid=98431) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 11 23:10:49.194951 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] [instance: 36688d94-68d3-4ae3-989a-b391d7ee4ad9] Created local disks {{(pid=98431) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}} Jun 11 23:10:49.195118 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] [instance: 36688d94-68d3-4ae3-989a-b391d7ee4ad9] Ensure instance console log exists: /opt/stack/data/nova/instances/36688d94-68d3-4ae3-989a-b391d7ee4ad9/console.log {{(pid=98431) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}} Jun 11 23:10:49.195384 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:10:49.195601 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:10:49.195737 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:10:49.317058 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98431) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 11 23:10:49.317289 np0000002687 nova-compute[98431]: DEBUG nova.compute.provider_tree [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Inventory has not changed in ProviderTree for provider: e3e65fe2-9de9-4821-8b4a-ccae37c66e25 {{(pid=98431) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 11 23:10:49.544862 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-dd35667d-ea77-4781-83f8-7bdecb4c5828 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] [instance: 73abd331-0bbf-432e-be1c-308801a5429f] Successfully updated port: d1203b92-b9d5-4d1c-bc39-326783c31294 {{(pid=98431) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 11 23:10:49.589257 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Releasing lock "refresh_cache-36688d94-68d3-4ae3-989a-b391d7ee4ad9" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 11 23:10:49.589574 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] [instance: 36688d94-68d3-4ae3-989a-b391d7ee4ad9] Instance network_info: |[{"id": "6075e13d-d32a-4d8f-8741-a4686059985e", "address": "fa:16:3e:8e:89:22", "network": {"id": "e87d6560-c7a9-4b70-83f1-b0863de32387", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1405293341-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ae41a1c4221b4e7483281a8b80f16ee6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6075e13d-d3", "ovs_interfaceid": "6075e13d-d32a-4d8f-8741-a4686059985e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98431) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 11 23:10:49.591574 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] [instance: 36688d94-68d3-4ae3-989a-b391d7ee4ad9] Start _get_guest_xml network_info=[{"id": "6075e13d-d32a-4d8f-8741-a4686059985e", "address": "fa:16:3e:8e:89:22", "network": {"id": "e87d6560-c7a9-4b70-83f1-b0863de32387", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1405293341-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ae41a1c4221b4e7483281a8b80f16ee6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6075e13d-d3", "ovs_interfaceid": "6075e13d-d32a-4d8f-8741-a4686059985e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-11T23:10:35Z,direct_url=,disk_format='qcow2',id=65e91f66-f375-4f5e-9b57-399258d96eca,min_disk=0,min_ram=0,name='',owner='4693972584654b1e9c2f1989feadc57b',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-11T23:10:37Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'device_name': '/dev/sda', 'boot_index': 0, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'scsi', 'encryption_format': None, 'encrypted': False, 'image_id': '65e91f66-f375-4f5e-9b57-399258d96eca'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98431) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 11 23:10:49.593360 np0000002687 nova-compute[98431]: WARNING nova.virt.libvirt.driver [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 11 23:10:49.594964 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='65e91f66-f375-4f5e-9b57-399258d96eca', instance_meta=NovaInstanceMeta(name='tempest-AttachSCSIVolumeTestJSON-server-1868622634', uuid='36688d94-68d3-4ae3-989a-b391d7ee4ad9'), owner=OwnerMeta(userid='776c0e8b8bb74ffea6010d632b9ba0d0', username='tempest-AttachSCSIVolumeTestJSON-613359672-project-member', projectid='ae41a1c4221b4e7483281a8b80f16ee6', projectname='tempest-AttachSCSIVolumeTestJSON-613359672'), image=ImageMeta(id='65e91f66-f375-4f5e-9b57-399258d96eca', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'scsi', 'hw_disk_bus': 'scsi', 'hw_scsi_model': 'virtio-scsi'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "6075e13d-d32a-4d8f-8741-a4686059985e", "address": "fa:16:3e:8e:89:22", "network": {"id": "e87d6560-c7a9-4b70-83f1-b0863de32387", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1405293341-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ae41a1c4221b4e7483281a8b80f16ee6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6075e13d-d3", "ovs_interfaceid": "6075e13d-d32a-4d8f-8741-a4686059985e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1781219449.5944612) {{(pid=98431) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 11 23:10:49.595921 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Searching host: 'np0000002687' for CPU controller through CGroups V1... {{(pid=98431) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 11 23:10:49.596281 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] CPU controller missing on host. {{(pid=98431) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 11 23:10:49.597485 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Searching host: 'np0000002687' for CPU controller through CGroups V2... {{(pid=98431) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 11 23:10:49.597647 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] CPU controller found on host. {{(pid=98431) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 11 23:10:49.598552 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98431) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 11 23:10:49.598878 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-11T23:08:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-11T23:10:35Z,direct_url=,disk_format='qcow2',id=65e91f66-f375-4f5e-9b57-399258d96eca,min_disk=0,min_ram=0,name='',owner='4693972584654b1e9c2f1989feadc57b',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-11T23:10:37Z,virtual_size=,visibility=), allow threads: True {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 11 23:10:49.599021 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Flavor limits 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 11 23:10:49.599089 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Image limits 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 11 23:10:49.599202 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Flavor pref 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 11 23:10:49.599459 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Image pref 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 11 23:10:49.599459 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 11 23:10:49.599610 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 11 23:10:49.599610 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98431) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 11 23:10:49.599733 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Got 1 possible topologies {{(pid=98431) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 11 23:10:49.599954 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 11 23:10:49.599954 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 11 23:10:49.610657 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-11T23:10:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1868622634',display_name='tempest-AttachSCSIVolumeTestJSON-server-1868622634',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='tempest-attachscsivolumetestjson-server-1868622634',id=5,image_ref='65e91f66-f375-4f5e-9b57-399258d96eca',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF1thjFvorvXqsEH/7y5pYr+XHh+/ziAmsipnoBI0/9KJESyszMx6EprZ77ONfMl5p2ViNQRpHNo2K7BPs6Tmw9iYp3BPUj79pp4DPz6glAqMmKCXoLegWno83hW4fAPmg==',key_name='tempest-keypair-243904066',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ae41a1c4221b4e7483281a8b80f16ee6',ramdisk_id='',reservation_id='r-52nfjfhu',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='65e91f66-f375-4f5e-9b57-399258d96eca',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-613359672',owner_user_name='tempest-AttachSCSIVolumeTestJSON-613359672-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-11T23:10:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='776c0e8b8bb74ffea6010d632b9ba0d0',uuid=36688d94-68d3-4ae3-989a-b391d7ee4ad9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6075e13d-d32a-4d8f-8741-a4686059985e", "address": "fa:16:3e:8e:89:22", "network": {"id": "e87d6560-c7a9-4b70-83f1-b0863de32387", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1405293341-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ae41a1c4221b4e7483281a8b80f16ee6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6075e13d-d3", "ovs_interfaceid": "6075e13d-d32a-4d8f-8741-a4686059985e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98431) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 11 23:10:49.610861 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Converting VIF {"id": "6075e13d-d32a-4d8f-8741-a4686059985e", "address": "fa:16:3e:8e:89:22", "network": {"id": "e87d6560-c7a9-4b70-83f1-b0863de32387", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1405293341-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ae41a1c4221b4e7483281a8b80f16ee6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6075e13d-d3", "ovs_interfaceid": "6075e13d-d32a-4d8f-8741-a4686059985e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:10:49.611484 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:89:22,bridge_name='br-int',has_traffic_filtering=True,id=6075e13d-d32a-4d8f-8741-a4686059985e,network=Network(e87d6560-c7a9-4b70-83f1-b0863de32387),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6075e13d-d3') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:10:49.612057 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Lazy-loading 'pci_devices' on Instance uuid 36688d94-68d3-4ae3-989a-b391d7ee4ad9 {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:10:49.820146 np0000002687 nova-compute[98431]: DEBUG nova.scheduler.client.report [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Inventory has not changed for provider e3e65fe2-9de9-4821-8b4a-ccae37c66e25 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98431) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 11 23:10:49.941418 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Found WWN 330000000e49e5703 for multipath device dm-0 {{(pid=98431) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 11 23:10:49.941751 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.030s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 11 23:10:49.941944 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] <== connect_volume: return (4031ms) {'type': 'block', 'scsi_wwn': '330000000e49e5703', 'path': '/dev/dm-0', 'multipath_id': '330000000e49e5703'} {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 11 23:10:49.942064 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: de4372a4-a0cc-4541-a5a2-87be3152c50e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000e49e5703', 'path': '/dev/dm-0', 'multipath_id': '330000000e49e5703'} {{(pid=98431) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 11 23:10:50.048780 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-dd35667d-ea77-4781-83f8-7bdecb4c5828 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] Acquiring lock "refresh_cache-73abd331-0bbf-432e-be1c-308801a5429f" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 11 23:10:50.048780 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-dd35667d-ea77-4781-83f8-7bdecb4c5828 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] Acquired lock "refresh_cache-73abd331-0bbf-432e-be1c-308801a5429f" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 11 23:10:50.048780 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-dd35667d-ea77-4781-83f8-7bdecb4c5828 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] [instance: 73abd331-0bbf-432e-be1c-308801a5429f] Building network info cache for instance {{(pid=98431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 11 23:10:50.058047 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-dd35667d-ea77-4781-83f8-7bdecb4c5828 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] [instance: 73abd331-0bbf-432e-be1c-308801a5429f] Start spawning the instance on the hypervisor. {{(pid=98431) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 11 23:10:50.059171 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-dd35667d-ea77-4781-83f8-7bdecb4c5828 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] [instance: 73abd331-0bbf-432e-be1c-308801a5429f] Creating instance directory {{(pid=98431) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}} Jun 11 23:10:50.059417 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-dd35667d-ea77-4781-83f8-7bdecb4c5828 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] [instance: 73abd331-0bbf-432e-be1c-308801a5429f] Creating image(s) Jun 11 23:10:50.059860 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-dd35667d-ea77-4781-83f8-7bdecb4c5828 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] Acquiring lock "/opt/stack/data/nova/instances/73abd331-0bbf-432e-be1c-308801a5429f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:10:50.060025 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-dd35667d-ea77-4781-83f8-7bdecb4c5828 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] Lock "/opt/stack/data/nova/instances/73abd331-0bbf-432e-be1c-308801a5429f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:10:50.060485 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-dd35667d-ea77-4781-83f8-7bdecb4c5828 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] Lock "/opt/stack/data/nova/instances/73abd331-0bbf-432e-be1c-308801a5429f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:10:50.060947 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-dd35667d-ea77-4781-83f8-7bdecb4c5828 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:10:50.063470 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-dd35667d-ea77-4781-83f8-7bdecb4c5828 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:10:50.064380 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-dd35667d-ea77-4781-83f8-7bdecb4c5828 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:10:50.115478 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] [instance: 36688d94-68d3-4ae3-989a-b391d7ee4ad9] End _get_guest_xml xml= Jun 11 23:10:50.115478 np0000002687 nova-compute[98431]: 36688d94-68d3-4ae3-989a-b391d7ee4ad9 Jun 11 23:10:50.115478 np0000002687 nova-compute[98431]: instance-00000005 Jun 11 23:10:50.115478 np0000002687 nova-compute[98431]: 196608 Jun 11 23:10:50.115478 np0000002687 nova-compute[98431]: 1 Jun 11 23:10:50.115478 np0000002687 nova-compute[98431]: Jun 11 23:10:50.115478 np0000002687 nova-compute[98431]: Jun 11 23:10:50.115478 np0000002687 nova-compute[98431]: Jun 11 23:10:50.115478 np0000002687 nova-compute[98431]: tempest-AttachSCSIVolumeTestJSON-server-1868622634 Jun 11 23:10:50.115478 np0000002687 nova-compute[98431]: 2026-06-11 23:10:49 Jun 11 23:10:50.115478 np0000002687 nova-compute[98431]: Jun 11 23:10:50.115478 np0000002687 nova-compute[98431]: 192 Jun 11 23:10:50.115478 np0000002687 nova-compute[98431]: 1 Jun 11 23:10:50.115478 np0000002687 nova-compute[98431]: 0 Jun 11 23:10:50.115478 np0000002687 nova-compute[98431]: 0 Jun 11 23:10:50.115478 np0000002687 nova-compute[98431]: 1 Jun 11 23:10:50.115478 np0000002687 nova-compute[98431]: Jun 11 23:10:50.115478 np0000002687 nova-compute[98431]: True Jun 11 23:10:50.115478 np0000002687 nova-compute[98431]: Jun 11 23:10:50.115478 np0000002687 nova-compute[98431]: Jun 11 23:10:50.115478 np0000002687 nova-compute[98431]: Jun 11 23:10:50.115478 np0000002687 nova-compute[98431]: bare Jun 11 23:10:50.115478 np0000002687 nova-compute[98431]: qcow2 Jun 11 23:10:50.115478 np0000002687 nova-compute[98431]: 1 Jun 11 23:10:50.115478 np0000002687 nova-compute[98431]: 0 Jun 11 23:10:50.115478 np0000002687 nova-compute[98431]: Jun 11 23:10:50.115478 np0000002687 nova-compute[98431]: scsi Jun 11 23:10:50.115478 np0000002687 nova-compute[98431]: scsi Jun 11 23:10:50.115478 np0000002687 nova-compute[98431]: virtio-scsi Jun 11 23:10:50.115478 np0000002687 nova-compute[98431]: Jun 11 23:10:50.115478 np0000002687 nova-compute[98431]: Jun 11 23:10:50.115478 np0000002687 nova-compute[98431]: Jun 11 23:10:50.115478 np0000002687 nova-compute[98431]: tempest-AttachSCSIVolumeTestJSON-613359672-project-member Jun 11 23:10:50.115478 np0000002687 nova-compute[98431]: tempest-AttachSCSIVolumeTestJSON-613359672 Jun 11 23:10:50.115478 np0000002687 nova-compute[98431]: Jun 11 23:10:50.115478 np0000002687 nova-compute[98431]: Jun 11 23:10:50.115478 np0000002687 nova-compute[98431]: Jun 11 23:10:50.115478 np0000002687 nova-compute[98431]: Jun 11 23:10:50.115478 np0000002687 nova-compute[98431]: Jun 11 23:10:50.115478 np0000002687 nova-compute[98431]: Jun 11 23:10:50.115478 np0000002687 nova-compute[98431]: Jun 11 23:10:50.115478 np0000002687 nova-compute[98431]: Jun 11 23:10:50.115478 np0000002687 nova-compute[98431]: Jun 11 23:10:50.115478 np0000002687 nova-compute[98431]: Jun 11 23:10:50.115478 np0000002687 nova-compute[98431]: Jun 11 23:10:50.115478 np0000002687 nova-compute[98431]: OpenStack Foundation Jun 11 23:10:50.115478 np0000002687 nova-compute[98431]: OpenStack Nova Jun 11 23:10:50.115478 np0000002687 nova-compute[98431]: 33.1.0 Jun 11 23:10:50.115478 np0000002687 nova-compute[98431]: 36688d94-68d3-4ae3-989a-b391d7ee4ad9 Jun 11 23:10:50.115478 np0000002687 nova-compute[98431]: 36688d94-68d3-4ae3-989a-b391d7ee4ad9 Jun 11 23:10:50.115478 np0000002687 nova-compute[98431]: Virtual Machine Jun 11 23:10:50.115478 np0000002687 nova-compute[98431]: Jun 11 23:10:50.115478 np0000002687 nova-compute[98431]: Jun 11 23:10:50.115478 np0000002687 nova-compute[98431]: Jun 11 23:10:50.115478 np0000002687 nova-compute[98431]: hvm Jun 11 23:10:50.115478 np0000002687 nova-compute[98431]: Jun 11 23:10:50.115478 np0000002687 nova-compute[98431]: Jun 11 23:10:50.115478 np0000002687 nova-compute[98431]: Jun 11 23:10:50.115478 np0000002687 nova-compute[98431]: Jun 11 23:10:50.115478 np0000002687 nova-compute[98431]: Jun 11 23:10:50.115478 np0000002687 nova-compute[98431]: Jun 11 23:10:50.115478 np0000002687 nova-compute[98431]: 128 Jun 11 23:10:50.115478 np0000002687 nova-compute[98431]: Jun 11 23:10:50.115478 np0000002687 nova-compute[98431]: Jun 11 23:10:50.115478 np0000002687 nova-compute[98431]: Jun 11 23:10:50.115478 np0000002687 nova-compute[98431]: 1 Jun 11 23:10:50.115478 np0000002687 nova-compute[98431]: Jun 11 23:10:50.115478 np0000002687 nova-compute[98431]: Jun 11 23:10:50.115478 np0000002687 nova-compute[98431]: Nehalem Jun 11 23:10:50.115478 np0000002687 nova-compute[98431]: Jun 11 23:10:50.115478 np0000002687 nova-compute[98431]: Jun 11 23:10:50.115478 np0000002687 nova-compute[98431]: Jun 11 23:10:50.115478 np0000002687 nova-compute[98431]: Jun 11 23:10:50.115478 np0000002687 nova-compute[98431]: Jun 11 23:10:50.115478 np0000002687 nova-compute[98431]: Jun 11 23:10:50.115478 np0000002687 nova-compute[98431]: Jun 11 23:10:50.115478 np0000002687 nova-compute[98431]:
Jun 11 23:10:50.115478 np0000002687 nova-compute[98431]: Jun 11 23:10:50.115478 np0000002687 nova-compute[98431]: Jun 11 23:10:50.115478 np0000002687 nova-compute[98431]: Jun 11 23:10:50.115478 np0000002687 nova-compute[98431]: Jun 11 23:10:50.115478 np0000002687 nova-compute[98431]: Jun 11 23:10:50.115478 np0000002687 nova-compute[98431]:
Jun 11 23:10:50.115478 np0000002687 nova-compute[98431]: Jun 11 23:10:50.115478 np0000002687 nova-compute[98431]: Jun 11 23:10:50.115478 np0000002687 nova-compute[98431]: Jun 11 23:10:50.115478 np0000002687 nova-compute[98431]: Jun 11 23:10:50.115478 np0000002687 nova-compute[98431]: Jun 11 23:10:50.115478 np0000002687 nova-compute[98431]: Jun 11 23:10:50.115478 np0000002687 nova-compute[98431]: Jun 11 23:10:50.115478 np0000002687 nova-compute[98431]: Jun 11 23:10:50.115478 np0000002687 nova-compute[98431]: Jun 11 23:10:50.115478 np0000002687 nova-compute[98431]: Jun 11 23:10:50.115478 np0000002687 nova-compute[98431]: Jun 11 23:10:50.115478 np0000002687 nova-compute[98431]: Jun 11 23:10:50.115478 np0000002687 nova-compute[98431]: Jun 11 23:10:50.115478 np0000002687 nova-compute[98431]: Jun 11 23:10:50.115478 np0000002687 nova-compute[98431]: Jun 11 23:10:50.115478 np0000002687 nova-compute[98431]: /dev/urandom Jun 11 23:10:50.115478 np0000002687 nova-compute[98431]: Jun 11 23:10:50.115478 np0000002687 nova-compute[98431]: Jun 11 23:10:50.115478 np0000002687 nova-compute[98431]: Jun 11 23:10:50.115478 np0000002687 nova-compute[98431]: Jun 11 23:10:50.115478 np0000002687 nova-compute[98431]: Jun 11 23:10:50.115478 np0000002687 nova-compute[98431]: Jun 11 23:10:50.115478 np0000002687 nova-compute[98431]: Jun 11 23:10:50.115478 np0000002687 nova-compute[98431]: {{(pid=98431) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 11 23:10:50.117644 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] [instance: 36688d94-68d3-4ae3-989a-b391d7ee4ad9] Preparing to wait for external event network-vif-plugged-6075e13d-d32a-4d8f-8741-a4686059985e {{(pid=98431) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 11 23:10:50.117644 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Acquiring lock "36688d94-68d3-4ae3-989a-b391d7ee4ad9-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:10:50.117644 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Lock "36688d94-68d3-4ae3-989a-b391d7ee4ad9-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:10:50.117644 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Lock "36688d94-68d3-4ae3-989a-b391d7ee4ad9-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:10:50.117644 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-11T23:10:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1868622634',display_name='tempest-AttachSCSIVolumeTestJSON-server-1868622634',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='tempest-attachscsivolumetestjson-server-1868622634',id=5,image_ref='65e91f66-f375-4f5e-9b57-399258d96eca',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF1thjFvorvXqsEH/7y5pYr+XHh+/ziAmsipnoBI0/9KJESyszMx6EprZ77ONfMl5p2ViNQRpHNo2K7BPs6Tmw9iYp3BPUj79pp4DPz6glAqMmKCXoLegWno83hW4fAPmg==',key_name='tempest-keypair-243904066',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ae41a1c4221b4e7483281a8b80f16ee6',ramdisk_id='',reservation_id='r-52nfjfhu',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='65e91f66-f375-4f5e-9b57-399258d96eca',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-613359672',owner_user_name='tempest-AttachSCSIVolumeTestJSON-613359672-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-11T23:10:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='776c0e8b8bb74ffea6010d632b9ba0d0',uuid=36688d94-68d3-4ae3-989a-b391d7ee4ad9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6075e13d-d32a-4d8f-8741-a4686059985e", "address": "fa:16:3e:8e:89:22", "network": {"id": "e87d6560-c7a9-4b70-83f1-b0863de32387", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1405293341-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ae41a1c4221b4e7483281a8b80f16ee6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6075e13d-d3", "ovs_interfaceid": "6075e13d-d32a-4d8f-8741-a4686059985e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 11 23:10:50.117920 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Converting VIF {"id": "6075e13d-d32a-4d8f-8741-a4686059985e", "address": "fa:16:3e:8e:89:22", "network": {"id": "e87d6560-c7a9-4b70-83f1-b0863de32387", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1405293341-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ae41a1c4221b4e7483281a8b80f16ee6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6075e13d-d3", "ovs_interfaceid": "6075e13d-d32a-4d8f-8741-a4686059985e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:10:50.117920 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:89:22,bridge_name='br-int',has_traffic_filtering=True,id=6075e13d-d32a-4d8f-8741-a4686059985e,network=Network(e87d6560-c7a9-4b70-83f1-b0863de32387),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6075e13d-d3') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:10:50.118055 np0000002687 nova-compute[98431]: DEBUG os_vif [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:89:22,bridge_name='br-int',has_traffic_filtering=True,id=6075e13d-d32a-4d8f-8741-a4686059985e,network=Network(e87d6560-c7a9-4b70-83f1-b0863de32387),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6075e13d-d3') {{(pid=98431) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 11 23:10:50.118328 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:50.118613 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:10:50.118895 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 11 23:10:50.119495 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:50.119618 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c24200f5-e119-5be0-a908-d684d698414c', '_type': 'linux-noop'}}, row=False) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:10:50.120342 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:50.120955 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:10:50.121388 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:50.123018 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:50.123174 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6075e13d-d3, may_exist=True, interface_attrs={}) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:10:50.123499 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6075e13d-d3, col_values=(('qos', UUID('463d949e-f594-488e-bfbc-ceb854b9a5b5')),), if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:10:50.123665 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6075e13d-d3, col_values=(('external_ids', {'iface-id': '6075e13d-d32a-4d8f-8741-a4686059985e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8e:89:22', 'vm-uuid': '36688d94-68d3-4ae3-989a-b391d7ee4ad9'}),), if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:10:50.124436 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-dd35667d-ea77-4781-83f8-7bdecb4c5828 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json" returned: 0 in 0.060s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:10:50.124585 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:50.124960 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-dd35667d-ea77-4781-83f8-7bdecb4c5828 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] Acquiring lock "d2c441059b2992961b5de03c05b32d04aff77cb1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:10:50.126158 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:10:50.126460 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-dd35667d-ea77-4781-83f8-7bdecb4c5828 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] Lock "d2c441059b2992961b5de03c05b32d04aff77cb1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.002s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:10:50.126926 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-dd35667d-ea77-4781-83f8-7bdecb4c5828 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:10:50.129154 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-dd35667d-ea77-4781-83f8-7bdecb4c5828 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:10:50.129432 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-dd35667d-ea77-4781-83f8-7bdecb4c5828 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:10:50.129612 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:50.130944 np0000002687 nova-compute[98431]: INFO os_vif [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:89:22,bridge_name='br-int',has_traffic_filtering=True,id=6075e13d-d32a-4d8f-8741-a4686059985e,network=Network(e87d6560-c7a9-4b70-83f1-b0863de32387),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6075e13d-d3') Jun 11 23:10:50.193010 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-dd35667d-ea77-4781-83f8-7bdecb4c5828 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json" returned: 0 in 0.063s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:10:50.193352 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-dd35667d-ea77-4781-83f8-7bdecb4c5828 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1,backing_fmt=raw /opt/stack/data/nova/instances/73abd331-0bbf-432e-be1c-308801a5429f/disk 1073741824 {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:10:50.219147 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-dd35667d-ea77-4781-83f8-7bdecb4c5828 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1,backing_fmt=raw /opt/stack/data/nova/instances/73abd331-0bbf-432e-be1c-308801a5429f/disk 1073741824" returned: 0 in 0.025s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:10:50.219595 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-dd35667d-ea77-4781-83f8-7bdecb4c5828 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] Lock "d2c441059b2992961b5de03c05b32d04aff77cb1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.093s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:10:50.219888 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-dd35667d-ea77-4781-83f8-7bdecb4c5828 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:10:50.277871 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-dd35667d-ea77-4781-83f8-7bdecb4c5828 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json" returned: 0 in 0.057s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:10:50.278343 np0000002687 nova-compute[98431]: DEBUG nova.virt.disk.api [None req-dd35667d-ea77-4781-83f8-7bdecb4c5828 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] Checking if we can resize image /opt/stack/data/nova/instances/73abd331-0bbf-432e-be1c-308801a5429f/disk. size=1073741824 {{(pid=98431) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 11 23:10:50.278664 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-dd35667d-ea77-4781-83f8-7bdecb4c5828 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73abd331-0bbf-432e-be1c-308801a5429f/disk --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:10:50.326784 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.633s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:10:50.327448 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.567s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:10:50.328512 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] [instance: 27ac8c84-e5db-4bd1-a148-ec5834c5b39c] Start building networks asynchronously for instance. {{(pid=98431) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 11 23:10:50.333590 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98431) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 11 23:10:50.333876 np0000002687 nova-compute[98431]: INFO nova.compute.claims [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] [instance: 14699717-b93f-4e67-b841-c67de8fff8d4] Claim successful on node np0000002687 Jun 11 23:10:50.344737 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-dd35667d-ea77-4781-83f8-7bdecb4c5828 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73abd331-0bbf-432e-be1c-308801a5429f/disk --force-share --output=json" returned: 0 in 0.066s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:10:50.345534 np0000002687 nova-compute[98431]: DEBUG nova.virt.disk.api [None req-dd35667d-ea77-4781-83f8-7bdecb4c5828 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] Cannot resize image /opt/stack/data/nova/instances/73abd331-0bbf-432e-be1c-308801a5429f/disk to a smaller size. {{(pid=98431) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 11 23:10:50.345534 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-dd35667d-ea77-4781-83f8-7bdecb4c5828 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] [instance: 73abd331-0bbf-432e-be1c-308801a5429f] Created local disks {{(pid=98431) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}} Jun 11 23:10:50.345769 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-dd35667d-ea77-4781-83f8-7bdecb4c5828 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] [instance: 73abd331-0bbf-432e-be1c-308801a5429f] Ensure instance console log exists: /opt/stack/data/nova/instances/73abd331-0bbf-432e-be1c-308801a5429f/console.log {{(pid=98431) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}} Jun 11 23:10:50.346019 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-dd35667d-ea77-4781-83f8-7bdecb4c5828 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:10:50.346174 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-dd35667d-ea77-4781-83f8-7bdecb4c5828 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:10:50.346292 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-dd35667d-ea77-4781-83f8-7bdecb4c5828 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:10:50.445989 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-11T23:10:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-1839648806',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='tempest-attachvolumemultiattachtest-server-1839648806',id=4,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='81fd45f475a04e5c8e9bd9deb7ad4c1e',ramdisk_id='',reservation_id='r-nqqlyl0y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1514006700',owner_user_name='tempest-AttachVolumeMultiAttachTest-1514006700-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-11T23:10:42Z,user_data=None,user_id='c17e84202f404c3c8e73292bb59d7b27',uuid=de4372a4-a0cc-4541-a5a2-87be3152c50e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "54aaea68-1159-4201-967a-c8074f08eadb", "address": "fa:16:3e:77:48:8d", "network": {"id": "17593db3-c22d-4354-ab29-933b1c6a5c3a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1094286565-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "81fd45f475a04e5c8e9bd9deb7ad4c1e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap54aaea68-11", "ovs_interfaceid": "54aaea68-1159-4201-967a-c8074f08eadb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98431) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 11 23:10:50.446263 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Converting VIF {"id": "54aaea68-1159-4201-967a-c8074f08eadb", "address": "fa:16:3e:77:48:8d", "network": {"id": "17593db3-c22d-4354-ab29-933b1c6a5c3a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1094286565-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "81fd45f475a04e5c8e9bd9deb7ad4c1e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap54aaea68-11", "ovs_interfaceid": "54aaea68-1159-4201-967a-c8074f08eadb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:10:50.446824 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:48:8d,bridge_name='br-int',has_traffic_filtering=True,id=54aaea68-1159-4201-967a-c8074f08eadb,network=Network(17593db3-c22d-4354-ab29-933b1c6a5c3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54aaea68-11') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:10:50.447515 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lazy-loading 'pci_devices' on Instance uuid de4372a4-a0cc-4541-a5a2-87be3152c50e {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:10:50.601383 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-dd35667d-ea77-4781-83f8-7bdecb4c5828 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] [instance: 73abd331-0bbf-432e-be1c-308801a5429f] Instance cache missing network info. {{(pid=98431) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 11 23:10:50.633142 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-df904792-6655-4ccf-98eb-8b70917334ea req-021b0f6f-61c2-4038-b4cd-bc2fd3cfc18f service nova] [instance: de4372a4-a0cc-4541-a5a2-87be3152c50e] Received event network-vif-unplugged-54aaea68-1159-4201-967a-c8074f08eadb {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:10:50.633388 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-df904792-6655-4ccf-98eb-8b70917334ea req-021b0f6f-61c2-4038-b4cd-bc2fd3cfc18f service nova] Acquiring lock "de4372a4-a0cc-4541-a5a2-87be3152c50e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:10:50.633565 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-df904792-6655-4ccf-98eb-8b70917334ea req-021b0f6f-61c2-4038-b4cd-bc2fd3cfc18f service nova] Lock "de4372a4-a0cc-4541-a5a2-87be3152c50e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:10:50.633699 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-df904792-6655-4ccf-98eb-8b70917334ea req-021b0f6f-61c2-4038-b4cd-bc2fd3cfc18f service nova] Lock "de4372a4-a0cc-4541-a5a2-87be3152c50e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:10:50.633862 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-df904792-6655-4ccf-98eb-8b70917334ea req-021b0f6f-61c2-4038-b4cd-bc2fd3cfc18f service nova] [instance: de4372a4-a0cc-4541-a5a2-87be3152c50e] No waiting events found dispatching network-vif-unplugged-54aaea68-1159-4201-967a-c8074f08eadb {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:10:50.634023 np0000002687 nova-compute[98431]: WARNING nova.compute.manager [req-df904792-6655-4ccf-98eb-8b70917334ea req-021b0f6f-61c2-4038-b4cd-bc2fd3cfc18f service nova] [instance: de4372a4-a0cc-4541-a5a2-87be3152c50e] Received unexpected event network-vif-unplugged-54aaea68-1159-4201-967a-c8074f08eadb for instance with vm_state building and task_state spawning. Jun 11 23:10:50.634162 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-df904792-6655-4ccf-98eb-8b70917334ea req-021b0f6f-61c2-4038-b4cd-bc2fd3cfc18f service nova] [instance: 689e510d-e0a4-4d6a-958e-9acfaebedc87] Received event network-vif-plugged-65f7170b-ae97-4cd6-93a1-7dd5111b7978 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:10:50.634293 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-df904792-6655-4ccf-98eb-8b70917334ea req-021b0f6f-61c2-4038-b4cd-bc2fd3cfc18f service nova] Acquiring lock "689e510d-e0a4-4d6a-958e-9acfaebedc87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:10:50.634437 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-df904792-6655-4ccf-98eb-8b70917334ea req-021b0f6f-61c2-4038-b4cd-bc2fd3cfc18f service nova] Lock "689e510d-e0a4-4d6a-958e-9acfaebedc87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:10:50.634570 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-df904792-6655-4ccf-98eb-8b70917334ea req-021b0f6f-61c2-4038-b4cd-bc2fd3cfc18f service nova] Lock "689e510d-e0a4-4d6a-958e-9acfaebedc87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:10:50.634704 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-df904792-6655-4ccf-98eb-8b70917334ea req-021b0f6f-61c2-4038-b4cd-bc2fd3cfc18f service nova] [instance: 689e510d-e0a4-4d6a-958e-9acfaebedc87] Processing event network-vif-plugged-65f7170b-ae97-4cd6-93a1-7dd5111b7978 {{(pid=98431) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 11 23:10:50.635022 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-df904792-6655-4ccf-98eb-8b70917334ea req-021b0f6f-61c2-4038-b4cd-bc2fd3cfc18f service nova] [instance: 689e510d-e0a4-4d6a-958e-9acfaebedc87] Received event network-vif-plugged-65f7170b-ae97-4cd6-93a1-7dd5111b7978 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:10:50.635733 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-ac70a8b6-6e47-48a8-bc39-40773397e5b3 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] [instance: 689e510d-e0a4-4d6a-958e-9acfaebedc87] Instance event wait completed in 5 seconds for network-vif-plugged {{(pid=98431) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 11 23:10:50.636000 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-df904792-6655-4ccf-98eb-8b70917334ea req-021b0f6f-61c2-4038-b4cd-bc2fd3cfc18f service nova] Acquiring lock "689e510d-e0a4-4d6a-958e-9acfaebedc87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:10:50.636128 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-df904792-6655-4ccf-98eb-8b70917334ea req-021b0f6f-61c2-4038-b4cd-bc2fd3cfc18f service nova] Lock "689e510d-e0a4-4d6a-958e-9acfaebedc87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:10:50.636264 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-df904792-6655-4ccf-98eb-8b70917334ea req-021b0f6f-61c2-4038-b4cd-bc2fd3cfc18f service nova] Lock "689e510d-e0a4-4d6a-958e-9acfaebedc87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:10:50.636718 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-df904792-6655-4ccf-98eb-8b70917334ea req-021b0f6f-61c2-4038-b4cd-bc2fd3cfc18f service nova] [instance: 689e510d-e0a4-4d6a-958e-9acfaebedc87] No waiting events found dispatching network-vif-plugged-65f7170b-ae97-4cd6-93a1-7dd5111b7978 {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:10:50.636718 np0000002687 nova-compute[98431]: WARNING nova.compute.manager [req-df904792-6655-4ccf-98eb-8b70917334ea req-021b0f6f-61c2-4038-b4cd-bc2fd3cfc18f service nova] [instance: 689e510d-e0a4-4d6a-958e-9acfaebedc87] Received unexpected event network-vif-plugged-65f7170b-ae97-4cd6-93a1-7dd5111b7978 for instance with vm_state building and task_state spawning. Jun 11 23:10:50.636718 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-df904792-6655-4ccf-98eb-8b70917334ea req-021b0f6f-61c2-4038-b4cd-bc2fd3cfc18f service nova] [instance: 73abd331-0bbf-432e-be1c-308801a5429f] Received event network-vif-unplugged-d1203b92-b9d5-4d1c-bc39-326783c31294 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:10:50.636955 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-df904792-6655-4ccf-98eb-8b70917334ea req-021b0f6f-61c2-4038-b4cd-bc2fd3cfc18f service nova] Acquiring lock "73abd331-0bbf-432e-be1c-308801a5429f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:10:50.637177 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-df904792-6655-4ccf-98eb-8b70917334ea req-021b0f6f-61c2-4038-b4cd-bc2fd3cfc18f service nova] Lock "73abd331-0bbf-432e-be1c-308801a5429f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:10:50.637177 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-df904792-6655-4ccf-98eb-8b70917334ea req-021b0f6f-61c2-4038-b4cd-bc2fd3cfc18f service nova] Lock "73abd331-0bbf-432e-be1c-308801a5429f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:10:50.637294 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-df904792-6655-4ccf-98eb-8b70917334ea req-021b0f6f-61c2-4038-b4cd-bc2fd3cfc18f service nova] [instance: 73abd331-0bbf-432e-be1c-308801a5429f] No waiting events found dispatching network-vif-unplugged-d1203b92-b9d5-4d1c-bc39-326783c31294 {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:10:50.637459 np0000002687 nova-compute[98431]: WARNING nova.compute.manager [req-df904792-6655-4ccf-98eb-8b70917334ea req-021b0f6f-61c2-4038-b4cd-bc2fd3cfc18f service nova] [instance: 73abd331-0bbf-432e-be1c-308801a5429f] Received unexpected event network-vif-unplugged-d1203b92-b9d5-4d1c-bc39-326783c31294 for instance with vm_state building and task_state spawning. Jun 11 23:10:50.637591 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-df904792-6655-4ccf-98eb-8b70917334ea req-021b0f6f-61c2-4038-b4cd-bc2fd3cfc18f service nova] [instance: 73abd331-0bbf-432e-be1c-308801a5429f] Received event network-changed-d1203b92-b9d5-4d1c-bc39-326783c31294 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:10:50.637718 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-df904792-6655-4ccf-98eb-8b70917334ea req-021b0f6f-61c2-4038-b4cd-bc2fd3cfc18f service nova] [instance: 73abd331-0bbf-432e-be1c-308801a5429f] Refreshing instance network info cache due to event network-changed-d1203b92-b9d5-4d1c-bc39-326783c31294. {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 11 23:10:50.637907 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-df904792-6655-4ccf-98eb-8b70917334ea req-021b0f6f-61c2-4038-b4cd-bc2fd3cfc18f service nova] Acquiring lock "refresh_cache-73abd331-0bbf-432e-be1c-308801a5429f" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 11 23:10:50.638274 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Emitting event Resumed> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:10:50.638405 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 689e510d-e0a4-4d6a-958e-9acfaebedc87] VM Resumed (Lifecycle Event) Jun 11 23:10:50.641492 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-ac70a8b6-6e47-48a8-bc39-40773397e5b3 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] [instance: 689e510d-e0a4-4d6a-958e-9acfaebedc87] Guest created on hypervisor {{(pid=98431) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}} Jun 11 23:10:50.642554 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [-] [instance: 689e510d-e0a4-4d6a-958e-9acfaebedc87] Instance spawned successfully. Jun 11 23:10:50.643256 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-ac70a8b6-6e47-48a8-bc39-40773397e5b3 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] [instance: 689e510d-e0a4-4d6a-958e-9acfaebedc87] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 11 23:10:50.756000 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-dd35667d-ea77-4781-83f8-7bdecb4c5828 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:10:50.840287 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] [instance: 27ac8c84-e5db-4bd1-a148-ec5834c5b39c] Allocating IP information in the background. {{(pid=98431) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 11 23:10:50.840643 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] [instance: 27ac8c84-e5db-4bd1-a148-ec5834c5b39c] allocate_for_instance() {{(pid=98431) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 11 23:10:50.840782 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:10:50.841059 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:10:50.873075 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-dd35667d-ea77-4781-83f8-7bdecb4c5828 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] [instance: 73abd331-0bbf-432e-be1c-308801a5429f] Updating instance_info_cache with network_info: [{"id": "d1203b92-b9d5-4d1c-bc39-326783c31294", "address": "fa:16:3e:bd:09:51", "network": {"id": "40608c63-4bf9-4326-a714-e03e56d8c4de", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1884073402-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bddeb2fac9c34c65996201c81b5c77e4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1203b92-b9", "ovs_interfaceid": "d1203b92-b9d5-4d1c-bc39-326783c31294", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:10:50.931396 np0000002687 nova-compute[98431]: DEBUG nova.policy [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4b63bb5265a040fc8f755a27d13f43b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a092509b877483183db8610c8763b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98431) authorize /opt/stack/nova/nova/policy.py:192}} Jun 11 23:10:50.950146 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: de4372a4-a0cc-4541-a5a2-87be3152c50e] End _get_guest_xml xml= Jun 11 23:10:50.950146 np0000002687 nova-compute[98431]: de4372a4-a0cc-4541-a5a2-87be3152c50e Jun 11 23:10:50.950146 np0000002687 nova-compute[98431]: instance-00000004 Jun 11 23:10:50.950146 np0000002687 nova-compute[98431]: 196608 Jun 11 23:10:50.950146 np0000002687 nova-compute[98431]: 1 Jun 11 23:10:50.950146 np0000002687 nova-compute[98431]: Jun 11 23:10:50.950146 np0000002687 nova-compute[98431]: Jun 11 23:10:50.950146 np0000002687 nova-compute[98431]: Jun 11 23:10:50.950146 np0000002687 nova-compute[98431]: tempest-AttachVolumeMultiAttachTest-server-1839648806 Jun 11 23:10:50.950146 np0000002687 nova-compute[98431]: 2026-06-11 23:10:45 Jun 11 23:10:50.950146 np0000002687 nova-compute[98431]: Jun 11 23:10:50.950146 np0000002687 nova-compute[98431]: 192 Jun 11 23:10:50.950146 np0000002687 nova-compute[98431]: 1 Jun 11 23:10:50.950146 np0000002687 nova-compute[98431]: 0 Jun 11 23:10:50.950146 np0000002687 nova-compute[98431]: 0 Jun 11 23:10:50.950146 np0000002687 nova-compute[98431]: 1 Jun 11 23:10:50.950146 np0000002687 nova-compute[98431]: Jun 11 23:10:50.950146 np0000002687 nova-compute[98431]: True Jun 11 23:10:50.950146 np0000002687 nova-compute[98431]: Jun 11 23:10:50.950146 np0000002687 nova-compute[98431]: Jun 11 23:10:50.950146 np0000002687 nova-compute[98431]: Jun 11 23:10:50.950146 np0000002687 nova-compute[98431]: 1 Jun 11 23:10:50.950146 np0000002687 nova-compute[98431]: 0 Jun 11 23:10:50.950146 np0000002687 nova-compute[98431]: Jun 11 23:10:50.950146 np0000002687 nova-compute[98431]: virtio Jun 11 23:10:50.950146 np0000002687 nova-compute[98431]: Jun 11 23:10:50.950146 np0000002687 nova-compute[98431]: Jun 11 23:10:50.950146 np0000002687 nova-compute[98431]: Jun 11 23:10:50.950146 np0000002687 nova-compute[98431]: tempest-AttachVolumeMultiAttachTest-1514006700-project-member Jun 11 23:10:50.950146 np0000002687 nova-compute[98431]: tempest-AttachVolumeMultiAttachTest-1514006700 Jun 11 23:10:50.950146 np0000002687 nova-compute[98431]: Jun 11 23:10:50.950146 np0000002687 nova-compute[98431]: Jun 11 23:10:50.950146 np0000002687 nova-compute[98431]: Jun 11 23:10:50.950146 np0000002687 nova-compute[98431]: Jun 11 23:10:50.950146 np0000002687 nova-compute[98431]: Jun 11 23:10:50.950146 np0000002687 nova-compute[98431]: Jun 11 23:10:50.950146 np0000002687 nova-compute[98431]: Jun 11 23:10:50.950146 np0000002687 nova-compute[98431]: Jun 11 23:10:50.950146 np0000002687 nova-compute[98431]: Jun 11 23:10:50.950146 np0000002687 nova-compute[98431]: Jun 11 23:10:50.950146 np0000002687 nova-compute[98431]: Jun 11 23:10:50.950146 np0000002687 nova-compute[98431]: OpenStack Foundation Jun 11 23:10:50.950146 np0000002687 nova-compute[98431]: OpenStack Nova Jun 11 23:10:50.950146 np0000002687 nova-compute[98431]: 33.1.0 Jun 11 23:10:50.950146 np0000002687 nova-compute[98431]: de4372a4-a0cc-4541-a5a2-87be3152c50e Jun 11 23:10:50.950146 np0000002687 nova-compute[98431]: de4372a4-a0cc-4541-a5a2-87be3152c50e Jun 11 23:10:50.950146 np0000002687 nova-compute[98431]: Virtual Machine Jun 11 23:10:50.950146 np0000002687 nova-compute[98431]: Jun 11 23:10:50.950146 np0000002687 nova-compute[98431]: Jun 11 23:10:50.950146 np0000002687 nova-compute[98431]: Jun 11 23:10:50.950146 np0000002687 nova-compute[98431]: hvm Jun 11 23:10:50.950146 np0000002687 nova-compute[98431]: Jun 11 23:10:50.950146 np0000002687 nova-compute[98431]: Jun 11 23:10:50.950146 np0000002687 nova-compute[98431]: Jun 11 23:10:50.950146 np0000002687 nova-compute[98431]: Jun 11 23:10:50.950146 np0000002687 nova-compute[98431]: Jun 11 23:10:50.950146 np0000002687 nova-compute[98431]: Jun 11 23:10:50.950146 np0000002687 nova-compute[98431]: 128 Jun 11 23:10:50.950146 np0000002687 nova-compute[98431]: Jun 11 23:10:50.950146 np0000002687 nova-compute[98431]: Jun 11 23:10:50.950146 np0000002687 nova-compute[98431]: Jun 11 23:10:50.950146 np0000002687 nova-compute[98431]: 1 Jun 11 23:10:50.950146 np0000002687 nova-compute[98431]: Jun 11 23:10:50.950146 np0000002687 nova-compute[98431]: Jun 11 23:10:50.950146 np0000002687 nova-compute[98431]: Nehalem Jun 11 23:10:50.950146 np0000002687 nova-compute[98431]: Jun 11 23:10:50.950146 np0000002687 nova-compute[98431]: Jun 11 23:10:50.950146 np0000002687 nova-compute[98431]: Jun 11 23:10:50.950146 np0000002687 nova-compute[98431]: Jun 11 23:10:50.950146 np0000002687 nova-compute[98431]: Jun 11 23:10:50.950146 np0000002687 nova-compute[98431]: Jun 11 23:10:50.950146 np0000002687 nova-compute[98431]: Jun 11 23:10:50.950146 np0000002687 nova-compute[98431]: Jun 11 23:10:50.950146 np0000002687 nova-compute[98431]: Jun 11 23:10:50.950146 np0000002687 nova-compute[98431]: Jun 11 23:10:50.950146 np0000002687 nova-compute[98431]: Jun 11 23:10:50.950146 np0000002687 nova-compute[98431]: Jun 11 23:10:50.950146 np0000002687 nova-compute[98431]: Jun 11 23:10:50.950146 np0000002687 nova-compute[98431]: 51510c5e-80aa-4db3-9246-3becbd15cde9 Jun 11 23:10:50.950146 np0000002687 nova-compute[98431]: Jun 11 23:10:50.950146 np0000002687 nova-compute[98431]: Jun 11 23:10:50.950146 np0000002687 nova-compute[98431]: Jun 11 23:10:50.950146 np0000002687 nova-compute[98431]: Jun 11 23:10:50.950146 np0000002687 nova-compute[98431]: Jun 11 23:10:50.950146 np0000002687 nova-compute[98431]: Jun 11 23:10:50.950146 np0000002687 nova-compute[98431]: Jun 11 23:10:50.950146 np0000002687 nova-compute[98431]: Jun 11 23:10:50.950146 np0000002687 nova-compute[98431]: Jun 11 23:10:50.950146 np0000002687 nova-compute[98431]: Jun 11 23:10:50.950146 np0000002687 nova-compute[98431]: Jun 11 23:10:50.950146 np0000002687 nova-compute[98431]: Jun 11 23:10:50.950146 np0000002687 nova-compute[98431]: Jun 11 23:10:50.950146 np0000002687 nova-compute[98431]: Jun 11 23:10:50.950146 np0000002687 nova-compute[98431]: Jun 11 23:10:50.950146 np0000002687 nova-compute[98431]: /dev/urandom Jun 11 23:10:50.950146 np0000002687 nova-compute[98431]: Jun 11 23:10:50.950146 np0000002687 nova-compute[98431]: Jun 11 23:10:50.950146 np0000002687 nova-compute[98431]: Jun 11 23:10:50.950146 np0000002687 nova-compute[98431]: Jun 11 23:10:50.950146 np0000002687 nova-compute[98431]: Jun 11 23:10:50.950146 np0000002687 nova-compute[98431]: Jun 11 23:10:50.950146 np0000002687 nova-compute[98431]: Jun 11 23:10:50.950146 np0000002687 nova-compute[98431]: {{(pid=98431) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 11 23:10:50.952054 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: de4372a4-a0cc-4541-a5a2-87be3152c50e] Preparing to wait for external event network-vif-plugged-54aaea68-1159-4201-967a-c8074f08eadb {{(pid=98431) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 11 23:10:50.952054 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Acquiring lock "de4372a4-a0cc-4541-a5a2-87be3152c50e-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:10:50.952054 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "de4372a4-a0cc-4541-a5a2-87be3152c50e-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:10:50.952054 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "de4372a4-a0cc-4541-a5a2-87be3152c50e-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:10:50.952054 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-11T23:10:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-1839648806',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='tempest-attachvolumemultiattachtest-server-1839648806',id=4,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='81fd45f475a04e5c8e9bd9deb7ad4c1e',ramdisk_id='',reservation_id='r-nqqlyl0y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1514006700',owner_user_name='tempest-AttachVolumeMultiAttachTest-1514006700-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-11T23:10:42Z,user_data=None,user_id='c17e84202f404c3c8e73292bb59d7b27',uuid=de4372a4-a0cc-4541-a5a2-87be3152c50e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "54aaea68-1159-4201-967a-c8074f08eadb", "address": "fa:16:3e:77:48:8d", "network": {"id": "17593db3-c22d-4354-ab29-933b1c6a5c3a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1094286565-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "81fd45f475a04e5c8e9bd9deb7ad4c1e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap54aaea68-11", "ovs_interfaceid": "54aaea68-1159-4201-967a-c8074f08eadb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 11 23:10:50.952280 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Converting VIF {"id": "54aaea68-1159-4201-967a-c8074f08eadb", "address": "fa:16:3e:77:48:8d", "network": {"id": "17593db3-c22d-4354-ab29-933b1c6a5c3a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1094286565-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "81fd45f475a04e5c8e9bd9deb7ad4c1e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap54aaea68-11", "ovs_interfaceid": "54aaea68-1159-4201-967a-c8074f08eadb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:10:50.952280 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:48:8d,bridge_name='br-int',has_traffic_filtering=True,id=54aaea68-1159-4201-967a-c8074f08eadb,network=Network(17593db3-c22d-4354-ab29-933b1c6a5c3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54aaea68-11') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:10:50.952280 np0000002687 nova-compute[98431]: DEBUG os_vif [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:48:8d,bridge_name='br-int',has_traffic_filtering=True,id=54aaea68-1159-4201-967a-c8074f08eadb,network=Network(17593db3-c22d-4354-ab29-933b1c6a5c3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54aaea68-11') {{(pid=98431) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 11 23:10:50.954050 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:50.954568 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:10:50.954658 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 11 23:10:50.955289 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:50.955447 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '03b3987d-222c-5fa9-8b83-6fd879939e2c', '_type': 'linux-noop'}}, row=False) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:10:50.958544 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:50.959345 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:10:50.961546 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:50.965430 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:50.965574 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap54aaea68-11, may_exist=True, interface_attrs={}) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:10:50.965922 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap54aaea68-11, col_values=(('qos', UUID('b2358729-c065-4227-b744-99b213bc6650')),), if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:10:50.966082 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap54aaea68-11, col_values=(('external_ids', {'iface-id': '54aaea68-1159-4201-967a-c8074f08eadb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:77:48:8d', 'vm-uuid': 'de4372a4-a0cc-4541-a5a2-87be3152c50e'}),), if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:10:50.967121 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:50.968063 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:10:50.977645 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:50.978629 np0000002687 nova-compute[98431]: INFO os_vif [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:48:8d,bridge_name='br-int',has_traffic_filtering=True,id=54aaea68-1159-4201-967a-c8074f08eadb,network=Network(17593db3-c22d-4354-ab29-933b1c6a5c3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54aaea68-11') Jun 11 23:10:51.141199 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 689e510d-e0a4-4d6a-958e-9acfaebedc87] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:10:51.143174 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 689e510d-e0a4-4d6a-958e-9acfaebedc87] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98431) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 11 23:10:51.154052 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-ac70a8b6-6e47-48a8-bc39-40773397e5b3 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] [instance: 689e510d-e0a4-4d6a-958e-9acfaebedc87] Found default for hw_cdrom_bus of ide {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:10:51.154234 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-ac70a8b6-6e47-48a8-bc39-40773397e5b3 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] [instance: 689e510d-e0a4-4d6a-958e-9acfaebedc87] Found default for hw_disk_bus of virtio {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:10:51.154644 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-ac70a8b6-6e47-48a8-bc39-40773397e5b3 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] [instance: 689e510d-e0a4-4d6a-958e-9acfaebedc87] Found default for hw_input_bus of None {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:10:51.154975 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-ac70a8b6-6e47-48a8-bc39-40773397e5b3 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] [instance: 689e510d-e0a4-4d6a-958e-9acfaebedc87] Found default for hw_pointer_model of None {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:10:51.155225 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-ac70a8b6-6e47-48a8-bc39-40773397e5b3 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] [instance: 689e510d-e0a4-4d6a-958e-9acfaebedc87] Found default for hw_video_model of virtio {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:10:51.155473 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-ac70a8b6-6e47-48a8-bc39-40773397e5b3 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] [instance: 689e510d-e0a4-4d6a-958e-9acfaebedc87] Found default for hw_vif_model of virtio {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:10:51.344354 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] [instance: 27ac8c84-e5db-4bd1-a148-ec5834c5b39c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 11 23:10:51.375156 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-dd35667d-ea77-4781-83f8-7bdecb4c5828 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] Releasing lock "refresh_cache-73abd331-0bbf-432e-be1c-308801a5429f" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 11 23:10:51.375435 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-dd35667d-ea77-4781-83f8-7bdecb4c5828 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] [instance: 73abd331-0bbf-432e-be1c-308801a5429f] Instance network_info: |[{"id": "d1203b92-b9d5-4d1c-bc39-326783c31294", "address": "fa:16:3e:bd:09:51", "network": {"id": "40608c63-4bf9-4326-a714-e03e56d8c4de", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1884073402-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bddeb2fac9c34c65996201c81b5c77e4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1203b92-b9", "ovs_interfaceid": "d1203b92-b9d5-4d1c-bc39-326783c31294", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98431) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 11 23:10:51.375852 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-df904792-6655-4ccf-98eb-8b70917334ea req-021b0f6f-61c2-4038-b4cd-bc2fd3cfc18f service nova] Acquired lock "refresh_cache-73abd331-0bbf-432e-be1c-308801a5429f" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 11 23:10:51.376060 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-df904792-6655-4ccf-98eb-8b70917334ea req-021b0f6f-61c2-4038-b4cd-bc2fd3cfc18f service nova] [instance: 73abd331-0bbf-432e-be1c-308801a5429f] Refreshing network info cache for port d1203b92-b9d5-4d1c-bc39-326783c31294 {{(pid=98431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 11 23:10:51.380300 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-dd35667d-ea77-4781-83f8-7bdecb4c5828 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] [instance: 73abd331-0bbf-432e-be1c-308801a5429f] Start _get_guest_xml network_info=[{"id": "d1203b92-b9d5-4d1c-bc39-326783c31294", "address": "fa:16:3e:bd:09:51", "network": {"id": "40608c63-4bf9-4326-a714-e03e56d8c4de", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1884073402-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bddeb2fac9c34c65996201c81b5c77e4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1203b92-b9", "ovs_interfaceid": "d1203b92-b9d5-4d1c-bc39-326783c31294", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-11T23:08:20Z,direct_url=,disk_format='qcow2',id=f30640f8-7aca-4300-a085-4706a5209a79,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ce012f9fabdb4ee5a73e212437f59d97',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-11T23:08:23Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'image_id': 'f30640f8-7aca-4300-a085-4706a5209a79'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98431) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 11 23:10:51.385856 np0000002687 nova-compute[98431]: WARNING nova.virt.libvirt.driver [None req-dd35667d-ea77-4781-83f8-7bdecb4c5828 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 11 23:10:51.387765 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-dd35667d-ea77-4781-83f8-7bdecb4c5828 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='f30640f8-7aca-4300-a085-4706a5209a79', instance_meta=NovaInstanceMeta(name='tempest-VolumesAssistedSnapshotsTest-server-1353756978', uuid='73abd331-0bbf-432e-be1c-308801a5429f'), owner=OwnerMeta(userid='fe97a7ae092d47588d6656d03aace2d4', username='tempest-VolumesAssistedSnapshotsTest-1009218362-project-member', projectid='bddeb2fac9c34c65996201c81b5c77e4', projectname='tempest-VolumesAssistedSnapshotsTest-1009218362'), image=ImageMeta(id='f30640f8-7aca-4300-a085-4706a5209a79', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "d1203b92-b9d5-4d1c-bc39-326783c31294", "address": "fa:16:3e:bd:09:51", "network": {"id": "40608c63-4bf9-4326-a714-e03e56d8c4de", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1884073402-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bddeb2fac9c34c65996201c81b5c77e4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1203b92-b9", "ovs_interfaceid": "d1203b92-b9d5-4d1c-bc39-326783c31294", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1781219451.3871243) {{(pid=98431) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 11 23:10:51.390091 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] [instance: 27ac8c84-e5db-4bd1-a148-ec5834c5b39c] Successfully created port: 673175fc-0e8b-46fe-9898-7e27d61b8694 {{(pid=98431) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 11 23:10:51.393104 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-dd35667d-ea77-4781-83f8-7bdecb4c5828 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] Searching host: 'np0000002687' for CPU controller through CGroups V1... {{(pid=98431) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 11 23:10:51.394168 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-dd35667d-ea77-4781-83f8-7bdecb4c5828 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] CPU controller missing on host. {{(pid=98431) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 11 23:10:51.395329 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-dd35667d-ea77-4781-83f8-7bdecb4c5828 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] Searching host: 'np0000002687' for CPU controller through CGroups V2... {{(pid=98431) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 11 23:10:51.395658 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-dd35667d-ea77-4781-83f8-7bdecb4c5828 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] CPU controller found on host. {{(pid=98431) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 11 23:10:51.398575 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-dd35667d-ea77-4781-83f8-7bdecb4c5828 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98431) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 11 23:10:51.398575 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-dd35667d-ea77-4781-83f8-7bdecb4c5828 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-11T23:08:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-11T23:08:20Z,direct_url=,disk_format='qcow2',id=f30640f8-7aca-4300-a085-4706a5209a79,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ce012f9fabdb4ee5a73e212437f59d97',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-11T23:08:23Z,virtual_size=,visibility=), allow threads: True {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 11 23:10:51.398575 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-dd35667d-ea77-4781-83f8-7bdecb4c5828 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] Flavor limits 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 11 23:10:51.398575 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-dd35667d-ea77-4781-83f8-7bdecb4c5828 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] Image limits 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 11 23:10:51.398575 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-dd35667d-ea77-4781-83f8-7bdecb4c5828 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] Flavor pref 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 11 23:10:51.398575 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-dd35667d-ea77-4781-83f8-7bdecb4c5828 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] Image pref 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 11 23:10:51.398575 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-dd35667d-ea77-4781-83f8-7bdecb4c5828 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 11 23:10:51.402154 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-dd35667d-ea77-4781-83f8-7bdecb4c5828 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 11 23:10:51.402154 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-dd35667d-ea77-4781-83f8-7bdecb4c5828 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98431) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 11 23:10:51.402154 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-dd35667d-ea77-4781-83f8-7bdecb4c5828 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] Got 1 possible topologies {{(pid=98431) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 11 23:10:51.402462 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-dd35667d-ea77-4781-83f8-7bdecb4c5828 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 11 23:10:51.402669 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-dd35667d-ea77-4781-83f8-7bdecb4c5828 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 11 23:10:51.411933 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-dd35667d-ea77-4781-83f8-7bdecb4c5828 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-11T23:10:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1353756978',display_name='tempest-VolumesAssistedSnapshotsTest-server-1353756978',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='tempest-volumesassistedsnapshotstest-server-1353756978',id=6,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLtWpmTL57Lc0YUQTSd5NfPApT5DUW8RTfDnqIDjCf8IZRaRZyzj4Oad3caiamoQEi2ojJRXJkaX6kBk4HafhVUNFjCaVH0FoduTDf6KbJiXGKZNdi6CtQ9AFkqYIhvXpg==',key_name='tempest-keypair-647594787',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bddeb2fac9c34c65996201c81b5c77e4',ramdisk_id='',reservation_id='r-ogjxfq8o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1009218362',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1009218362-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-11T23:10:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fe97a7ae092d47588d6656d03aace2d4',uuid=73abd331-0bbf-432e-be1c-308801a5429f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d1203b92-b9d5-4d1c-bc39-326783c31294", "address": "fa:16:3e:bd:09:51", "network": {"id": "40608c63-4bf9-4326-a714-e03e56d8c4de", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1884073402-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bddeb2fac9c34c65996201c81b5c77e4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1203b92-b9", "ovs_interfaceid": "d1203b92-b9d5-4d1c-bc39-326783c31294", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98431) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 11 23:10:51.413627 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-dd35667d-ea77-4781-83f8-7bdecb4c5828 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] Converting VIF {"id": "d1203b92-b9d5-4d1c-bc39-326783c31294", "address": "fa:16:3e:bd:09:51", "network": {"id": "40608c63-4bf9-4326-a714-e03e56d8c4de", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1884073402-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bddeb2fac9c34c65996201c81b5c77e4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1203b92-b9", "ovs_interfaceid": "d1203b92-b9d5-4d1c-bc39-326783c31294", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:10:51.413627 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-dd35667d-ea77-4781-83f8-7bdecb4c5828 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:09:51,bridge_name='br-int',has_traffic_filtering=True,id=d1203b92-b9d5-4d1c-bc39-326783c31294,network=Network(40608c63-4bf9-4326-a714-e03e56d8c4de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1203b92-b9') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:10:51.413627 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-dd35667d-ea77-4781-83f8-7bdecb4c5828 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] Lazy-loading 'pci_devices' on Instance uuid 73abd331-0bbf-432e-be1c-308801a5429f {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:10:51.645613 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 689e510d-e0a4-4d6a-958e-9acfaebedc87] During sync_power_state the instance has a pending task (spawning). Skip. Jun 11 23:10:51.661260 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-ac70a8b6-6e47-48a8-bc39-40773397e5b3 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] [instance: 689e510d-e0a4-4d6a-958e-9acfaebedc87] Took 14.25 seconds to spawn the instance on the hypervisor. Jun 11 23:10:51.661892 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-ac70a8b6-6e47-48a8-bc39-40773397e5b3 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] [instance: 689e510d-e0a4-4d6a-958e-9acfaebedc87] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:10:51.669648 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] No BDM found with device name sda, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:10:51.669648 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] No BDM found with device name sdb, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:10:51.671461 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] No VIF found with MAC fa:16:3e:8e:89:22, not building metadata {{(pid=98431) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13199}} Jun 11 23:10:51.671461 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] [instance: 36688d94-68d3-4ae3-989a-b391d7ee4ad9] Using config drive Jun 11 23:10:51.803110 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98431) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 11 23:10:51.803356 np0000002687 nova-compute[98431]: DEBUG nova.compute.provider_tree [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Inventory has not changed in ProviderTree for provider: e3e65fe2-9de9-4821-8b4a-ccae37c66e25 {{(pid=98431) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 11 23:10:51.850475 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] [instance: 27ac8c84-e5db-4bd1-a148-ec5834c5b39c] Start building block device mappings for instance. {{(pid=98431) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 11 23:10:51.880910 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [req-df904792-6655-4ccf-98eb-8b70917334ea req-021b0f6f-61c2-4038-b4cd-bc2fd3cfc18f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:10:51.915663 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-dd35667d-ea77-4781-83f8-7bdecb4c5828 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] [instance: 73abd331-0bbf-432e-be1c-308801a5429f] End _get_guest_xml xml= Jun 11 23:10:51.915663 np0000002687 nova-compute[98431]: 73abd331-0bbf-432e-be1c-308801a5429f Jun 11 23:10:51.915663 np0000002687 nova-compute[98431]: instance-00000006 Jun 11 23:10:51.915663 np0000002687 nova-compute[98431]: 196608 Jun 11 23:10:51.915663 np0000002687 nova-compute[98431]: 1 Jun 11 23:10:51.915663 np0000002687 nova-compute[98431]: Jun 11 23:10:51.915663 np0000002687 nova-compute[98431]: Jun 11 23:10:51.915663 np0000002687 nova-compute[98431]: Jun 11 23:10:51.915663 np0000002687 nova-compute[98431]: tempest-VolumesAssistedSnapshotsTest-server-1353756978 Jun 11 23:10:51.915663 np0000002687 nova-compute[98431]: 2026-06-11 23:10:51 Jun 11 23:10:51.915663 np0000002687 nova-compute[98431]: Jun 11 23:10:51.915663 np0000002687 nova-compute[98431]: 192 Jun 11 23:10:51.915663 np0000002687 nova-compute[98431]: 1 Jun 11 23:10:51.915663 np0000002687 nova-compute[98431]: 0 Jun 11 23:10:51.915663 np0000002687 nova-compute[98431]: 0 Jun 11 23:10:51.915663 np0000002687 nova-compute[98431]: 1 Jun 11 23:10:51.915663 np0000002687 nova-compute[98431]: Jun 11 23:10:51.915663 np0000002687 nova-compute[98431]: True Jun 11 23:10:51.915663 np0000002687 nova-compute[98431]: Jun 11 23:10:51.915663 np0000002687 nova-compute[98431]: Jun 11 23:10:51.915663 np0000002687 nova-compute[98431]: Jun 11 23:10:51.915663 np0000002687 nova-compute[98431]: bare Jun 11 23:10:51.915663 np0000002687 nova-compute[98431]: qcow2 Jun 11 23:10:51.915663 np0000002687 nova-compute[98431]: 1 Jun 11 23:10:51.915663 np0000002687 nova-compute[98431]: 0 Jun 11 23:10:51.915663 np0000002687 nova-compute[98431]: Jun 11 23:10:51.915663 np0000002687 nova-compute[98431]: virtio Jun 11 23:10:51.915663 np0000002687 nova-compute[98431]: Jun 11 23:10:51.915663 np0000002687 nova-compute[98431]: Jun 11 23:10:51.915663 np0000002687 nova-compute[98431]: Jun 11 23:10:51.915663 np0000002687 nova-compute[98431]: tempest-VolumesAssistedSnapshotsTest-1009218362-project-member Jun 11 23:10:51.915663 np0000002687 nova-compute[98431]: tempest-VolumesAssistedSnapshotsTest-1009218362 Jun 11 23:10:51.915663 np0000002687 nova-compute[98431]: Jun 11 23:10:51.915663 np0000002687 nova-compute[98431]: Jun 11 23:10:51.915663 np0000002687 nova-compute[98431]: Jun 11 23:10:51.915663 np0000002687 nova-compute[98431]: Jun 11 23:10:51.915663 np0000002687 nova-compute[98431]: Jun 11 23:10:51.915663 np0000002687 nova-compute[98431]: Jun 11 23:10:51.915663 np0000002687 nova-compute[98431]: Jun 11 23:10:51.915663 np0000002687 nova-compute[98431]: Jun 11 23:10:51.915663 np0000002687 nova-compute[98431]: Jun 11 23:10:51.915663 np0000002687 nova-compute[98431]: Jun 11 23:10:51.915663 np0000002687 nova-compute[98431]: Jun 11 23:10:51.915663 np0000002687 nova-compute[98431]: OpenStack Foundation Jun 11 23:10:51.915663 np0000002687 nova-compute[98431]: OpenStack Nova Jun 11 23:10:51.915663 np0000002687 nova-compute[98431]: 33.1.0 Jun 11 23:10:51.915663 np0000002687 nova-compute[98431]: 73abd331-0bbf-432e-be1c-308801a5429f Jun 11 23:10:51.915663 np0000002687 nova-compute[98431]: 73abd331-0bbf-432e-be1c-308801a5429f Jun 11 23:10:51.915663 np0000002687 nova-compute[98431]: Virtual Machine Jun 11 23:10:51.915663 np0000002687 nova-compute[98431]: Jun 11 23:10:51.915663 np0000002687 nova-compute[98431]: Jun 11 23:10:51.915663 np0000002687 nova-compute[98431]: Jun 11 23:10:51.915663 np0000002687 nova-compute[98431]: hvm Jun 11 23:10:51.915663 np0000002687 nova-compute[98431]: Jun 11 23:10:51.915663 np0000002687 nova-compute[98431]: Jun 11 23:10:51.915663 np0000002687 nova-compute[98431]: Jun 11 23:10:51.915663 np0000002687 nova-compute[98431]: Jun 11 23:10:51.915663 np0000002687 nova-compute[98431]: Jun 11 23:10:51.915663 np0000002687 nova-compute[98431]: Jun 11 23:10:51.915663 np0000002687 nova-compute[98431]: 128 Jun 11 23:10:51.915663 np0000002687 nova-compute[98431]: Jun 11 23:10:51.915663 np0000002687 nova-compute[98431]: Jun 11 23:10:51.915663 np0000002687 nova-compute[98431]: Jun 11 23:10:51.915663 np0000002687 nova-compute[98431]: 1 Jun 11 23:10:51.915663 np0000002687 nova-compute[98431]: Jun 11 23:10:51.915663 np0000002687 nova-compute[98431]: Jun 11 23:10:51.915663 np0000002687 nova-compute[98431]: Nehalem Jun 11 23:10:51.915663 np0000002687 nova-compute[98431]: Jun 11 23:10:51.915663 np0000002687 nova-compute[98431]: Jun 11 23:10:51.915663 np0000002687 nova-compute[98431]: Jun 11 23:10:51.915663 np0000002687 nova-compute[98431]: Jun 11 23:10:51.915663 np0000002687 nova-compute[98431]: Jun 11 23:10:51.915663 np0000002687 nova-compute[98431]: Jun 11 23:10:51.915663 np0000002687 nova-compute[98431]: Jun 11 23:10:51.915663 np0000002687 nova-compute[98431]: Jun 11 23:10:51.915663 np0000002687 nova-compute[98431]: Jun 11 23:10:51.915663 np0000002687 nova-compute[98431]: Jun 11 23:10:51.915663 np0000002687 nova-compute[98431]: Jun 11 23:10:51.915663 np0000002687 nova-compute[98431]: Jun 11 23:10:51.915663 np0000002687 nova-compute[98431]: Jun 11 23:10:51.915663 np0000002687 nova-compute[98431]: Jun 11 23:10:51.915663 np0000002687 nova-compute[98431]: Jun 11 23:10:51.915663 np0000002687 nova-compute[98431]: Jun 11 23:10:51.915663 np0000002687 nova-compute[98431]: Jun 11 23:10:51.915663 np0000002687 nova-compute[98431]: Jun 11 23:10:51.915663 np0000002687 nova-compute[98431]: Jun 11 23:10:51.915663 np0000002687 nova-compute[98431]: Jun 11 23:10:51.915663 np0000002687 nova-compute[98431]: Jun 11 23:10:51.915663 np0000002687 nova-compute[98431]: Jun 11 23:10:51.915663 np0000002687 nova-compute[98431]: Jun 11 23:10:51.915663 np0000002687 nova-compute[98431]: Jun 11 23:10:51.915663 np0000002687 nova-compute[98431]: Jun 11 23:10:51.915663 np0000002687 nova-compute[98431]: Jun 11 23:10:51.915663 np0000002687 nova-compute[98431]: /dev/urandom Jun 11 23:10:51.915663 np0000002687 nova-compute[98431]: Jun 11 23:10:51.915663 np0000002687 nova-compute[98431]: Jun 11 23:10:51.915663 np0000002687 nova-compute[98431]: Jun 11 23:10:51.915663 np0000002687 nova-compute[98431]: Jun 11 23:10:51.915663 np0000002687 nova-compute[98431]: Jun 11 23:10:51.915663 np0000002687 nova-compute[98431]: Jun 11 23:10:51.915663 np0000002687 nova-compute[98431]: Jun 11 23:10:51.915663 np0000002687 nova-compute[98431]: {{(pid=98431) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 11 23:10:52.304336 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-dd35667d-ea77-4781-83f8-7bdecb4c5828 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] [instance: 73abd331-0bbf-432e-be1c-308801a5429f] Preparing to wait for external event network-vif-plugged-d1203b92-b9d5-4d1c-bc39-326783c31294 {{(pid=98431) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 11 23:10:52.304336 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-dd35667d-ea77-4781-83f8-7bdecb4c5828 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] Acquiring lock "73abd331-0bbf-432e-be1c-308801a5429f-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:10:52.304336 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-dd35667d-ea77-4781-83f8-7bdecb4c5828 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] Lock "73abd331-0bbf-432e-be1c-308801a5429f-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:10:52.304336 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-dd35667d-ea77-4781-83f8-7bdecb4c5828 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] Lock "73abd331-0bbf-432e-be1c-308801a5429f-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:10:52.304336 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-dd35667d-ea77-4781-83f8-7bdecb4c5828 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-11T23:10:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1353756978',display_name='tempest-VolumesAssistedSnapshotsTest-server-1353756978',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='tempest-volumesassistedsnapshotstest-server-1353756978',id=6,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLtWpmTL57Lc0YUQTSd5NfPApT5DUW8RTfDnqIDjCf8IZRaRZyzj4Oad3caiamoQEi2ojJRXJkaX6kBk4HafhVUNFjCaVH0FoduTDf6KbJiXGKZNdi6CtQ9AFkqYIhvXpg==',key_name='tempest-keypair-647594787',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bddeb2fac9c34c65996201c81b5c77e4',ramdisk_id='',reservation_id='r-ogjxfq8o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1009218362',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1009218362-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-11T23:10:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fe97a7ae092d47588d6656d03aace2d4',uuid=73abd331-0bbf-432e-be1c-308801a5429f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d1203b92-b9d5-4d1c-bc39-326783c31294", "address": "fa:16:3e:bd:09:51", "network": {"id": "40608c63-4bf9-4326-a714-e03e56d8c4de", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1884073402-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bddeb2fac9c34c65996201c81b5c77e4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1203b92-b9", "ovs_interfaceid": "d1203b92-b9d5-4d1c-bc39-326783c31294", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 11 23:10:52.304832 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-dd35667d-ea77-4781-83f8-7bdecb4c5828 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] Converting VIF {"id": "d1203b92-b9d5-4d1c-bc39-326783c31294", "address": "fa:16:3e:bd:09:51", "network": {"id": "40608c63-4bf9-4326-a714-e03e56d8c4de", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1884073402-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bddeb2fac9c34c65996201c81b5c77e4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1203b92-b9", "ovs_interfaceid": "d1203b92-b9d5-4d1c-bc39-326783c31294", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:10:52.304832 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-dd35667d-ea77-4781-83f8-7bdecb4c5828 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:09:51,bridge_name='br-int',has_traffic_filtering=True,id=d1203b92-b9d5-4d1c-bc39-326783c31294,network=Network(40608c63-4bf9-4326-a714-e03e56d8c4de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1203b92-b9') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:10:52.304832 np0000002687 nova-compute[98431]: DEBUG os_vif [None req-dd35667d-ea77-4781-83f8-7bdecb4c5828 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:09:51,bridge_name='br-int',has_traffic_filtering=True,id=d1203b92-b9d5-4d1c-bc39-326783c31294,network=Network(40608c63-4bf9-4326-a714-e03e56d8c4de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1203b92-b9') {{(pid=98431) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 11 23:10:52.304832 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:52.304832 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:10:52.304832 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 11 23:10:52.304832 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:52.304832 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2710dc26-a65d-5bb4-b43e-6361b10573a0', '_type': 'linux-noop'}}, row=False) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:10:52.304832 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:52.304832 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] [instance: 27ac8c84-e5db-4bd1-a148-ec5834c5b39c] Successfully updated port: 673175fc-0e8b-46fe-9898-7e27d61b8694 {{(pid=98431) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 11 23:10:52.304832 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:10:52.304832 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:52.304832 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:52.304832 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd1203b92-b9, may_exist=True, interface_attrs={}) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:10:52.304832 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd1203b92-b9, col_values=(('qos', UUID('9004d72f-35e5-4464-bab4-e0f06be635ab')),), if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:10:52.305534 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd1203b92-b9, col_values=(('external_ids', {'iface-id': 'd1203b92-b9d5-4d1c-bc39-326783c31294', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bd:09:51', 'vm-uuid': '73abd331-0bbf-432e-be1c-308801a5429f'}),), if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:10:52.305534 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:10:52.305534 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:52.305534 np0000002687 nova-compute[98431]: INFO os_vif [None req-dd35667d-ea77-4781-83f8-7bdecb4c5828 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:09:51,bridge_name='br-int',has_traffic_filtering=True,id=d1203b92-b9d5-4d1c-bc39-326783c31294,network=Network(40608c63-4bf9-4326-a714-e03e56d8c4de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1203b92-b9') Jun 11 23:10:52.305534 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [req-df904792-6655-4ccf-98eb-8b70917334ea req-021b0f6f-61c2-4038-b4cd-bc2fd3cfc18f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:10:52.305534 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-ac70a8b6-6e47-48a8-bc39-40773397e5b3 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] [instance: 689e510d-e0a4-4d6a-958e-9acfaebedc87] Took 19.63 seconds to build instance. Jun 11 23:10:52.305534 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:10:52.305534 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-df904792-6655-4ccf-98eb-8b70917334ea req-021b0f6f-61c2-4038-b4cd-bc2fd3cfc18f service nova] [instance: 73abd331-0bbf-432e-be1c-308801a5429f] Updated VIF entry in instance network info cache for port d1203b92-b9d5-4d1c-bc39-326783c31294. {{(pid=98431) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 11 23:10:52.305534 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-df904792-6655-4ccf-98eb-8b70917334ea req-021b0f6f-61c2-4038-b4cd-bc2fd3cfc18f service nova] [instance: 73abd331-0bbf-432e-be1c-308801a5429f] Updating instance_info_cache with network_info: [{"id": "d1203b92-b9d5-4d1c-bc39-326783c31294", "address": "fa:16:3e:bd:09:51", "network": {"id": "40608c63-4bf9-4326-a714-e03e56d8c4de", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1884073402-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bddeb2fac9c34c65996201c81b5c77e4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1203b92-b9", "ovs_interfaceid": "d1203b92-b9d5-4d1c-bc39-326783c31294", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:10:52.306050 np0000002687 nova-compute[98431]: DEBUG nova.scheduler.client.report [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Inventory has not changed for provider e3e65fe2-9de9-4821-8b4a-ccae37c66e25 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98431) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 11 23:10:52.320942 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] [instance: 36688d94-68d3-4ae3-989a-b391d7ee4ad9] Creating config drive at /opt/stack/data/nova/instances/36688d94-68d3-4ae3-989a-b391d7ee4ad9/disk.config Jun 11 23:10:52.325884 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/36688d94-68d3-4ae3-989a-b391d7ee4ad9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpc_6args1 {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:10:52.361827 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/36688d94-68d3-4ae3-989a-b391d7ee4ad9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpc_6args1" returned: 0 in 0.033s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:10:52.430286 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Acquiring lock "refresh_cache-27ac8c84-e5db-4bd1-a148-ec5834c5b39c" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 11 23:10:52.430404 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Acquired lock "refresh_cache-27ac8c84-e5db-4bd1-a148-ec5834c5b39c" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 11 23:10:52.430584 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] [instance: 27ac8c84-e5db-4bd1-a148-ec5834c5b39c] Building network info cache for instance {{(pid=98431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 11 23:10:52.493271 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] No BDM found with device name hda, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:10:52.493384 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] No BDM found with device name vda, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:10:52.493531 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] No VIF found with MAC fa:16:3e:77:48:8d, not building metadata {{(pid=98431) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13199}} Jun 11 23:10:52.494048 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: de4372a4-a0cc-4541-a5a2-87be3152c50e] Using config drive Jun 11 23:10:52.578685 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:52.670919 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-ac70a8b6-6e47-48a8-bc39-40773397e5b3 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Lock "689e510d-e0a4-4d6a-958e-9acfaebedc87" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 21.135s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:10:52.699063 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-e6cf05ec-1e71-4d90-8362-d23f392b52f2 req-e1f75959-60e6-4c9a-873b-60e6417a3e49 service nova] [instance: 27ac8c84-e5db-4bd1-a148-ec5834c5b39c] Received event network-changed-673175fc-0e8b-46fe-9898-7e27d61b8694 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:10:52.699581 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-e6cf05ec-1e71-4d90-8362-d23f392b52f2 req-e1f75959-60e6-4c9a-873b-60e6417a3e49 service nova] [instance: 27ac8c84-e5db-4bd1-a148-ec5834c5b39c] Refreshing instance network info cache due to event network-changed-673175fc-0e8b-46fe-9898-7e27d61b8694. {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 11 23:10:52.699759 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-e6cf05ec-1e71-4d90-8362-d23f392b52f2 req-e1f75959-60e6-4c9a-873b-60e6417a3e49 service nova] Acquiring lock "refresh_cache-27ac8c84-e5db-4bd1-a148-ec5834c5b39c" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 11 23:10:52.745868 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:52.774286 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:52.775299 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:52.793038 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-df904792-6655-4ccf-98eb-8b70917334ea req-021b0f6f-61c2-4038-b4cd-bc2fd3cfc18f service nova] Releasing lock "refresh_cache-73abd331-0bbf-432e-be1c-308801a5429f" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 11 23:10:52.813270 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.486s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:10:52.814219 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 4.151s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:10:52.814619 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] [instance: 14699717-b93f-4e67-b841-c67de8fff8d4] Start building networks asynchronously for instance. {{(pid=98431) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 11 23:10:52.818942 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98431) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 11 23:10:52.819233 np0000002687 nova-compute[98431]: INFO nova.compute.claims [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Claim successful on node np0000002687 Jun 11 23:10:52.850151 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:52.859992 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] [instance: 27ac8c84-e5db-4bd1-a148-ec5834c5b39c] Start spawning the instance on the hypervisor. {{(pid=98431) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 11 23:10:52.861268 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] [instance: 27ac8c84-e5db-4bd1-a148-ec5834c5b39c] Creating instance directory {{(pid=98431) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}} Jun 11 23:10:52.861544 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] [instance: 27ac8c84-e5db-4bd1-a148-ec5834c5b39c] Creating image(s) Jun 11 23:10:52.862285 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Acquiring lock "/opt/stack/data/nova/instances/27ac8c84-e5db-4bd1-a148-ec5834c5b39c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:10:52.862574 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Lock "/opt/stack/data/nova/instances/27ac8c84-e5db-4bd1-a148-ec5834c5b39c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:10:52.863266 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Lock "/opt/stack/data/nova/instances/27ac8c84-e5db-4bd1-a148-ec5834c5b39c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:10:52.863938 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:10:52.871763 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:10:52.873625 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:10:52.942039 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json" returned: 0 in 0.068s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:10:52.942503 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Acquiring lock "d2c441059b2992961b5de03c05b32d04aff77cb1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:10:52.943019 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Lock "d2c441059b2992961b5de03c05b32d04aff77cb1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:10:52.943510 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:10:52.946343 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:10:52.946625 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:10:53.001870 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:10:53.008940 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] [instance: 27ac8c84-e5db-4bd1-a148-ec5834c5b39c] Instance cache missing network info. {{(pid=98431) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 11 23:10:53.022126 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json" returned: 0 in 0.075s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:10:53.023822 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1,backing_fmt=raw /opt/stack/data/nova/instances/27ac8c84-e5db-4bd1-a148-ec5834c5b39c/disk 1073741824 {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:10:53.058003 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1,backing_fmt=raw /opt/stack/data/nova/instances/27ac8c84-e5db-4bd1-a148-ec5834c5b39c/disk 1073741824" returned: 0 in 0.035s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:10:53.058514 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Lock "d2c441059b2992961b5de03c05b32d04aff77cb1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.115s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:10:53.058929 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:10:53.091335 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:53.104263 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:53.107159 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:53.131584 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:53.138484 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json" returned: 0 in 0.079s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:10:53.138760 np0000002687 nova-compute[98431]: DEBUG nova.virt.disk.api [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Checking if we can resize image /opt/stack/data/nova/instances/27ac8c84-e5db-4bd1-a148-ec5834c5b39c/disk. size=1073741824 {{(pid=98431) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 11 23:10:53.139071 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27ac8c84-e5db-4bd1-a148-ec5834c5b39c/disk --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:10:53.149537 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:53.207664 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: de4372a4-a0cc-4541-a5a2-87be3152c50e] Creating config drive at /opt/stack/data/nova/instances/de4372a4-a0cc-4541-a5a2-87be3152c50e/disk.config Jun 11 23:10:53.211409 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/de4372a4-a0cc-4541-a5a2-87be3152c50e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpg41m_5qk {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:10:53.230310 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27ac8c84-e5db-4bd1-a148-ec5834c5b39c/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:10:53.230945 np0000002687 nova-compute[98431]: DEBUG nova.virt.disk.api [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Cannot resize image /opt/stack/data/nova/instances/27ac8c84-e5db-4bd1-a148-ec5834c5b39c/disk to a smaller size. {{(pid=98431) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 11 23:10:53.231434 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] [instance: 27ac8c84-e5db-4bd1-a148-ec5834c5b39c] Created local disks {{(pid=98431) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}} Jun 11 23:10:53.231654 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] [instance: 27ac8c84-e5db-4bd1-a148-ec5834c5b39c] Ensure instance console log exists: /opt/stack/data/nova/instances/27ac8c84-e5db-4bd1-a148-ec5834c5b39c/console.log {{(pid=98431) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}} Jun 11 23:10:53.232041 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:10:53.232338 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:10:53.232539 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:10:53.238738 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/de4372a4-a0cc-4541-a5a2-87be3152c50e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpg41m_5qk" returned: 0 in 0.027s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:10:53.260625 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:10:53.331844 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] [instance: 14699717-b93f-4e67-b841-c67de8fff8d4] Allocating IP information in the background. {{(pid=98431) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 11 23:10:53.332173 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] [instance: 14699717-b93f-4e67-b841-c67de8fff8d4] allocate_for_instance() {{(pid=98431) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 11 23:10:53.332771 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:10:53.334694 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:10:53.430644 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] [instance: 27ac8c84-e5db-4bd1-a148-ec5834c5b39c] Updating instance_info_cache with network_info: [{"id": "673175fc-0e8b-46fe-9898-7e27d61b8694", "address": "fa:16:3e:dc:9c:b5", "network": {"id": "0dc6da23-6c97-4fd1-9e59-910adaa610a9", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-968328905-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a092509b877483183db8610c8763b93", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap673175fc-0e", "ovs_interfaceid": "673175fc-0e8b-46fe-9898-7e27d61b8694", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:10:53.449008 np0000002687 nova-compute[98431]: DEBUG nova.policy [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4b63bb5265a040fc8f755a27d13f43b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a092509b877483183db8610c8763b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98431) authorize /opt/stack/nova/nova/policy.py:192}} Jun 11 23:10:53.482135 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-dd35667d-ea77-4781-83f8-7bdecb4c5828 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] No BDM found with device name vda, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:10:53.482250 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-dd35667d-ea77-4781-83f8-7bdecb4c5828 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] No BDM found with device name hda, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:10:53.482596 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-dd35667d-ea77-4781-83f8-7bdecb4c5828 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] No VIF found with MAC fa:16:3e:bd:09:51, not building metadata {{(pid=98431) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13199}} Jun 11 23:10:53.483025 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-dd35667d-ea77-4781-83f8-7bdecb4c5828 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] [instance: 73abd331-0bbf-432e-be1c-308801a5429f] Using config drive Jun 11 23:10:53.550745 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Emitting event Started> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:10:53.550950 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 36688d94-68d3-4ae3-989a-b391d7ee4ad9] VM Started (Lifecycle Event) Jun 11 23:10:53.682464 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:53.705878 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:53.794482 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:53.837682 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] [instance: 14699717-b93f-4e67-b841-c67de8fff8d4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 11 23:10:53.931131 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] [instance: 14699717-b93f-4e67-b841-c67de8fff8d4] Successfully created port: a266c7d4-9f0e-474d-a4d9-5190dbdd0fc2 {{(pid=98431) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 11 23:10:53.933978 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Releasing lock "refresh_cache-27ac8c84-e5db-4bd1-a148-ec5834c5b39c" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 11 23:10:53.934717 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] [instance: 27ac8c84-e5db-4bd1-a148-ec5834c5b39c] Instance network_info: |[{"id": "673175fc-0e8b-46fe-9898-7e27d61b8694", "address": "fa:16:3e:dc:9c:b5", "network": {"id": "0dc6da23-6c97-4fd1-9e59-910adaa610a9", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-968328905-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a092509b877483183db8610c8763b93", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap673175fc-0e", "ovs_interfaceid": "673175fc-0e8b-46fe-9898-7e27d61b8694", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98431) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 11 23:10:53.936023 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-e6cf05ec-1e71-4d90-8362-d23f392b52f2 req-e1f75959-60e6-4c9a-873b-60e6417a3e49 service nova] Acquired lock "refresh_cache-27ac8c84-e5db-4bd1-a148-ec5834c5b39c" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 11 23:10:53.936023 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-e6cf05ec-1e71-4d90-8362-d23f392b52f2 req-e1f75959-60e6-4c9a-873b-60e6417a3e49 service nova] [instance: 27ac8c84-e5db-4bd1-a148-ec5834c5b39c] Refreshing network info cache for port 673175fc-0e8b-46fe-9898-7e27d61b8694 {{(pid=98431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 11 23:10:53.939223 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] [instance: 27ac8c84-e5db-4bd1-a148-ec5834c5b39c] Start _get_guest_xml network_info=[{"id": "673175fc-0e8b-46fe-9898-7e27d61b8694", "address": "fa:16:3e:dc:9c:b5", "network": {"id": "0dc6da23-6c97-4fd1-9e59-910adaa610a9", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-968328905-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a092509b877483183db8610c8763b93", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap673175fc-0e", "ovs_interfaceid": "673175fc-0e8b-46fe-9898-7e27d61b8694", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-11T23:08:20Z,direct_url=,disk_format='qcow2',id=f30640f8-7aca-4300-a085-4706a5209a79,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ce012f9fabdb4ee5a73e212437f59d97',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-11T23:08:23Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'image_id': 'f30640f8-7aca-4300-a085-4706a5209a79'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98431) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 11 23:10:53.946499 np0000002687 nova-compute[98431]: WARNING nova.virt.libvirt.driver [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 11 23:10:53.947692 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='f30640f8-7aca-4300-a085-4706a5209a79', instance_meta=NovaInstanceMeta(name='tempest-TestMultiAttachVolumeSwap-server-439003148-1', uuid='27ac8c84-e5db-4bd1-a148-ec5834c5b39c'), owner=OwnerMeta(userid='4b63bb5265a040fc8f755a27d13f43b3', username='tempest-TestMultiAttachVolumeSwap-329912157-project-member', projectid='3a092509b877483183db8610c8763b93', projectname='tempest-TestMultiAttachVolumeSwap-329912157'), image=ImageMeta(id='f30640f8-7aca-4300-a085-4706a5209a79', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "673175fc-0e8b-46fe-9898-7e27d61b8694", "address": "fa:16:3e:dc:9c:b5", "network": {"id": "0dc6da23-6c97-4fd1-9e59-910adaa610a9", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-968328905-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a092509b877483183db8610c8763b93", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap673175fc-0e", "ovs_interfaceid": "673175fc-0e8b-46fe-9898-7e27d61b8694", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1781219453.9473245) {{(pid=98431) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 11 23:10:53.948887 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Searching host: 'np0000002687' for CPU controller through CGroups V1... {{(pid=98431) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 11 23:10:53.949563 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] CPU controller missing on host. {{(pid=98431) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 11 23:10:53.949932 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Searching host: 'np0000002687' for CPU controller through CGroups V2... {{(pid=98431) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 11 23:10:53.950072 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] CPU controller found on host. {{(pid=98431) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 11 23:10:53.950916 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98431) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 11 23:10:53.951190 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-11T23:08:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-11T23:08:20Z,direct_url=,disk_format='qcow2',id=f30640f8-7aca-4300-a085-4706a5209a79,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ce012f9fabdb4ee5a73e212437f59d97',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-11T23:08:23Z,virtual_size=,visibility=), allow threads: True {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 11 23:10:53.951322 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Flavor limits 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 11 23:10:53.951423 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Image limits 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 11 23:10:53.951573 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Flavor pref 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 11 23:10:53.951655 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Image pref 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 11 23:10:53.951750 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 11 23:10:53.951927 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 11 23:10:53.952732 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98431) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 11 23:10:53.954859 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Got 1 possible topologies {{(pid=98431) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 11 23:10:53.954859 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 11 23:10:53.956225 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 11 23:10:53.973081 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-11T23:10:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-439003148-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='tempest-testmultiattachvolumeswap-server-439003148-1',id=7,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJiPvaCzf6MnI1RIMFh7OGuYa8yejf4/MQ6XARcaU53VShAH2UqbgZMb0xxWuJdSGbXJNSkROJtN6eI7LOlxJllHoSwhWlfsLKPCGWl7oacshhsOrgJkm+Nq/cHNgBG2uQ==',key_name='tempest-keypair-270932437',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3a092509b877483183db8610c8763b93',ramdisk_id='',reservation_id='r-44bv6jg5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestMultiAttachVolumeSwap-329912157',owner_user_name='tempest-TestMultiAttachVolumeSwap-329912157-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-11T23:10:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b63bb5265a040fc8f755a27d13f43b3',uuid=27ac8c84-e5db-4bd1-a148-ec5834c5b39c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "673175fc-0e8b-46fe-9898-7e27d61b8694", "address": "fa:16:3e:dc:9c:b5", "network": {"id": "0dc6da23-6c97-4fd1-9e59-910adaa610a9", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-968328905-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a092509b877483183db8610c8763b93", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap673175fc-0e", "ovs_interfaceid": "673175fc-0e8b-46fe-9898-7e27d61b8694", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98431) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 11 23:10:53.973290 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Converting VIF {"id": "673175fc-0e8b-46fe-9898-7e27d61b8694", "address": "fa:16:3e:dc:9c:b5", "network": {"id": "0dc6da23-6c97-4fd1-9e59-910adaa610a9", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-968328905-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a092509b877483183db8610c8763b93", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap673175fc-0e", "ovs_interfaceid": "673175fc-0e8b-46fe-9898-7e27d61b8694", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:10:53.973734 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:9c:b5,bridge_name='br-int',has_traffic_filtering=True,id=673175fc-0e8b-46fe-9898-7e27d61b8694,network=Network(0dc6da23-6c97-4fd1-9e59-910adaa610a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap673175fc-0e') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:10:53.976052 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Lazy-loading 'pci_devices' on Instance uuid 27ac8c84-e5db-4bd1-a148-ec5834c5b39c {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:10:53.993322 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-dd35667d-ea77-4781-83f8-7bdecb4c5828 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:10:54.000834 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:54.008464 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:54.038955 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:54.042313 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:54.058297 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 36688d94-68d3-4ae3-989a-b391d7ee4ad9] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:10:54.068419 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Emitting event Paused> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:10:54.068566 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 36688d94-68d3-4ae3-989a-b391d7ee4ad9] VM Paused (Lifecycle Event) Jun 11 23:10:54.164118 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-dd35667d-ea77-4781-83f8-7bdecb4c5828 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] [instance: 73abd331-0bbf-432e-be1c-308801a5429f] Creating config drive at /opt/stack/data/nova/instances/73abd331-0bbf-432e-be1c-308801a5429f/disk.config Jun 11 23:10:54.168106 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-dd35667d-ea77-4781-83f8-7bdecb4c5828 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/73abd331-0bbf-432e-be1c-308801a5429f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmplhr195rs {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:10:54.197539 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-dd35667d-ea77-4781-83f8-7bdecb4c5828 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/73abd331-0bbf-432e-be1c-308801a5429f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmplhr195rs" returned: 0 in 0.029s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:10:54.227989 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-c5553338-94f5-4a23-b4db-49ad6afbc6a2 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Acquiring lock "689e510d-e0a4-4d6a-958e-9acfaebedc87" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:10:54.228435 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-c5553338-94f5-4a23-b4db-49ad6afbc6a2 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Lock "689e510d-e0a4-4d6a-958e-9acfaebedc87" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:10:54.341536 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] [instance: 14699717-b93f-4e67-b841-c67de8fff8d4] Start building block device mappings for instance. {{(pid=98431) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 11 23:10:54.400400 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98431) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 11 23:10:54.400580 np0000002687 nova-compute[98431]: DEBUG nova.compute.provider_tree [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Inventory has not changed in ProviderTree for provider: e3e65fe2-9de9-4821-8b4a-ccae37c66e25 {{(pid=98431) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 11 23:10:54.441582 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [req-e6cf05ec-1e71-4d90-8362-d23f392b52f2 req-e1f75959-60e6-4c9a-873b-60e6417a3e49 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:10:54.455282 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] [instance: 14699717-b93f-4e67-b841-c67de8fff8d4] Successfully updated port: a266c7d4-9f0e-474d-a4d9-5190dbdd0fc2 {{(pid=98431) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 11 23:10:54.477247 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] [instance: 27ac8c84-e5db-4bd1-a148-ec5834c5b39c] End _get_guest_xml xml= Jun 11 23:10:54.477247 np0000002687 nova-compute[98431]: 27ac8c84-e5db-4bd1-a148-ec5834c5b39c Jun 11 23:10:54.477247 np0000002687 nova-compute[98431]: instance-00000007 Jun 11 23:10:54.477247 np0000002687 nova-compute[98431]: 196608 Jun 11 23:10:54.477247 np0000002687 nova-compute[98431]: 1 Jun 11 23:10:54.477247 np0000002687 nova-compute[98431]: Jun 11 23:10:54.477247 np0000002687 nova-compute[98431]: Jun 11 23:10:54.477247 np0000002687 nova-compute[98431]: Jun 11 23:10:54.477247 np0000002687 nova-compute[98431]: tempest-TestMultiAttachVolumeSwap-server-439003148-1 Jun 11 23:10:54.477247 np0000002687 nova-compute[98431]: 2026-06-11 23:10:53 Jun 11 23:10:54.477247 np0000002687 nova-compute[98431]: Jun 11 23:10:54.477247 np0000002687 nova-compute[98431]: 192 Jun 11 23:10:54.477247 np0000002687 nova-compute[98431]: 1 Jun 11 23:10:54.477247 np0000002687 nova-compute[98431]: 0 Jun 11 23:10:54.477247 np0000002687 nova-compute[98431]: 0 Jun 11 23:10:54.477247 np0000002687 nova-compute[98431]: 1 Jun 11 23:10:54.477247 np0000002687 nova-compute[98431]: Jun 11 23:10:54.477247 np0000002687 nova-compute[98431]: True Jun 11 23:10:54.477247 np0000002687 nova-compute[98431]: Jun 11 23:10:54.477247 np0000002687 nova-compute[98431]: Jun 11 23:10:54.477247 np0000002687 nova-compute[98431]: Jun 11 23:10:54.477247 np0000002687 nova-compute[98431]: bare Jun 11 23:10:54.477247 np0000002687 nova-compute[98431]: qcow2 Jun 11 23:10:54.477247 np0000002687 nova-compute[98431]: 1 Jun 11 23:10:54.477247 np0000002687 nova-compute[98431]: 0 Jun 11 23:10:54.477247 np0000002687 nova-compute[98431]: Jun 11 23:10:54.477247 np0000002687 nova-compute[98431]: virtio Jun 11 23:10:54.477247 np0000002687 nova-compute[98431]: Jun 11 23:10:54.477247 np0000002687 nova-compute[98431]: Jun 11 23:10:54.477247 np0000002687 nova-compute[98431]: Jun 11 23:10:54.477247 np0000002687 nova-compute[98431]: tempest-TestMultiAttachVolumeSwap-329912157-project-member Jun 11 23:10:54.477247 np0000002687 nova-compute[98431]: tempest-TestMultiAttachVolumeSwap-329912157 Jun 11 23:10:54.477247 np0000002687 nova-compute[98431]: Jun 11 23:10:54.477247 np0000002687 nova-compute[98431]: Jun 11 23:10:54.477247 np0000002687 nova-compute[98431]: Jun 11 23:10:54.477247 np0000002687 nova-compute[98431]: Jun 11 23:10:54.477247 np0000002687 nova-compute[98431]: Jun 11 23:10:54.477247 np0000002687 nova-compute[98431]: Jun 11 23:10:54.477247 np0000002687 nova-compute[98431]: Jun 11 23:10:54.477247 np0000002687 nova-compute[98431]: Jun 11 23:10:54.477247 np0000002687 nova-compute[98431]: Jun 11 23:10:54.477247 np0000002687 nova-compute[98431]: Jun 11 23:10:54.477247 np0000002687 nova-compute[98431]: Jun 11 23:10:54.477247 np0000002687 nova-compute[98431]: OpenStack Foundation Jun 11 23:10:54.477247 np0000002687 nova-compute[98431]: OpenStack Nova Jun 11 23:10:54.477247 np0000002687 nova-compute[98431]: 33.1.0 Jun 11 23:10:54.477247 np0000002687 nova-compute[98431]: 27ac8c84-e5db-4bd1-a148-ec5834c5b39c Jun 11 23:10:54.477247 np0000002687 nova-compute[98431]: 27ac8c84-e5db-4bd1-a148-ec5834c5b39c Jun 11 23:10:54.477247 np0000002687 nova-compute[98431]: Virtual Machine Jun 11 23:10:54.477247 np0000002687 nova-compute[98431]: Jun 11 23:10:54.477247 np0000002687 nova-compute[98431]: Jun 11 23:10:54.477247 np0000002687 nova-compute[98431]: Jun 11 23:10:54.477247 np0000002687 nova-compute[98431]: hvm Jun 11 23:10:54.477247 np0000002687 nova-compute[98431]: Jun 11 23:10:54.477247 np0000002687 nova-compute[98431]: Jun 11 23:10:54.477247 np0000002687 nova-compute[98431]: Jun 11 23:10:54.477247 np0000002687 nova-compute[98431]: Jun 11 23:10:54.477247 np0000002687 nova-compute[98431]: Jun 11 23:10:54.477247 np0000002687 nova-compute[98431]: Jun 11 23:10:54.477247 np0000002687 nova-compute[98431]: 128 Jun 11 23:10:54.477247 np0000002687 nova-compute[98431]: Jun 11 23:10:54.477247 np0000002687 nova-compute[98431]: Jun 11 23:10:54.477247 np0000002687 nova-compute[98431]: Jun 11 23:10:54.477247 np0000002687 nova-compute[98431]: 1 Jun 11 23:10:54.477247 np0000002687 nova-compute[98431]: Jun 11 23:10:54.477247 np0000002687 nova-compute[98431]: Jun 11 23:10:54.477247 np0000002687 nova-compute[98431]: Nehalem Jun 11 23:10:54.477247 np0000002687 nova-compute[98431]: Jun 11 23:10:54.477247 np0000002687 nova-compute[98431]: Jun 11 23:10:54.477247 np0000002687 nova-compute[98431]: Jun 11 23:10:54.477247 np0000002687 nova-compute[98431]: Jun 11 23:10:54.477247 np0000002687 nova-compute[98431]: Jun 11 23:10:54.477247 np0000002687 nova-compute[98431]: Jun 11 23:10:54.477247 np0000002687 nova-compute[98431]: Jun 11 23:10:54.477247 np0000002687 nova-compute[98431]: Jun 11 23:10:54.477247 np0000002687 nova-compute[98431]: Jun 11 23:10:54.477247 np0000002687 nova-compute[98431]: Jun 11 23:10:54.477247 np0000002687 nova-compute[98431]: Jun 11 23:10:54.477247 np0000002687 nova-compute[98431]: Jun 11 23:10:54.477247 np0000002687 nova-compute[98431]: Jun 11 23:10:54.477247 np0000002687 nova-compute[98431]: Jun 11 23:10:54.477247 np0000002687 nova-compute[98431]: Jun 11 23:10:54.477247 np0000002687 nova-compute[98431]: Jun 11 23:10:54.477247 np0000002687 nova-compute[98431]: Jun 11 23:10:54.477247 np0000002687 nova-compute[98431]: Jun 11 23:10:54.477247 np0000002687 nova-compute[98431]: Jun 11 23:10:54.477247 np0000002687 nova-compute[98431]: Jun 11 23:10:54.477247 np0000002687 nova-compute[98431]: Jun 11 23:10:54.477247 np0000002687 nova-compute[98431]: Jun 11 23:10:54.477247 np0000002687 nova-compute[98431]: Jun 11 23:10:54.477247 np0000002687 nova-compute[98431]: Jun 11 23:10:54.477247 np0000002687 nova-compute[98431]: Jun 11 23:10:54.477247 np0000002687 nova-compute[98431]: Jun 11 23:10:54.477247 np0000002687 nova-compute[98431]: /dev/urandom Jun 11 23:10:54.477247 np0000002687 nova-compute[98431]: Jun 11 23:10:54.477247 np0000002687 nova-compute[98431]: Jun 11 23:10:54.477247 np0000002687 nova-compute[98431]: Jun 11 23:10:54.477247 np0000002687 nova-compute[98431]: Jun 11 23:10:54.477247 np0000002687 nova-compute[98431]: Jun 11 23:10:54.477247 np0000002687 nova-compute[98431]: Jun 11 23:10:54.477247 np0000002687 nova-compute[98431]: Jun 11 23:10:54.477247 np0000002687 nova-compute[98431]: {{(pid=98431) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 11 23:10:54.480216 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] [instance: 27ac8c84-e5db-4bd1-a148-ec5834c5b39c] Preparing to wait for external event network-vif-plugged-673175fc-0e8b-46fe-9898-7e27d61b8694 {{(pid=98431) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 11 23:10:54.480216 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Acquiring lock "27ac8c84-e5db-4bd1-a148-ec5834c5b39c-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:10:54.480216 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Lock "27ac8c84-e5db-4bd1-a148-ec5834c5b39c-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:10:54.480216 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Lock "27ac8c84-e5db-4bd1-a148-ec5834c5b39c-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:10:54.480216 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-11T23:10:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-439003148-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='tempest-testmultiattachvolumeswap-server-439003148-1',id=7,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJiPvaCzf6MnI1RIMFh7OGuYa8yejf4/MQ6XARcaU53VShAH2UqbgZMb0xxWuJdSGbXJNSkROJtN6eI7LOlxJllHoSwhWlfsLKPCGWl7oacshhsOrgJkm+Nq/cHNgBG2uQ==',key_name='tempest-keypair-270932437',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3a092509b877483183db8610c8763b93',ramdisk_id='',reservation_id='r-44bv6jg5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestMultiAttachVolumeSwap-329912157',owner_user_name='tempest-TestMultiAttachVolumeSwap-329912157-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-11T23:10:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b63bb5265a040fc8f755a27d13f43b3',uuid=27ac8c84-e5db-4bd1-a148-ec5834c5b39c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "673175fc-0e8b-46fe-9898-7e27d61b8694", "address": "fa:16:3e:dc:9c:b5", "network": {"id": "0dc6da23-6c97-4fd1-9e59-910adaa610a9", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-968328905-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a092509b877483183db8610c8763b93", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap673175fc-0e", "ovs_interfaceid": "673175fc-0e8b-46fe-9898-7e27d61b8694", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 11 23:10:54.480543 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Converting VIF {"id": "673175fc-0e8b-46fe-9898-7e27d61b8694", "address": "fa:16:3e:dc:9c:b5", "network": {"id": "0dc6da23-6c97-4fd1-9e59-910adaa610a9", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-968328905-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a092509b877483183db8610c8763b93", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap673175fc-0e", "ovs_interfaceid": "673175fc-0e8b-46fe-9898-7e27d61b8694", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:10:54.480543 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:9c:b5,bridge_name='br-int',has_traffic_filtering=True,id=673175fc-0e8b-46fe-9898-7e27d61b8694,network=Network(0dc6da23-6c97-4fd1-9e59-910adaa610a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap673175fc-0e') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:10:54.480543 np0000002687 nova-compute[98431]: DEBUG os_vif [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:9c:b5,bridge_name='br-int',has_traffic_filtering=True,id=673175fc-0e8b-46fe-9898-7e27d61b8694,network=Network(0dc6da23-6c97-4fd1-9e59-910adaa610a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap673175fc-0e') {{(pid=98431) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 11 23:10:54.480543 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:54.480543 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:10:54.484377 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 11 23:10:54.484377 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:54.484377 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '78c642c0-174c-5b64-89b6-78361f3e4806', '_type': 'linux-noop'}}, row=False) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:10:54.484377 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:54.484377 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:10:54.490573 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:54.493155 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:54.493377 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap673175fc-0e, may_exist=True, interface_attrs={}) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:10:54.494356 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap673175fc-0e, col_values=(('qos', UUID('13914899-caa9-47d2-919f-ab3941b9a916')),), if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:10:54.494356 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap673175fc-0e, col_values=(('external_ids', {'iface-id': '673175fc-0e8b-46fe-9898-7e27d61b8694', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dc:9c:b5', 'vm-uuid': '27ac8c84-e5db-4bd1-a148-ec5834c5b39c'}),), if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:10:54.497050 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:54.498611 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:10:54.507545 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:54.509045 np0000002687 nova-compute[98431]: INFO os_vif [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:9c:b5,bridge_name='br-int',has_traffic_filtering=True,id=673175fc-0e8b-46fe-9898-7e27d61b8694,network=Network(0dc6da23-6c97-4fd1-9e59-910adaa610a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap673175fc-0e') Jun 11 23:10:54.577064 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 36688d94-68d3-4ae3-989a-b391d7ee4ad9] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:10:54.578424 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 36688d94-68d3-4ae3-989a-b391d7ee4ad9] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98431) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 11 23:10:54.623283 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:54.652939 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:54.657772 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:54.733664 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-c5553338-94f5-4a23-b4db-49ad6afbc6a2 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Lazy-loading 'flavor' on Instance uuid 689e510d-e0a4-4d6a-958e-9acfaebedc87 {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:10:54.749838 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:54.886080 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [req-e6cf05ec-1e71-4d90-8362-d23f392b52f2 req-e1f75959-60e6-4c9a-873b-60e6417a3e49 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:10:54.905625 np0000002687 nova-compute[98431]: DEBUG nova.scheduler.client.report [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Inventory has not changed for provider e3e65fe2-9de9-4821-8b4a-ccae37c66e25 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98431) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 11 23:10:54.937132 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-d5850329-6f8b-48cb-bf1c-75c7c3f7eddf req-e1d7a048-4526-48ee-ae7a-7ee2f81ffa1f service nova] [instance: de4372a4-a0cc-4541-a5a2-87be3152c50e] Received event network-vif-plugged-54aaea68-1159-4201-967a-c8074f08eadb {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:10:54.937622 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-d5850329-6f8b-48cb-bf1c-75c7c3f7eddf req-e1d7a048-4526-48ee-ae7a-7ee2f81ffa1f service nova] Acquiring lock "de4372a4-a0cc-4541-a5a2-87be3152c50e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:10:54.941473 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-d5850329-6f8b-48cb-bf1c-75c7c3f7eddf req-e1d7a048-4526-48ee-ae7a-7ee2f81ffa1f service nova] Lock "de4372a4-a0cc-4541-a5a2-87be3152c50e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.004s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:10:54.941473 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-d5850329-6f8b-48cb-bf1c-75c7c3f7eddf req-e1d7a048-4526-48ee-ae7a-7ee2f81ffa1f service nova] Lock "de4372a4-a0cc-4541-a5a2-87be3152c50e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:10:54.941602 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-d5850329-6f8b-48cb-bf1c-75c7c3f7eddf req-e1d7a048-4526-48ee-ae7a-7ee2f81ffa1f service nova] [instance: de4372a4-a0cc-4541-a5a2-87be3152c50e] Processing event network-vif-plugged-54aaea68-1159-4201-967a-c8074f08eadb {{(pid=98431) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 11 23:10:54.941733 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-d5850329-6f8b-48cb-bf1c-75c7c3f7eddf req-e1d7a048-4526-48ee-ae7a-7ee2f81ffa1f service nova] [instance: de4372a4-a0cc-4541-a5a2-87be3152c50e] Received event network-vif-plugged-54aaea68-1159-4201-967a-c8074f08eadb {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:10:54.941915 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-d5850329-6f8b-48cb-bf1c-75c7c3f7eddf req-e1d7a048-4526-48ee-ae7a-7ee2f81ffa1f service nova] Acquiring lock "de4372a4-a0cc-4541-a5a2-87be3152c50e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:10:54.942488 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-d5850329-6f8b-48cb-bf1c-75c7c3f7eddf req-e1d7a048-4526-48ee-ae7a-7ee2f81ffa1f service nova] Lock "de4372a4-a0cc-4541-a5a2-87be3152c50e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:10:54.942488 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-d5850329-6f8b-48cb-bf1c-75c7c3f7eddf req-e1d7a048-4526-48ee-ae7a-7ee2f81ffa1f service nova] Lock "de4372a4-a0cc-4541-a5a2-87be3152c50e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:10:54.943464 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-d5850329-6f8b-48cb-bf1c-75c7c3f7eddf req-e1d7a048-4526-48ee-ae7a-7ee2f81ffa1f service nova] [instance: de4372a4-a0cc-4541-a5a2-87be3152c50e] No waiting events found dispatching network-vif-plugged-54aaea68-1159-4201-967a-c8074f08eadb {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:10:54.945027 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: de4372a4-a0cc-4541-a5a2-87be3152c50e] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98431) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 11 23:10:54.947345 np0000002687 nova-compute[98431]: WARNING nova.compute.manager [req-d5850329-6f8b-48cb-bf1c-75c7c3f7eddf req-e1d7a048-4526-48ee-ae7a-7ee2f81ffa1f service nova] [instance: de4372a4-a0cc-4541-a5a2-87be3152c50e] Received unexpected event network-vif-plugged-54aaea68-1159-4201-967a-c8074f08eadb for instance with vm_state building and task_state spawning. Jun 11 23:10:54.947345 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-d5850329-6f8b-48cb-bf1c-75c7c3f7eddf req-e1d7a048-4526-48ee-ae7a-7ee2f81ffa1f service nova] [instance: 14699717-b93f-4e67-b841-c67de8fff8d4] Received event network-changed-a266c7d4-9f0e-474d-a4d9-5190dbdd0fc2 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:10:54.947345 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-d5850329-6f8b-48cb-bf1c-75c7c3f7eddf req-e1d7a048-4526-48ee-ae7a-7ee2f81ffa1f service nova] [instance: 14699717-b93f-4e67-b841-c67de8fff8d4] Refreshing instance network info cache due to event network-changed-a266c7d4-9f0e-474d-a4d9-5190dbdd0fc2. {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 11 23:10:54.947345 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-d5850329-6f8b-48cb-bf1c-75c7c3f7eddf req-e1d7a048-4526-48ee-ae7a-7ee2f81ffa1f service nova] Acquiring lock "refresh_cache-14699717-b93f-4e67-b841-c67de8fff8d4" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 11 23:10:54.947345 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-d5850329-6f8b-48cb-bf1c-75c7c3f7eddf req-e1d7a048-4526-48ee-ae7a-7ee2f81ffa1f service nova] Acquired lock "refresh_cache-14699717-b93f-4e67-b841-c67de8fff8d4" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 11 23:10:54.947345 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-d5850329-6f8b-48cb-bf1c-75c7c3f7eddf req-e1d7a048-4526-48ee-ae7a-7ee2f81ffa1f service nova] [instance: 14699717-b93f-4e67-b841-c67de8fff8d4] Refreshing network info cache for port a266c7d4-9f0e-474d-a4d9-5190dbdd0fc2 {{(pid=98431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 11 23:10:54.951107 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: de4372a4-a0cc-4541-a5a2-87be3152c50e] Guest created on hypervisor {{(pid=98431) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}} Jun 11 23:10:54.957456 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Acquiring lock "refresh_cache-14699717-b93f-4e67-b841-c67de8fff8d4" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 11 23:10:54.957638 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [-] [instance: de4372a4-a0cc-4541-a5a2-87be3152c50e] Instance spawned successfully. Jun 11 23:10:54.958139 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: de4372a4-a0cc-4541-a5a2-87be3152c50e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 11 23:10:55.016858 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:55.025679 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:55.048640 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:55.080787 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 36688d94-68d3-4ae3-989a-b391d7ee4ad9] During sync_power_state the instance has a pending task (spawning). Skip. Jun 11 23:10:55.081082 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Emitting event Started> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:10:55.081188 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: de4372a4-a0cc-4541-a5a2-87be3152c50e] VM Started (Lifecycle Event) Jun 11 23:10:55.111938 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-3c23ba4a-8e4a-49fa-9b55-f6a7f67cc87b req-de0bffc4-f151-4fe5-b14a-89e206e0504e service nova] [instance: 8aec3cea-109d-43f8-983c-1d5ee2f71181] Received event network-vif-unplugged-6d2a143c-c69d-424d-8c91-e8553a8166a9 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:10:55.112113 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-3c23ba4a-8e4a-49fa-9b55-f6a7f67cc87b req-de0bffc4-f151-4fe5-b14a-89e206e0504e service nova] Acquiring lock "8aec3cea-109d-43f8-983c-1d5ee2f71181-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:10:55.112243 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-3c23ba4a-8e4a-49fa-9b55-f6a7f67cc87b req-de0bffc4-f151-4fe5-b14a-89e206e0504e service nova] Lock "8aec3cea-109d-43f8-983c-1d5ee2f71181-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:10:55.112363 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-3c23ba4a-8e4a-49fa-9b55-f6a7f67cc87b req-de0bffc4-f151-4fe5-b14a-89e206e0504e service nova] Lock "8aec3cea-109d-43f8-983c-1d5ee2f71181-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:10:55.112451 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-3c23ba4a-8e4a-49fa-9b55-f6a7f67cc87b req-de0bffc4-f151-4fe5-b14a-89e206e0504e service nova] [instance: 8aec3cea-109d-43f8-983c-1d5ee2f71181] No event matching network-vif-unplugged-6d2a143c-c69d-424d-8c91-e8553a8166a9 in dict_keys([('network-vif-plugged', '6d2a143c-c69d-424d-8c91-e8553a8166a9')]) {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jun 11 23:10:55.112602 np0000002687 nova-compute[98431]: WARNING nova.compute.manager [req-3c23ba4a-8e4a-49fa-9b55-f6a7f67cc87b req-de0bffc4-f151-4fe5-b14a-89e206e0504e service nova] [instance: 8aec3cea-109d-43f8-983c-1d5ee2f71181] Received unexpected event network-vif-unplugged-6d2a143c-c69d-424d-8c91-e8553a8166a9 for instance with vm_state building and task_state spawning. Jun 11 23:10:55.158724 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-e6cf05ec-1e71-4d90-8362-d23f392b52f2 req-e1f75959-60e6-4c9a-873b-60e6417a3e49 service nova] [instance: 27ac8c84-e5db-4bd1-a148-ec5834c5b39c] Updated VIF entry in instance network info cache for port 673175fc-0e8b-46fe-9898-7e27d61b8694. {{(pid=98431) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 11 23:10:55.158940 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-e6cf05ec-1e71-4d90-8362-d23f392b52f2 req-e1f75959-60e6-4c9a-873b-60e6417a3e49 service nova] [instance: 27ac8c84-e5db-4bd1-a148-ec5834c5b39c] Updating instance_info_cache with network_info: [{"id": "673175fc-0e8b-46fe-9898-7e27d61b8694", "address": "fa:16:3e:dc:9c:b5", "network": {"id": "0dc6da23-6c97-4fd1-9e59-910adaa610a9", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-968328905-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a092509b877483183db8610c8763b93", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap673175fc-0e", "ovs_interfaceid": "673175fc-0e8b-46fe-9898-7e27d61b8694", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:10:55.294700 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-a57d5009-f5a1-485c-be52-da67617bd7c3 req-edf0519b-4733-4883-b76f-44927c79833d service nova] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Received event network-vif-unplugged-2d6dd8b9-e3ff-462f-92cf-8c3a62bc27d1 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:10:55.294700 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-a57d5009-f5a1-485c-be52-da67617bd7c3 req-edf0519b-4733-4883-b76f-44927c79833d service nova] Acquiring lock "cb63f66c-b69e-42b0-805c-be6fe9b3aee3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:10:55.294700 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-a57d5009-f5a1-485c-be52-da67617bd7c3 req-edf0519b-4733-4883-b76f-44927c79833d service nova] Lock "cb63f66c-b69e-42b0-805c-be6fe9b3aee3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:10:55.295013 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-a57d5009-f5a1-485c-be52-da67617bd7c3 req-edf0519b-4733-4883-b76f-44927c79833d service nova] Lock "cb63f66c-b69e-42b0-805c-be6fe9b3aee3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:10:55.295083 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-a57d5009-f5a1-485c-be52-da67617bd7c3 req-edf0519b-4733-4883-b76f-44927c79833d service nova] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] No event matching network-vif-unplugged-2d6dd8b9-e3ff-462f-92cf-8c3a62bc27d1 in dict_keys([('network-vif-plugged', '2d6dd8b9-e3ff-462f-92cf-8c3a62bc27d1')]) {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jun 11 23:10:55.297523 np0000002687 nova-compute[98431]: WARNING nova.compute.manager [req-a57d5009-f5a1-485c-be52-da67617bd7c3 req-edf0519b-4733-4883-b76f-44927c79833d service nova] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Received unexpected event network-vif-unplugged-2d6dd8b9-e3ff-462f-92cf-8c3a62bc27d1 for instance with vm_state building and task_state spawning. Jun 11 23:10:55.357009 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] [instance: 14699717-b93f-4e67-b841-c67de8fff8d4] Start spawning the instance on the hypervisor. {{(pid=98431) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 11 23:10:55.358157 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] [instance: 14699717-b93f-4e67-b841-c67de8fff8d4] Creating instance directory {{(pid=98431) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}} Jun 11 23:10:55.358658 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] [instance: 14699717-b93f-4e67-b841-c67de8fff8d4] Creating image(s) Jun 11 23:10:55.359549 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Acquiring lock "/opt/stack/data/nova/instances/14699717-b93f-4e67-b841-c67de8fff8d4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:10:55.360030 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Lock "/opt/stack/data/nova/instances/14699717-b93f-4e67-b841-c67de8fff8d4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:10:55.360988 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Lock "/opt/stack/data/nova/instances/14699717-b93f-4e67-b841-c67de8fff8d4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:10:55.361262 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:10:55.365633 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:10:55.366597 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:10:55.417427 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.604s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:10:55.418115 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Start building networks asynchronously for instance. {{(pid=98431) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 11 23:10:55.449515 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [req-d5850329-6f8b-48cb-bf1c-75c7c3f7eddf req-e1d7a048-4526-48ee-ae7a-7ee2f81ffa1f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:10:55.454896 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json" returned: 0 in 0.088s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:10:55.455512 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Acquiring lock "d2c441059b2992961b5de03c05b32d04aff77cb1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:10:55.456528 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Lock "d2c441059b2992961b5de03c05b32d04aff77cb1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:10:55.457433 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:10:55.461195 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:10:55.467506 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:10:55.492463 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: de4372a4-a0cc-4541-a5a2-87be3152c50e] Found default for hw_cdrom_bus of ide {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:10:55.493080 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: de4372a4-a0cc-4541-a5a2-87be3152c50e] Found default for hw_disk_bus of virtio {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:10:55.493609 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: de4372a4-a0cc-4541-a5a2-87be3152c50e] Found default for hw_input_bus of None {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:10:55.495295 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: de4372a4-a0cc-4541-a5a2-87be3152c50e] Found default for hw_pointer_model of None {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:10:55.496161 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: de4372a4-a0cc-4541-a5a2-87be3152c50e] Found default for hw_video_model of virtio {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:10:55.499635 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: de4372a4-a0cc-4541-a5a2-87be3152c50e] Found default for hw_vif_model of virtio {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:10:55.562304 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json" returned: 0 in 0.094s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:10:55.562847 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1,backing_fmt=raw /opt/stack/data/nova/instances/14699717-b93f-4e67-b841-c67de8fff8d4/disk 1073741824 {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:10:55.583032 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-d5850329-6f8b-48cb-bf1c-75c7c3f7eddf req-e1d7a048-4526-48ee-ae7a-7ee2f81ffa1f service nova] [instance: 14699717-b93f-4e67-b841-c67de8fff8d4] Instance cache missing network info. {{(pid=98431) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 11 23:10:55.588646 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: de4372a4-a0cc-4541-a5a2-87be3152c50e] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:10:55.591723 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: de4372a4-a0cc-4541-a5a2-87be3152c50e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98431) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 11 23:10:55.599565 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1,backing_fmt=raw /opt/stack/data/nova/instances/14699717-b93f-4e67-b841-c67de8fff8d4/disk 1073741824" returned: 0 in 0.037s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:10:55.600185 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Lock "d2c441059b2992961b5de03c05b32d04aff77cb1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.144s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:10:55.600923 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:10:55.664825 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-e6cf05ec-1e71-4d90-8362-d23f392b52f2 req-e1f75959-60e6-4c9a-873b-60e6417a3e49 service nova] Releasing lock "refresh_cache-27ac8c84-e5db-4bd1-a148-ec5834c5b39c" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 11 23:10:55.685708 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json" returned: 0 in 0.085s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:10:55.686099 np0000002687 nova-compute[98431]: DEBUG nova.virt.disk.api [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Checking if we can resize image /opt/stack/data/nova/instances/14699717-b93f-4e67-b841-c67de8fff8d4/disk. size=1073741824 {{(pid=98431) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 11 23:10:55.686306 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14699717-b93f-4e67-b841-c67de8fff8d4/disk --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:10:55.745403 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-c5553338-94f5-4a23-b4db-49ad6afbc6a2 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Lock "689e510d-e0a4-4d6a-958e-9acfaebedc87" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.517s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:10:55.769029 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14699717-b93f-4e67-b841-c67de8fff8d4/disk --force-share --output=json" returned: 0 in 0.082s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:10:55.769455 np0000002687 nova-compute[98431]: DEBUG nova.virt.disk.api [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Cannot resize image /opt/stack/data/nova/instances/14699717-b93f-4e67-b841-c67de8fff8d4/disk to a smaller size. {{(pid=98431) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 11 23:10:55.769890 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] [instance: 14699717-b93f-4e67-b841-c67de8fff8d4] Created local disks {{(pid=98431) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}} Jun 11 23:10:55.770095 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] [instance: 14699717-b93f-4e67-b841-c67de8fff8d4] Ensure instance console log exists: /opt/stack/data/nova/instances/14699717-b93f-4e67-b841-c67de8fff8d4/console.log {{(pid=98431) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}} Jun 11 23:10:55.771583 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:10:55.771583 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:10:55.771583 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:10:55.828099 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-d5850329-6f8b-48cb-bf1c-75c7c3f7eddf req-e1d7a048-4526-48ee-ae7a-7ee2f81ffa1f service nova] [instance: 14699717-b93f-4e67-b841-c67de8fff8d4] Updating instance_info_cache with network_info: [] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:10:55.925200 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Allocating IP information in the background. {{(pid=98431) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 11 23:10:55.925899 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] allocate_for_instance() {{(pid=98431) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 11 23:10:55.926388 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:10:55.926762 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:10:56.007965 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: de4372a4-a0cc-4541-a5a2-87be3152c50e] Took 10.35 seconds to spawn the instance on the hypervisor. Jun 11 23:10:56.007965 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: de4372a4-a0cc-4541-a5a2-87be3152c50e] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:10:56.033714 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] No BDM found with device name vda, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:10:56.038070 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] No BDM found with device name hda, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:10:56.038337 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] No VIF found with MAC fa:16:3e:dc:9c:b5, not building metadata {{(pid=98431) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13199}} Jun 11 23:10:56.039360 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] [instance: 27ac8c84-e5db-4bd1-a148-ec5834c5b39c] Using config drive Jun 11 23:10:56.095842 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: de4372a4-a0cc-4541-a5a2-87be3152c50e] During sync_power_state the instance has a pending task (spawning). Skip. Jun 11 23:10:56.096003 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Emitting event Paused> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:10:56.096003 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: de4372a4-a0cc-4541-a5a2-87be3152c50e] VM Paused (Lifecycle Event) Jun 11 23:10:56.193330 np0000002687 nova-compute[98431]: DEBUG nova.policy [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c853441cf4f34e4d9cd6821201efc91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57813123648a4335a97e8fc5c245cc73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98431) authorize /opt/stack/nova/nova/policy.py:192}} Jun 11 23:10:56.330120 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-d5850329-6f8b-48cb-bf1c-75c7c3f7eddf req-e1d7a048-4526-48ee-ae7a-7ee2f81ffa1f service nova] Releasing lock "refresh_cache-14699717-b93f-4e67-b841-c67de8fff8d4" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 11 23:10:56.330731 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Acquired lock "refresh_cache-14699717-b93f-4e67-b841-c67de8fff8d4" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 11 23:10:56.330949 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] [instance: 14699717-b93f-4e67-b841-c67de8fff8d4] Building network info cache for instance {{(pid=98431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 11 23:10:56.431984 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 11 23:10:56.519449 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: de4372a4-a0cc-4541-a5a2-87be3152c50e] Took 18.53 seconds to build instance. Jun 11 23:10:56.549334 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:10:56.598995 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: de4372a4-a0cc-4541-a5a2-87be3152c50e] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:10:56.604285 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Emitting event Resumed> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:10:56.604442 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: de4372a4-a0cc-4541-a5a2-87be3152c50e] VM Resumed (Lifecycle Event) Jun 11 23:10:56.667136 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Successfully created port: 7808ce0e-ec36-4dfa-84d5-0eb1ce542139 {{(pid=98431) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 11 23:10:56.711835 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] [instance: 27ac8c84-e5db-4bd1-a148-ec5834c5b39c] Creating config drive at /opt/stack/data/nova/instances/27ac8c84-e5db-4bd1-a148-ec5834c5b39c/disk.config Jun 11 23:10:56.719223 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/27ac8c84-e5db-4bd1-a148-ec5834c5b39c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpvzthpcnw {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:10:56.757263 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/27ac8c84-e5db-4bd1-a148-ec5834c5b39c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpvzthpcnw" returned: 0 in 0.038s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:10:56.921070 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] [instance: 14699717-b93f-4e67-b841-c67de8fff8d4] Instance cache missing network info. {{(pid=98431) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 11 23:10:57.016219 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-1ce00b65-5ad4-4ccf-8f80-b322e82219f1 req-3eddb3da-31fe-4ffb-b2bc-160ab0b66a47 service nova] [instance: 73abd331-0bbf-432e-be1c-308801a5429f] Received event network-vif-plugged-d1203b92-b9d5-4d1c-bc39-326783c31294 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:10:57.018299 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-1ce00b65-5ad4-4ccf-8f80-b322e82219f1 req-3eddb3da-31fe-4ffb-b2bc-160ab0b66a47 service nova] Acquiring lock "73abd331-0bbf-432e-be1c-308801a5429f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:10:57.018618 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-1ce00b65-5ad4-4ccf-8f80-b322e82219f1 req-3eddb3da-31fe-4ffb-b2bc-160ab0b66a47 service nova] Lock "73abd331-0bbf-432e-be1c-308801a5429f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:10:57.018863 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-1ce00b65-5ad4-4ccf-8f80-b322e82219f1 req-3eddb3da-31fe-4ffb-b2bc-160ab0b66a47 service nova] Lock "73abd331-0bbf-432e-be1c-308801a5429f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:10:57.019233 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-1ce00b65-5ad4-4ccf-8f80-b322e82219f1 req-3eddb3da-31fe-4ffb-b2bc-160ab0b66a47 service nova] [instance: 73abd331-0bbf-432e-be1c-308801a5429f] Processing event network-vif-plugged-d1203b92-b9d5-4d1c-bc39-326783c31294 {{(pid=98431) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 11 23:10:57.019415 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-1ce00b65-5ad4-4ccf-8f80-b322e82219f1 req-3eddb3da-31fe-4ffb-b2bc-160ab0b66a47 service nova] [instance: 73abd331-0bbf-432e-be1c-308801a5429f] Received event network-vif-plugged-d1203b92-b9d5-4d1c-bc39-326783c31294 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:10:57.019578 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-1ce00b65-5ad4-4ccf-8f80-b322e82219f1 req-3eddb3da-31fe-4ffb-b2bc-160ab0b66a47 service nova] Acquiring lock "73abd331-0bbf-432e-be1c-308801a5429f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:10:57.020036 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-dd35667d-ea77-4781-83f8-7bdecb4c5828 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] [instance: 73abd331-0bbf-432e-be1c-308801a5429f] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=98431) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 11 23:10:57.020261 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-1ce00b65-5ad4-4ccf-8f80-b322e82219f1 req-3eddb3da-31fe-4ffb-b2bc-160ab0b66a47 service nova] Lock "73abd331-0bbf-432e-be1c-308801a5429f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:10:57.020405 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-1ce00b65-5ad4-4ccf-8f80-b322e82219f1 req-3eddb3da-31fe-4ffb-b2bc-160ab0b66a47 service nova] Lock "73abd331-0bbf-432e-be1c-308801a5429f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:10:57.020551 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-1ce00b65-5ad4-4ccf-8f80-b322e82219f1 req-3eddb3da-31fe-4ffb-b2bc-160ab0b66a47 service nova] [instance: 73abd331-0bbf-432e-be1c-308801a5429f] No waiting events found dispatching network-vif-plugged-d1203b92-b9d5-4d1c-bc39-326783c31294 {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:10:57.020713 np0000002687 nova-compute[98431]: WARNING nova.compute.manager [req-1ce00b65-5ad4-4ccf-8f80-b322e82219f1 req-3eddb3da-31fe-4ffb-b2bc-160ab0b66a47 service nova] [instance: 73abd331-0bbf-432e-be1c-308801a5429f] Received unexpected event network-vif-plugged-d1203b92-b9d5-4d1c-bc39-326783c31294 for instance with vm_state building and task_state spawning. Jun 11 23:10:57.021726 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "de4372a4-a0cc-4541-a5a2-87be3152c50e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 20.044s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:10:57.026183 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-dd35667d-ea77-4781-83f8-7bdecb4c5828 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] [instance: 73abd331-0bbf-432e-be1c-308801a5429f] Guest created on hypervisor {{(pid=98431) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}} Jun 11 23:10:57.033264 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [-] [instance: 73abd331-0bbf-432e-be1c-308801a5429f] Instance spawned successfully. Jun 11 23:10:57.034191 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-dd35667d-ea77-4781-83f8-7bdecb4c5828 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] [instance: 73abd331-0bbf-432e-be1c-308801a5429f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 11 23:10:57.099198 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:10:57.106755 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: de4372a4-a0cc-4541-a5a2-87be3152c50e] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:10:57.112170 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: de4372a4-a0cc-4541-a5a2-87be3152c50e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98431) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 11 23:10:57.163351 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Successfully created port: b54ddd43-d4cb-4d4a-840e-895e75419e25 {{(pid=98431) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 11 23:10:57.196751 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-fd4b2405-7419-40ad-99f8-8d7d07e0e61e req-df031cdb-d49e-4a9b-9604-7381d1942c16 service nova] [instance: 8aec3cea-109d-43f8-983c-1d5ee2f71181] Received event network-vif-plugged-6d2a143c-c69d-424d-8c91-e8553a8166a9 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:10:57.197194 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-fd4b2405-7419-40ad-99f8-8d7d07e0e61e req-df031cdb-d49e-4a9b-9604-7381d1942c16 service nova] Acquiring lock "8aec3cea-109d-43f8-983c-1d5ee2f71181-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:10:57.197363 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-fd4b2405-7419-40ad-99f8-8d7d07e0e61e req-df031cdb-d49e-4a9b-9604-7381d1942c16 service nova] Lock "8aec3cea-109d-43f8-983c-1d5ee2f71181-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:10:57.197527 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-fd4b2405-7419-40ad-99f8-8d7d07e0e61e req-df031cdb-d49e-4a9b-9604-7381d1942c16 service nova] Lock "8aec3cea-109d-43f8-983c-1d5ee2f71181-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:10:57.197678 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-fd4b2405-7419-40ad-99f8-8d7d07e0e61e req-df031cdb-d49e-4a9b-9604-7381d1942c16 service nova] [instance: 8aec3cea-109d-43f8-983c-1d5ee2f71181] Processing event network-vif-plugged-6d2a143c-c69d-424d-8c91-e8553a8166a9 {{(pid=98431) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 11 23:10:57.197842 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-fd4b2405-7419-40ad-99f8-8d7d07e0e61e req-df031cdb-d49e-4a9b-9604-7381d1942c16 service nova] [instance: 8aec3cea-109d-43f8-983c-1d5ee2f71181] Received event network-vif-plugged-6d2a143c-c69d-424d-8c91-e8553a8166a9 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:10:57.198229 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-fd4b2405-7419-40ad-99f8-8d7d07e0e61e req-df031cdb-d49e-4a9b-9604-7381d1942c16 service nova] Acquiring lock "8aec3cea-109d-43f8-983c-1d5ee2f71181-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:10:57.198431 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-fd4b2405-7419-40ad-99f8-8d7d07e0e61e req-df031cdb-d49e-4a9b-9604-7381d1942c16 service nova] Lock "8aec3cea-109d-43f8-983c-1d5ee2f71181-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:10:57.198518 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-fd4b2405-7419-40ad-99f8-8d7d07e0e61e req-df031cdb-d49e-4a9b-9604-7381d1942c16 service nova] Lock "8aec3cea-109d-43f8-983c-1d5ee2f71181-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:10:57.199101 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 8aec3cea-109d-43f8-983c-1d5ee2f71181] Instance event wait completed in 14 seconds for network-vif-plugged {{(pid=98431) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 11 23:10:57.199489 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-fd4b2405-7419-40ad-99f8-8d7d07e0e61e req-df031cdb-d49e-4a9b-9604-7381d1942c16 service nova] [instance: 8aec3cea-109d-43f8-983c-1d5ee2f71181] No waiting events found dispatching network-vif-plugged-6d2a143c-c69d-424d-8c91-e8553a8166a9 {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:10:57.199649 np0000002687 nova-compute[98431]: WARNING nova.compute.manager [req-fd4b2405-7419-40ad-99f8-8d7d07e0e61e req-df031cdb-d49e-4a9b-9604-7381d1942c16 service nova] [instance: 8aec3cea-109d-43f8-983c-1d5ee2f71181] Received unexpected event network-vif-plugged-6d2a143c-c69d-424d-8c91-e8553a8166a9 for instance with vm_state building and task_state spawning. Jun 11 23:10:57.199788 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-fd4b2405-7419-40ad-99f8-8d7d07e0e61e req-df031cdb-d49e-4a9b-9604-7381d1942c16 service nova] [instance: 36688d94-68d3-4ae3-989a-b391d7ee4ad9] Received event network-vif-unplugged-6075e13d-d32a-4d8f-8741-a4686059985e {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:10:57.199947 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-fd4b2405-7419-40ad-99f8-8d7d07e0e61e req-df031cdb-d49e-4a9b-9604-7381d1942c16 service nova] Acquiring lock "36688d94-68d3-4ae3-989a-b391d7ee4ad9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:10:57.200088 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-fd4b2405-7419-40ad-99f8-8d7d07e0e61e req-df031cdb-d49e-4a9b-9604-7381d1942c16 service nova] Lock "36688d94-68d3-4ae3-989a-b391d7ee4ad9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:10:57.200228 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-fd4b2405-7419-40ad-99f8-8d7d07e0e61e req-df031cdb-d49e-4a9b-9604-7381d1942c16 service nova] Lock "36688d94-68d3-4ae3-989a-b391d7ee4ad9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:10:57.200369 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-fd4b2405-7419-40ad-99f8-8d7d07e0e61e req-df031cdb-d49e-4a9b-9604-7381d1942c16 service nova] [instance: 36688d94-68d3-4ae3-989a-b391d7ee4ad9] No event matching network-vif-unplugged-6075e13d-d32a-4d8f-8741-a4686059985e in dict_keys([('network-vif-plugged', '6075e13d-d32a-4d8f-8741-a4686059985e')]) {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jun 11 23:10:57.200506 np0000002687 nova-compute[98431]: WARNING nova.compute.manager [req-fd4b2405-7419-40ad-99f8-8d7d07e0e61e req-df031cdb-d49e-4a9b-9604-7381d1942c16 service nova] [instance: 36688d94-68d3-4ae3-989a-b391d7ee4ad9] Received unexpected event network-vif-unplugged-6075e13d-d32a-4d8f-8741-a4686059985e for instance with vm_state building and task_state spawning. Jun 11 23:10:57.200631 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-fd4b2405-7419-40ad-99f8-8d7d07e0e61e req-df031cdb-d49e-4a9b-9604-7381d1942c16 service nova] [instance: 36688d94-68d3-4ae3-989a-b391d7ee4ad9] Received event network-vif-plugged-6075e13d-d32a-4d8f-8741-a4686059985e {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:10:57.200773 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-fd4b2405-7419-40ad-99f8-8d7d07e0e61e req-df031cdb-d49e-4a9b-9604-7381d1942c16 service nova] Acquiring lock "36688d94-68d3-4ae3-989a-b391d7ee4ad9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:10:57.200955 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-fd4b2405-7419-40ad-99f8-8d7d07e0e61e req-df031cdb-d49e-4a9b-9604-7381d1942c16 service nova] Lock "36688d94-68d3-4ae3-989a-b391d7ee4ad9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:10:57.201079 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-fd4b2405-7419-40ad-99f8-8d7d07e0e61e req-df031cdb-d49e-4a9b-9604-7381d1942c16 service nova] Lock "36688d94-68d3-4ae3-989a-b391d7ee4ad9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:10:57.201206 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-fd4b2405-7419-40ad-99f8-8d7d07e0e61e req-df031cdb-d49e-4a9b-9604-7381d1942c16 service nova] [instance: 36688d94-68d3-4ae3-989a-b391d7ee4ad9] Processing event network-vif-plugged-6075e13d-d32a-4d8f-8741-a4686059985e {{(pid=98431) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 11 23:10:57.201362 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-fd4b2405-7419-40ad-99f8-8d7d07e0e61e req-df031cdb-d49e-4a9b-9604-7381d1942c16 service nova] [instance: 36688d94-68d3-4ae3-989a-b391d7ee4ad9] Received event network-vif-plugged-6075e13d-d32a-4d8f-8741-a4686059985e {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:10:57.201499 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-fd4b2405-7419-40ad-99f8-8d7d07e0e61e req-df031cdb-d49e-4a9b-9604-7381d1942c16 service nova] Acquiring lock "36688d94-68d3-4ae3-989a-b391d7ee4ad9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:10:57.201632 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-fd4b2405-7419-40ad-99f8-8d7d07e0e61e req-df031cdb-d49e-4a9b-9604-7381d1942c16 service nova] Lock "36688d94-68d3-4ae3-989a-b391d7ee4ad9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:10:57.201751 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-fd4b2405-7419-40ad-99f8-8d7d07e0e61e req-df031cdb-d49e-4a9b-9604-7381d1942c16 service nova] Lock "36688d94-68d3-4ae3-989a-b391d7ee4ad9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:10:57.201905 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-fd4b2405-7419-40ad-99f8-8d7d07e0e61e req-df031cdb-d49e-4a9b-9604-7381d1942c16 service nova] [instance: 36688d94-68d3-4ae3-989a-b391d7ee4ad9] No waiting events found dispatching network-vif-plugged-6075e13d-d32a-4d8f-8741-a4686059985e {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:10:57.202352 np0000002687 nova-compute[98431]: WARNING nova.compute.manager [req-fd4b2405-7419-40ad-99f8-8d7d07e0e61e req-df031cdb-d49e-4a9b-9604-7381d1942c16 service nova] [instance: 36688d94-68d3-4ae3-989a-b391d7ee4ad9] Received unexpected event network-vif-plugged-6075e13d-d32a-4d8f-8741-a4686059985e for instance with vm_state building and task_state spawning. Jun 11 23:10:57.202733 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] [instance: 36688d94-68d3-4ae3-989a-b391d7ee4ad9] Instance event wait completed in 3 seconds for network-vif-plugged {{(pid=98431) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 11 23:10:57.204737 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 8aec3cea-109d-43f8-983c-1d5ee2f71181] Guest created on hypervisor {{(pid=98431) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}} Jun 11 23:10:57.208450 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [-] [instance: 8aec3cea-109d-43f8-983c-1d5ee2f71181] Instance spawned successfully. Jun 11 23:10:57.208973 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 8aec3cea-109d-43f8-983c-1d5ee2f71181] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 11 23:10:57.213537 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] [instance: 36688d94-68d3-4ae3-989a-b391d7ee4ad9] Guest created on hypervisor {{(pid=98431) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}} Jun 11 23:10:57.218747 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [-] [instance: 36688d94-68d3-4ae3-989a-b391d7ee4ad9] Instance spawned successfully. Jun 11 23:10:57.219837 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] [instance: 36688d94-68d3-4ae3-989a-b391d7ee4ad9] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 11 23:10:57.225843 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] [instance: 36688d94-68d3-4ae3-989a-b391d7ee4ad9] Found default for hw_input_bus of None {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:10:57.226259 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] [instance: 36688d94-68d3-4ae3-989a-b391d7ee4ad9] Found default for hw_pointer_model of None {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:10:57.226380 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] [instance: 36688d94-68d3-4ae3-989a-b391d7ee4ad9] Found default for hw_video_model of virtio {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:10:57.228840 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] [instance: 36688d94-68d3-4ae3-989a-b391d7ee4ad9] Found default for hw_vif_model of virtio {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:10:57.257108 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-c5553338-94f5-4a23-b4db-49ad6afbc6a2 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Acquiring lock "689e510d-e0a4-4d6a-958e-9acfaebedc87" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:10:57.257298 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-c5553338-94f5-4a23-b4db-49ad6afbc6a2 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Lock "689e510d-e0a4-4d6a-958e-9acfaebedc87" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:10:57.257519 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-c5553338-94f5-4a23-b4db-49ad6afbc6a2 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] [instance: 689e510d-e0a4-4d6a-958e-9acfaebedc87] Attaching volume 64645843-e0b4-46bb-8426-698daf25b044 to /dev/vdb Jun 11 23:10:57.275134 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:57.282908 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] [instance: 14699717-b93f-4e67-b841-c67de8fff8d4] Updating instance_info_cache with network_info: [{"id": "a266c7d4-9f0e-474d-a4d9-5190dbdd0fc2", "address": "fa:16:3e:8a:95:c7", "network": {"id": "0dc6da23-6c97-4fd1-9e59-910adaa610a9", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-968328905-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a092509b877483183db8610c8763b93", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa266c7d4-9f", "ovs_interfaceid": "a266c7d4-9f0e-474d-a4d9-5190dbdd0fc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:10:57.299060 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:57.342465 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-c5553338-94f5-4a23-b4db-49ad6afbc6a2 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.209', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000002687', 'execute': None}" {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 11 23:10:57.355196 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.scaleio [None req-c5553338-94f5-4a23-b4db-49ad6afbc6a2 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98431) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 11 23:10:57.389099 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-c5553338-94f5-4a23-b4db-49ad6afbc6a2 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Running cmd (subprocess): nvme version {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:10:57.433659 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:57.437398 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-c5553338-94f5-4a23-b4db-49ad6afbc6a2 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] 'nvme version' failed. Not Retrying. {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 11 23:10:57.438464 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c5553338-94f5-4a23-b4db-49ad6afbc6a2 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] nvme not present on system {{(pid=98431) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 11 23:10:57.460134 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.lightos [None req-c5553338-94f5-4a23-b4db-49ad6afbc6a2 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98431) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 11 23:10:57.460134 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.lightos [None req-c5553338-94f5-4a23-b4db-49ad6afbc6a2 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Current host hostNQN and IP(s) are ['10.4.3.209', 'fe80::f816:3eff:fea3:3707', '192.168.40.6', 'fe80::f816:3eff:fe06:bdab', '192.168.50.6', 'fe80::f816:3eff:fe7a:46f2', '192.168.10.6', 'fe80::f816:3eff:fe13:793b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::38fa:21ff:fe6c:3746', 'fe80::fc16:3eff:fe6c:eb30', 'fe80::fc16:3eff:fe12:588f', 'fe80::20a8:54ff:fe51:da0a', 'fe80::fc16:3eff:feb5:6ffd', 'fe80::707d:43ff:fe4a:49d0', 'fe80::4cb3:64ff:fe13:8a75', 'fe80::fc16:3eff:fe8e:8922', 'fe80::4c61:61ff:fe7d:90dc', 'fe80::fc16:3eff:fe77:488d', 'fe80::9469:f2ff:feae:5824', 'fe80::fc16:3eff:febd:951', 'fe80::84b1:8fff:fe59:2d4f', 'fe80::fc16:3eff:fedc:9cb5'] Jun 11 23:10:57.460518 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.lightos [None req-c5553338-94f5-4a23-b4db-49ad6afbc6a2 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98431) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 11 23:10:57.460759 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.lightos [None req-c5553338-94f5-4a23-b4db-49ad6afbc6a2 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] LIGHTOS: no hostnqn found. {{(pid=98431) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 11 23:10:57.461203 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-c5553338-94f5-4a23-b4db-49ad6afbc6a2 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.209', 'host': 'np0000002687', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:798b370f1cc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad465dfe-0ed1-4637-98c3-ddaebebd61a4', 'nvme_native_multipath': False} {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 11 23:10:57.461587 np0000002687 nova-compute[98431]: DEBUG nova.virt.block_device [None req-c5553338-94f5-4a23-b4db-49ad6afbc6a2 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] [instance: 689e510d-e0a4-4d6a-958e-9acfaebedc87] Updating existing volume attachment record: 108be263-b819-4711-a8c1-e52479536e86 {{(pid=98431) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 11 23:10:57.548307 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-dd35667d-ea77-4781-83f8-7bdecb4c5828 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] [instance: 73abd331-0bbf-432e-be1c-308801a5429f] Found default for hw_cdrom_bus of ide {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:10:57.548307 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-dd35667d-ea77-4781-83f8-7bdecb4c5828 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] [instance: 73abd331-0bbf-432e-be1c-308801a5429f] Found default for hw_disk_bus of virtio {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:10:57.548414 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-dd35667d-ea77-4781-83f8-7bdecb4c5828 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] [instance: 73abd331-0bbf-432e-be1c-308801a5429f] Found default for hw_input_bus of None {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:10:57.549440 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-dd35667d-ea77-4781-83f8-7bdecb4c5828 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] [instance: 73abd331-0bbf-432e-be1c-308801a5429f] Found default for hw_pointer_model of None {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:10:57.549440 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-dd35667d-ea77-4781-83f8-7bdecb4c5828 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] [instance: 73abd331-0bbf-432e-be1c-308801a5429f] Found default for hw_video_model of virtio {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:10:57.549440 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-dd35667d-ea77-4781-83f8-7bdecb4c5828 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] [instance: 73abd331-0bbf-432e-be1c-308801a5429f] Found default for hw_vif_model of virtio {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:10:57.584736 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:57.617235 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Emitting event Started> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:10:57.617903 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 73abd331-0bbf-432e-be1c-308801a5429f] VM Started (Lifecycle Event) Jun 11 23:10:57.719707 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 8aec3cea-109d-43f8-983c-1d5ee2f71181] Found default for hw_cdrom_bus of ide {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:10:57.719707 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 8aec3cea-109d-43f8-983c-1d5ee2f71181] Found default for hw_disk_bus of virtio {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:10:57.719707 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 8aec3cea-109d-43f8-983c-1d5ee2f71181] Found default for hw_input_bus of None {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:10:57.719707 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 8aec3cea-109d-43f8-983c-1d5ee2f71181] Found default for hw_pointer_model of None {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:10:57.720111 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 8aec3cea-109d-43f8-983c-1d5ee2f71181] Found default for hw_video_model of virtio {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:10:57.720312 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 8aec3cea-109d-43f8-983c-1d5ee2f71181] Found default for hw_vif_model of virtio {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:10:57.740881 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] [instance: 36688d94-68d3-4ae3-989a-b391d7ee4ad9] Took 10.04 seconds to spawn the instance on the hypervisor. Jun 11 23:10:57.740881 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] [instance: 36688d94-68d3-4ae3-989a-b391d7ee4ad9] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:10:57.788936 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Releasing lock "refresh_cache-14699717-b93f-4e67-b841-c67de8fff8d4" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 11 23:10:57.789685 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] [instance: 14699717-b93f-4e67-b841-c67de8fff8d4] Instance network_info: |[{"id": "a266c7d4-9f0e-474d-a4d9-5190dbdd0fc2", "address": "fa:16:3e:8a:95:c7", "network": {"id": "0dc6da23-6c97-4fd1-9e59-910adaa610a9", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-968328905-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a092509b877483183db8610c8763b93", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa266c7d4-9f", "ovs_interfaceid": "a266c7d4-9f0e-474d-a4d9-5190dbdd0fc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98431) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 11 23:10:57.793963 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] [instance: 14699717-b93f-4e67-b841-c67de8fff8d4] Start _get_guest_xml network_info=[{"id": "a266c7d4-9f0e-474d-a4d9-5190dbdd0fc2", "address": "fa:16:3e:8a:95:c7", "network": {"id": "0dc6da23-6c97-4fd1-9e59-910adaa610a9", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-968328905-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a092509b877483183db8610c8763b93", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa266c7d4-9f", "ovs_interfaceid": "a266c7d4-9f0e-474d-a4d9-5190dbdd0fc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-11T23:08:20Z,direct_url=,disk_format='qcow2',id=f30640f8-7aca-4300-a085-4706a5209a79,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ce012f9fabdb4ee5a73e212437f59d97',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-11T23:08:23Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'image_id': 'f30640f8-7aca-4300-a085-4706a5209a79'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98431) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 11 23:10:57.798079 np0000002687 nova-compute[98431]: WARNING nova.virt.libvirt.driver [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 11 23:10:57.802768 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='f30640f8-7aca-4300-a085-4706a5209a79', instance_meta=NovaInstanceMeta(name='tempest-TestMultiAttachVolumeSwap-server-439003148-2', uuid='14699717-b93f-4e67-b841-c67de8fff8d4'), owner=OwnerMeta(userid='4b63bb5265a040fc8f755a27d13f43b3', username='tempest-TestMultiAttachVolumeSwap-329912157-project-member', projectid='3a092509b877483183db8610c8763b93', projectname='tempest-TestMultiAttachVolumeSwap-329912157'), image=ImageMeta(id='f30640f8-7aca-4300-a085-4706a5209a79', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "a266c7d4-9f0e-474d-a4d9-5190dbdd0fc2", "address": "fa:16:3e:8a:95:c7", "network": {"id": "0dc6da23-6c97-4fd1-9e59-910adaa610a9", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-968328905-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a092509b877483183db8610c8763b93", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa266c7d4-9f", "ovs_interfaceid": "a266c7d4-9f0e-474d-a4d9-5190dbdd0fc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1781219457.801262) {{(pid=98431) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 11 23:10:57.803729 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:57.808886 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:57.810452 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:57.812363 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Searching host: 'np0000002687' for CPU controller through CGroups V1... {{(pid=98431) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 11 23:10:57.813111 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] CPU controller missing on host. {{(pid=98431) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 11 23:10:57.820392 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Searching host: 'np0000002687' for CPU controller through CGroups V2... {{(pid=98431) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 11 23:10:57.820617 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] CPU controller found on host. {{(pid=98431) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 11 23:10:57.822235 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98431) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 11 23:10:57.822616 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-11T23:08:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-11T23:08:20Z,direct_url=,disk_format='qcow2',id=f30640f8-7aca-4300-a085-4706a5209a79,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ce012f9fabdb4ee5a73e212437f59d97',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-11T23:08:23Z,virtual_size=,visibility=), allow threads: True {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 11 23:10:57.822967 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Flavor limits 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 11 23:10:57.823505 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Image limits 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 11 23:10:57.823505 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Flavor pref 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 11 23:10:57.823505 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Image pref 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 11 23:10:57.823505 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 11 23:10:57.823879 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 11 23:10:57.824052 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98431) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 11 23:10:57.824210 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Got 1 possible topologies {{(pid=98431) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 11 23:10:57.824340 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 11 23:10:57.824536 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 11 23:10:57.835040 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:57.854493 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-11T23:10:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-439003148-2',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='tempest-testmultiattachvolumeswap-server-439003148-2',id=8,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJiPvaCzf6MnI1RIMFh7OGuYa8yejf4/MQ6XARcaU53VShAH2UqbgZMb0xxWuJdSGbXJNSkROJtN6eI7LOlxJllHoSwhWlfsLKPCGWl7oacshhsOrgJkm+Nq/cHNgBG2uQ==',key_name='tempest-keypair-270932437',keypairs=KeyPairList,launch_index=1,launched_at=None,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3a092509b877483183db8610c8763b93',ramdisk_id='',reservation_id='r-44bv6jg5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestMultiAttachVolumeSwap-329912157',owner_user_name='tempest-TestMultiAttachVolumeSwap-329912157-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-11T23:10:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b63bb5265a040fc8f755a27d13f43b3',uuid=14699717-b93f-4e67-b841-c67de8fff8d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a266c7d4-9f0e-474d-a4d9-5190dbdd0fc2", "address": "fa:16:3e:8a:95:c7", "network": {"id": "0dc6da23-6c97-4fd1-9e59-910adaa610a9", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-968328905-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a092509b877483183db8610c8763b93", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa266c7d4-9f", "ovs_interfaceid": "a266c7d4-9f0e-474d-a4d9-5190dbdd0fc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98431) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 11 23:10:57.855055 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Converting VIF {"id": "a266c7d4-9f0e-474d-a4d9-5190dbdd0fc2", "address": "fa:16:3e:8a:95:c7", "network": {"id": "0dc6da23-6c97-4fd1-9e59-910adaa610a9", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-968328905-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a092509b877483183db8610c8763b93", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa266c7d4-9f", "ovs_interfaceid": "a266c7d4-9f0e-474d-a4d9-5190dbdd0fc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:10:57.856635 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:95:c7,bridge_name='br-int',has_traffic_filtering=True,id=a266c7d4-9f0e-474d-a4d9-5190dbdd0fc2,network=Network(0dc6da23-6c97-4fd1-9e59-910adaa610a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa266c7d4-9f') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:10:57.858168 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Lazy-loading 'pci_devices' on Instance uuid 14699717-b93f-4e67-b841-c67de8fff8d4 {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:10:57.882276 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Successfully created port: 77424d75-6e25-4791-a44d-495051f7e89f {{(pid=98431) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 11 23:10:57.952635 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Start building block device mappings for instance. {{(pid=98431) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 11 23:10:58.069625 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-dd35667d-ea77-4781-83f8-7bdecb4c5828 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] [instance: 73abd331-0bbf-432e-be1c-308801a5429f] Took 8.01 seconds to spawn the instance on the hypervisor. Jun 11 23:10:58.069625 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-dd35667d-ea77-4781-83f8-7bdecb4c5828 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] [instance: 73abd331-0bbf-432e-be1c-308801a5429f] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:10:58.081257 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5553338-94f5-4a23-b4db-49ad6afbc6a2 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] [instance: 689e510d-e0a4-4d6a-958e-9acfaebedc87] Calling os-brick to attach iSCSI Volume {{(pid=98431) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 11 23:10:58.081257 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5553338-94f5-4a23-b4db-49ad6afbc6a2 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-64645843-e0b4-46bb-8426-698daf25b044', 'iqn.2023-03.storpool.com:os--volume-64645843-e0b4-46bb-8426-698daf25b044'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-64645843-e0b4-46bb-8426-698daf25b044', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '64645843-e0b4-46bb-8426-698daf25b044', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 11 23:10:58.081257 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-c5553338-94f5-4a23-b4db-49ad6afbc6a2 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 11 23:10:58.081257 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-c5553338-94f5-4a23-b4db-49ad6afbc6a2 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 11 23:10:58.081257 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-c5553338-94f5-4a23-b4db-49ad6afbc6a2 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-64645843-e0b4-46bb-8426-698daf25b044', 'iqn.2023-03.storpool.com:os--volume-64645843-e0b4-46bb-8426-698daf25b044'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-64645843-e0b4-46bb-8426-698daf25b044', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '64645843-e0b4-46bb-8426-698daf25b044', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98431) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 11 23:10:58.102820 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-c5553338-94f5-4a23-b4db-49ad6afbc6a2 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-64645843-e0b4-46bb-8426-698daf25b044" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 11 23:10:58.102820 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-c5553338-94f5-4a23-b4db-49ad6afbc6a2 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-64645843-e0b4-46bb-8426-698daf25b044" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 11 23:10:58.102820 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-c5553338-94f5-4a23-b4db-49ad6afbc6a2 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-64645843-e0b4-46bb-8426-698daf25b044" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 11 23:10:58.103071 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.iscsi [None req-c5553338-94f5-4a23-b4db-49ad6afbc6a2 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 11 23:10:58.103432 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-c5553338-94f5-4a23-b4db-49ad6afbc6a2 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-64645843-e0b4-46bb-8426-698daf25b044" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 11 23:10:58.103860 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.iscsi [None req-c5553338-94f5-4a23-b4db-49ad6afbc6a2 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 11 23:10:58.121152 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5553338-94f5-4a23-b4db-49ad6afbc6a2 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 11 23:10:58.121152 np0000002687 nova-compute[98431]: {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:10:58.122232 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5553338-94f5-4a23-b4db-49ad6afbc6a2 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 11 23:10:58.122232 np0000002687 nova-compute[98431]: {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:10:58.124083 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 73abd331-0bbf-432e-be1c-308801a5429f] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:10:58.134398 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 73abd331-0bbf-432e-be1c-308801a5429f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98431) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 11 23:10:58.141022 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5553338-94f5-4a23-b4db-49ad6afbc6a2 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-64645843-e0b4-46bb-8426-698daf25b044] added Jun 11 23:10:58.141022 np0000002687 nova-compute[98431]: stderr=iscsiadm: Config file line 363 does not have value Jun 11 23:10:58.141022 np0000002687 nova-compute[98431]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 11 23:10:58.141022 np0000002687 nova-compute[98431]: iscsiadm: Config file line 363 does not have value Jun 11 23:10:58.141022 np0000002687 nova-compute[98431]: iscsiadm: Config file line 363 does not have value Jun 11 23:10:58.141022 np0000002687 nova-compute[98431]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 11 23:10:58.141022 np0000002687 nova-compute[98431]: {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:10:58.141022 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5553338-94f5-4a23-b4db-49ad6afbc6a2 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98431) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 11 23:10:58.141305 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-c5553338-94f5-4a23-b4db-49ad6afbc6a2 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0372(s), this was the 1st time calling it. {{(pid=98431) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 11 23:10:58.141511 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-c5553338-94f5-4a23-b4db-49ad6afbc6a2 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98431) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 11 23:10:58.143146 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5553338-94f5-4a23-b4db-49ad6afbc6a2 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-64645843-e0b4-46bb-8426-698daf25b044] added Jun 11 23:10:58.143146 np0000002687 nova-compute[98431]: stderr=iscsiadm: Config file line 363 does not have value Jun 11 23:10:58.143146 np0000002687 nova-compute[98431]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 11 23:10:58.143146 np0000002687 nova-compute[98431]: iscsiadm: Config file line 363 does not have value Jun 11 23:10:58.143146 np0000002687 nova-compute[98431]: iscsiadm: Config file line 363 does not have value Jun 11 23:10:58.143146 np0000002687 nova-compute[98431]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 11 23:10:58.143146 np0000002687 nova-compute[98431]: {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:10:58.143370 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5553338-94f5-4a23-b4db-49ad6afbc6a2 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98431) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 11 23:10:58.143531 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-c5553338-94f5-4a23-b4db-49ad6afbc6a2 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0406(s), this was the 1st time calling it. {{(pid=98431) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 11 23:10:58.143695 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-c5553338-94f5-4a23-b4db-49ad6afbc6a2 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98431) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 11 23:10:58.226549 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 8aec3cea-109d-43f8-983c-1d5ee2f71181] Took 24.32 seconds to spawn the instance on the hypervisor. Jun 11 23:10:58.226721 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 8aec3cea-109d-43f8-983c-1d5ee2f71181] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:10:58.259462 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] [instance: 36688d94-68d3-4ae3-989a-b391d7ee4ad9] Took 15.54 seconds to build instance. Jun 11 23:10:58.272963 np0000002687 nova-compute[98431]: DEBUG oslo_service.periodic_task [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 11 23:10:58.272963 np0000002687 nova-compute[98431]: DEBUG oslo_service.periodic_task [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 11 23:10:58.272963 np0000002687 nova-compute[98431]: DEBUG oslo_service.periodic_task [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 11 23:10:58.272963 np0000002687 nova-compute[98431]: DEBUG oslo_service.periodic_task [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 11 23:10:58.278016 np0000002687 nova-compute[98431]: DEBUG oslo_service.periodic_task [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 11 23:10:58.278016 np0000002687 nova-compute[98431]: DEBUG oslo_service.periodic_task [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 11 23:10:58.278016 np0000002687 nova-compute[98431]: DEBUG oslo_service.periodic_task [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 11 23:10:58.278016 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98431) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}} Jun 11 23:10:58.278016 np0000002687 nova-compute[98431]: DEBUG oslo_service.periodic_task [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running periodic task ComputeManager.update_available_resource {{(pid=98431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 11 23:10:58.363447 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] [instance: 14699717-b93f-4e67-b841-c67de8fff8d4] End _get_guest_xml xml= Jun 11 23:10:58.363447 np0000002687 nova-compute[98431]: 14699717-b93f-4e67-b841-c67de8fff8d4 Jun 11 23:10:58.363447 np0000002687 nova-compute[98431]: instance-00000008 Jun 11 23:10:58.363447 np0000002687 nova-compute[98431]: 196608 Jun 11 23:10:58.363447 np0000002687 nova-compute[98431]: 1 Jun 11 23:10:58.363447 np0000002687 nova-compute[98431]: Jun 11 23:10:58.363447 np0000002687 nova-compute[98431]: Jun 11 23:10:58.363447 np0000002687 nova-compute[98431]: Jun 11 23:10:58.363447 np0000002687 nova-compute[98431]: tempest-TestMultiAttachVolumeSwap-server-439003148-2 Jun 11 23:10:58.363447 np0000002687 nova-compute[98431]: 2026-06-11 23:10:57 Jun 11 23:10:58.363447 np0000002687 nova-compute[98431]: Jun 11 23:10:58.363447 np0000002687 nova-compute[98431]: 192 Jun 11 23:10:58.363447 np0000002687 nova-compute[98431]: 1 Jun 11 23:10:58.363447 np0000002687 nova-compute[98431]: 0 Jun 11 23:10:58.363447 np0000002687 nova-compute[98431]: 0 Jun 11 23:10:58.363447 np0000002687 nova-compute[98431]: 1 Jun 11 23:10:58.363447 np0000002687 nova-compute[98431]: Jun 11 23:10:58.363447 np0000002687 nova-compute[98431]: True Jun 11 23:10:58.363447 np0000002687 nova-compute[98431]: Jun 11 23:10:58.363447 np0000002687 nova-compute[98431]: Jun 11 23:10:58.363447 np0000002687 nova-compute[98431]: Jun 11 23:10:58.363447 np0000002687 nova-compute[98431]: bare Jun 11 23:10:58.363447 np0000002687 nova-compute[98431]: qcow2 Jun 11 23:10:58.363447 np0000002687 nova-compute[98431]: 1 Jun 11 23:10:58.363447 np0000002687 nova-compute[98431]: 0 Jun 11 23:10:58.363447 np0000002687 nova-compute[98431]: Jun 11 23:10:58.363447 np0000002687 nova-compute[98431]: virtio Jun 11 23:10:58.363447 np0000002687 nova-compute[98431]: Jun 11 23:10:58.363447 np0000002687 nova-compute[98431]: Jun 11 23:10:58.363447 np0000002687 nova-compute[98431]: Jun 11 23:10:58.363447 np0000002687 nova-compute[98431]: tempest-TestMultiAttachVolumeSwap-329912157-project-member Jun 11 23:10:58.363447 np0000002687 nova-compute[98431]: tempest-TestMultiAttachVolumeSwap-329912157 Jun 11 23:10:58.363447 np0000002687 nova-compute[98431]: Jun 11 23:10:58.363447 np0000002687 nova-compute[98431]: Jun 11 23:10:58.363447 np0000002687 nova-compute[98431]: Jun 11 23:10:58.363447 np0000002687 nova-compute[98431]: Jun 11 23:10:58.363447 np0000002687 nova-compute[98431]: Jun 11 23:10:58.363447 np0000002687 nova-compute[98431]: Jun 11 23:10:58.363447 np0000002687 nova-compute[98431]: Jun 11 23:10:58.363447 np0000002687 nova-compute[98431]: Jun 11 23:10:58.363447 np0000002687 nova-compute[98431]: Jun 11 23:10:58.363447 np0000002687 nova-compute[98431]: Jun 11 23:10:58.363447 np0000002687 nova-compute[98431]: Jun 11 23:10:58.363447 np0000002687 nova-compute[98431]: OpenStack Foundation Jun 11 23:10:58.363447 np0000002687 nova-compute[98431]: OpenStack Nova Jun 11 23:10:58.363447 np0000002687 nova-compute[98431]: 33.1.0 Jun 11 23:10:58.363447 np0000002687 nova-compute[98431]: 14699717-b93f-4e67-b841-c67de8fff8d4 Jun 11 23:10:58.363447 np0000002687 nova-compute[98431]: 14699717-b93f-4e67-b841-c67de8fff8d4 Jun 11 23:10:58.363447 np0000002687 nova-compute[98431]: Virtual Machine Jun 11 23:10:58.363447 np0000002687 nova-compute[98431]: Jun 11 23:10:58.363447 np0000002687 nova-compute[98431]: Jun 11 23:10:58.363447 np0000002687 nova-compute[98431]: Jun 11 23:10:58.363447 np0000002687 nova-compute[98431]: hvm Jun 11 23:10:58.363447 np0000002687 nova-compute[98431]: Jun 11 23:10:58.363447 np0000002687 nova-compute[98431]: Jun 11 23:10:58.363447 np0000002687 nova-compute[98431]: Jun 11 23:10:58.363447 np0000002687 nova-compute[98431]: Jun 11 23:10:58.363447 np0000002687 nova-compute[98431]: Jun 11 23:10:58.363447 np0000002687 nova-compute[98431]: Jun 11 23:10:58.363447 np0000002687 nova-compute[98431]: 128 Jun 11 23:10:58.363447 np0000002687 nova-compute[98431]: Jun 11 23:10:58.363447 np0000002687 nova-compute[98431]: Jun 11 23:10:58.363447 np0000002687 nova-compute[98431]: Jun 11 23:10:58.363447 np0000002687 nova-compute[98431]: 1 Jun 11 23:10:58.363447 np0000002687 nova-compute[98431]: Jun 11 23:10:58.363447 np0000002687 nova-compute[98431]: Jun 11 23:10:58.363447 np0000002687 nova-compute[98431]: Nehalem Jun 11 23:10:58.363447 np0000002687 nova-compute[98431]: Jun 11 23:10:58.363447 np0000002687 nova-compute[98431]: Jun 11 23:10:58.363447 np0000002687 nova-compute[98431]: Jun 11 23:10:58.363447 np0000002687 nova-compute[98431]: Jun 11 23:10:58.363447 np0000002687 nova-compute[98431]: Jun 11 23:10:58.363447 np0000002687 nova-compute[98431]: Jun 11 23:10:58.363447 np0000002687 nova-compute[98431]: Jun 11 23:10:58.363447 np0000002687 nova-compute[98431]: Jun 11 23:10:58.363447 np0000002687 nova-compute[98431]: Jun 11 23:10:58.363447 np0000002687 nova-compute[98431]: Jun 11 23:10:58.363447 np0000002687 nova-compute[98431]: Jun 11 23:10:58.363447 np0000002687 nova-compute[98431]: Jun 11 23:10:58.363447 np0000002687 nova-compute[98431]: Jun 11 23:10:58.363447 np0000002687 nova-compute[98431]: Jun 11 23:10:58.363447 np0000002687 nova-compute[98431]: Jun 11 23:10:58.363447 np0000002687 nova-compute[98431]: Jun 11 23:10:58.363447 np0000002687 nova-compute[98431]: Jun 11 23:10:58.363447 np0000002687 nova-compute[98431]: Jun 11 23:10:58.363447 np0000002687 nova-compute[98431]: Jun 11 23:10:58.363447 np0000002687 nova-compute[98431]: Jun 11 23:10:58.363447 np0000002687 nova-compute[98431]: Jun 11 23:10:58.363447 np0000002687 nova-compute[98431]: Jun 11 23:10:58.363447 np0000002687 nova-compute[98431]: Jun 11 23:10:58.363447 np0000002687 nova-compute[98431]: Jun 11 23:10:58.363447 np0000002687 nova-compute[98431]: Jun 11 23:10:58.363447 np0000002687 nova-compute[98431]: Jun 11 23:10:58.363447 np0000002687 nova-compute[98431]: /dev/urandom Jun 11 23:10:58.363447 np0000002687 nova-compute[98431]: Jun 11 23:10:58.363447 np0000002687 nova-compute[98431]: Jun 11 23:10:58.363447 np0000002687 nova-compute[98431]: Jun 11 23:10:58.363447 np0000002687 nova-compute[98431]: Jun 11 23:10:58.363447 np0000002687 nova-compute[98431]: Jun 11 23:10:58.363447 np0000002687 nova-compute[98431]: Jun 11 23:10:58.363447 np0000002687 nova-compute[98431]: Jun 11 23:10:58.363447 np0000002687 nova-compute[98431]: {{(pid=98431) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 11 23:10:58.366402 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] [instance: 14699717-b93f-4e67-b841-c67de8fff8d4] Preparing to wait for external event network-vif-plugged-a266c7d4-9f0e-474d-a4d9-5190dbdd0fc2 {{(pid=98431) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 11 23:10:58.366402 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Acquiring lock "14699717-b93f-4e67-b841-c67de8fff8d4-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:10:58.366402 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Lock "14699717-b93f-4e67-b841-c67de8fff8d4-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:10:58.366402 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Lock "14699717-b93f-4e67-b841-c67de8fff8d4-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:10:58.368244 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-11T23:10:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-439003148-2',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='tempest-testmultiattachvolumeswap-server-439003148-2',id=8,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJiPvaCzf6MnI1RIMFh7OGuYa8yejf4/MQ6XARcaU53VShAH2UqbgZMb0xxWuJdSGbXJNSkROJtN6eI7LOlxJllHoSwhWlfsLKPCGWl7oacshhsOrgJkm+Nq/cHNgBG2uQ==',key_name='tempest-keypair-270932437',keypairs=KeyPairList,launch_index=1,launched_at=None,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3a092509b877483183db8610c8763b93',ramdisk_id='',reservation_id='r-44bv6jg5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestMultiAttachVolumeSwap-329912157',owner_user_name='tempest-TestMultiAttachVolumeSwap-329912157-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-11T23:10:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b63bb5265a040fc8f755a27d13f43b3',uuid=14699717-b93f-4e67-b841-c67de8fff8d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a266c7d4-9f0e-474d-a4d9-5190dbdd0fc2", "address": "fa:16:3e:8a:95:c7", "network": {"id": "0dc6da23-6c97-4fd1-9e59-910adaa610a9", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-968328905-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a092509b877483183db8610c8763b93", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa266c7d4-9f", "ovs_interfaceid": "a266c7d4-9f0e-474d-a4d9-5190dbdd0fc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 11 23:10:58.368427 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Converting VIF {"id": "a266c7d4-9f0e-474d-a4d9-5190dbdd0fc2", "address": "fa:16:3e:8a:95:c7", "network": {"id": "0dc6da23-6c97-4fd1-9e59-910adaa610a9", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-968328905-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a092509b877483183db8610c8763b93", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa266c7d4-9f", "ovs_interfaceid": "a266c7d4-9f0e-474d-a4d9-5190dbdd0fc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:10:58.368976 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:95:c7,bridge_name='br-int',has_traffic_filtering=True,id=a266c7d4-9f0e-474d-a4d9-5190dbdd0fc2,network=Network(0dc6da23-6c97-4fd1-9e59-910adaa610a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa266c7d4-9f') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:10:58.369220 np0000002687 nova-compute[98431]: DEBUG os_vif [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:95:c7,bridge_name='br-int',has_traffic_filtering=True,id=a266c7d4-9f0e-474d-a4d9-5190dbdd0fc2,network=Network(0dc6da23-6c97-4fd1-9e59-910adaa610a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa266c7d4-9f') {{(pid=98431) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 11 23:10:58.369638 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:58.370014 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:10:58.370605 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 11 23:10:58.372975 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:58.372975 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8e131e7d-53a5-599b-986a-92c91e2b2c72', '_type': 'linux-noop'}}, row=False) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:10:58.374788 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:58.377249 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:10:58.379588 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:58.379845 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa266c7d4-9f, may_exist=True, interface_attrs={}) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:10:58.380260 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa266c7d4-9f, col_values=(('qos', UUID('1743eb27-0f57-46a3-a81a-f8a9e4aa4396')),), if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:10:58.380445 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa266c7d4-9f, col_values=(('external_ids', {'iface-id': 'a266c7d4-9f0e-474d-a4d9-5190dbdd0fc2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8a:95:c7', 'vm-uuid': '14699717-b93f-4e67-b841-c67de8fff8d4'}),), if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:10:58.381590 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:58.383978 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:10:58.390200 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:10:58.396321 np0000002687 nova-compute[98431]: INFO os_vif [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:95:c7,bridge_name='br-int',has_traffic_filtering=True,id=a266c7d4-9f0e-474d-a4d9-5190dbdd0fc2,network=Network(0dc6da23-6c97-4fd1-9e59-910adaa610a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa266c7d4-9f') Jun 11 23:10:58.465470 np0000002687 nova-compute[98431]: INFO nova.virt.block_device [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Booting with volume 5c45c988-5aa0-400e-ba7a-59581071a2f9 at /dev/vda Jun 11 23:10:58.520102 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.209', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000002687', 'execute': None}" {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 11 23:10:58.528232 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Successfully created port: 0263e39d-c835-4cf1-b333-265608e81a93 {{(pid=98431) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 11 23:10:58.534285 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.scaleio [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98431) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 11 23:10:58.556810 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Running cmd (subprocess): nvme version {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:10:58.586578 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] 'nvme version' failed. Not Retrying. {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 11 23:10:58.587467 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-dd35667d-ea77-4781-83f8-7bdecb4c5828 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] [instance: 73abd331-0bbf-432e-be1c-308801a5429f] Took 15.15 seconds to build instance. Jun 11 23:10:58.589011 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.nvmeof [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] nvme not present on system {{(pid=98431) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 11 23:10:58.603852 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.lightos [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98431) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 11 23:10:58.603996 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.lightos [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Current host hostNQN and IP(s) are ['10.4.3.209', 'fe80::f816:3eff:fea3:3707', '192.168.40.6', 'fe80::f816:3eff:fe06:bdab', '192.168.50.6', 'fe80::f816:3eff:fe7a:46f2', '192.168.10.6', 'fe80::f816:3eff:fe13:793b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::38fa:21ff:fe6c:3746', 'fe80::fc16:3eff:fe6c:eb30', 'fe80::fc16:3eff:fe12:588f', 'fe80::20a8:54ff:fe51:da0a', 'fe80::fc16:3eff:feb5:6ffd', 'fe80::707d:43ff:fe4a:49d0', 'fe80::4cb3:64ff:fe13:8a75', 'fe80::fc16:3eff:fe8e:8922', 'fe80::4c61:61ff:fe7d:90dc', 'fe80::fc16:3eff:fe77:488d', 'fe80::9469:f2ff:feae:5824', 'fe80::fc16:3eff:febd:951', 'fe80::84b1:8fff:fe59:2d4f', 'fe80::fc16:3eff:fedc:9cb5', 'fe80::f489:94ff:fe75:ec8a'] Jun 11 23:10:58.604135 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.lightos [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98431) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 11 23:10:58.604266 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.lightos [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] LIGHTOS: no hostnqn found. {{(pid=98431) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 11 23:10:58.604816 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] <== get_connector_properties: return (83ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.209', 'host': 'np0000002687', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:798b370f1cc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad465dfe-0ed1-4637-98c3-ddaebebd61a4', 'nvme_native_multipath': False} {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 11 23:10:58.605178 np0000002687 nova-compute[98431]: DEBUG nova.virt.block_device [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Updating existing volume attachment record: 54269af2-69bc-4c56-b932-8aebd5638326 {{(pid=98431) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 11 23:10:58.640830 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Emitting event Paused> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:10:58.641013 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 73abd331-0bbf-432e-be1c-308801a5429f] VM Paused (Lifecycle Event) Jun 11 23:10:58.747528 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 8aec3cea-109d-43f8-983c-1d5ee2f71181] Took 29.56 seconds to build instance. Jun 11 23:10:58.763632 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-1338533c-0299-4b1f-94a5-96be36e8ed04 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Lock "36688d94-68d3-4ae3-989a-b391d7ee4ad9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 17.053s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:10:58.786335 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:10:58.787302 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:10:58.787467 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:10:58.787650 np0000002687 nova-compute[98431]: DEBUG nova.compute.resource_tracker [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Auditing locally available compute resources for np0000002687 (node: np0000002687) {{(pid=98431) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}} Jun 11 23:10:58.998613 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Successfully created port: 09135c79-b0df-40af-b05b-2e171390f37f {{(pid=98431) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 11 23:10:59.091319 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-dd35667d-ea77-4781-83f8-7bdecb4c5828 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] Lock "73abd331-0bbf-432e-be1c-308801a5429f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 16.668s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:10:59.142002 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.iscsi [None req-c5553338-94f5-4a23-b4db-49ad6afbc6a2 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 11 23:10:59.144099 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 73abd331-0bbf-432e-be1c-308801a5429f] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:10:59.144431 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.iscsi [None req-c5553338-94f5-4a23-b4db-49ad6afbc6a2 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 11 23:10:59.152322 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Emitting event Resumed> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:10:59.152425 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 73abd331-0bbf-432e-be1c-308801a5429f] VM Resumed (Lifecycle Event) Jun 11 23:10:59.157789 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5553338-94f5-4a23-b4db-49ad6afbc6a2 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 11 23:10:59.157789 np0000002687 nova-compute[98431]: node.name = iqn.2023-03.storpool.com:os--volume-64645843-e0b4-46bb-8426-698daf25b044 Jun 11 23:10:59.157789 np0000002687 nova-compute[98431]: node.tpgt = -1 Jun 11 23:10:59.157789 np0000002687 nova-compute[98431]: node.startup = manual Jun 11 23:10:59.157789 np0000002687 nova-compute[98431]: node.leading_login = No Jun 11 23:10:59.157789 np0000002687 nova-compute[98431]: iface.iscsi_ifacename = default Jun 11 23:10:59.157789 np0000002687 nova-compute[98431]: iface.net_ifacename = Jun 11 23:10:59.157789 np0000002687 nova-compute[98431]: iface.ipaddress = Jun 11 23:10:59.157789 np0000002687 nova-compute[98431]: iface.prefix_len = 0 Jun 11 23:10:59.157789 np0000002687 nova-compute[98431]: iface.hwaddress = Jun 11 23:10:59.157789 np0000002687 nova-compute[98431]: iface.transport_name = tcp Jun 11 23:10:59.157789 np0000002687 nova-compute[98431]: iface.initiatorname = Jun 11 23:10:59.157789 np0000002687 nova-compute[98431]: iface.state = Jun 11 23:10:59.157789 np0000002687 nova-compute[98431]: iface.vlan_id = 0 Jun 11 23:10:59.157789 np0000002687 nova-compute[98431]: iface.vlan_priority = 0 Jun 11 23:10:59.157789 np0000002687 nova-compute[98431]: iface.vlan_state = Jun 11 23:10:59.157789 np0000002687 nova-compute[98431]: iface.iface_num = 0 Jun 11 23:10:59.157789 np0000002687 nova-compute[98431]: iface.mtu = 0 Jun 11 23:10:59.157789 np0000002687 nova-compute[98431]: iface.port = 0 Jun 11 23:10:59.157789 np0000002687 nova-compute[98431]: iface.bootproto = Jun 11 23:10:59.157789 np0000002687 nova-compute[98431]: iface.subnet_mask = Jun 11 23:10:59.157789 np0000002687 nova-compute[98431]: iface.gateway = Jun 11 23:10:59.157789 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id_state = Jun 11 23:10:59.157789 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id = Jun 11 23:10:59.157789 np0000002687 nova-compute[98431]: iface.dhcp_dns = Jun 11 23:10:59.157789 np0000002687 nova-compute[98431]: iface.dhcp_learn_iqn = Jun 11 23:10:59.157789 np0000002687 nova-compute[98431]: iface.dhcp_req_vendor_id_state = Jun 11 23:10:59.157789 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id_state = Jun 11 23:10:59.157789 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id = Jun 11 23:10:59.157789 np0000002687 nova-compute[98431]: iface.dhcp_slp_da = Jun 11 23:10:59.157789 np0000002687 nova-compute[98431]: iface.fragmentation = Jun 11 23:10:59.157789 np0000002687 nova-compute[98431]: iface.gratuitous_arp = Jun 11 23:10:59.157789 np0000002687 nova-compute[98431]: iface.incoming_forwarding = Jun 11 23:10:59.157789 np0000002687 nova-compute[98431]: iface.tos_state = Jun 11 23:10:59.157789 np0000002687 nova-compute[98431]: iface.tos = 0 Jun 11 23:10:59.157789 np0000002687 nova-compute[98431]: iface.ttl = 0 Jun 11 23:10:59.157789 np0000002687 nova-compute[98431]: iface.delayed_ack = Jun 11 23:10:59.157789 np0000002687 nova-compute[98431]: iface.tcp_nagle = Jun 11 23:10:59.157789 np0000002687 nova-compute[98431]: iface.tcp_wsf_state = Jun 11 23:10:59.157789 np0000002687 nova-compute[98431]: iface.tcp_wsf = 0 Jun 11 23:10:59.157789 np0000002687 nova-compute[98431]: iface.tcp_timer_scale = 0 Jun 11 23:10:59.157789 np0000002687 nova-compute[98431]: iface.tcp_timestamp = Jun 11 23:10:59.157789 np0000002687 nova-compute[98431]: iface.redirect = Jun 11 23:10:59.157789 np0000002687 nova-compute[98431]: iface.def_task_mgmt_timeout = 0 Jun 11 23:10:59.157789 np0000002687 nova-compute[98431]: iface.header_digest = Jun 11 23:10:59.157789 np0000002687 nova-compute[98431]: iface.data_digest = Jun 11 23:10:59.157789 np0000002687 nova-compute[98431]: iface.immediate_data = Jun 11 23:10:59.157789 np0000002687 nova-compute[98431]: iface.initial_r2t = Jun 11 23:10:59.157789 np0000002687 nova-compute[98431]: iface.data_seq_inorder = Jun 11 23:10:59.157789 np0000002687 nova-compute[98431]: iface.data_pdu_inorder = Jun 11 23:10:59.157789 np0000002687 nova-compute[98431]: iface.erl = 0 Jun 11 23:10:59.157789 np0000002687 nova-compute[98431]: iface.max_receive_data_len = 0 Jun 11 23:10:59.157789 np0000002687 nova-compute[98431]: iface.first_burst_len = 0 Jun 11 23:10:59.157789 np0000002687 nova-compute[98431]: iface.max_outstanding_r2t = 0 Jun 11 23:10:59.157789 np0000002687 nova-compute[98431]: iface.max_burst_len = 0 Jun 11 23:10:59.157789 np0000002687 nova-compute[98431]: iface.chap_auth = Jun 11 23:10:59.157789 np0000002687 nova-compute[98431]: iface.bidi_chap = Jun 11 23:10:59.157789 np0000002687 nova-compute[98431]: iface.strict_login_compliance = Jun 11 23:10:59.157789 np0000002687 nova-compute[98431]: iface.discovery_auth = Jun 11 23:10:59.157789 np0000002687 nova-compute[98431]: iface.discovery_logout = Jun 11 23:10:59.157789 np0000002687 nova-compute[98431]: node.discovery_address = Jun 11 23:10:59.157789 np0000002687 nova-compute[98431]: node.discovery_port = 0 Jun 11 23:10:59.157789 np0000002687 nova-compute[98431]: node.discovery_type = fw Jun 11 23:10:59.157789 np0000002687 nova-compute[98431]: node.session.initial_cmdsn = 0 Jun 11 23:10:59.157789 np0000002687 nova-compute[98431]: node.session.initial_login_retry_max = 8 Jun 11 23:10:59.157789 np0000002687 nova-compute[98431]: node.session.xmit_thread_priority = 0 Jun 11 23:10:59.157789 np0000002687 nova-compute[98431]: node.session.cmds_max = 128 Jun 11 23:10:59.157789 np0000002687 nova-compute[98431]: node.session.queue_depth = 32 Jun 11 23:10:59.157789 np0000002687 nova-compute[98431]: node.session.nr_sessions = 1 Jun 11 23:10:59.157789 np0000002687 nova-compute[98431]: node.session.auth.authmethod = None Jun 11 23:10:59.157789 np0000002687 nova-compute[98431]: node.session.auth.username = Jun 11 23:10:59.157789 np0000002687 nova-compute[98431]: node.session.auth.password = *** Jun 11 23:10:59.157789 np0000002687 nova-compute[98431]: node.session.auth.username_in = Jun 11 23:10:59.157789 np0000002687 nova-compute[98431]: node.session.auth.password_in = Jun 11 23:10:59.157789 np0000002687 nova-compute[98431]: node.session.auth.chap_algs = SHA256 Jun 11 23:10:59.157789 np0000002687 nova-compute[98431]: node.session.timeo.replacement_timeout = 120 Jun 11 23:10:59.157789 np0000002687 nova-compute[98431]: node.session.err_timeo.abort_timeout = 15 Jun 11 23:10:59.157789 np0000002687 nova-compute[98431]: node.session.err_timeo.lu_reset_timeout = 30 Jun 11 23:10:59.157789 np0000002687 nova-compute[98431]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 11 23:10:59.157789 np0000002687 nova-compute[98431]: node.session.err_timeo.host_reset_timeout = 60 Jun 11 23:10:59.157789 np0000002687 nova-compute[98431]: node.session.iscsi.FastAbort = Yes Jun 11 23:10:59.157789 np0000002687 nova-compute[98431]: node.session.iscsi.InitialR2T = No Jun 11 23:10:59.157789 np0000002687 nova-compute[98431]: node.session.iscsi.ImmediateData = Yes Jun 11 23:10:59.157789 np0000002687 nova-compute[98431]: node.session.iscsi.FirstBurstLength = 262144 Jun 11 23:10:59.157789 np0000002687 nova-compute[98431]: node.session.iscsi.MaxBurstLength = 16776192 Jun 11 23:10:59.157789 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Retain = 0 Jun 11 23:10:59.157789 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Wait = 2 Jun 11 23:10:59.157789 np0000002687 nova-compute[98431]: node.session.iscsi.MaxConnections = 1 Jun 11 23:10:59.157789 np0000002687 nova-compute[98431]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 11 23:10:59.157789 np0000002687 nova-compute[98431]: node.session.iscsi.ERL = 0 Jun 11 23:10:59.157789 np0000002687 nova-compute[98431]: node.session.scan = auto Jun 11 23:10:59.157789 np0000002687 nova-compute[98431]: node.session.reopen_max = 0 Jun 11 23:10:59.157789 np0000002687 nova-compute[98431]: node.conn[0].address = 192.168.50.100 Jun 11 23:10:59.157789 np0000002687 nova-compute[98431]: node.conn[0].port = 3260 Jun 11 23:10:59.157789 np0000002687 nova-compute[98431]: node.conn[0].startup = manual Jun 11 23:10:59.157789 np0000002687 nova-compute[98431]: node.conn[0].tcp.window_size = 524288 Jun 11 23:10:59.157789 np0000002687 nova-compute[98431]: node.conn[0].tcp.type_of_service = 0 Jun 11 23:10:59.157789 np0000002687 nova-compute[98431]: node.conn[0].timeo.logout_timeout = 15 Jun 11 23:10:59.157789 np0000002687 nova-compute[98431]: node.conn[0].timeo.login_timeout = 15 Jun 11 23:10:59.157789 np0000002687 nova-compute[98431]: node.conn[0].timeo.auth_timeout = 45 Jun 11 23:10:59.157789 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_interval = 5 Jun 11 23:10:59.157789 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_timeout = 5 Jun 11 23:10:59.157789 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 11 23:10:59.157789 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 11 23:10:59.157789 np0000002687 nova-compute[98431]: node.conn[0].iscsi.HeaderDigest = None Jun 11 23:10:59.157789 np0000002687 nova-compute[98431]: node.conn[0].iscsi.DataDigest = None Jun 11 23:10:59.157789 np0000002687 nova-compute[98431]: node.conn[0].iscsi.IFMarker = No Jun 11 23:10:59.157789 np0000002687 nova-compute[98431]: node.conn[0].iscsi.OFMarker = No Jun 11 23:10:59.157789 np0000002687 nova-compute[98431]: # END RECORD Jun 11 23:10:59.157789 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:10:59.164548 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5553338-94f5-4a23-b4db-49ad6afbc6a2 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 11 23:10:59.164548 np0000002687 nova-compute[98431]: node.name = iqn.2023-03.storpool.com:os--volume-64645843-e0b4-46bb-8426-698daf25b044 Jun 11 23:10:59.164548 np0000002687 nova-compute[98431]: node.tpgt = -1 Jun 11 23:10:59.164548 np0000002687 nova-compute[98431]: node.startup = manual Jun 11 23:10:59.164548 np0000002687 nova-compute[98431]: node.leading_login = No Jun 11 23:10:59.164548 np0000002687 nova-compute[98431]: iface.iscsi_ifacename = default Jun 11 23:10:59.164548 np0000002687 nova-compute[98431]: iface.net_ifacename = Jun 11 23:10:59.164548 np0000002687 nova-compute[98431]: iface.ipaddress = Jun 11 23:10:59.164548 np0000002687 nova-compute[98431]: iface.prefix_len = 0 Jun 11 23:10:59.164548 np0000002687 nova-compute[98431]: iface.hwaddress = Jun 11 23:10:59.164548 np0000002687 nova-compute[98431]: iface.transport_name = tcp Jun 11 23:10:59.164548 np0000002687 nova-compute[98431]: iface.initiatorname = Jun 11 23:10:59.164548 np0000002687 nova-compute[98431]: iface.state = Jun 11 23:10:59.164548 np0000002687 nova-compute[98431]: iface.vlan_id = 0 Jun 11 23:10:59.164548 np0000002687 nova-compute[98431]: iface.vlan_priority = 0 Jun 11 23:10:59.164548 np0000002687 nova-compute[98431]: iface.vlan_state = Jun 11 23:10:59.164548 np0000002687 nova-compute[98431]: iface.iface_num = 0 Jun 11 23:10:59.164548 np0000002687 nova-compute[98431]: iface.mtu = 0 Jun 11 23:10:59.164548 np0000002687 nova-compute[98431]: iface.port = 0 Jun 11 23:10:59.164548 np0000002687 nova-compute[98431]: iface.bootproto = Jun 11 23:10:59.164548 np0000002687 nova-compute[98431]: iface.subnet_mask = Jun 11 23:10:59.164548 np0000002687 nova-compute[98431]: iface.gateway = Jun 11 23:10:59.164548 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id_state = Jun 11 23:10:59.164548 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id = Jun 11 23:10:59.164548 np0000002687 nova-compute[98431]: iface.dhcp_dns = Jun 11 23:10:59.164548 np0000002687 nova-compute[98431]: iface.dhcp_learn_iqn = Jun 11 23:10:59.164548 np0000002687 nova-compute[98431]: iface.dhcp_req_vendor_id_state = Jun 11 23:10:59.164548 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id_state = Jun 11 23:10:59.164548 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id = Jun 11 23:10:59.164548 np0000002687 nova-compute[98431]: iface.dhcp_slp_da = Jun 11 23:10:59.164548 np0000002687 nova-compute[98431]: iface.fragmentation = Jun 11 23:10:59.164548 np0000002687 nova-compute[98431]: iface.gratuitous_arp = Jun 11 23:10:59.164548 np0000002687 nova-compute[98431]: iface.incoming_forwarding = Jun 11 23:10:59.164548 np0000002687 nova-compute[98431]: iface.tos_state = Jun 11 23:10:59.164548 np0000002687 nova-compute[98431]: iface.tos = 0 Jun 11 23:10:59.164548 np0000002687 nova-compute[98431]: iface.ttl = 0 Jun 11 23:10:59.164548 np0000002687 nova-compute[98431]: iface.delayed_ack = Jun 11 23:10:59.164548 np0000002687 nova-compute[98431]: iface.tcp_nagle = Jun 11 23:10:59.164548 np0000002687 nova-compute[98431]: iface.tcp_wsf_state = Jun 11 23:10:59.164548 np0000002687 nova-compute[98431]: iface.tcp_wsf = 0 Jun 11 23:10:59.164548 np0000002687 nova-compute[98431]: iface.tcp_timer_scale = 0 Jun 11 23:10:59.164548 np0000002687 nova-compute[98431]: iface.tcp_timestamp = Jun 11 23:10:59.164548 np0000002687 nova-compute[98431]: iface.redirect = Jun 11 23:10:59.164548 np0000002687 nova-compute[98431]: iface.def_task_mgmt_timeout = 0 Jun 11 23:10:59.164548 np0000002687 nova-compute[98431]: iface.header_digest = Jun 11 23:10:59.164548 np0000002687 nova-compute[98431]: iface.data_digest = Jun 11 23:10:59.164548 np0000002687 nova-compute[98431]: iface.immediate_data = Jun 11 23:10:59.164548 np0000002687 nova-compute[98431]: iface.initial_r2t = Jun 11 23:10:59.164548 np0000002687 nova-compute[98431]: iface.data_seq_inorder = Jun 11 23:10:59.164548 np0000002687 nova-compute[98431]: iface.data_pdu_inorder = Jun 11 23:10:59.164548 np0000002687 nova-compute[98431]: iface.erl = 0 Jun 11 23:10:59.164548 np0000002687 nova-compute[98431]: iface.max_receive_data_len = 0 Jun 11 23:10:59.164548 np0000002687 nova-compute[98431]: iface.first_burst_len = 0 Jun 11 23:10:59.164548 np0000002687 nova-compute[98431]: iface.max_outstanding_r2t = 0 Jun 11 23:10:59.164548 np0000002687 nova-compute[98431]: iface.max_burst_len = 0 Jun 11 23:10:59.164548 np0000002687 nova-compute[98431]: iface.chap_auth = Jun 11 23:10:59.164548 np0000002687 nova-compute[98431]: iface.bidi_chap = Jun 11 23:10:59.164548 np0000002687 nova-compute[98431]: iface.strict_login_compliance = Jun 11 23:10:59.164548 np0000002687 nova-compute[98431]: iface.discovery_auth = Jun 11 23:10:59.164548 np0000002687 nova-compute[98431]: iface.discovery_logout = Jun 11 23:10:59.164548 np0000002687 nova-compute[98431]: node.discovery_address = Jun 11 23:10:59.164548 np0000002687 nova-compute[98431]: node.discovery_port = 0 Jun 11 23:10:59.164548 np0000002687 nova-compute[98431]: node.discovery_type = fw Jun 11 23:10:59.164548 np0000002687 nova-compute[98431]: node.session.initial_cmdsn = 0 Jun 11 23:10:59.164548 np0000002687 nova-compute[98431]: node.session.initial_login_retry_max = 8 Jun 11 23:10:59.164548 np0000002687 nova-compute[98431]: node.session.xmit_thread_priority = 0 Jun 11 23:10:59.164548 np0000002687 nova-compute[98431]: node.session.cmds_max = 128 Jun 11 23:10:59.164548 np0000002687 nova-compute[98431]: node.session.queue_depth = 32 Jun 11 23:10:59.164548 np0000002687 nova-compute[98431]: node.session.nr_sessions = 1 Jun 11 23:10:59.164548 np0000002687 nova-compute[98431]: node.session.auth.authmethod = None Jun 11 23:10:59.164548 np0000002687 nova-compute[98431]: node.session.auth.username = Jun 11 23:10:59.164548 np0000002687 nova-compute[98431]: node.session.auth.password = *** Jun 11 23:10:59.164548 np0000002687 nova-compute[98431]: node.session.auth.username_in = Jun 11 23:10:59.164548 np0000002687 nova-compute[98431]: node.session.auth.password_in = Jun 11 23:10:59.164548 np0000002687 nova-compute[98431]: node.session.auth.chap_algs = SHA256 Jun 11 23:10:59.164548 np0000002687 nova-compute[98431]: node.session.timeo.replacement_timeout = 120 Jun 11 23:10:59.164548 np0000002687 nova-compute[98431]: node.session.err_timeo.abort_timeout = 15 Jun 11 23:10:59.164548 np0000002687 nova-compute[98431]: node.session.err_timeo.lu_reset_timeout = 30 Jun 11 23:10:59.164548 np0000002687 nova-compute[98431]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 11 23:10:59.164548 np0000002687 nova-compute[98431]: node.session.err_timeo.host_reset_timeout = 60 Jun 11 23:10:59.164548 np0000002687 nova-compute[98431]: node.session.iscsi.FastAbort = Yes Jun 11 23:10:59.164548 np0000002687 nova-compute[98431]: node.session.iscsi.InitialR2T = No Jun 11 23:10:59.164548 np0000002687 nova-compute[98431]: node.session.iscsi.ImmediateData = Yes Jun 11 23:10:59.164548 np0000002687 nova-compute[98431]: node.session.iscsi.FirstBurstLength = 262144 Jun 11 23:10:59.164548 np0000002687 nova-compute[98431]: node.session.iscsi.MaxBurstLength = 16776192 Jun 11 23:10:59.164548 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Retain = 0 Jun 11 23:10:59.164548 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Wait = 2 Jun 11 23:10:59.164548 np0000002687 nova-compute[98431]: node.session.iscsi.MaxConnections = 1 Jun 11 23:10:59.164548 np0000002687 nova-compute[98431]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 11 23:10:59.164548 np0000002687 nova-compute[98431]: node.session.iscsi.ERL = 0 Jun 11 23:10:59.164548 np0000002687 nova-compute[98431]: node.session.scan = auto Jun 11 23:10:59.164548 np0000002687 nova-compute[98431]: node.session.reopen_max = 0 Jun 11 23:10:59.164548 np0000002687 nova-compute[98431]: node.conn[0].address = 192.168.40.100 Jun 11 23:10:59.164548 np0000002687 nova-compute[98431]: node.conn[0].port = 3260 Jun 11 23:10:59.164548 np0000002687 nova-compute[98431]: node.conn[0].startup = manual Jun 11 23:10:59.164548 np0000002687 nova-compute[98431]: node.conn[0].tcp.window_size = 524288 Jun 11 23:10:59.164548 np0000002687 nova-compute[98431]: node.conn[0].tcp.type_of_service = 0 Jun 11 23:10:59.164548 np0000002687 nova-compute[98431]: node.conn[0].timeo.logout_timeout = 15 Jun 11 23:10:59.164548 np0000002687 nova-compute[98431]: node.conn[0].timeo.login_timeout = 15 Jun 11 23:10:59.164548 np0000002687 nova-compute[98431]: node.conn[0].timeo.auth_timeout = 45 Jun 11 23:10:59.164548 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_interval = 5 Jun 11 23:10:59.164548 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_timeout = 5 Jun 11 23:10:59.164548 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 11 23:10:59.164548 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 11 23:10:59.164548 np0000002687 nova-compute[98431]: node.conn[0].iscsi.HeaderDigest = None Jun 11 23:10:59.164548 np0000002687 nova-compute[98431]: node.conn[0].iscsi.DataDigest = None Jun 11 23:10:59.164548 np0000002687 nova-compute[98431]: node.conn[0].iscsi.IFMarker = No Jun 11 23:10:59.164548 np0000002687 nova-compute[98431]: node.conn[0].iscsi.OFMarker = No Jun 11 23:10:59.164548 np0000002687 nova-compute[98431]: # END RECORD Jun 11 23:10:59.164548 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:10:59.173453 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5553338-94f5-4a23-b4db-49ad6afbc6a2 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:10:59.178717 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5553338-94f5-4a23-b4db-49ad6afbc6a2 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:10:59.191211 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5553338-94f5-4a23-b4db-49ad6afbc6a2 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:10:59.191211 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:10:59.191211 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:10:59.191442 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5553338-94f5-4a23-b4db-49ad6afbc6a2 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:10:59.191442 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:10:59.191442 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:10:59.194393 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5553338-94f5-4a23-b4db-49ad6afbc6a2 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:10:59.194393 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:10:59.194393 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:10:59.194599 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5553338-94f5-4a23-b4db-49ad6afbc6a2 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:10:59.194599 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:10:59.194599 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:10:59.241121 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5553338-94f5-4a23-b4db-49ad6afbc6a2 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-64645843-e0b4-46bb-8426-698daf25b044, portal: 192.168.40.100,3260] Jun 11 23:10:59.241121 np0000002687 nova-compute[98431]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-64645843-e0b4-46bb-8426-698daf25b044, portal: 192.168.40.100,3260] successful. Jun 11 23:10:59.241121 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:10:59.248325 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5553338-94f5-4a23-b4db-49ad6afbc6a2 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-64645843-e0b4-46bb-8426-698daf25b044, portal: 192.168.50.100,3260] Jun 11 23:10:59.248325 np0000002687 nova-compute[98431]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-64645843-e0b4-46bb-8426-698daf25b044, portal: 192.168.50.100,3260] successful. Jun 11 23:10:59.248325 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:10:59.250137 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-2e7b721b-542e-4761-9436-67a99e7a1e67 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lock "8aec3cea-109d-43f8-983c-1d5ee2f71181" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 31.069s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:10:59.259828 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5553338-94f5-4a23-b4db-49ad6afbc6a2 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:10:59.264606 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5553338-94f5-4a23-b4db-49ad6afbc6a2 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:10:59.281744 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5553338-94f5-4a23-b4db-49ad6afbc6a2 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:10:59.281744 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:10:59.281744 np0000002687 nova-compute[98431]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-64645843-e0b4-46bb-8426-698daf25b044 (non-flash) Jun 11 23:10:59.281744 np0000002687 nova-compute[98431]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-64645843-e0b4-46bb-8426-698daf25b044 (non-flash) Jun 11 23:10:59.281744 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:10:59.281744 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5553338-94f5-4a23-b4db-49ad6afbc6a2 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:10:59.281744 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:10:59.281744 np0000002687 nova-compute[98431]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-64645843-e0b4-46bb-8426-698daf25b044 (non-flash) Jun 11 23:10:59.281744 np0000002687 nova-compute[98431]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-64645843-e0b4-46bb-8426-698daf25b044 (non-flash) Jun 11 23:10:59.281744 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:10:59.282120 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-c5553338-94f5-4a23-b4db-49ad6afbc6a2 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-64645843-e0b4-46bb-8426-698daf25b044" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.179s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 11 23:10:59.282120 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5553338-94f5-4a23-b4db-49ad6afbc6a2 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Connected to 192.168.40.100:3260 {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 11 23:10:59.286695 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-c5553338-94f5-4a23-b4db-49ad6afbc6a2 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] HCTL ('9', '-', '-', 0) found on session 5 with lun 0 {{(pid=98431) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 11 23:10:59.286695 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-c5553338-94f5-4a23-b4db-49ad6afbc6a2 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98431) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 11 23:10:59.286695 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5553338-94f5-4a23-b4db-49ad6afbc6a2 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:10:59.286695 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:10:59.286695 np0000002687 nova-compute[98431]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-64645843-e0b4-46bb-8426-698daf25b044 (non-flash) Jun 11 23:10:59.286695 np0000002687 nova-compute[98431]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-64645843-e0b4-46bb-8426-698daf25b044 (non-flash) Jun 11 23:10:59.286695 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:10:59.286695 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5553338-94f5-4a23-b4db-49ad6afbc6a2 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:10:59.286695 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:10:59.286695 np0000002687 nova-compute[98431]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-64645843-e0b4-46bb-8426-698daf25b044 (non-flash) Jun 11 23:10:59.286695 np0000002687 nova-compute[98431]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-64645843-e0b4-46bb-8426-698daf25b044 (non-flash) Jun 11 23:10:59.286695 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:10:59.286695 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-c5553338-94f5-4a23-b4db-49ad6afbc6a2 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-64645843-e0b4-46bb-8426-698daf25b044" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.183s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 11 23:10:59.286695 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5553338-94f5-4a23-b4db-49ad6afbc6a2 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Connected to 192.168.50.100:3260 {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 11 23:10:59.287425 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-c5553338-94f5-4a23-b4db-49ad6afbc6a2 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] HCTL ('10', '-', '-', 0) found on session 6 with lun 0 {{(pid=98431) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 11 23:10:59.287425 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-c5553338-94f5-4a23-b4db-49ad6afbc6a2 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98431) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 11 23:10:59.308011 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-c5553338-94f5-4a23-b4db-49ad6afbc6a2 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Searching for a device in session 5 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98431) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 11 23:10:59.308011 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5553338-94f5-4a23-b4db-49ad6afbc6a2 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-64645843-e0b4-46bb-8426-698daf25b044', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '64645843-e0b4-46bb-8426-698daf25b044', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 11 23:10:59.329680 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-c5553338-94f5-4a23-b4db-49ad6afbc6a2 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Searching for a device in session 6 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98431) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 11 23:10:59.329887 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5553338-94f5-4a23-b4db-49ad6afbc6a2 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-64645843-e0b4-46bb-8426-698daf25b044', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '64645843-e0b4-46bb-8426-698daf25b044', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 11 23:10:59.341403 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-0a1cb0c7-94b7-4482-be4e-6a34fc916d50 req-09db4f41-7291-4525-a16b-809aad2e7541 service nova] [instance: 27ac8c84-e5db-4bd1-a148-ec5834c5b39c] Received event network-vif-plugged-673175fc-0e8b-46fe-9898-7e27d61b8694 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:10:59.342245 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-0a1cb0c7-94b7-4482-be4e-6a34fc916d50 req-09db4f41-7291-4525-a16b-809aad2e7541 service nova] Acquiring lock "27ac8c84-e5db-4bd1-a148-ec5834c5b39c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:10:59.342245 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-0a1cb0c7-94b7-4482-be4e-6a34fc916d50 req-09db4f41-7291-4525-a16b-809aad2e7541 service nova] Lock "27ac8c84-e5db-4bd1-a148-ec5834c5b39c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:10:59.342245 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-0a1cb0c7-94b7-4482-be4e-6a34fc916d50 req-09db4f41-7291-4525-a16b-809aad2e7541 service nova] Lock "27ac8c84-e5db-4bd1-a148-ec5834c5b39c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:10:59.343415 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-0a1cb0c7-94b7-4482-be4e-6a34fc916d50 req-09db4f41-7291-4525-a16b-809aad2e7541 service nova] [instance: 27ac8c84-e5db-4bd1-a148-ec5834c5b39c] Processing event network-vif-plugged-673175fc-0e8b-46fe-9898-7e27d61b8694 {{(pid=98431) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 11 23:10:59.343415 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-0a1cb0c7-94b7-4482-be4e-6a34fc916d50 req-09db4f41-7291-4525-a16b-809aad2e7541 service nova] [instance: 27ac8c84-e5db-4bd1-a148-ec5834c5b39c] Received event network-vif-plugged-673175fc-0e8b-46fe-9898-7e27d61b8694 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:10:59.343415 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-0a1cb0c7-94b7-4482-be4e-6a34fc916d50 req-09db4f41-7291-4525-a16b-809aad2e7541 service nova] Acquiring lock "27ac8c84-e5db-4bd1-a148-ec5834c5b39c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:10:59.344812 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-0a1cb0c7-94b7-4482-be4e-6a34fc916d50 req-09db4f41-7291-4525-a16b-809aad2e7541 service nova] Lock "27ac8c84-e5db-4bd1-a148-ec5834c5b39c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:10:59.344812 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-0a1cb0c7-94b7-4482-be4e-6a34fc916d50 req-09db4f41-7291-4525-a16b-809aad2e7541 service nova] Lock "27ac8c84-e5db-4bd1-a148-ec5834c5b39c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:10:59.346125 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-0a1cb0c7-94b7-4482-be4e-6a34fc916d50 req-09db4f41-7291-4525-a16b-809aad2e7541 service nova] [instance: 27ac8c84-e5db-4bd1-a148-ec5834c5b39c] No waiting events found dispatching network-vif-plugged-673175fc-0e8b-46fe-9898-7e27d61b8694 {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:10:59.347392 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] [instance: 27ac8c84-e5db-4bd1-a148-ec5834c5b39c] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98431) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 11 23:10:59.347561 np0000002687 nova-compute[98431]: WARNING nova.compute.manager [req-0a1cb0c7-94b7-4482-be4e-6a34fc916d50 req-09db4f41-7291-4525-a16b-809aad2e7541 service nova] [instance: 27ac8c84-e5db-4bd1-a148-ec5834c5b39c] Received unexpected event network-vif-plugged-673175fc-0e8b-46fe-9898-7e27d61b8694 for instance with vm_state building and task_state spawning. Jun 11 23:10:59.351504 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] [instance: 27ac8c84-e5db-4bd1-a148-ec5834c5b39c] Guest created on hypervisor {{(pid=98431) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}} Jun 11 23:10:59.357607 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [-] [instance: 27ac8c84-e5db-4bd1-a148-ec5834c5b39c] Instance spawned successfully. Jun 11 23:10:59.357607 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] [instance: 27ac8c84-e5db-4bd1-a148-ec5834c5b39c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 11 23:10:59.655420 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 73abd331-0bbf-432e-be1c-308801a5429f] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:10:59.656746 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 73abd331-0bbf-432e-be1c-308801a5429f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98431) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 11 23:10:59.678821 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Successfully updated port: 7808ce0e-ec36-4dfa-84d5-0eb1ce542139 {{(pid=98431) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 11 23:10:59.749615 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-92f3ad1f-4472-4719-bad5-9fcf8e863503 req-d5033377-5967-4523-9d07-5ec525e11935 service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Received event network-changed-7808ce0e-ec36-4dfa-84d5-0eb1ce542139 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:10:59.754057 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-92f3ad1f-4472-4719-bad5-9fcf8e863503 req-d5033377-5967-4523-9d07-5ec525e11935 service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Refreshing instance network info cache due to event network-changed-7808ce0e-ec36-4dfa-84d5-0eb1ce542139. {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 11 23:10:59.754312 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-92f3ad1f-4472-4719-bad5-9fcf8e863503 req-d5033377-5967-4523-9d07-5ec525e11935 service nova] Acquiring lock "refresh_cache-49a042ba-28ba-4401-9bdf-92f96da8f80e" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 11 23:10:59.754439 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-92f3ad1f-4472-4719-bad5-9fcf8e863503 req-d5033377-5967-4523-9d07-5ec525e11935 service nova] Acquired lock "refresh_cache-49a042ba-28ba-4401-9bdf-92f96da8f80e" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 11 23:10:59.754616 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-92f3ad1f-4472-4719-bad5-9fcf8e863503 req-d5033377-5967-4523-9d07-5ec525e11935 service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Refreshing network info cache for port 7808ce0e-ec36-4dfa-84d5-0eb1ce542139 {{(pid=98431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 11 23:10:59.854428 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98431) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12344}} Jun 11 23:10:59.859410 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27ac8c84-e5db-4bd1-a148-ec5834c5b39c/disk --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:10:59.878272 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] [instance: 27ac8c84-e5db-4bd1-a148-ec5834c5b39c] Found default for hw_cdrom_bus of ide {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:10:59.878544 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] [instance: 27ac8c84-e5db-4bd1-a148-ec5834c5b39c] Found default for hw_disk_bus of virtio {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:10:59.879196 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] [instance: 27ac8c84-e5db-4bd1-a148-ec5834c5b39c] Found default for hw_input_bus of None {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:10:59.880411 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] [instance: 27ac8c84-e5db-4bd1-a148-ec5834c5b39c] Found default for hw_pointer_model of None {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:10:59.880899 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] [instance: 27ac8c84-e5db-4bd1-a148-ec5834c5b39c] Found default for hw_video_model of virtio {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:10:59.882463 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] [instance: 27ac8c84-e5db-4bd1-a148-ec5834c5b39c] Found default for hw_vif_model of virtio {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:10:59.919340 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] No BDM found with device name vda, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:10:59.919340 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] No BDM found with device name hda, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:10:59.919340 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] No VIF found with MAC fa:16:3e:8a:95:c7, not building metadata {{(pid=98431) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13199}} Jun 11 23:10:59.919340 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] [instance: 14699717-b93f-4e67-b841-c67de8fff8d4] Using config drive Jun 11 23:10:59.946832 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27ac8c84-e5db-4bd1-a148-ec5834c5b39c/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:10:59.947336 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27ac8c84-e5db-4bd1-a148-ec5834c5b39c/disk --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:11:00.050027 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27ac8c84-e5db-4bd1-a148-ec5834c5b39c/disk --force-share --output=json" returned: 0 in 0.102s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:11:00.057825 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/689e510d-e0a4-4d6a-958e-9acfaebedc87/disk --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:11:00.105036 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5553338-94f5-4a23-b4db-49ad6afbc6a2 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98431) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 11 23:11:00.145892 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/689e510d-e0a4-4d6a-958e-9acfaebedc87/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:11:00.147529 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/689e510d-e0a4-4d6a-958e-9acfaebedc87/disk --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:11:00.166241 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Emitting event Resumed> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:11:00.166480 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 8aec3cea-109d-43f8-983c-1d5ee2f71181] VM Resumed (Lifecycle Event) Jun 11 23:11:00.257074 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [req-92f3ad1f-4472-4719-bad5-9fcf8e863503 req-d5033377-5967-4523-9d07-5ec525e11935 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:11:00.263385 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/689e510d-e0a4-4d6a-958e-9acfaebedc87/disk --force-share --output=json" returned: 0 in 0.113s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:11:00.264824 np0000002687 nova-compute[98431]: INFO nova.virt.block_device [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Booting with volume 23264eac-8f91-4074-b3b0-51b6cb738b7c at /dev/vdb Jun 11 23:11:00.273772 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14699717-b93f-4e67-b841-c67de8fff8d4/disk --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:11:00.358488 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.209', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000002687', 'execute': None}" {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 11 23:11:00.379979 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.scaleio [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98431) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 11 23:11:00.392828 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-92f3ad1f-4472-4719-bad5-9fcf8e863503 req-d5033377-5967-4523-9d07-5ec525e11935 service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Instance cache missing network info. {{(pid=98431) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 11 23:11:00.394417 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] [instance: 27ac8c84-e5db-4bd1-a148-ec5834c5b39c] Took 7.53 seconds to spawn the instance on the hypervisor. Jun 11 23:11:00.394417 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] [instance: 27ac8c84-e5db-4bd1-a148-ec5834c5b39c] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:11:00.417825 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Running cmd (subprocess): nvme version {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:11:00.454431 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:11:00.460285 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14699717-b93f-4e67-b841-c67de8fff8d4/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:11:00.461602 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] 'nvme version' failed. Not Retrying. {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 11 23:11:00.462527 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14699717-b93f-4e67-b841-c67de8fff8d4/disk --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:11:00.463229 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.nvmeof [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] nvme not present on system {{(pid=98431) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 11 23:11:00.504993 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.lightos [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98431) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 11 23:11:00.508136 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.lightos [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Current host hostNQN and IP(s) are ['10.4.3.209', 'fe80::f816:3eff:fea3:3707', '192.168.40.6', 'fe80::f816:3eff:fe06:bdab', '192.168.50.6', 'fe80::f816:3eff:fe7a:46f2', '192.168.10.6', 'fe80::f816:3eff:fe13:793b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::38fa:21ff:fe6c:3746', 'fe80::fc16:3eff:fe6c:eb30', 'fe80::fc16:3eff:fe12:588f', 'fe80::20a8:54ff:fe51:da0a', 'fe80::fc16:3eff:feb5:6ffd', 'fe80::707d:43ff:fe4a:49d0', 'fe80::4cb3:64ff:fe13:8a75', 'fe80::fc16:3eff:fe8e:8922', 'fe80::4c61:61ff:fe7d:90dc', 'fe80::fc16:3eff:fe77:488d', 'fe80::9469:f2ff:feae:5824', 'fe80::fc16:3eff:febd:951', 'fe80::84b1:8fff:fe59:2d4f', 'fe80::fc16:3eff:fedc:9cb5', 'fe80::f489:94ff:fe75:ec8a'] Jun 11 23:11:00.512969 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.lightos [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98431) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 11 23:11:00.512969 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.lightos [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] LIGHTOS: no hostnqn found. {{(pid=98431) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 11 23:11:00.512969 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.209', 'host': 'np0000002687', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:798b370f1cc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad465dfe-0ed1-4637-98c3-ddaebebd61a4', 'nvme_native_multipath': False} {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 11 23:11:00.512969 np0000002687 nova-compute[98431]: DEBUG nova.virt.block_device [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Updating existing volume attachment record: 39843094-2973-49b9-856e-02bdec21e8ae {{(pid=98431) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 11 23:11:00.608156 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14699717-b93f-4e67-b841-c67de8fff8d4/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:11:00.608899 np0000002687 nova-compute[98431]: WARNING nova.virt.libvirt.driver [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Periodic task is updating the host stat, it is trying to get disk instance-00000008, but disk file was removed by concurrent operations such as resize.: FileNotFoundError: [Errno 2] No such file or directory: '/opt/stack/data/nova/instances/14699717-b93f-4e67-b841-c67de8fff8d4/disk.config' Jun 11 23:11:00.614518 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36688d94-68d3-4ae3-989a-b391d7ee4ad9/disk --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:11:00.680574 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 8aec3cea-109d-43f8-983c-1d5ee2f71181] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:11:00.686552 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 8aec3cea-109d-43f8-983c-1d5ee2f71181] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98431) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 11 23:11:00.760355 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36688d94-68d3-4ae3-989a-b391d7ee4ad9/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:11:00.760859 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36688d94-68d3-4ae3-989a-b391d7ee4ad9/disk --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:11:00.784154 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] [instance: 14699717-b93f-4e67-b841-c67de8fff8d4] Creating config drive at /opt/stack/data/nova/instances/14699717-b93f-4e67-b841-c67de8fff8d4/disk.config Jun 11 23:11:00.798871 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-0a9b4fdf-1bb0-4c23-befb-c54c0aed40ed req-a0e163de-dfb9-44c2-b5cf-c511ec418f77 service nova] [instance: 73abd331-0bbf-432e-be1c-308801a5429f] Received event network-changed-d1203b92-b9d5-4d1c-bc39-326783c31294 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:11:00.799233 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-0a9b4fdf-1bb0-4c23-befb-c54c0aed40ed req-a0e163de-dfb9-44c2-b5cf-c511ec418f77 service nova] [instance: 73abd331-0bbf-432e-be1c-308801a5429f] Refreshing instance network info cache due to event network-changed-d1203b92-b9d5-4d1c-bc39-326783c31294. {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 11 23:11:00.804972 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-92f3ad1f-4472-4719-bad5-9fcf8e863503 req-d5033377-5967-4523-9d07-5ec525e11935 service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Updating instance_info_cache with network_info: [] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:11:00.807432 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-0a9b4fdf-1bb0-4c23-befb-c54c0aed40ed req-a0e163de-dfb9-44c2-b5cf-c511ec418f77 service nova] Acquiring lock "refresh_cache-73abd331-0bbf-432e-be1c-308801a5429f" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 11 23:11:00.807432 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-0a9b4fdf-1bb0-4c23-befb-c54c0aed40ed req-a0e163de-dfb9-44c2-b5cf-c511ec418f77 service nova] Acquired lock "refresh_cache-73abd331-0bbf-432e-be1c-308801a5429f" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 11 23:11:00.807588 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-0a9b4fdf-1bb0-4c23-befb-c54c0aed40ed req-a0e163de-dfb9-44c2-b5cf-c511ec418f77 service nova] [instance: 73abd331-0bbf-432e-be1c-308801a5429f] Refreshing network info cache for port d1203b92-b9d5-4d1c-bc39-326783c31294 {{(pid=98431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 11 23:11:00.818470 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/14699717-b93f-4e67-b841-c67de8fff8d4/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpgb5rxx1l {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:11:00.862438 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/14699717-b93f-4e67-b841-c67de8fff8d4/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpgb5rxx1l" returned: 0 in 0.045s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:11:00.871167 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36688d94-68d3-4ae3-989a-b391d7ee4ad9/disk --force-share --output=json" returned: 0 in 0.110s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:11:00.874760 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73abd331-0bbf-432e-be1c-308801a5429f/disk --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:11:00.918093 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] [instance: 27ac8c84-e5db-4bd1-a148-ec5834c5b39c] Took 13.27 seconds to build instance. Jun 11 23:11:00.954979 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73abd331-0bbf-432e-be1c-308801a5429f/disk --force-share --output=json" returned: 0 in 0.080s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:11:00.956742 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73abd331-0bbf-432e-be1c-308801a5429f/disk --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:11:01.039702 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73abd331-0bbf-432e-be1c-308801a5429f/disk --force-share --output=json" returned: 0 in 0.083s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:11:01.047879 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8aec3cea-109d-43f8-983c-1d5ee2f71181/disk --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:11:01.124406 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5553338-94f5-4a23-b4db-49ad6afbc6a2 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Found WWN 330000000331a74ea for multipath device dm-3 {{(pid=98431) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 11 23:11:01.125135 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-c5553338-94f5-4a23-b4db-49ad6afbc6a2 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.045s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 11 23:11:01.125400 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5553338-94f5-4a23-b4db-49ad6afbc6a2 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] <== connect_volume: return (3046ms) {'type': 'block', 'scsi_wwn': '330000000331a74ea', 'path': '/dev/dm-3', 'multipath_id': '330000000331a74ea'} {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 11 23:11:01.125621 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5553338-94f5-4a23-b4db-49ad6afbc6a2 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] [instance: 689e510d-e0a4-4d6a-958e-9acfaebedc87] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000331a74ea', 'path': '/dev/dm-3', 'multipath_id': '330000000331a74ea'} {{(pid=98431) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 11 23:11:01.134123 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-c5553338-94f5-4a23-b4db-49ad6afbc6a2 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Lazy-loading 'flavor' on Instance uuid 689e510d-e0a4-4d6a-958e-9acfaebedc87 {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:11:01.144829 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8aec3cea-109d-43f8-983c-1d5ee2f71181/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:11:01.145674 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8aec3cea-109d-43f8-983c-1d5ee2f71181/disk --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:11:01.192996 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Emitting event Resumed> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:11:01.193956 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 36688d94-68d3-4ae3-989a-b391d7ee4ad9] VM Resumed (Lifecycle Event) Jun 11 23:11:01.230528 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8aec3cea-109d-43f8-983c-1d5ee2f71181/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:11:01.236070 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb63f66c-b69e-42b0-805c-be6fe9b3aee3/disk --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:11:01.303201 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Successfully updated port: 7051cdff-8b40-42d6-9d8a-9b7748621f1f {{(pid=98431) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 11 23:11:01.313417 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-92f3ad1f-4472-4719-bad5-9fcf8e863503 req-d5033377-5967-4523-9d07-5ec525e11935 service nova] Releasing lock "refresh_cache-49a042ba-28ba-4401-9bdf-92f96da8f80e" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 11 23:11:01.315588 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [req-0a9b4fdf-1bb0-4c23-befb-c54c0aed40ed req-a0e163de-dfb9-44c2-b5cf-c511ec418f77 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:11:01.337913 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb63f66c-b69e-42b0-805c-be6fe9b3aee3/disk --force-share --output=json" returned: 0 in 0.102s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:11:01.339180 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb63f66c-b69e-42b0-805c-be6fe9b3aee3/disk --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:11:01.365988 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-9a1b1d47-e44a-4eef-9570-7c76ea8942f7 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Acquiring lock "206476b7-d805-4c6c-b7fb-db8b5c2a94a6" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:11:01.366159 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-9a1b1d47-e44a-4eef-9570-7c76ea8942f7 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "206476b7-d805-4c6c-b7fb-db8b5c2a94a6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:11:01.408329 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-2e66051f-b1b8-41e5-bb2d-be9240f3adce req-a5bee75e-4cf2-4019-878f-ae6436b98fea service nova] [instance: 36688d94-68d3-4ae3-989a-b391d7ee4ad9] Received event network-changed-6075e13d-d32a-4d8f-8741-a4686059985e {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:11:01.408500 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-2e66051f-b1b8-41e5-bb2d-be9240f3adce req-a5bee75e-4cf2-4019-878f-ae6436b98fea service nova] [instance: 36688d94-68d3-4ae3-989a-b391d7ee4ad9] Refreshing instance network info cache due to event network-changed-6075e13d-d32a-4d8f-8741-a4686059985e. {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 11 23:11:01.408857 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-2e66051f-b1b8-41e5-bb2d-be9240f3adce req-a5bee75e-4cf2-4019-878f-ae6436b98fea service nova] Acquiring lock "refresh_cache-36688d94-68d3-4ae3-989a-b391d7ee4ad9" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 11 23:11:01.408997 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-2e66051f-b1b8-41e5-bb2d-be9240f3adce req-a5bee75e-4cf2-4019-878f-ae6436b98fea service nova] Acquired lock "refresh_cache-36688d94-68d3-4ae3-989a-b391d7ee4ad9" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 11 23:11:01.412958 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-2e66051f-b1b8-41e5-bb2d-be9240f3adce req-a5bee75e-4cf2-4019-878f-ae6436b98fea service nova] [instance: 36688d94-68d3-4ae3-989a-b391d7ee4ad9] Refreshing network info cache for port 6075e13d-d32a-4d8f-8741-a4686059985e {{(pid=98431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 11 23:11:01.419459 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb63f66c-b69e-42b0-805c-be6fe9b3aee3/disk --force-share --output=json" returned: 0 in 0.072s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:11:01.427205 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Lock "27ac8c84-e5db-4bd1-a148-ec5834c5b39c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 14.781s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:11:01.432023 np0000002687 nova-compute[98431]: WARNING nova.virt.libvirt.driver [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 11 23:11:01.434023 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:11:01.454961 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:01.472217 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] CMD "env LANG=C uptime" returned: 0 in 0.038s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:11:01.472573 np0000002687 nova-compute[98431]: DEBUG nova.compute.resource_tracker [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Hypervisor/Node resource view: name=np0000002687 free_ram=14194MB free_disk=74.68314743041992GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}] {{(pid=98431) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}} Jun 11 23:11:01.472785 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:11:01.472944 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:11:01.480730 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:01.635447 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:01.643938 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-c5553338-94f5-4a23-b4db-49ad6afbc6a2 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] [instance: 689e510d-e0a4-4d6a-958e-9acfaebedc87] Attempting to attach volume 64645843-e0b4-46bb-8426-698daf25b044 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98431) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}} Jun 11 23:11:01.646427 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.guest [None req-c5553338-94f5-4a23-b4db-49ad6afbc6a2 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] attach device xml: Jun 11 23:11:01.646427 np0000002687 nova-compute[98431]: Jun 11 23:11:01.646427 np0000002687 nova-compute[98431]: Jun 11 23:11:01.646427 np0000002687 nova-compute[98431]: Jun 11 23:11:01.646427 np0000002687 nova-compute[98431]: Jun 11 23:11:01.646427 np0000002687 nova-compute[98431]: 64645843-e0b4-46bb-8426-698daf25b044 Jun 11 23:11:01.646427 np0000002687 nova-compute[98431]: Jun 11 23:11:01.646427 np0000002687 nova-compute[98431]: {{(pid=98431) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} Jun 11 23:11:01.687102 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:01.688649 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:01.701822 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 36688d94-68d3-4ae3-989a-b391d7ee4ad9] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:11:01.706542 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 36688d94-68d3-4ae3-989a-b391d7ee4ad9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98431) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 11 23:11:01.858824 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-b6bab62b-32e4-4528-b4ea-503046598d71 req-2e8eda25-cd9c-429c-8aca-f47ce54c4452 service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Received event network-changed-7051cdff-8b40-42d6-9d8a-9b7748621f1f {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:11:01.860090 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-b6bab62b-32e4-4528-b4ea-503046598d71 req-2e8eda25-cd9c-429c-8aca-f47ce54c4452 service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Refreshing instance network info cache due to event network-changed-7051cdff-8b40-42d6-9d8a-9b7748621f1f. {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 11 23:11:01.860873 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-b6bab62b-32e4-4528-b4ea-503046598d71 req-2e8eda25-cd9c-429c-8aca-f47ce54c4452 service nova] Acquiring lock "refresh_cache-49a042ba-28ba-4401-9bdf-92f96da8f80e" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 11 23:11:01.860873 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-b6bab62b-32e4-4528-b4ea-503046598d71 req-2e8eda25-cd9c-429c-8aca-f47ce54c4452 service nova] Acquired lock "refresh_cache-49a042ba-28ba-4401-9bdf-92f96da8f80e" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 11 23:11:01.860873 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-b6bab62b-32e4-4528-b4ea-503046598d71 req-2e8eda25-cd9c-429c-8aca-f47ce54c4452 service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Refreshing network info cache for port 7051cdff-8b40-42d6-9d8a-9b7748621f1f {{(pid=98431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 11 23:11:01.871559 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-9a1b1d47-e44a-4eef-9570-7c76ea8942f7 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 206476b7-d805-4c6c-b7fb-db8b5c2a94a6] Starting instance... {{(pid=98431) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 11 23:11:01.893007 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [req-0a9b4fdf-1bb0-4c23-befb-c54c0aed40ed req-a0e163de-dfb9-44c2-b5cf-c511ec418f77 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:11:01.925260 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [req-2e66051f-b1b8-41e5-bb2d-be9240f3adce req-a5bee75e-4cf2-4019-878f-ae6436b98fea service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:11:02.191823 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-fc764edc-3b38-4c46-95f7-10bbdd116239 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 8aec3cea-109d-43f8-983c-1d5ee2f71181] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:11:02.210332 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Emitting event Started> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:11:02.210486 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 27ac8c84-e5db-4bd1-a148-ec5834c5b39c] VM Started (Lifecycle Event) Jun 11 23:11:02.242620 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-0a9b4fdf-1bb0-4c23-befb-c54c0aed40ed req-a0e163de-dfb9-44c2-b5cf-c511ec418f77 service nova] [instance: 73abd331-0bbf-432e-be1c-308801a5429f] Updated VIF entry in instance network info cache for port d1203b92-b9d5-4d1c-bc39-326783c31294. {{(pid=98431) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 11 23:11:02.245078 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-0a9b4fdf-1bb0-4c23-befb-c54c0aed40ed req-a0e163de-dfb9-44c2-b5cf-c511ec418f77 service nova] [instance: 73abd331-0bbf-432e-be1c-308801a5429f] Updating instance_info_cache with network_info: [{"id": "d1203b92-b9d5-4d1c-bc39-326783c31294", "address": "fa:16:3e:bd:09:51", "network": {"id": "40608c63-4bf9-4326-a714-e03e56d8c4de", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1884073402-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bddeb2fac9c34c65996201c81b5c77e4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1203b92-b9", "ovs_interfaceid": "d1203b92-b9d5-4d1c-bc39-326783c31294", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:11:02.259750 np0000002687 nova-compute[98431]: INFO nova.virt.block_device [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Booting with volume 0001b9c6-a8d0-4709-88d4-b91656096dff at /dev/vdc Jun 11 23:11:02.330773 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.209', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000002687', 'execute': None}" {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 11 23:11:02.348169 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.scaleio [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98431) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 11 23:11:02.369783 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [req-b6bab62b-32e4-4528-b4ea-503046598d71 req-2e8eda25-cd9c-429c-8aca-f47ce54c4452 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:11:02.382722 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Running cmd (subprocess): nvme version {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:11:02.435239 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] 'nvme version' failed. Not Retrying. {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 11 23:11:02.435828 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.nvmeof [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] nvme not present on system {{(pid=98431) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 11 23:11:02.448040 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.lightos [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98431) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 11 23:11:02.450505 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.lightos [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Current host hostNQN and IP(s) are ['10.4.3.209', 'fe80::f816:3eff:fea3:3707', '192.168.40.6', 'fe80::f816:3eff:fe06:bdab', '192.168.50.6', 'fe80::f816:3eff:fe7a:46f2', '192.168.10.6', 'fe80::f816:3eff:fe13:793b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::38fa:21ff:fe6c:3746', 'fe80::fc16:3eff:fe6c:eb30', 'fe80::fc16:3eff:fe12:588f', 'fe80::20a8:54ff:fe51:da0a', 'fe80::fc16:3eff:feb5:6ffd', 'fe80::707d:43ff:fe4a:49d0', 'fe80::4cb3:64ff:fe13:8a75', 'fe80::fc16:3eff:fe8e:8922', 'fe80::4c61:61ff:fe7d:90dc', 'fe80::fc16:3eff:fe77:488d', 'fe80::9469:f2ff:feae:5824', 'fe80::fc16:3eff:febd:951', 'fe80::84b1:8fff:fe59:2d4f', 'fe80::fc16:3eff:fedc:9cb5', 'fe80::f489:94ff:fe75:ec8a', 'fe80::fc16:3eff:fe8a:95c7'] Jun 11 23:11:02.450647 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.lightos [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98431) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 11 23:11:02.450778 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.lightos [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] LIGHTOS: no hostnqn found. {{(pid=98431) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 11 23:11:02.451096 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.209', 'host': 'np0000002687', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:798b370f1cc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad465dfe-0ed1-4637-98c3-ddaebebd61a4', 'nvme_native_multipath': False} {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 11 23:11:02.451321 np0000002687 nova-compute[98431]: DEBUG nova.virt.block_device [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Updating existing volume attachment record: cd842a96-68b3-48d9-80b9-2c6e0870d43f {{(pid=98431) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 11 23:11:02.519569 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-9a1b1d47-e44a-4eef-9570-7c76ea8942f7 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:11:02.532416 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-b6bab62b-32e4-4528-b4ea-503046598d71 req-2e8eda25-cd9c-429c-8aca-f47ce54c4452 service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Instance cache missing network info. {{(pid=98431) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 11 23:11:02.583342 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:02.593680 np0000002687 nova-compute[98431]: DEBUG nova.compute.resource_tracker [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Instance cb63f66c-b69e-42b0-805c-be6fe9b3aee3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98431) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 11 23:11:02.595894 np0000002687 nova-compute[98431]: DEBUG nova.compute.resource_tracker [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Instance 14699717-b93f-4e67-b841-c67de8fff8d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98431) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 11 23:11:02.595894 np0000002687 nova-compute[98431]: DEBUG nova.compute.resource_tracker [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Instance 27ac8c84-e5db-4bd1-a148-ec5834c5b39c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98431) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 11 23:11:02.596263 np0000002687 nova-compute[98431]: DEBUG nova.compute.resource_tracker [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Instance 49a042ba-28ba-4401-9bdf-92f96da8f80e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98431) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 11 23:11:02.680367 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [req-2e66051f-b1b8-41e5-bb2d-be9240f3adce req-a5bee75e-4cf2-4019-878f-ae6436b98fea service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:11:02.702839 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-fc764edc-3b38-4c46-95f7-10bbdd116239 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 8aec3cea-109d-43f8-983c-1d5ee2f71181] instance snapshotting Jun 11 23:11:02.718003 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 27ac8c84-e5db-4bd1-a148-ec5834c5b39c] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:11:02.721414 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 27ac8c84-e5db-4bd1-a148-ec5834c5b39c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98431) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 11 23:11:02.752674 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-0a9b4fdf-1bb0-4c23-befb-c54c0aed40ed req-a0e163de-dfb9-44c2-b5cf-c511ec418f77 service nova] Releasing lock "refresh_cache-73abd331-0bbf-432e-be1c-308801a5429f" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 11 23:11:02.787314 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-b6bab62b-32e4-4528-b4ea-503046598d71 req-2e8eda25-cd9c-429c-8aca-f47ce54c4452 service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Updating instance_info_cache with network_info: [] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:11:02.833262 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Successfully updated port: 609ed1b7-9ea3-4ae3-8c37-f0a952a45507 {{(pid=98431) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 11 23:11:02.838428 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-fc764edc-3b38-4c46-95f7-10bbdd116239 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 8aec3cea-109d-43f8-983c-1d5ee2f71181] Beginning live snapshot process Jun 11 23:11:02.865289 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-2e66051f-b1b8-41e5-bb2d-be9240f3adce req-a5bee75e-4cf2-4019-878f-ae6436b98fea service nova] [instance: 36688d94-68d3-4ae3-989a-b391d7ee4ad9] Updated VIF entry in instance network info cache for port 6075e13d-d32a-4d8f-8741-a4686059985e. {{(pid=98431) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 11 23:11:02.865707 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-2e66051f-b1b8-41e5-bb2d-be9240f3adce req-a5bee75e-4cf2-4019-878f-ae6436b98fea service nova] [instance: 36688d94-68d3-4ae3-989a-b391d7ee4ad9] Updating instance_info_cache with network_info: [{"id": "6075e13d-d32a-4d8f-8741-a4686059985e", "address": "fa:16:3e:8e:89:22", "network": {"id": "e87d6560-c7a9-4b70-83f1-b0863de32387", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1405293341-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ae41a1c4221b4e7483281a8b80f16ee6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6075e13d-d3", "ovs_interfaceid": "6075e13d-d32a-4d8f-8741-a4686059985e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:11:03.106191 np0000002687 nova-compute[98431]: DEBUG nova.compute.resource_tracker [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Instance 206476b7-d805-4c6c-b7fb-db8b5c2a94a6 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98431) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}} Jun 11 23:11:03.106368 np0000002687 nova-compute[98431]: DEBUG nova.compute.resource_tracker [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Instance de4372a4-a0cc-4541-a5a2-87be3152c50e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98431) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 11 23:11:03.106518 np0000002687 nova-compute[98431]: DEBUG nova.compute.resource_tracker [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Instance 8aec3cea-109d-43f8-983c-1d5ee2f71181 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98431) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 11 23:11:03.106708 np0000002687 nova-compute[98431]: DEBUG nova.compute.resource_tracker [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Instance 36688d94-68d3-4ae3-989a-b391d7ee4ad9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98431) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 11 23:11:03.106839 np0000002687 nova-compute[98431]: DEBUG nova.compute.resource_tracker [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Instance 73abd331-0bbf-432e-be1c-308801a5429f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98431) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 11 23:11:03.106968 np0000002687 nova-compute[98431]: DEBUG nova.compute.resource_tracker [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Instance 689e510d-e0a4-4d6a-958e-9acfaebedc87 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98431) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 11 23:11:03.107235 np0000002687 nova-compute[98431]: DEBUG nova.compute.resource_tracker [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=98431) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}} Jun 11 23:11:03.107613 np0000002687 nova-compute[98431]: DEBUG nova.compute.resource_tracker [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Final resource view: name=np0000002687 phys_ram=24030MB used_ram=2240MB phys_disk=95GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 23:11:01 up 25 min, 2 users, load average: 5.08, 2.49, 1.26\n', 'num_instances': '9', 'num_vm_active': '6', 'num_task_image_snapshot_pending': '1', 'num_os_type_None': '9', 'num_proj_aaf744af828a4a5eba1e98da63373b2b': '1', 'io_workload': '3', 'num_task_None': '5', 'num_proj_d78539cb9b504ed0908d5bfe6745a628': '1', 'num_vm_building': '3', 'num_task_spawning': '2', 'num_proj_2d62cddce233457caf7eb43be819e513': '1', 'num_proj_81fd45f475a04e5c8e9bd9deb7ad4c1e': '1', 'num_proj_ae41a1c4221b4e7483281a8b80f16ee6': '1', 'num_proj_bddeb2fac9c34c65996201c81b5c77e4': '1', 'num_proj_3a092509b877483183db8610c8763b93': '2', 'num_task_block_device_mapping': '1', 'num_proj_57813123648a4335a97e8fc5c245cc73': '1'} {{(pid=98431) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}} Jun 11 23:11:03.225145 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Emitting event Paused> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:11:03.225621 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 27ac8c84-e5db-4bd1-a148-ec5834c5b39c] VM Paused (Lifecycle Event) Jun 11 23:11:03.291359 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-b6bab62b-32e4-4528-b4ea-503046598d71 req-2e8eda25-cd9c-429c-8aca-f47ce54c4452 service nova] Releasing lock "refresh_cache-49a042ba-28ba-4401-9bdf-92f96da8f80e" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 11 23:11:03.291359 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-b6bab62b-32e4-4528-b4ea-503046598d71 req-2e8eda25-cd9c-429c-8aca-f47ce54c4452 service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Received event network-vif-unplugged-7051cdff-8b40-42d6-9d8a-9b7748621f1f {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:11:03.291359 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-b6bab62b-32e4-4528-b4ea-503046598d71 req-2e8eda25-cd9c-429c-8aca-f47ce54c4452 service nova] Acquiring lock "49a042ba-28ba-4401-9bdf-92f96da8f80e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:11:03.291537 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-b6bab62b-32e4-4528-b4ea-503046598d71 req-2e8eda25-cd9c-429c-8aca-f47ce54c4452 service nova] Lock "49a042ba-28ba-4401-9bdf-92f96da8f80e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:11:03.292944 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-b6bab62b-32e4-4528-b4ea-503046598d71 req-2e8eda25-cd9c-429c-8aca-f47ce54c4452 service nova] Lock "49a042ba-28ba-4401-9bdf-92f96da8f80e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:11:03.292944 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-b6bab62b-32e4-4528-b4ea-503046598d71 req-2e8eda25-cd9c-429c-8aca-f47ce54c4452 service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] No waiting events found dispatching network-vif-unplugged-7051cdff-8b40-42d6-9d8a-9b7748621f1f {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:11:03.292944 np0000002687 nova-compute[98431]: WARNING nova.compute.manager [req-b6bab62b-32e4-4528-b4ea-503046598d71 req-2e8eda25-cd9c-429c-8aca-f47ce54c4452 service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Received unexpected event network-vif-unplugged-7051cdff-8b40-42d6-9d8a-9b7748621f1f for instance with vm_state building and task_state block_device_mapping. Jun 11 23:11:03.374530 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-2e66051f-b1b8-41e5-bb2d-be9240f3adce req-a5bee75e-4cf2-4019-878f-ae6436b98fea service nova] Releasing lock "refresh_cache-36688d94-68d3-4ae3-989a-b391d7ee4ad9" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 11 23:11:03.382651 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:03.447492 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-c5553338-94f5-4a23-b4db-49ad6afbc6a2 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] No BDM found with device name vda, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:11:03.447492 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-c5553338-94f5-4a23-b4db-49ad6afbc6a2 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:11:03.449569 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-c5553338-94f5-4a23-b4db-49ad6afbc6a2 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] No BDM found with device name hda, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:11:03.449569 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-c5553338-94f5-4a23-b4db-49ad6afbc6a2 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] No VIF found with MAC fa:16:3e:12:58:8f, not building metadata {{(pid=98431) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13199}} Jun 11 23:11:03.496126 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-45adaec2-980e-43ac-98f2-6b840c694680 req-82bbada1-418c-406d-a492-a3cfd4d3199a service nova] [instance: 14699717-b93f-4e67-b841-c67de8fff8d4] Received event network-vif-plugged-a266c7d4-9f0e-474d-a4d9-5190dbdd0fc2 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:11:03.496246 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-45adaec2-980e-43ac-98f2-6b840c694680 req-82bbada1-418c-406d-a492-a3cfd4d3199a service nova] Acquiring lock "14699717-b93f-4e67-b841-c67de8fff8d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:11:03.496395 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-45adaec2-980e-43ac-98f2-6b840c694680 req-82bbada1-418c-406d-a492-a3cfd4d3199a service nova] Lock "14699717-b93f-4e67-b841-c67de8fff8d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:11:03.496511 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-45adaec2-980e-43ac-98f2-6b840c694680 req-82bbada1-418c-406d-a492-a3cfd4d3199a service nova] Lock "14699717-b93f-4e67-b841-c67de8fff8d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:11:03.499745 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-45adaec2-980e-43ac-98f2-6b840c694680 req-82bbada1-418c-406d-a492-a3cfd4d3199a service nova] [instance: 14699717-b93f-4e67-b841-c67de8fff8d4] Processing event network-vif-plugged-a266c7d4-9f0e-474d-a4d9-5190dbdd0fc2 {{(pid=98431) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 11 23:11:03.499945 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-45adaec2-980e-43ac-98f2-6b840c694680 req-82bbada1-418c-406d-a492-a3cfd4d3199a service nova] [instance: 14699717-b93f-4e67-b841-c67de8fff8d4] Received event network-vif-plugged-a266c7d4-9f0e-474d-a4d9-5190dbdd0fc2 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:11:03.500104 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-45adaec2-980e-43ac-98f2-6b840c694680 req-82bbada1-418c-406d-a492-a3cfd4d3199a service nova] Acquiring lock "14699717-b93f-4e67-b841-c67de8fff8d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:11:03.500266 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-45adaec2-980e-43ac-98f2-6b840c694680 req-82bbada1-418c-406d-a492-a3cfd4d3199a service nova] Lock "14699717-b93f-4e67-b841-c67de8fff8d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:11:03.500382 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-45adaec2-980e-43ac-98f2-6b840c694680 req-82bbada1-418c-406d-a492-a3cfd4d3199a service nova] Lock "14699717-b93f-4e67-b841-c67de8fff8d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:11:03.503835 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] [instance: 14699717-b93f-4e67-b841-c67de8fff8d4] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98431) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 11 23:11:03.504661 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-45adaec2-980e-43ac-98f2-6b840c694680 req-82bbada1-418c-406d-a492-a3cfd4d3199a service nova] [instance: 14699717-b93f-4e67-b841-c67de8fff8d4] No waiting events found dispatching network-vif-plugged-a266c7d4-9f0e-474d-a4d9-5190dbdd0fc2 {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:11:03.504850 np0000002687 nova-compute[98431]: WARNING nova.compute.manager [req-45adaec2-980e-43ac-98f2-6b840c694680 req-82bbada1-418c-406d-a492-a3cfd4d3199a service nova] [instance: 14699717-b93f-4e67-b841-c67de8fff8d4] Received unexpected event network-vif-plugged-a266c7d4-9f0e-474d-a4d9-5190dbdd0fc2 for instance with vm_state building and task_state spawning. Jun 11 23:11:03.504951 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-45adaec2-980e-43ac-98f2-6b840c694680 req-82bbada1-418c-406d-a492-a3cfd4d3199a service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Received event network-changed-609ed1b7-9ea3-4ae3-8c37-f0a952a45507 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:11:03.505060 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-45adaec2-980e-43ac-98f2-6b840c694680 req-82bbada1-418c-406d-a492-a3cfd4d3199a service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Refreshing instance network info cache due to event network-changed-609ed1b7-9ea3-4ae3-8c37-f0a952a45507. {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 11 23:11:03.505193 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-45adaec2-980e-43ac-98f2-6b840c694680 req-82bbada1-418c-406d-a492-a3cfd4d3199a service nova] Acquiring lock "refresh_cache-49a042ba-28ba-4401-9bdf-92f96da8f80e" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 11 23:11:03.505274 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-45adaec2-980e-43ac-98f2-6b840c694680 req-82bbada1-418c-406d-a492-a3cfd4d3199a service nova] Acquired lock "refresh_cache-49a042ba-28ba-4401-9bdf-92f96da8f80e" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 11 23:11:03.505408 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-45adaec2-980e-43ac-98f2-6b840c694680 req-82bbada1-418c-406d-a492-a3cfd4d3199a service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Refreshing network info cache for port 609ed1b7-9ea3-4ae3-8c37-f0a952a45507 {{(pid=98431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 11 23:11:03.510865 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] [instance: 14699717-b93f-4e67-b841-c67de8fff8d4] Guest created on hypervisor {{(pid=98431) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}} Jun 11 23:11:03.513620 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [-] [instance: 14699717-b93f-4e67-b841-c67de8fff8d4] Instance spawned successfully. Jun 11 23:11:03.515209 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] [instance: 14699717-b93f-4e67-b841-c67de8fff8d4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 11 23:11:03.731396 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 27ac8c84-e5db-4bd1-a148-ec5834c5b39c] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:11:03.736234 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Emitting event Resumed> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:11:03.736401 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 27ac8c84-e5db-4bd1-a148-ec5834c5b39c] VM Resumed (Lifecycle Event) Jun 11 23:11:03.851113 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98431) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 11 23:11:03.851914 np0000002687 nova-compute[98431]: DEBUG nova.compute.provider_tree [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Inventory has not changed in ProviderTree for provider: e3e65fe2-9de9-4821-8b4a-ccae37c66e25 {{(pid=98431) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 11 23:11:03.961682 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-87a110a2-fd16-4abd-a51e-e1f7eafa005d req-d264239e-905a-41da-b4a6-ab8ce8f4034a service nova] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Received event network-vif-plugged-2d6dd8b9-e3ff-462f-92cf-8c3a62bc27d1 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:11:03.961682 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-87a110a2-fd16-4abd-a51e-e1f7eafa005d req-d264239e-905a-41da-b4a6-ab8ce8f4034a service nova] Acquiring lock "cb63f66c-b69e-42b0-805c-be6fe9b3aee3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:11:03.961682 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-87a110a2-fd16-4abd-a51e-e1f7eafa005d req-d264239e-905a-41da-b4a6-ab8ce8f4034a service nova] Lock "cb63f66c-b69e-42b0-805c-be6fe9b3aee3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:11:03.962016 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-87a110a2-fd16-4abd-a51e-e1f7eafa005d req-d264239e-905a-41da-b4a6-ab8ce8f4034a service nova] Lock "cb63f66c-b69e-42b0-805c-be6fe9b3aee3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:11:03.962016 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-87a110a2-fd16-4abd-a51e-e1f7eafa005d req-d264239e-905a-41da-b4a6-ab8ce8f4034a service nova] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Processing event network-vif-plugged-2d6dd8b9-e3ff-462f-92cf-8c3a62bc27d1 {{(pid=98431) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 11 23:11:03.962133 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-87a110a2-fd16-4abd-a51e-e1f7eafa005d req-d264239e-905a-41da-b4a6-ab8ce8f4034a service nova] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Received event network-vif-plugged-2d6dd8b9-e3ff-462f-92cf-8c3a62bc27d1 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:11:03.964072 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-87a110a2-fd16-4abd-a51e-e1f7eafa005d req-d264239e-905a-41da-b4a6-ab8ce8f4034a service nova] Acquiring lock "cb63f66c-b69e-42b0-805c-be6fe9b3aee3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:11:03.964072 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-87a110a2-fd16-4abd-a51e-e1f7eafa005d req-d264239e-905a-41da-b4a6-ab8ce8f4034a service nova] Lock "cb63f66c-b69e-42b0-805c-be6fe9b3aee3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:11:03.964072 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-87a110a2-fd16-4abd-a51e-e1f7eafa005d req-d264239e-905a-41da-b4a6-ab8ce8f4034a service nova] Lock "cb63f66c-b69e-42b0-805c-be6fe9b3aee3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:11:03.964072 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-87a110a2-fd16-4abd-a51e-e1f7eafa005d req-d264239e-905a-41da-b4a6-ab8ce8f4034a service nova] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] No waiting events found dispatching network-vif-plugged-2d6dd8b9-e3ff-462f-92cf-8c3a62bc27d1 {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:11:03.964072 np0000002687 nova-compute[98431]: WARNING nova.compute.manager [req-87a110a2-fd16-4abd-a51e-e1f7eafa005d req-d264239e-905a-41da-b4a6-ab8ce8f4034a service nova] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Received unexpected event network-vif-plugged-2d6dd8b9-e3ff-462f-92cf-8c3a62bc27d1 for instance with vm_state building and task_state spawning. Jun 11 23:11:03.964072 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-6a2a9908-fc7f-49fd-ba64-85c281bbf910 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Instance event wait completed in 17 seconds for network-vif-plugged {{(pid=98431) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 11 23:11:03.968196 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-6a2a9908-fc7f-49fd-ba64-85c281bbf910 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Guest created on hypervisor {{(pid=98431) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}} Jun 11 23:11:03.972071 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [-] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Instance spawned successfully. Jun 11 23:11:03.973446 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-6a2a9908-fc7f-49fd-ba64-85c281bbf910 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 11 23:11:04.008246 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Successfully updated port: b54ddd43-d4cb-4d4a-840e-895e75419e25 {{(pid=98431) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 11 23:11:04.011973 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [req-45adaec2-980e-43ac-98f2-6b840c694680 req-82bbada1-418c-406d-a492-a3cfd4d3199a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:11:04.019690 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] [instance: 14699717-b93f-4e67-b841-c67de8fff8d4] Found default for hw_cdrom_bus of ide {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:11:04.019690 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] [instance: 14699717-b93f-4e67-b841-c67de8fff8d4] Found default for hw_disk_bus of virtio {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:11:04.019863 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] [instance: 14699717-b93f-4e67-b841-c67de8fff8d4] Found default for hw_input_bus of None {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:11:04.020071 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] [instance: 14699717-b93f-4e67-b841-c67de8fff8d4] Found default for hw_pointer_model of None {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:11:04.020896 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] [instance: 14699717-b93f-4e67-b841-c67de8fff8d4] Found default for hw_video_model of virtio {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:11:04.020896 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] [instance: 14699717-b93f-4e67-b841-c67de8fff8d4] Found default for hw_vif_model of virtio {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:11:04.093892 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-eb7176d4-1a53-442b-8f50-4057cb20d289 req-93d5bf92-287b-46c3-968e-9fee08c2665c service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Received event network-changed-b54ddd43-d4cb-4d4a-840e-895e75419e25 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:11:04.095112 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-eb7176d4-1a53-442b-8f50-4057cb20d289 req-93d5bf92-287b-46c3-968e-9fee08c2665c service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Refreshing instance network info cache due to event network-changed-b54ddd43-d4cb-4d4a-840e-895e75419e25. {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 11 23:11:04.095380 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-eb7176d4-1a53-442b-8f50-4057cb20d289 req-93d5bf92-287b-46c3-968e-9fee08c2665c service nova] Acquiring lock "refresh_cache-49a042ba-28ba-4401-9bdf-92f96da8f80e" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 11 23:11:04.099813 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-45adaec2-980e-43ac-98f2-6b840c694680 req-82bbada1-418c-406d-a492-a3cfd4d3199a service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Instance cache missing network info. {{(pid=98431) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 11 23:11:04.236818 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-45adaec2-980e-43ac-98f2-6b840c694680 req-82bbada1-418c-406d-a492-a3cfd4d3199a service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Updating instance_info_cache with network_info: [] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:11:04.242073 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 27ac8c84-e5db-4bd1-a148-ec5834c5b39c] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:11:04.243238 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 27ac8c84-e5db-4bd1-a148-ec5834c5b39c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98431) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 11 23:11:04.354912 np0000002687 nova-compute[98431]: DEBUG nova.scheduler.client.report [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Inventory has not changed for provider e3e65fe2-9de9-4821-8b4a-ccae37c66e25 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98431) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 11 23:11:04.366718 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-fc764edc-3b38-4c46-95f7-10bbdd116239 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8aec3cea-109d-43f8-983c-1d5ee2f71181/disk --force-share --output=json -f qcow2 {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:11:04.462898 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-fc764edc-3b38-4c46-95f7-10bbdd116239 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8aec3cea-109d-43f8-983c-1d5ee2f71181/disk --force-share --output=json -f qcow2" returned: 0 in 0.096s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:11:04.463620 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-fc764edc-3b38-4c46-95f7-10bbdd116239 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8aec3cea-109d-43f8-983c-1d5ee2f71181/disk --force-share --output=json -f qcow2 {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:11:04.486534 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-6a2a9908-fc7f-49fd-ba64-85c281bbf910 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Found default for hw_cdrom_bus of ide {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:11:04.486534 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-6a2a9908-fc7f-49fd-ba64-85c281bbf910 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Found default for hw_disk_bus of virtio {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:11:04.487037 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-6a2a9908-fc7f-49fd-ba64-85c281bbf910 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Found default for hw_input_bus of None {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:11:04.487628 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-6a2a9908-fc7f-49fd-ba64-85c281bbf910 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Found default for hw_pointer_model of None {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:11:04.488194 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-6a2a9908-fc7f-49fd-ba64-85c281bbf910 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Found default for hw_video_model of virtio {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:11:04.488637 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-6a2a9908-fc7f-49fd-ba64-85c281bbf910 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Found default for hw_vif_model of virtio {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:11:04.529653 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] [instance: 14699717-b93f-4e67-b841-c67de8fff8d4] Took 9.17 seconds to spawn the instance on the hypervisor. Jun 11 23:11:04.529918 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] [instance: 14699717-b93f-4e67-b841-c67de8fff8d4] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:11:04.556205 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-fc764edc-3b38-4c46-95f7-10bbdd116239 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8aec3cea-109d-43f8-983c-1d5ee2f71181/disk --force-share --output=json -f qcow2" returned: 0 in 0.092s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:11:04.556971 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-fc764edc-3b38-4c46-95f7-10bbdd116239 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:11:04.562100 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-fc764edc-3b38-4c46-95f7-10bbdd116239 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:11:04.563789 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-fc764edc-3b38-4c46-95f7-10bbdd116239 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:11:04.626066 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Start spawning the instance on the hypervisor. {{(pid=98431) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 11 23:11:04.629184 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Creating instance directory {{(pid=98431) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}} Jun 11 23:11:04.629477 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Creating image(s) Jun 11 23:11:04.629895 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Did not create local disks {{(pid=98431) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}} Jun 11 23:11:04.630058 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Ensure instance console log exists: /opt/stack/data/nova/instances/49a042ba-28ba-4401-9bdf-92f96da8f80e/console.log {{(pid=98431) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}} Jun 11 23:11:04.631852 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:11:04.632076 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:11:04.632239 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:11:04.658394 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-fc764edc-3b38-4c46-95f7-10bbdd116239 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json" returned: 0 in 0.095s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:11:04.659148 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-fc764edc-3b38-4c46-95f7-10bbdd116239 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpx90od27b/128a4efca67c457490c6691ff64ea3ad.delta 1073741824 {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:11:04.699939 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-fc764edc-3b38-4c46-95f7-10bbdd116239 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpx90od27b/128a4efca67c457490c6691ff64ea3ad.delta 1073741824" returned: 0 in 0.040s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:11:04.701534 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-fc764edc-3b38-4c46-95f7-10bbdd116239 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 8aec3cea-109d-43f8-983c-1d5ee2f71181] Quiescing instance not available: QEMU guest agent is not enabled. Jun 11 23:11:04.739204 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-45adaec2-980e-43ac-98f2-6b840c694680 req-82bbada1-418c-406d-a492-a3cfd4d3199a service nova] Releasing lock "refresh_cache-49a042ba-28ba-4401-9bdf-92f96da8f80e" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 11 23:11:04.740856 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-eb7176d4-1a53-442b-8f50-4057cb20d289 req-93d5bf92-287b-46c3-968e-9fee08c2665c service nova] Acquired lock "refresh_cache-49a042ba-28ba-4401-9bdf-92f96da8f80e" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 11 23:11:04.740856 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-eb7176d4-1a53-442b-8f50-4057cb20d289 req-93d5bf92-287b-46c3-968e-9fee08c2665c service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Refreshing network info cache for port b54ddd43-d4cb-4d4a-840e-895e75419e25 {{(pid=98431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 11 23:11:04.748856 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Emitting event Started> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:11:04.749085 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 14699717-b93f-4e67-b841-c67de8fff8d4] VM Started (Lifecycle Event) Jun 11 23:11:04.868320 np0000002687 nova-compute[98431]: DEBUG nova.compute.resource_tracker [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Compute_service record updated for np0000002687:np0000002687 {{(pid=98431) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}} Jun 11 23:11:04.868522 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 3.396s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:11:04.870349 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-9a1b1d47-e44a-4eef-9570-7c76ea8942f7 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.351s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:11:04.874489 np0000002687 nova-compute[98431]: DEBUG oslo.service.backend._threading.loopingcall [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 56.75 seconds {{(pid=98431) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jun 11 23:11:04.877637 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-9a1b1d47-e44a-4eef-9570-7c76ea8942f7 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98431) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 11 23:11:04.877821 np0000002687 nova-compute[98431]: INFO nova.compute.claims [None req-9a1b1d47-e44a-4eef-9570-7c76ea8942f7 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 206476b7-d805-4c6c-b7fb-db8b5c2a94a6] Claim successful on node np0000002687 Jun 11 23:11:04.998356 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-6a2a9908-fc7f-49fd-ba64-85c281bbf910 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Took 25.32 seconds to spawn the instance on the hypervisor. Jun 11 23:11:04.998356 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-6a2a9908-fc7f-49fd-ba64-85c281bbf910 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:11:05.011182 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.guest [None req-fc764edc-3b38-4c46-95f7-10bbdd116239 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] COPY block job progress, current cursor: 1 final cursor: 1 {{(pid=98431) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}} Jun 11 23:11:05.015274 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-fc764edc-3b38-4c46-95f7-10bbdd116239 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 8aec3cea-109d-43f8-983c-1d5ee2f71181] Skipping quiescing instance: QEMU guest agent is not enabled. Jun 11 23:11:05.044298 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] [instance: 14699717-b93f-4e67-b841-c67de8fff8d4] Took 17.35 seconds to build instance. Jun 11 23:11:05.067577 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-c5553338-94f5-4a23-b4db-49ad6afbc6a2 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Lock "689e510d-e0a4-4d6a-958e-9acfaebedc87" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 7.809s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:11:05.077882 np0000002687 nova-compute[98431]: DEBUG nova.privsep.utils [None req-fc764edc-3b38-4c46-95f7-10bbdd116239 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98431) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}} Jun 11 23:11:05.080931 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-fc764edc-3b38-4c46-95f7-10bbdd116239 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpx90od27b/128a4efca67c457490c6691ff64ea3ad.delta /opt/stack/data/nova/instances/snapshots/tmpx90od27b/128a4efca67c457490c6691ff64ea3ad {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:11:05.162065 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Successfully updated port: 77424d75-6e25-4791-a44d-495051f7e89f {{(pid=98431) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 11 23:11:05.200075 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-fc764edc-3b38-4c46-95f7-10bbdd116239 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpx90od27b/128a4efca67c457490c6691ff64ea3ad.delta /opt/stack/data/nova/instances/snapshots/tmpx90od27b/128a4efca67c457490c6691ff64ea3ad" returned: 0 in 0.122s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:11:05.201690 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-fc764edc-3b38-4c46-95f7-10bbdd116239 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 8aec3cea-109d-43f8-983c-1d5ee2f71181] Snapshot extracted, beginning image upload Jun 11 23:11:05.245783 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [req-eb7176d4-1a53-442b-8f50-4057cb20d289 req-93d5bf92-287b-46c3-968e-9fee08c2665c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:11:05.253608 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 14699717-b93f-4e67-b841-c67de8fff8d4] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:11:05.258047 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 14699717-b93f-4e67-b841-c67de8fff8d4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98431) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 11 23:11:05.335253 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-eb7176d4-1a53-442b-8f50-4057cb20d289 req-93d5bf92-287b-46c3-968e-9fee08c2665c service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Instance cache missing network info. {{(pid=98431) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 11 23:11:05.495835 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-ab251e3a-468c-40fc-b3b5-c292f2e7a520 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Acquiring lock "689e510d-e0a4-4d6a-958e-9acfaebedc87" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:11:05.496291 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-ab251e3a-468c-40fc-b3b5-c292f2e7a520 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Lock "689e510d-e0a4-4d6a-958e-9acfaebedc87" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.002s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:11:05.497862 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-ab251e3a-468c-40fc-b3b5-c292f2e7a520 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Acquiring lock "689e510d-e0a4-4d6a-958e-9acfaebedc87-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:11:05.497862 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-ab251e3a-468c-40fc-b3b5-c292f2e7a520 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Lock "689e510d-e0a4-4d6a-958e-9acfaebedc87-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:11:05.497862 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-ab251e3a-468c-40fc-b3b5-c292f2e7a520 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Lock "689e510d-e0a4-4d6a-958e-9acfaebedc87-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:11:05.498977 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-eb7176d4-1a53-442b-8f50-4057cb20d289 req-93d5bf92-287b-46c3-968e-9fee08c2665c service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Updating instance_info_cache with network_info: [] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:11:05.500219 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-ab251e3a-468c-40fc-b3b5-c292f2e7a520 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] [instance: 689e510d-e0a4-4d6a-958e-9acfaebedc87] Terminating instance Jun 11 23:11:05.513105 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-6a2a9908-fc7f-49fd-ba64-85c281bbf910 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Took 32.58 seconds to build instance. Jun 11 23:11:05.548236 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-190da6ef-456e-4453-aa0f-95de5c29f404 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Lock "14699717-b93f-4e67-b841-c67de8fff8d4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 18.866s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:11:05.760532 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Emitting event Paused> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:11:05.760711 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 14699717-b93f-4e67-b841-c67de8fff8d4] VM Paused (Lifecycle Event) Jun 11 23:11:06.001868 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-eb7176d4-1a53-442b-8f50-4057cb20d289 req-93d5bf92-287b-46c3-968e-9fee08c2665c service nova] Releasing lock "refresh_cache-49a042ba-28ba-4401-9bdf-92f96da8f80e" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 11 23:11:06.008627 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-ab251e3a-468c-40fc-b3b5-c292f2e7a520 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] [instance: 689e510d-e0a4-4d6a-958e-9acfaebedc87] Start destroying the instance on the hypervisor. {{(pid=98431) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}} Jun 11 23:11:06.017898 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-6a2a9908-fc7f-49fd-ba64-85c281bbf910 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Lock "cb63f66c-b69e-42b0-805c-be6fe9b3aee3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 34.095s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:11:06.035361 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:06.056049 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:06.084845 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:06.108298 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:06.109970 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:06.193916 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-68b7f07d-12c3-43ad-8c60-f2b2fbb44535 req-a84c53a6-c926-43cf-9bb0-f5e7e567ad75 service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Received event network-changed-77424d75-6e25-4791-a44d-495051f7e89f {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:11:06.193916 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-68b7f07d-12c3-43ad-8c60-f2b2fbb44535 req-a84c53a6-c926-43cf-9bb0-f5e7e567ad75 service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Refreshing instance network info cache due to event network-changed-77424d75-6e25-4791-a44d-495051f7e89f. {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 11 23:11:06.193916 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-68b7f07d-12c3-43ad-8c60-f2b2fbb44535 req-a84c53a6-c926-43cf-9bb0-f5e7e567ad75 service nova] Acquiring lock "refresh_cache-49a042ba-28ba-4401-9bdf-92f96da8f80e" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 11 23:11:06.193916 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-68b7f07d-12c3-43ad-8c60-f2b2fbb44535 req-a84c53a6-c926-43cf-9bb0-f5e7e567ad75 service nova] Acquired lock "refresh_cache-49a042ba-28ba-4401-9bdf-92f96da8f80e" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 11 23:11:06.193916 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-68b7f07d-12c3-43ad-8c60-f2b2fbb44535 req-a84c53a6-c926-43cf-9bb0-f5e7e567ad75 service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Refreshing network info cache for port 77424d75-6e25-4791-a44d-495051f7e89f {{(pid=98431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 11 23:11:06.264729 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 14699717-b93f-4e67-b841-c67de8fff8d4] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:11:06.273184 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Emitting event Resumed> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:11:06.273932 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 14699717-b93f-4e67-b841-c67de8fff8d4] VM Resumed (Lifecycle Event) Jun 11 23:11:06.417839 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [-] [instance: 689e510d-e0a4-4d6a-958e-9acfaebedc87] Instance destroyed successfully. Jun 11 23:11:06.418299 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-ab251e3a-468c-40fc-b3b5-c292f2e7a520 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Lazy-loading 'resources' on Instance uuid 689e510d-e0a4-4d6a-958e-9acfaebedc87 {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:11:06.652627 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Successfully updated port: 0263e39d-c835-4cf1-b333-265608e81a93 {{(pid=98431) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 11 23:11:06.699509 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [req-68b7f07d-12c3-43ad-8c60-f2b2fbb44535 req-a84c53a6-c926-43cf-9bb0-f5e7e567ad75 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:11:06.745263 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-1ff9453a-8aa9-4a89-abb5-dea9b1dca976 req-2c7ca9ca-58b2-4688-83fa-081d358bd953 service nova] [instance: 689e510d-e0a4-4d6a-958e-9acfaebedc87] Received event network-vif-unplugged-65f7170b-ae97-4cd6-93a1-7dd5111b7978 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:11:06.745836 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-1ff9453a-8aa9-4a89-abb5-dea9b1dca976 req-2c7ca9ca-58b2-4688-83fa-081d358bd953 service nova] Acquiring lock "689e510d-e0a4-4d6a-958e-9acfaebedc87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:11:06.745836 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-1ff9453a-8aa9-4a89-abb5-dea9b1dca976 req-2c7ca9ca-58b2-4688-83fa-081d358bd953 service nova] Lock "689e510d-e0a4-4d6a-958e-9acfaebedc87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:11:06.745836 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-1ff9453a-8aa9-4a89-abb5-dea9b1dca976 req-2c7ca9ca-58b2-4688-83fa-081d358bd953 service nova] Lock "689e510d-e0a4-4d6a-958e-9acfaebedc87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:11:06.745836 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-1ff9453a-8aa9-4a89-abb5-dea9b1dca976 req-2c7ca9ca-58b2-4688-83fa-081d358bd953 service nova] [instance: 689e510d-e0a4-4d6a-958e-9acfaebedc87] No waiting events found dispatching network-vif-unplugged-65f7170b-ae97-4cd6-93a1-7dd5111b7978 {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:11:06.746005 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-1ff9453a-8aa9-4a89-abb5-dea9b1dca976 req-2c7ca9ca-58b2-4688-83fa-081d358bd953 service nova] [instance: 689e510d-e0a4-4d6a-958e-9acfaebedc87] Received event network-vif-unplugged-65f7170b-ae97-4cd6-93a1-7dd5111b7978 for instance with task_state deleting. {{(pid=98431) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 11 23:11:06.781007 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 14699717-b93f-4e67-b841-c67de8fff8d4] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:11:06.782850 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-ff7db34d-d2db-4f92-a01e-45261c899db3 req-7000775e-ba46-4e1b-9296-544ddac2aed0 service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Received event network-changed-0263e39d-c835-4cf1-b333-265608e81a93 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:11:06.783005 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-ff7db34d-d2db-4f92-a01e-45261c899db3 req-7000775e-ba46-4e1b-9296-544ddac2aed0 service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Refreshing instance network info cache due to event network-changed-0263e39d-c835-4cf1-b333-265608e81a93. {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 11 23:11:06.783134 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-ff7db34d-d2db-4f92-a01e-45261c899db3 req-7000775e-ba46-4e1b-9296-544ddac2aed0 service nova] Acquiring lock "refresh_cache-49a042ba-28ba-4401-9bdf-92f96da8f80e" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 11 23:11:06.785489 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 14699717-b93f-4e67-b841-c67de8fff8d4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98431) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 11 23:11:06.902570 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-68b7f07d-12c3-43ad-8c60-f2b2fbb44535 req-a84c53a6-c926-43cf-9bb0-f5e7e567ad75 service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Instance cache missing network info. {{(pid=98431) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 11 23:11:06.921557 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-ab251e3a-468c-40fc-b3b5-c292f2e7a520 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-11T23:10:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1500808158',display_name='tempest-DeleteServersTestJSON-server-1500808158',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='tempest-deleteserverstestjson-server-1500808158',id=2,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-06-11T23:10:51Z,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='d78539cb9b504ed0908d5bfe6745a628',ramdisk_id='',reservation_id='r-0l3u61cz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-807627983',owner_user_name='tempest-DeleteServersTestJSON-807627983-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-11T23:10:52Z,user_data=None,user_id='3d47d776b5de49189b8790124ba4bd14',uuid=689e510d-e0a4-4d6a-958e-9acfaebedc87,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "65f7170b-ae97-4cd6-93a1-7dd5111b7978", "address": "fa:16:3e:12:58:8f", "network": {"id": "7433cdeb-8dc1-430a-aade-959bf6c26aa4", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1384636967-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d78539cb9b504ed0908d5bfe6745a628", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap65f7170b-ae", "ovs_interfaceid": "65f7170b-ae97-4cd6-93a1-7dd5111b7978", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 11 23:11:06.921838 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-ab251e3a-468c-40fc-b3b5-c292f2e7a520 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Converting VIF {"id": "65f7170b-ae97-4cd6-93a1-7dd5111b7978", "address": "fa:16:3e:12:58:8f", "network": {"id": "7433cdeb-8dc1-430a-aade-959bf6c26aa4", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1384636967-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d78539cb9b504ed0908d5bfe6745a628", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap65f7170b-ae", "ovs_interfaceid": "65f7170b-ae97-4cd6-93a1-7dd5111b7978", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:11:06.922610 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-ab251e3a-468c-40fc-b3b5-c292f2e7a520 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:58:8f,bridge_name='br-int',has_traffic_filtering=True,id=65f7170b-ae97-4cd6-93a1-7dd5111b7978,network=Network(7433cdeb-8dc1-430a-aade-959bf6c26aa4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65f7170b-ae') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:11:06.922967 np0000002687 nova-compute[98431]: DEBUG os_vif [None req-ab251e3a-468c-40fc-b3b5-c292f2e7a520 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:58:8f,bridge_name='br-int',has_traffic_filtering=True,id=65f7170b-ae97-4cd6-93a1-7dd5111b7978,network=Network(7433cdeb-8dc1-430a-aade-959bf6c26aa4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65f7170b-ae') {{(pid=98431) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 11 23:11:06.927510 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:06.927510 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap65f7170b-ae, bridge=br-int, if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:11:06.927915 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:06.928934 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:11:06.929646 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:06.930481 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:06.930623 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a75ba5d7-239f-4665-a038-aa1bc08f7cfa) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:11:06.933488 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:06.933488 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:11:06.933488 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:06.935262 np0000002687 nova-compute[98431]: INFO os_vif [None req-ab251e3a-468c-40fc-b3b5-c292f2e7a520 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:58:8f,bridge_name='br-int',has_traffic_filtering=True,id=65f7170b-ae97-4cd6-93a1-7dd5111b7978,network=Network(7433cdeb-8dc1-430a-aade-959bf6c26aa4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65f7170b-ae') Jun 11 23:11:06.936398 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab251e3a-468c-40fc-b3b5-c292f2e7a520 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] [instance: 689e510d-e0a4-4d6a-958e-9acfaebedc87] calling os-brick to detach iSCSI Volume {{(pid=98431) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jun 11 23:11:06.936867 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab251e3a-468c-40fc-b3b5-c292f2e7a520 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-64645843-e0b4-46bb-8426-698daf25b044', 'iqn.2023-03.storpool.com:os--volume-64645843-e0b4-46bb-8426-698daf25b044'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-64645843-e0b4-46bb-8426-698daf25b044', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '64645843-e0b4-46bb-8426-698daf25b044', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': True}}" {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 11 23:11:06.937033 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-ab251e3a-468c-40fc-b3b5-c292f2e7a520 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 11 23:11:06.937438 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-ab251e3a-468c-40fc-b3b5-c292f2e7a520 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 11 23:11:06.937886 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab251e3a-468c-40fc-b3b5-c292f2e7a520 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-64645843-e0b4-46bb-8426-698daf25b044', 'iqn.2023-03.storpool.com:os--volume-64645843-e0b4-46bb-8426-698daf25b044'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-64645843-e0b4-46bb-8426-698daf25b044', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '64645843-e0b4-46bb-8426-698daf25b044', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 11 23:11:06.938055 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab251e3a-468c-40fc-b3b5-c292f2e7a520 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-64645843-e0b4-46bb-8426-698daf25b044', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-64645843-e0b4-46bb-8426-698daf25b044', 0)] {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 11 23:11:06.955509 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-9a1b1d47-e44a-4eef-9570-7c76ea8942f7 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98431) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 11 23:11:06.955509 np0000002687 nova-compute[98431]: DEBUG nova.compute.provider_tree [None req-9a1b1d47-e44a-4eef-9570-7c76ea8942f7 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Inventory has not changed in ProviderTree for provider: e3e65fe2-9de9-4821-8b4a-ccae37c66e25 {{(pid=98431) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 11 23:11:06.979078 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab251e3a-468c-40fc-b3b5-c292f2e7a520 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:06.979078 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:06.979078 np0000002687 nova-compute[98431]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-64645843-e0b4-46bb-8426-698daf25b044 (non-flash) Jun 11 23:11:06.979078 np0000002687 nova-compute[98431]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-64645843-e0b4-46bb-8426-698daf25b044 (non-flash) Jun 11 23:11:06.979078 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:11:06.979326 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab251e3a-468c-40fc-b3b5-c292f2e7a520 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:06.979326 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:06.979326 np0000002687 nova-compute[98431]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-64645843-e0b4-46bb-8426-698daf25b044 (non-flash) Jun 11 23:11:06.979326 np0000002687 nova-compute[98431]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-64645843-e0b4-46bb-8426-698daf25b044 (non-flash) Jun 11 23:11:06.979326 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:11:06.979786 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab251e3a-468c-40fc-b3b5-c292f2e7a520 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9', '3'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9', '4'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-64645843-e0b4-46bb-8426-698daf25b044', '5'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-64645843-e0b4-46bb-8426-698daf25b044', '6')] {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 11 23:11:06.979998 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab251e3a-468c-40fc-b3b5-c292f2e7a520 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-64645843-e0b4-46bb-8426-698daf25b044, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-64645843-e0b4-46bb-8426-698daf25b044', '5')] {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 11 23:11:06.982084 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab251e3a-468c-40fc-b3b5-c292f2e7a520 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-64645843-e0b4-46bb-8426-698daf25b044, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-64645843-e0b4-46bb-8426-698daf25b044', '6')] {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 11 23:11:06.982504 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab251e3a-468c-40fc-b3b5-c292f2e7a520 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Resulting device map defaultdict(. at 0x7e1ea010ede0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-64645843-e0b4-46bb-8426-698daf25b044'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-64645843-e0b4-46bb-8426-698daf25b044'): ({'sde'}, set())}) {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 11 23:11:06.982774 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-ab251e3a-468c-40fc-b3b5-c292f2e7a520 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Removing multipathed devices sdd, sde {{(pid=98431) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 11 23:11:06.983090 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-ab251e3a-468c-40fc-b3b5-c292f2e7a520 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Flush multipath device 330000000331a74ea {{(pid=98431) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jun 11 23:11:07.025841 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-ab251e3a-468c-40fc-b3b5-c292f2e7a520 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98431) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 11 23:11:07.063699 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-ab251e3a-468c-40fc-b3b5-c292f2e7a520 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98431) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 11 23:11:07.108214 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-ab251e3a-468c-40fc-b3b5-c292f2e7a520 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Checking to see if SCSI volumes sdd, sde have been removed. {{(pid=98431) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 11 23:11:07.109571 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-ab251e3a-468c-40fc-b3b5-c292f2e7a520 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] SCSI volumes sdd, sde have been removed. {{(pid=98431) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 11 23:11:07.115207 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-ab251e3a-468c-40fc-b3b5-c292f2e7a520 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Checking to see if device paths {'sdd', 'sde'} are still under multipathd monitoring {{(pid=98431) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 11 23:11:07.129382 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-ab251e3a-468c-40fc-b3b5-c292f2e7a520 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Device paths {'sdd', 'sde'} have been removed from multipathd monitoring. {{(pid=98431) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 11 23:11:07.130090 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab251e3a-468c-40fc-b3b5-c292f2e7a520 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-64645843-e0b4-46bb-8426-698daf25b044'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-64645843-e0b4-46bb-8426-698daf25b044')] {{(pid=98431) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 11 23:11:07.148624 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab251e3a-468c-40fc-b3b5-c292f2e7a520 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:07.178745 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-68b7f07d-12c3-43ad-8c60-f2b2fbb44535 req-a84c53a6-c926-43cf-9bb0-f5e7e567ad75 service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Updating instance_info_cache with network_info: [] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:11:07.181951 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab251e3a-468c-40fc-b3b5-c292f2e7a520 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2023-03.storpool.com:os--volume-64645843-e0b4-46bb-8426-698daf25b044, portal: 192.168.40.100,3260] Jun 11 23:11:07.181951 np0000002687 nova-compute[98431]: Logout of [sid: 5, target: iqn.2023-03.storpool.com:os--volume-64645843-e0b4-46bb-8426-698daf25b044, portal: 192.168.40.100,3260] successful. Jun 11 23:11:07.181951 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:07.208172 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab251e3a-468c-40fc-b3b5-c292f2e7a520 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:07.223618 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab251e3a-468c-40fc-b3b5-c292f2e7a520 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:07.251406 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab251e3a-468c-40fc-b3b5-c292f2e7a520 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2023-03.storpool.com:os--volume-64645843-e0b4-46bb-8426-698daf25b044, portal: 192.168.50.100,3260] Jun 11 23:11:07.251406 np0000002687 nova-compute[98431]: Logout of [sid: 6, target: iqn.2023-03.storpool.com:os--volume-64645843-e0b4-46bb-8426-698daf25b044, portal: 192.168.50.100,3260] successful. Jun 11 23:11:07.251406 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:07.266655 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab251e3a-468c-40fc-b3b5-c292f2e7a520 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:07.267052 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-ab251e3a-468c-40fc-b3b5-c292f2e7a520 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 11 23:11:07.267052 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab251e3a-468c-40fc-b3b5-c292f2e7a520 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] <== disconnect_volume: return (330ms) None {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 11 23:11:07.267481 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab251e3a-468c-40fc-b3b5-c292f2e7a520 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] [instance: 689e510d-e0a4-4d6a-958e-9acfaebedc87] Disconnected iSCSI Volume {{(pid=98431) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jun 11 23:11:07.267985 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-ab251e3a-468c-40fc-b3b5-c292f2e7a520 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] [instance: 689e510d-e0a4-4d6a-958e-9acfaebedc87] Deleting instance files /opt/stack/data/nova/instances/689e510d-e0a4-4d6a-958e-9acfaebedc87_del Jun 11 23:11:07.269974 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-ab251e3a-468c-40fc-b3b5-c292f2e7a520 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] [instance: 689e510d-e0a4-4d6a-958e-9acfaebedc87] Deletion of /opt/stack/data/nova/instances/689e510d-e0a4-4d6a-958e-9acfaebedc87_del complete Jun 11 23:11:07.295818 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Emitting event Resumed> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:11:07.295818 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] VM Resumed (Lifecycle Event) Jun 11 23:11:07.461872 np0000002687 nova-compute[98431]: DEBUG nova.scheduler.client.report [None req-9a1b1d47-e44a-4eef-9570-7c76ea8942f7 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Inventory has not changed for provider e3e65fe2-9de9-4821-8b4a-ccae37c66e25 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98431) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 11 23:11:07.587270 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:07.682824 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-68b7f07d-12c3-43ad-8c60-f2b2fbb44535 req-a84c53a6-c926-43cf-9bb0-f5e7e567ad75 service nova] Releasing lock "refresh_cache-49a042ba-28ba-4401-9bdf-92f96da8f80e" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 11 23:11:07.686114 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-ff7db34d-d2db-4f92-a01e-45261c899db3 req-7000775e-ba46-4e1b-9296-544ddac2aed0 service nova] Acquired lock "refresh_cache-49a042ba-28ba-4401-9bdf-92f96da8f80e" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 11 23:11:07.686368 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-ff7db34d-d2db-4f92-a01e-45261c899db3 req-7000775e-ba46-4e1b-9296-544ddac2aed0 service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Refreshing network info cache for port 0263e39d-c835-4cf1-b333-265608e81a93 {{(pid=98431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 11 23:11:07.778478 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-ab251e3a-468c-40fc-b3b5-c292f2e7a520 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] [instance: 689e510d-e0a4-4d6a-958e-9acfaebedc87] Took 1.77 seconds to destroy the instance on the hypervisor. Jun 11 23:11:07.782009 np0000002687 nova-compute[98431]: DEBUG oslo.service.backend._common.loopingcall [None req-ab251e3a-468c-40fc-b3b5-c292f2e7a520 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98431) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jun 11 23:11:07.782009 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [-] [instance: 689e510d-e0a4-4d6a-958e-9acfaebedc87] Deallocating network for instance {{(pid=98431) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}} Jun 11 23:11:07.782009 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [-] [instance: 689e510d-e0a4-4d6a-958e-9acfaebedc87] deallocate_for_instance() {{(pid=98431) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jun 11 23:11:07.782009 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:11:07.800949 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:11:07.807827 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98431) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 11 23:11:07.964684 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:11:07.972195 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-9a1b1d47-e44a-4eef-9570-7c76ea8942f7 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.102s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:11:07.972645 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-9a1b1d47-e44a-4eef-9570-7c76ea8942f7 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 206476b7-d805-4c6c-b7fb-db8b5c2a94a6] Start building networks asynchronously for instance. {{(pid=98431) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 11 23:11:07.977572 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Successfully updated port: 09135c79-b0df-40af-b05b-2e171390f37f {{(pid=98431) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 11 23:11:08.189458 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [req-ff7db34d-d2db-4f92-a01e-45261c899db3 req-7000775e-ba46-4e1b-9296-544ddac2aed0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:11:08.305129 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-19d21e5f-1fdd-4390-9afd-ab388ac7f644 req-b2dcdf3a-f42f-434c-ad03-d6d8439f8c65 service nova] [instance: 14699717-b93f-4e67-b841-c67de8fff8d4] Received event network-changed-a266c7d4-9f0e-474d-a4d9-5190dbdd0fc2 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:11:08.305586 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-19d21e5f-1fdd-4390-9afd-ab388ac7f644 req-b2dcdf3a-f42f-434c-ad03-d6d8439f8c65 service nova] [instance: 14699717-b93f-4e67-b841-c67de8fff8d4] Refreshing instance network info cache due to event network-changed-a266c7d4-9f0e-474d-a4d9-5190dbdd0fc2. {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 11 23:11:08.305860 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-19d21e5f-1fdd-4390-9afd-ab388ac7f644 req-b2dcdf3a-f42f-434c-ad03-d6d8439f8c65 service nova] Acquiring lock "refresh_cache-14699717-b93f-4e67-b841-c67de8fff8d4" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 11 23:11:08.305860 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-19d21e5f-1fdd-4390-9afd-ab388ac7f644 req-b2dcdf3a-f42f-434c-ad03-d6d8439f8c65 service nova] Acquired lock "refresh_cache-14699717-b93f-4e67-b841-c67de8fff8d4" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 11 23:11:08.306151 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-19d21e5f-1fdd-4390-9afd-ab388ac7f644 req-b2dcdf3a-f42f-434c-ad03-d6d8439f8c65 service nova] [instance: 14699717-b93f-4e67-b841-c67de8fff8d4] Refreshing network info cache for port a266c7d4-9f0e-474d-a4d9-5190dbdd0fc2 {{(pid=98431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 11 23:11:08.313623 np0000002687 nova-compute[98431]: DEBUG nova.utils [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Queued Task(fn=>, remaining_delay=14.999481622999838 future=) {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:11:08.314096 np0000002687 nova-compute[98431]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=14.999005493999903 future=) {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:11:08.314263 np0000002687 nova-compute[98431]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=14.998828025999956 future=) {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:11:08.331625 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-ff7db34d-d2db-4f92-a01e-45261c899db3 req-7000775e-ba46-4e1b-9296-544ddac2aed0 service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Instance cache missing network info. {{(pid=98431) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 11 23:11:08.483220 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Acquiring lock "refresh_cache-49a042ba-28ba-4401-9bdf-92f96da8f80e" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 11 23:11:08.484084 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-9a1b1d47-e44a-4eef-9570-7c76ea8942f7 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 206476b7-d805-4c6c-b7fb-db8b5c2a94a6] Allocating IP information in the background. {{(pid=98431) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 11 23:11:08.484266 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-9a1b1d47-e44a-4eef-9570-7c76ea8942f7 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 206476b7-d805-4c6c-b7fb-db8b5c2a94a6] allocate_for_instance() {{(pid=98431) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 11 23:11:08.484572 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-9a1b1d47-e44a-4eef-9570-7c76ea8942f7 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:11:08.484846 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-9a1b1d47-e44a-4eef-9570-7c76ea8942f7 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:11:08.574124 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-ff7db34d-d2db-4f92-a01e-45261c899db3 req-7000775e-ba46-4e1b-9296-544ddac2aed0 service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Updating instance_info_cache with network_info: [] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:11:08.598854 np0000002687 nova-compute[98431]: DEBUG nova.policy [None req-9a1b1d47-e44a-4eef-9570-7c76ea8942f7 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c17e84202f404c3c8e73292bb59d7b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fd45f475a04e5c8e9bd9deb7ad4c1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98431) authorize /opt/stack/nova/nova/policy.py:192}} Jun 11 23:11:08.815401 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [req-19d21e5f-1fdd-4390-9afd-ab388ac7f644 req-b2dcdf3a-f42f-434c-ad03-d6d8439f8c65 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:11:08.833853 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [-] [instance: 689e510d-e0a4-4d6a-958e-9acfaebedc87] Updating instance_info_cache with network_info: [] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:11:08.849951 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-46721677-83c4-4223-b90d-e8a646477900 req-7cadcc3d-9f30-42d2-87f8-ec29e58da81d service nova] [instance: 689e510d-e0a4-4d6a-958e-9acfaebedc87] Received event network-vif-unplugged-65f7170b-ae97-4cd6-93a1-7dd5111b7978 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:11:08.853555 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-46721677-83c4-4223-b90d-e8a646477900 req-7cadcc3d-9f30-42d2-87f8-ec29e58da81d service nova] Acquiring lock "689e510d-e0a4-4d6a-958e-9acfaebedc87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:11:08.853826 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-46721677-83c4-4223-b90d-e8a646477900 req-7cadcc3d-9f30-42d2-87f8-ec29e58da81d service nova] Lock "689e510d-e0a4-4d6a-958e-9acfaebedc87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:11:08.854282 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-46721677-83c4-4223-b90d-e8a646477900 req-7cadcc3d-9f30-42d2-87f8-ec29e58da81d service nova] Lock "689e510d-e0a4-4d6a-958e-9acfaebedc87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:11:08.854282 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-46721677-83c4-4223-b90d-e8a646477900 req-7cadcc3d-9f30-42d2-87f8-ec29e58da81d service nova] [instance: 689e510d-e0a4-4d6a-958e-9acfaebedc87] No waiting events found dispatching network-vif-unplugged-65f7170b-ae97-4cd6-93a1-7dd5111b7978 {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:11:08.854447 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-46721677-83c4-4223-b90d-e8a646477900 req-7cadcc3d-9f30-42d2-87f8-ec29e58da81d service nova] [instance: 689e510d-e0a4-4d6a-958e-9acfaebedc87] Received event network-vif-unplugged-65f7170b-ae97-4cd6-93a1-7dd5111b7978 for instance with task_state deleting. {{(pid=98431) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 11 23:11:08.854853 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-46721677-83c4-4223-b90d-e8a646477900 req-7cadcc3d-9f30-42d2-87f8-ec29e58da81d service nova] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Received event network-changed-2d6dd8b9-e3ff-462f-92cf-8c3a62bc27d1 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:11:08.855133 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-46721677-83c4-4223-b90d-e8a646477900 req-7cadcc3d-9f30-42d2-87f8-ec29e58da81d service nova] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Refreshing instance network info cache due to event network-changed-2d6dd8b9-e3ff-462f-92cf-8c3a62bc27d1. {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 11 23:11:08.857229 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-46721677-83c4-4223-b90d-e8a646477900 req-7cadcc3d-9f30-42d2-87f8-ec29e58da81d service nova] Acquiring lock "refresh_cache-cb63f66c-b69e-42b0-805c-be6fe9b3aee3" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 11 23:11:08.859559 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-46721677-83c4-4223-b90d-e8a646477900 req-7cadcc3d-9f30-42d2-87f8-ec29e58da81d service nova] Acquired lock "refresh_cache-cb63f66c-b69e-42b0-805c-be6fe9b3aee3" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 11 23:11:08.859559 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-46721677-83c4-4223-b90d-e8a646477900 req-7cadcc3d-9f30-42d2-87f8-ec29e58da81d service nova] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Refreshing network info cache for port 2d6dd8b9-e3ff-462f-92cf-8c3a62bc27d1 {{(pid=98431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 11 23:11:08.865006 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-e159039b-c457-4050-a4d1-3a341aafaf2c req-bf866035-5c2c-4afd-aa33-6894d783dc99 service nova] [instance: 689e510d-e0a4-4d6a-958e-9acfaebedc87] Received event network-vif-deleted-65f7170b-ae97-4cd6-93a1-7dd5111b7978 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:11:08.865339 np0000002687 nova-compute[98431]: INFO nova.compute.manager [req-e159039b-c457-4050-a4d1-3a341aafaf2c req-bf866035-5c2c-4afd-aa33-6894d783dc99 service nova] [instance: 689e510d-e0a4-4d6a-958e-9acfaebedc87] Neutron deleted interface 65f7170b-ae97-4cd6-93a1-7dd5111b7978; detaching it from the instance and deleting it from the info cache Jun 11 23:11:08.869745 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-e159039b-c457-4050-a4d1-3a341aafaf2c req-bf866035-5c2c-4afd-aa33-6894d783dc99 service nova] [instance: 689e510d-e0a4-4d6a-958e-9acfaebedc87] Detach interface failed, port_id=65f7170b-ae97-4cd6-93a1-7dd5111b7978, reason: Instance 689e510d-e0a4-4d6a-958e-9acfaebedc87 could not be found. {{(pid=98431) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}} Jun 11 23:11:08.987777 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-9a1b1d47-e44a-4eef-9570-7c76ea8942f7 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 206476b7-d805-4c6c-b7fb-db8b5c2a94a6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 11 23:11:09.078534 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-ff7db34d-d2db-4f92-a01e-45261c899db3 req-7000775e-ba46-4e1b-9296-544ddac2aed0 service nova] Releasing lock "refresh_cache-49a042ba-28ba-4401-9bdf-92f96da8f80e" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 11 23:11:09.079942 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Acquired lock "refresh_cache-49a042ba-28ba-4401-9bdf-92f96da8f80e" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 11 23:11:09.079942 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Building network info cache for instance {{(pid=98431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 11 23:11:09.264630 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-fc764edc-3b38-4c46-95f7-10bbdd116239 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 8aec3cea-109d-43f8-983c-1d5ee2f71181] Snapshot image upload complete Jun 11 23:11:09.264885 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-fc764edc-3b38-4c46-95f7-10bbdd116239 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 8aec3cea-109d-43f8-983c-1d5ee2f71181] Took 6.56 seconds to snapshot the instance on the hypervisor. Jun 11 23:11:09.277736 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-9a1b1d47-e44a-4eef-9570-7c76ea8942f7 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 206476b7-d805-4c6c-b7fb-db8b5c2a94a6] Successfully created port: 4ba0e6d8-03d5-4849-8b1a-ca9b093ff8be {{(pid=98431) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 11 23:11:09.338098 np0000002687 nova-compute[98431]: INFO nova.compute.manager [-] [instance: 689e510d-e0a4-4d6a-958e-9acfaebedc87] Took 1.56 seconds to deallocate network for instance. Jun 11 23:11:09.363870 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [req-46721677-83c4-4223-b90d-e8a646477900 req-7cadcc3d-9f30-42d2-87f8-ec29e58da81d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:11:09.496817 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-9a1b1d47-e44a-4eef-9570-7c76ea8942f7 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 206476b7-d805-4c6c-b7fb-db8b5c2a94a6] Start building block device mappings for instance. {{(pid=98431) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 11 23:11:09.729961 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [req-19d21e5f-1fdd-4390-9afd-ab388ac7f644 req-b2dcdf3a-f42f-434c-ad03-d6d8439f8c65 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:11:09.863979 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Instance cache missing network info. {{(pid=98431) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 11 23:11:09.909430 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-9a1b1d47-e44a-4eef-9570-7c76ea8942f7 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 206476b7-d805-4c6c-b7fb-db8b5c2a94a6] Successfully updated port: 4ba0e6d8-03d5-4849-8b1a-ca9b093ff8be {{(pid=98431) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 11 23:11:09.969289 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-ab251e3a-468c-40fc-b3b5-c292f2e7a520 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] [instance: 689e510d-e0a4-4d6a-958e-9acfaebedc87] Took 0.63 seconds to detach 1 volumes for instance. Jun 11 23:11:10.034841 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [req-46721677-83c4-4223-b90d-e8a646477900 req-7cadcc3d-9f30-42d2-87f8-ec29e58da81d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:11:10.086178 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-19d21e5f-1fdd-4390-9afd-ab388ac7f644 req-b2dcdf3a-f42f-434c-ad03-d6d8439f8c65 service nova] [instance: 14699717-b93f-4e67-b841-c67de8fff8d4] Updated VIF entry in instance network info cache for port a266c7d4-9f0e-474d-a4d9-5190dbdd0fc2. {{(pid=98431) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 11 23:11:10.086621 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-19d21e5f-1fdd-4390-9afd-ab388ac7f644 req-b2dcdf3a-f42f-434c-ad03-d6d8439f8c65 service nova] [instance: 14699717-b93f-4e67-b841-c67de8fff8d4] Updating instance_info_cache with network_info: [{"id": "a266c7d4-9f0e-474d-a4d9-5190dbdd0fc2", "address": "fa:16:3e:8a:95:c7", "network": {"id": "0dc6da23-6c97-4fd1-9e59-910adaa610a9", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-968328905-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a092509b877483183db8610c8763b93", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa266c7d4-9f", "ovs_interfaceid": "a266c7d4-9f0e-474d-a4d9-5190dbdd0fc2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:11:10.121192 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:11:10.227516 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-46721677-83c4-4223-b90d-e8a646477900 req-7cadcc3d-9f30-42d2-87f8-ec29e58da81d service nova] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Updated VIF entry in instance network info cache for port 2d6dd8b9-e3ff-462f-92cf-8c3a62bc27d1. {{(pid=98431) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 11 23:11:10.227516 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-46721677-83c4-4223-b90d-e8a646477900 req-7cadcc3d-9f30-42d2-87f8-ec29e58da81d service nova] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Updating instance_info_cache with network_info: [{"id": "2d6dd8b9-e3ff-462f-92cf-8c3a62bc27d1", "address": "fa:16:3e:b5:6f:fd", "network": {"id": "b1a1d33f-f9b6-48cf-86a1-0260d53f3bb0", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1779972098-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2d62cddce233457caf7eb43be819e513", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d6dd8b9-e3", "ovs_interfaceid": "2d6dd8b9-e3ff-462f-92cf-8c3a62bc27d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:11:10.416380 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-9a1b1d47-e44a-4eef-9570-7c76ea8942f7 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Acquiring lock "refresh_cache-206476b7-d805-4c6c-b7fb-db8b5c2a94a6" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 11 23:11:10.416380 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-9a1b1d47-e44a-4eef-9570-7c76ea8942f7 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Acquired lock "refresh_cache-206476b7-d805-4c6c-b7fb-db8b5c2a94a6" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 11 23:11:10.416380 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-9a1b1d47-e44a-4eef-9570-7c76ea8942f7 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 206476b7-d805-4c6c-b7fb-db8b5c2a94a6] Building network info cache for instance {{(pid=98431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 11 23:11:10.480356 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-ab251e3a-468c-40fc-b3b5-c292f2e7a520 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:11:10.481100 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-ab251e3a-468c-40fc-b3b5-c292f2e7a520 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:11:10.513379 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-9a1b1d47-e44a-4eef-9570-7c76ea8942f7 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 206476b7-d805-4c6c-b7fb-db8b5c2a94a6] Start spawning the instance on the hypervisor. {{(pid=98431) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 11 23:11:10.513379 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-9a1b1d47-e44a-4eef-9570-7c76ea8942f7 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 206476b7-d805-4c6c-b7fb-db8b5c2a94a6] Creating instance directory {{(pid=98431) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}} Jun 11 23:11:10.513704 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-9a1b1d47-e44a-4eef-9570-7c76ea8942f7 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 206476b7-d805-4c6c-b7fb-db8b5c2a94a6] Creating image(s) Jun 11 23:11:10.516506 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-9a1b1d47-e44a-4eef-9570-7c76ea8942f7 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Acquiring lock "/opt/stack/data/nova/instances/206476b7-d805-4c6c-b7fb-db8b5c2a94a6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:11:10.516694 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-9a1b1d47-e44a-4eef-9570-7c76ea8942f7 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "/opt/stack/data/nova/instances/206476b7-d805-4c6c-b7fb-db8b5c2a94a6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:11:10.517133 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-9a1b1d47-e44a-4eef-9570-7c76ea8942f7 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "/opt/stack/data/nova/instances/206476b7-d805-4c6c-b7fb-db8b5c2a94a6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:11:10.517660 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-9a1b1d47-e44a-4eef-9570-7c76ea8942f7 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:11:10.521966 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-9a1b1d47-e44a-4eef-9570-7c76ea8942f7 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:11:10.523196 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-9a1b1d47-e44a-4eef-9570-7c76ea8942f7 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:11:10.548556 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:11:10.590266 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-19d21e5f-1fdd-4390-9afd-ab388ac7f644 req-b2dcdf3a-f42f-434c-ad03-d6d8439f8c65 service nova] Releasing lock "refresh_cache-14699717-b93f-4e67-b841-c67de8fff8d4" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 11 23:11:10.605886 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-9a1b1d47-e44a-4eef-9570-7c76ea8942f7 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json" returned: 0 in 0.082s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:11:10.608952 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-9a1b1d47-e44a-4eef-9570-7c76ea8942f7 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Acquiring lock "d2c441059b2992961b5de03c05b32d04aff77cb1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:11:10.612393 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-9a1b1d47-e44a-4eef-9570-7c76ea8942f7 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "d2c441059b2992961b5de03c05b32d04aff77cb1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.004s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:11:10.613112 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-9a1b1d47-e44a-4eef-9570-7c76ea8942f7 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:11:10.617349 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-9a1b1d47-e44a-4eef-9570-7c76ea8942f7 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:11:10.617823 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-9a1b1d47-e44a-4eef-9570-7c76ea8942f7 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:11:10.703493 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-9a1b1d47-e44a-4eef-9570-7c76ea8942f7 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json" returned: 0 in 0.084s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:11:10.704952 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-9a1b1d47-e44a-4eef-9570-7c76ea8942f7 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1,backing_fmt=raw /opt/stack/data/nova/instances/206476b7-d805-4c6c-b7fb-db8b5c2a94a6/disk 1073741824 {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:11:10.736345 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-46721677-83c4-4223-b90d-e8a646477900 req-7cadcc3d-9f30-42d2-87f8-ec29e58da81d service nova] Releasing lock "refresh_cache-cb63f66c-b69e-42b0-805c-be6fe9b3aee3" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 11 23:11:10.739107 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-46721677-83c4-4223-b90d-e8a646477900 req-7cadcc3d-9f30-42d2-87f8-ec29e58da81d service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Received event network-changed-09135c79-b0df-40af-b05b-2e171390f37f {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:11:10.744855 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-46721677-83c4-4223-b90d-e8a646477900 req-7cadcc3d-9f30-42d2-87f8-ec29e58da81d service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Refreshing instance network info cache due to event network-changed-09135c79-b0df-40af-b05b-2e171390f37f. {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 11 23:11:10.745839 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-46721677-83c4-4223-b90d-e8a646477900 req-7cadcc3d-9f30-42d2-87f8-ec29e58da81d service nova] Acquiring lock "refresh_cache-49a042ba-28ba-4401-9bdf-92f96da8f80e" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 11 23:11:10.763509 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-9a1b1d47-e44a-4eef-9570-7c76ea8942f7 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1,backing_fmt=raw /opt/stack/data/nova/instances/206476b7-d805-4c6c-b7fb-db8b5c2a94a6/disk 1073741824" returned: 0 in 0.057s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:11:10.764846 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-9a1b1d47-e44a-4eef-9570-7c76ea8942f7 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "d2c441059b2992961b5de03c05b32d04aff77cb1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.153s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:11:10.764846 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-9a1b1d47-e44a-4eef-9570-7c76ea8942f7 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:11:10.853670 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-9a1b1d47-e44a-4eef-9570-7c76ea8942f7 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json" returned: 0 in 0.088s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:11:10.854023 np0000002687 nova-compute[98431]: DEBUG nova.virt.disk.api [None req-9a1b1d47-e44a-4eef-9570-7c76ea8942f7 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Checking if we can resize image /opt/stack/data/nova/instances/206476b7-d805-4c6c-b7fb-db8b5c2a94a6/disk. size=1073741824 {{(pid=98431) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 11 23:11:10.854023 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-9a1b1d47-e44a-4eef-9570-7c76ea8942f7 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/206476b7-d805-4c6c-b7fb-db8b5c2a94a6/disk --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:11:10.940776 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-9a1b1d47-e44a-4eef-9570-7c76ea8942f7 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/206476b7-d805-4c6c-b7fb-db8b5c2a94a6/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:11:10.942524 np0000002687 nova-compute[98431]: DEBUG nova.virt.disk.api [None req-9a1b1d47-e44a-4eef-9570-7c76ea8942f7 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Cannot resize image /opt/stack/data/nova/instances/206476b7-d805-4c6c-b7fb-db8b5c2a94a6/disk to a smaller size. {{(pid=98431) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 11 23:11:10.942524 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-9a1b1d47-e44a-4eef-9570-7c76ea8942f7 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 206476b7-d805-4c6c-b7fb-db8b5c2a94a6] Created local disks {{(pid=98431) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}} Jun 11 23:11:10.942524 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-9a1b1d47-e44a-4eef-9570-7c76ea8942f7 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 206476b7-d805-4c6c-b7fb-db8b5c2a94a6] Ensure instance console log exists: /opt/stack/data/nova/instances/206476b7-d805-4c6c-b7fb-db8b5c2a94a6/console.log {{(pid=98431) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}} Jun 11 23:11:10.942524 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-9a1b1d47-e44a-4eef-9570-7c76ea8942f7 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:11:10.942524 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-9a1b1d47-e44a-4eef-9570-7c76ea8942f7 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:11:10.942524 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-9a1b1d47-e44a-4eef-9570-7c76ea8942f7 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:11:10.958299 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-8f2fb268-d31c-40a6-91d5-e83eb47d44e4 req-d908dd93-a039-489f-9c08-51e30bb8d0b3 service nova] [instance: 206476b7-d805-4c6c-b7fb-db8b5c2a94a6] Received event network-changed-4ba0e6d8-03d5-4849-8b1a-ca9b093ff8be {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:11:10.958444 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-8f2fb268-d31c-40a6-91d5-e83eb47d44e4 req-d908dd93-a039-489f-9c08-51e30bb8d0b3 service nova] [instance: 206476b7-d805-4c6c-b7fb-db8b5c2a94a6] Refreshing instance network info cache due to event network-changed-4ba0e6d8-03d5-4849-8b1a-ca9b093ff8be. {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 11 23:11:10.958590 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-8f2fb268-d31c-40a6-91d5-e83eb47d44e4 req-d908dd93-a039-489f-9c08-51e30bb8d0b3 service nova] Acquiring lock "refresh_cache-206476b7-d805-4c6c-b7fb-db8b5c2a94a6" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 11 23:11:10.980647 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:11:11.042204 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-9a1b1d47-e44a-4eef-9570-7c76ea8942f7 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 206476b7-d805-4c6c-b7fb-db8b5c2a94a6] Instance cache missing network info. {{(pid=98431) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 11 23:11:11.357328 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-9a1b1d47-e44a-4eef-9570-7c76ea8942f7 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:11:11.382076 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-ab251e3a-468c-40fc-b3b5-c292f2e7a520 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98431) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 11 23:11:11.382076 np0000002687 nova-compute[98431]: DEBUG nova.compute.provider_tree [None req-ab251e3a-468c-40fc-b3b5-c292f2e7a520 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Inventory has not changed in ProviderTree for provider: e3e65fe2-9de9-4821-8b4a-ccae37c66e25 {{(pid=98431) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 11 23:11:11.485737 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:11:11.521412 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-9a1b1d47-e44a-4eef-9570-7c76ea8942f7 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 206476b7-d805-4c6c-b7fb-db8b5c2a94a6] Updating instance_info_cache with network_info: [{"id": "4ba0e6d8-03d5-4849-8b1a-ca9b093ff8be", "address": "fa:16:3e:c7:33:6a", "network": {"id": "17593db3-c22d-4354-ab29-933b1c6a5c3a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1094286565-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "81fd45f475a04e5c8e9bd9deb7ad4c1e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ba0e6d8-03", "ovs_interfaceid": "4ba0e6d8-03d5-4849-8b1a-ca9b093ff8be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:11:11.592036 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Acquiring lock "c82748e6-1c78-4372-ad4b-48d1c6448efa" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:11:11.593187 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lock "c82748e6-1c78-4372-ad4b-48d1c6448efa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:11:11.861374 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:11:11.886938 np0000002687 nova-compute[98431]: DEBUG nova.scheduler.client.report [None req-ab251e3a-468c-40fc-b3b5-c292f2e7a520 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Inventory has not changed for provider e3e65fe2-9de9-4821-8b4a-ccae37c66e25 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98431) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 11 23:11:11.933232 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:12.024432 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-9a1b1d47-e44a-4eef-9570-7c76ea8942f7 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Releasing lock "refresh_cache-206476b7-d805-4c6c-b7fb-db8b5c2a94a6" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 11 23:11:12.024823 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-9a1b1d47-e44a-4eef-9570-7c76ea8942f7 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 206476b7-d805-4c6c-b7fb-db8b5c2a94a6] Instance network_info: |[{"id": "4ba0e6d8-03d5-4849-8b1a-ca9b093ff8be", "address": "fa:16:3e:c7:33:6a", "network": {"id": "17593db3-c22d-4354-ab29-933b1c6a5c3a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1094286565-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "81fd45f475a04e5c8e9bd9deb7ad4c1e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ba0e6d8-03", "ovs_interfaceid": "4ba0e6d8-03d5-4849-8b1a-ca9b093ff8be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98431) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 11 23:11:12.028147 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-9a1b1d47-e44a-4eef-9570-7c76ea8942f7 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 206476b7-d805-4c6c-b7fb-db8b5c2a94a6] Start _get_guest_xml network_info=[{"id": "4ba0e6d8-03d5-4849-8b1a-ca9b093ff8be", "address": "fa:16:3e:c7:33:6a", "network": {"id": "17593db3-c22d-4354-ab29-933b1c6a5c3a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1094286565-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "81fd45f475a04e5c8e9bd9deb7ad4c1e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ba0e6d8-03", "ovs_interfaceid": "4ba0e6d8-03d5-4849-8b1a-ca9b093ff8be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-11T23:08:20Z,direct_url=,disk_format='qcow2',id=f30640f8-7aca-4300-a085-4706a5209a79,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ce012f9fabdb4ee5a73e212437f59d97',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-11T23:08:23Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'image_id': 'f30640f8-7aca-4300-a085-4706a5209a79'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98431) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 11 23:11:12.028640 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-8f2fb268-d31c-40a6-91d5-e83eb47d44e4 req-d908dd93-a039-489f-9c08-51e30bb8d0b3 service nova] Acquired lock "refresh_cache-206476b7-d805-4c6c-b7fb-db8b5c2a94a6" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 11 23:11:12.028878 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-8f2fb268-d31c-40a6-91d5-e83eb47d44e4 req-d908dd93-a039-489f-9c08-51e30bb8d0b3 service nova] [instance: 206476b7-d805-4c6c-b7fb-db8b5c2a94a6] Refreshing network info cache for port 4ba0e6d8-03d5-4849-8b1a-ca9b093ff8be {{(pid=98431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 11 23:11:12.034460 np0000002687 nova-compute[98431]: WARNING nova.virt.libvirt.driver [None req-9a1b1d47-e44a-4eef-9570-7c76ea8942f7 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 11 23:11:12.036245 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-9a1b1d47-e44a-4eef-9570-7c76ea8942f7 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='f30640f8-7aca-4300-a085-4706a5209a79', instance_meta=NovaInstanceMeta(name='multiattach-server-0', uuid='206476b7-d805-4c6c-b7fb-db8b5c2a94a6'), owner=OwnerMeta(userid='c17e84202f404c3c8e73292bb59d7b27', username='tempest-AttachVolumeMultiAttachTest-1514006700-project-member', projectid='81fd45f475a04e5c8e9bd9deb7ad4c1e', projectname='tempest-AttachVolumeMultiAttachTest-1514006700'), image=ImageMeta(id='f30640f8-7aca-4300-a085-4706a5209a79', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "4ba0e6d8-03d5-4849-8b1a-ca9b093ff8be", "address": "fa:16:3e:c7:33:6a", "network": {"id": "17593db3-c22d-4354-ab29-933b1c6a5c3a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1094286565-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "81fd45f475a04e5c8e9bd9deb7ad4c1e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ba0e6d8-03", "ovs_interfaceid": "4ba0e6d8-03d5-4849-8b1a-ca9b093ff8be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1781219472.0356674) {{(pid=98431) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 11 23:11:12.039565 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-9a1b1d47-e44a-4eef-9570-7c76ea8942f7 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Searching host: 'np0000002687' for CPU controller through CGroups V1... {{(pid=98431) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 11 23:11:12.039565 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-9a1b1d47-e44a-4eef-9570-7c76ea8942f7 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] CPU controller missing on host. {{(pid=98431) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 11 23:11:12.040072 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-9a1b1d47-e44a-4eef-9570-7c76ea8942f7 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Searching host: 'np0000002687' for CPU controller through CGroups V2... {{(pid=98431) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 11 23:11:12.040304 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-9a1b1d47-e44a-4eef-9570-7c76ea8942f7 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] CPU controller found on host. {{(pid=98431) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 11 23:11:12.043441 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-9a1b1d47-e44a-4eef-9570-7c76ea8942f7 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98431) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 11 23:11:12.044554 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-9a1b1d47-e44a-4eef-9570-7c76ea8942f7 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-11T23:08:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-11T23:08:20Z,direct_url=,disk_format='qcow2',id=f30640f8-7aca-4300-a085-4706a5209a79,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ce012f9fabdb4ee5a73e212437f59d97',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-11T23:08:23Z,virtual_size=,visibility=), allow threads: True {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 11 23:11:12.044770 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-9a1b1d47-e44a-4eef-9570-7c76ea8942f7 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Flavor limits 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 11 23:11:12.044997 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-9a1b1d47-e44a-4eef-9570-7c76ea8942f7 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Image limits 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 11 23:11:12.045844 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-9a1b1d47-e44a-4eef-9570-7c76ea8942f7 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Flavor pref 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 11 23:11:12.050135 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-9a1b1d47-e44a-4eef-9570-7c76ea8942f7 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Image pref 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 11 23:11:12.050681 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-9a1b1d47-e44a-4eef-9570-7c76ea8942f7 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 11 23:11:12.051031 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-9a1b1d47-e44a-4eef-9570-7c76ea8942f7 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 11 23:11:12.051201 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-9a1b1d47-e44a-4eef-9570-7c76ea8942f7 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98431) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 11 23:11:12.051342 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-9a1b1d47-e44a-4eef-9570-7c76ea8942f7 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Got 1 possible topologies {{(pid=98431) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 11 23:11:12.051463 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-9a1b1d47-e44a-4eef-9570-7c76ea8942f7 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 11 23:11:12.051620 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-9a1b1d47-e44a-4eef-9570-7c76ea8942f7 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 11 23:11:12.063142 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-9a1b1d47-e44a-4eef-9570-7c76ea8942f7 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-11T23:11:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='multiattach-server-0',id=10,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHngWA9S/0M7yAiCaKN7wJ0iqGBq18p6o1N91kfGTes8iMQtxmsCxH/Iqg51e2HEWFsjD10S17Kahb+vCzu07nJJQGe3fNUonThwHNf0exiWq4jZuXjSZtHJPO0dbow48A==',key_name='tempest-keypair-1974490716',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='81fd45f475a04e5c8e9bd9deb7ad4c1e',ramdisk_id='',reservation_id='r-6azrcy8d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1514006700',owner_user_name='tempest-AttachVolumeMultiAttachTest-1514006700-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-11T23:11:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c17e84202f404c3c8e73292bb59d7b27',uuid=206476b7-d805-4c6c-b7fb-db8b5c2a94a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ba0e6d8-03d5-4849-8b1a-ca9b093ff8be", "address": "fa:16:3e:c7:33:6a", "network": {"id": "17593db3-c22d-4354-ab29-933b1c6a5c3a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1094286565-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "81fd45f475a04e5c8e9bd9deb7ad4c1e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ba0e6d8-03", "ovs_interfaceid": "4ba0e6d8-03d5-4849-8b1a-ca9b093ff8be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98431) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 11 23:11:12.063401 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-9a1b1d47-e44a-4eef-9570-7c76ea8942f7 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Converting VIF {"id": "4ba0e6d8-03d5-4849-8b1a-ca9b093ff8be", "address": "fa:16:3e:c7:33:6a", "network": {"id": "17593db3-c22d-4354-ab29-933b1c6a5c3a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1094286565-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "81fd45f475a04e5c8e9bd9deb7ad4c1e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ba0e6d8-03", "ovs_interfaceid": "4ba0e6d8-03d5-4849-8b1a-ca9b093ff8be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:11:12.064288 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-9a1b1d47-e44a-4eef-9570-7c76ea8942f7 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:33:6a,bridge_name='br-int',has_traffic_filtering=True,id=4ba0e6d8-03d5-4849-8b1a-ca9b093ff8be,network=Network(17593db3-c22d-4354-ab29-933b1c6a5c3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ba0e6d8-03') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:11:12.064924 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-9a1b1d47-e44a-4eef-9570-7c76ea8942f7 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lazy-loading 'pci_devices' on Instance uuid 206476b7-d805-4c6c-b7fb-db8b5c2a94a6 {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:11:12.096661 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Starting instance... {{(pid=98431) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 11 23:11:12.290543 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:11:12.399931 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-ab251e3a-468c-40fc-b3b5-c292f2e7a520 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.918s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:11:12.502395 np0000002687 nova-compute[98431]: INFO nova.scheduler.client.report [None req-ab251e3a-468c-40fc-b3b5-c292f2e7a520 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Deleted allocations for instance 689e510d-e0a4-4d6a-958e-9acfaebedc87 Jun 11 23:11:12.532102 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [req-8f2fb268-d31c-40a6-91d5-e83eb47d44e4 req-d908dd93-a039-489f-9c08-51e30bb8d0b3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:11:12.572004 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-9a1b1d47-e44a-4eef-9570-7c76ea8942f7 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 206476b7-d805-4c6c-b7fb-db8b5c2a94a6] End _get_guest_xml xml= Jun 11 23:11:12.572004 np0000002687 nova-compute[98431]: 206476b7-d805-4c6c-b7fb-db8b5c2a94a6 Jun 11 23:11:12.572004 np0000002687 nova-compute[98431]: instance-0000000a Jun 11 23:11:12.572004 np0000002687 nova-compute[98431]: 196608 Jun 11 23:11:12.572004 np0000002687 nova-compute[98431]: 1 Jun 11 23:11:12.572004 np0000002687 nova-compute[98431]: Jun 11 23:11:12.572004 np0000002687 nova-compute[98431]: Jun 11 23:11:12.572004 np0000002687 nova-compute[98431]: Jun 11 23:11:12.572004 np0000002687 nova-compute[98431]: multiattach-server-0 Jun 11 23:11:12.572004 np0000002687 nova-compute[98431]: 2026-06-11 23:11:12 Jun 11 23:11:12.572004 np0000002687 nova-compute[98431]: Jun 11 23:11:12.572004 np0000002687 nova-compute[98431]: 192 Jun 11 23:11:12.572004 np0000002687 nova-compute[98431]: 1 Jun 11 23:11:12.572004 np0000002687 nova-compute[98431]: 0 Jun 11 23:11:12.572004 np0000002687 nova-compute[98431]: 0 Jun 11 23:11:12.572004 np0000002687 nova-compute[98431]: 1 Jun 11 23:11:12.572004 np0000002687 nova-compute[98431]: Jun 11 23:11:12.572004 np0000002687 nova-compute[98431]: True Jun 11 23:11:12.572004 np0000002687 nova-compute[98431]: Jun 11 23:11:12.572004 np0000002687 nova-compute[98431]: Jun 11 23:11:12.572004 np0000002687 nova-compute[98431]: Jun 11 23:11:12.572004 np0000002687 nova-compute[98431]: bare Jun 11 23:11:12.572004 np0000002687 nova-compute[98431]: qcow2 Jun 11 23:11:12.572004 np0000002687 nova-compute[98431]: 1 Jun 11 23:11:12.572004 np0000002687 nova-compute[98431]: 0 Jun 11 23:11:12.572004 np0000002687 nova-compute[98431]: Jun 11 23:11:12.572004 np0000002687 nova-compute[98431]: virtio Jun 11 23:11:12.572004 np0000002687 nova-compute[98431]: Jun 11 23:11:12.572004 np0000002687 nova-compute[98431]: Jun 11 23:11:12.572004 np0000002687 nova-compute[98431]: Jun 11 23:11:12.572004 np0000002687 nova-compute[98431]: tempest-AttachVolumeMultiAttachTest-1514006700-project-member Jun 11 23:11:12.572004 np0000002687 nova-compute[98431]: tempest-AttachVolumeMultiAttachTest-1514006700 Jun 11 23:11:12.572004 np0000002687 nova-compute[98431]: Jun 11 23:11:12.572004 np0000002687 nova-compute[98431]: Jun 11 23:11:12.572004 np0000002687 nova-compute[98431]: Jun 11 23:11:12.572004 np0000002687 nova-compute[98431]: Jun 11 23:11:12.572004 np0000002687 nova-compute[98431]: Jun 11 23:11:12.572004 np0000002687 nova-compute[98431]: Jun 11 23:11:12.572004 np0000002687 nova-compute[98431]: Jun 11 23:11:12.572004 np0000002687 nova-compute[98431]: Jun 11 23:11:12.572004 np0000002687 nova-compute[98431]: Jun 11 23:11:12.572004 np0000002687 nova-compute[98431]: Jun 11 23:11:12.572004 np0000002687 nova-compute[98431]: Jun 11 23:11:12.572004 np0000002687 nova-compute[98431]: OpenStack Foundation Jun 11 23:11:12.572004 np0000002687 nova-compute[98431]: OpenStack Nova Jun 11 23:11:12.572004 np0000002687 nova-compute[98431]: 33.1.0 Jun 11 23:11:12.572004 np0000002687 nova-compute[98431]: 206476b7-d805-4c6c-b7fb-db8b5c2a94a6 Jun 11 23:11:12.572004 np0000002687 nova-compute[98431]: 206476b7-d805-4c6c-b7fb-db8b5c2a94a6 Jun 11 23:11:12.572004 np0000002687 nova-compute[98431]: Virtual Machine Jun 11 23:11:12.572004 np0000002687 nova-compute[98431]: Jun 11 23:11:12.572004 np0000002687 nova-compute[98431]: Jun 11 23:11:12.572004 np0000002687 nova-compute[98431]: Jun 11 23:11:12.572004 np0000002687 nova-compute[98431]: hvm Jun 11 23:11:12.572004 np0000002687 nova-compute[98431]: Jun 11 23:11:12.572004 np0000002687 nova-compute[98431]: Jun 11 23:11:12.572004 np0000002687 nova-compute[98431]: Jun 11 23:11:12.572004 np0000002687 nova-compute[98431]: Jun 11 23:11:12.572004 np0000002687 nova-compute[98431]: Jun 11 23:11:12.572004 np0000002687 nova-compute[98431]: Jun 11 23:11:12.572004 np0000002687 nova-compute[98431]: 128 Jun 11 23:11:12.572004 np0000002687 nova-compute[98431]: Jun 11 23:11:12.572004 np0000002687 nova-compute[98431]: Jun 11 23:11:12.572004 np0000002687 nova-compute[98431]: Jun 11 23:11:12.572004 np0000002687 nova-compute[98431]: 1 Jun 11 23:11:12.572004 np0000002687 nova-compute[98431]: Jun 11 23:11:12.572004 np0000002687 nova-compute[98431]: Jun 11 23:11:12.572004 np0000002687 nova-compute[98431]: Nehalem Jun 11 23:11:12.572004 np0000002687 nova-compute[98431]: Jun 11 23:11:12.572004 np0000002687 nova-compute[98431]: Jun 11 23:11:12.572004 np0000002687 nova-compute[98431]: Jun 11 23:11:12.572004 np0000002687 nova-compute[98431]: Jun 11 23:11:12.572004 np0000002687 nova-compute[98431]: Jun 11 23:11:12.572004 np0000002687 nova-compute[98431]: Jun 11 23:11:12.572004 np0000002687 nova-compute[98431]: Jun 11 23:11:12.572004 np0000002687 nova-compute[98431]: Jun 11 23:11:12.572004 np0000002687 nova-compute[98431]: Jun 11 23:11:12.572004 np0000002687 nova-compute[98431]: Jun 11 23:11:12.572004 np0000002687 nova-compute[98431]: Jun 11 23:11:12.572004 np0000002687 nova-compute[98431]: Jun 11 23:11:12.572004 np0000002687 nova-compute[98431]: Jun 11 23:11:12.572004 np0000002687 nova-compute[98431]: Jun 11 23:11:12.572004 np0000002687 nova-compute[98431]: Jun 11 23:11:12.572004 np0000002687 nova-compute[98431]: Jun 11 23:11:12.572004 np0000002687 nova-compute[98431]: Jun 11 23:11:12.572004 np0000002687 nova-compute[98431]: Jun 11 23:11:12.572004 np0000002687 nova-compute[98431]: Jun 11 23:11:12.572004 np0000002687 nova-compute[98431]: Jun 11 23:11:12.572004 np0000002687 nova-compute[98431]: Jun 11 23:11:12.572004 np0000002687 nova-compute[98431]: Jun 11 23:11:12.572004 np0000002687 nova-compute[98431]: Jun 11 23:11:12.572004 np0000002687 nova-compute[98431]: Jun 11 23:11:12.572004 np0000002687 nova-compute[98431]: Jun 11 23:11:12.572004 np0000002687 nova-compute[98431]: Jun 11 23:11:12.572004 np0000002687 nova-compute[98431]: /dev/urandom Jun 11 23:11:12.572004 np0000002687 nova-compute[98431]: Jun 11 23:11:12.572004 np0000002687 nova-compute[98431]: Jun 11 23:11:12.572004 np0000002687 nova-compute[98431]: Jun 11 23:11:12.572004 np0000002687 nova-compute[98431]: Jun 11 23:11:12.572004 np0000002687 nova-compute[98431]: Jun 11 23:11:12.572004 np0000002687 nova-compute[98431]: Jun 11 23:11:12.572004 np0000002687 nova-compute[98431]: Jun 11 23:11:12.572004 np0000002687 nova-compute[98431]: {{(pid=98431) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 11 23:11:12.572004 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-9a1b1d47-e44a-4eef-9570-7c76ea8942f7 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 206476b7-d805-4c6c-b7fb-db8b5c2a94a6] Preparing to wait for external event network-vif-plugged-4ba0e6d8-03d5-4849-8b1a-ca9b093ff8be {{(pid=98431) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 11 23:11:12.572004 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-9a1b1d47-e44a-4eef-9570-7c76ea8942f7 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Acquiring lock "206476b7-d805-4c6c-b7fb-db8b5c2a94a6-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:11:12.572004 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-9a1b1d47-e44a-4eef-9570-7c76ea8942f7 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "206476b7-d805-4c6c-b7fb-db8b5c2a94a6-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:11:12.577553 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-9a1b1d47-e44a-4eef-9570-7c76ea8942f7 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "206476b7-d805-4c6c-b7fb-db8b5c2a94a6-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:11:12.577553 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-9a1b1d47-e44a-4eef-9570-7c76ea8942f7 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-11T23:11:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='multiattach-server-0',id=10,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHngWA9S/0M7yAiCaKN7wJ0iqGBq18p6o1N91kfGTes8iMQtxmsCxH/Iqg51e2HEWFsjD10S17Kahb+vCzu07nJJQGe3fNUonThwHNf0exiWq4jZuXjSZtHJPO0dbow48A==',key_name='tempest-keypair-1974490716',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='81fd45f475a04e5c8e9bd9deb7ad4c1e',ramdisk_id='',reservation_id='r-6azrcy8d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1514006700',owner_user_name='tempest-AttachVolumeMultiAttachTest-1514006700-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-11T23:11:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c17e84202f404c3c8e73292bb59d7b27',uuid=206476b7-d805-4c6c-b7fb-db8b5c2a94a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ba0e6d8-03d5-4849-8b1a-ca9b093ff8be", "address": "fa:16:3e:c7:33:6a", "network": {"id": "17593db3-c22d-4354-ab29-933b1c6a5c3a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1094286565-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "81fd45f475a04e5c8e9bd9deb7ad4c1e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ba0e6d8-03", "ovs_interfaceid": "4ba0e6d8-03d5-4849-8b1a-ca9b093ff8be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 11 23:11:12.577553 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-9a1b1d47-e44a-4eef-9570-7c76ea8942f7 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Converting VIF {"id": "4ba0e6d8-03d5-4849-8b1a-ca9b093ff8be", "address": "fa:16:3e:c7:33:6a", "network": {"id": "17593db3-c22d-4354-ab29-933b1c6a5c3a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1094286565-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "81fd45f475a04e5c8e9bd9deb7ad4c1e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ba0e6d8-03", "ovs_interfaceid": "4ba0e6d8-03d5-4849-8b1a-ca9b093ff8be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:11:12.577929 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-9a1b1d47-e44a-4eef-9570-7c76ea8942f7 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:33:6a,bridge_name='br-int',has_traffic_filtering=True,id=4ba0e6d8-03d5-4849-8b1a-ca9b093ff8be,network=Network(17593db3-c22d-4354-ab29-933b1c6a5c3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ba0e6d8-03') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:11:12.577929 np0000002687 nova-compute[98431]: DEBUG os_vif [None req-9a1b1d47-e44a-4eef-9570-7c76ea8942f7 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:33:6a,bridge_name='br-int',has_traffic_filtering=True,id=4ba0e6d8-03d5-4849-8b1a-ca9b093ff8be,network=Network(17593db3-c22d-4354-ab29-933b1c6a5c3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ba0e6d8-03') {{(pid=98431) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 11 23:11:12.578086 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:12.578428 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:11:12.578747 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 11 23:11:12.583109 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:12.583426 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5a09f088-a71c-5d57-b6d8-faabbb99b79c', '_type': 'linux-noop'}}, row=False) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:11:12.588830 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:12.588830 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:11:12.592000 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:12.600291 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:12.600461 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4ba0e6d8-03, may_exist=True, interface_attrs={}) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:11:12.601053 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4ba0e6d8-03, col_values=(('qos', UUID('2033e392-74d0-42bf-b9ed-1014321043d1')),), if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:11:12.601284 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4ba0e6d8-03, col_values=(('external_ids', {'iface-id': '4ba0e6d8-03d5-4849-8b1a-ca9b093ff8be', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c7:33:6a', 'vm-uuid': '206476b7-d805-4c6c-b7fb-db8b5c2a94a6'}),), if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:11:12.605391 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:11:12.610980 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:12.615036 np0000002687 nova-compute[98431]: INFO os_vif [None req-9a1b1d47-e44a-4eef-9570-7c76ea8942f7 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:33:6a,bridge_name='br-int',has_traffic_filtering=True,id=4ba0e6d8-03d5-4849-8b1a-ca9b093ff8be,network=Network(17593db3-c22d-4354-ab29-933b1c6a5c3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ba0e6d8-03') Jun 11 23:11:12.724686 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:11:12.724686 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:11:12.729191 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98431) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 11 23:11:12.729191 np0000002687 nova-compute[98431]: INFO nova.compute.claims [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Claim successful on node np0000002687 Jun 11 23:11:12.816984 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:11:13.026179 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Updating instance_info_cache with network_info: [{"id": "7808ce0e-ec36-4dfa-84d5-0eb1ce542139", "address": "fa:16:3e:e8:a7:df", "network": {"id": "ef5cc6c6-1b8e-4a88-bf58-ad07356064fc", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1332694516-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57813123648a4335a97e8fc5c245cc73", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7808ce0e-ec", "ovs_interfaceid": "7808ce0e-ec36-4dfa-84d5-0eb1ce542139", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7051cdff-8b40-42d6-9d8a-9b7748621f1f", "address": "fa:16:3e:9f:58:c8", "network": {"id": "b4ad3a49-46fc-4f87-83ac-2f820e779189", "bridge": "br-int", "label": "tempest-device-tagging-net1-1763764299", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.184", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57813123648a4335a97e8fc5c245cc73", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7051cdff-8b", "ovs_interfaceid": "7051cdff-8b40-42d6-9d8a-9b7748621f1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "609ed1b7-9ea3-4ae3-8c37-f0a952a45507", "address": "fa:16:3e:c3:0b:6b", "network": {"id": "b4ad3a49-46fc-4f87-83ac-2f820e779189", "bridge": "br-int", "label": "tempest-device-tagging-net1-1763764299", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.189", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57813123648a4335a97e8fc5c245cc73", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap609ed1b7-9e", "ovs_interfaceid": "609ed1b7-9ea3-4ae3-8c37-f0a952a45507", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b54ddd43-d4cb-4d4a-840e-895e75419e25", "address": "fa:16:3e:b9:2e:2c", "network": {"id": "b4ad3a49-46fc-4f87-83ac-2f820e779189", "bridge": "br-int", "label": "tempest-device-tagging-net1-1763764299", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57813123648a4335a97e8fc5c245cc73", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb54ddd43-d4", "ovs_interfaceid": "b54ddd43-d4cb-4d4a-840e-895e75419e25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "77424d75-6e25-4791-a44d-495051f7e89f", "address": "fa:16:3e:a0:a2:82", "network": {"id": "b4ad3a49-46fc-4f87-83ac-2f820e779189", "bridge": "br-int", "label": "tempest-device-tagging-net1-1763764299", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57813123648a4335a97e8fc5c245cc73", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap77424d75-6e", "ovs_interfaceid": "77424d75-6e25-4791-a44d-495051f7e89f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0263e39d-c835-4cf1-b333-265608e81a93", "address": "fa:16:3e:50:0f:6b", "network": {"id": "25259518-16fe-4690-8216-636e994936ba", "bridge": "br-int", "label": "tempest-device-tagging-net2-736260586", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57813123648a4335a97e8fc5c245cc73", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0263e39d-c8", "ovs_interfaceid": "0263e39d-c835-4cf1-b333-265608e81a93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "09135c79-b0df-40af-b05b-2e171390f37f", "address": "fa:16:3e:c4:56:b3", "network": {"id": "25259518-16fe-4690-8216-636e994936ba", "bridge": "br-int", "label": "tempest-device-tagging-net2-736260586", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57813123648a4335a97e8fc5c245cc73", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap09135c79-b0", "ovs_interfaceid": "09135c79-b0df-40af-b05b-2e171390f37f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:11:13.052598 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [req-8f2fb268-d31c-40a6-91d5-e83eb47d44e4 req-d908dd93-a039-489f-9c08-51e30bb8d0b3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:11:13.242729 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-8f2fb268-d31c-40a6-91d5-e83eb47d44e4 req-d908dd93-a039-489f-9c08-51e30bb8d0b3 service nova] [instance: 206476b7-d805-4c6c-b7fb-db8b5c2a94a6] Updated VIF entry in instance network info cache for port 4ba0e6d8-03d5-4849-8b1a-ca9b093ff8be. {{(pid=98431) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 11 23:11:13.243038 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-8f2fb268-d31c-40a6-91d5-e83eb47d44e4 req-d908dd93-a039-489f-9c08-51e30bb8d0b3 service nova] [instance: 206476b7-d805-4c6c-b7fb-db8b5c2a94a6] Updating instance_info_cache with network_info: [{"id": "4ba0e6d8-03d5-4849-8b1a-ca9b093ff8be", "address": "fa:16:3e:c7:33:6a", "network": {"id": "17593db3-c22d-4354-ab29-933b1c6a5c3a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1094286565-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "81fd45f475a04e5c8e9bd9deb7ad4c1e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ba0e6d8-03", "ovs_interfaceid": "4ba0e6d8-03d5-4849-8b1a-ca9b093ff8be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:11:13.515361 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-ab251e3a-468c-40fc-b3b5-c292f2e7a520 tempest-DeleteServersTestJSON-807627983 tempest-DeleteServersTestJSON-807627983-project-member] Lock "689e510d-e0a4-4d6a-958e-9acfaebedc87" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 8.019s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:11:13.529103 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Releasing lock "refresh_cache-49a042ba-28ba-4401-9bdf-92f96da8f80e" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 11 23:11:13.529608 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Instance network_info: |[{"id": "7808ce0e-ec36-4dfa-84d5-0eb1ce542139", "address": "fa:16:3e:e8:a7:df", "network": {"id": "ef5cc6c6-1b8e-4a88-bf58-ad07356064fc", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1332694516-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57813123648a4335a97e8fc5c245cc73", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7808ce0e-ec", "ovs_interfaceid": "7808ce0e-ec36-4dfa-84d5-0eb1ce542139", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7051cdff-8b40-42d6-9d8a-9b7748621f1f", "address": "fa:16:3e:9f:58:c8", "network": {"id": "b4ad3a49-46fc-4f87-83ac-2f820e779189", "bridge": "br-int", "label": "tempest-device-tagging-net1-1763764299", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.184", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57813123648a4335a97e8fc5c245cc73", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7051cdff-8b", "ovs_interfaceid": "7051cdff-8b40-42d6-9d8a-9b7748621f1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "609ed1b7-9ea3-4ae3-8c37-f0a952a45507", "address": "fa:16:3e:c3:0b:6b", "network": {"id": "b4ad3a49-46fc-4f87-83ac-2f820e779189", "bridge": "br-int", "label": "tempest-device-tagging-net1-1763764299", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.189", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57813123648a4335a97e8fc5c245cc73", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap609ed1b7-9e", "ovs_interfaceid": "609ed1b7-9ea3-4ae3-8c37-f0a952a45507", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b54ddd43-d4cb-4d4a-840e-895e75419e25", "address": "fa:16:3e:b9:2e:2c", "network": {"id": "b4ad3a49-46fc-4f87-83ac-2f820e779189", "bridge": "br-int", "label": "tempest-device-tagging-net1-1763764299", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57813123648a4335a97e8fc5c245cc73", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb54ddd43-d4", "ovs_interfaceid": "b54ddd43-d4cb-4d4a-840e-895e75419e25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "77424d75-6e25-4791-a44d-495051f7e89f", "address": "fa:16:3e:a0:a2:82", "network": {"id": "b4ad3a49-46fc-4f87-83ac-2f820e779189", "bridge": "br-int", "label": "tempest-device-tagging-net1-1763764299", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57813123648a4335a97e8fc5c245cc73", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap77424d75-6e", "ovs_interfaceid": "77424d75-6e25-4791-a44d-495051f7e89f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0263e39d-c835-4cf1-b333-265608e81a93", "address": "fa:16:3e:50:0f:6b", "network": {"id": "25259518-16fe-4690-8216-636e994936ba", "bridge": "br-int", "label": "tempest-device-tagging-net2-736260586", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57813123648a4335a97e8fc5c245cc73", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0263e39d-c8", "ovs_interfaceid": "0263e39d-c835-4cf1-b333-265608e81a93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "09135c79-b0df-40af-b05b-2e171390f37f", "address": "fa:16:3e:c4:56:b3", "network": {"id": "25259518-16fe-4690-8216-636e994936ba", "bridge": "br-int", "label": "tempest-device-tagging-net2-736260586", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57813123648a4335a97e8fc5c245cc73", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap09135c79-b0", "ovs_interfaceid": "09135c79-b0df-40af-b05b-2e171390f37f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98431) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 11 23:11:13.530419 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-46721677-83c4-4223-b90d-e8a646477900 req-7cadcc3d-9f30-42d2-87f8-ec29e58da81d service nova] Acquired lock "refresh_cache-49a042ba-28ba-4401-9bdf-92f96da8f80e" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 11 23:11:13.531775 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Start _get_guest_xml network_info=[{"id": "7808ce0e-ec36-4dfa-84d5-0eb1ce542139", "address": "fa:16:3e:e8:a7:df", "network": {"id": "ef5cc6c6-1b8e-4a88-bf58-ad07356064fc", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1332694516-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57813123648a4335a97e8fc5c245cc73", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7808ce0e-ec", "ovs_interfaceid": "7808ce0e-ec36-4dfa-84d5-0eb1ce542139", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7051cdff-8b40-42d6-9d8a-9b7748621f1f", "address": "fa:16:3e:9f:58:c8", "network": {"id": "b4ad3a49-46fc-4f87-83ac-2f820e779189", "bridge": "br-int", "label": "tempest-device-tagging-net1-1763764299", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.184", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57813123648a4335a97e8fc5c245cc73", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7051cdff-8b", "ovs_interfaceid": "7051cdff-8b40-42d6-9d8a-9b7748621f1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "609ed1b7-9ea3-4ae3-8c37-f0a952a45507", "address": "fa:16:3e:c3:0b:6b", "network": {"id": "b4ad3a49-46fc-4f87-83ac-2f820e779189", "bridge": "br-int", "label": "tempest-device-tagging-net1-1763764299", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.189", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57813123648a4335a97e8fc5c245cc73", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap609ed1b7-9e", "ovs_interfaceid": "609ed1b7-9ea3-4ae3-8c37-f0a952a45507", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b54ddd43-d4cb-4d4a-840e-895e75419e25", "address": "fa:16:3e:b9:2e:2c", "network": {"id": "b4ad3a49-46fc-4f87-83ac-2f820e779189", "bridge": "br-int", "label": "tempest-device-tagging-net1-1763764299", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57813123648a4335a97e8fc5c245cc73", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb54ddd43-d4", "ovs_interfaceid": "b54ddd43-d4cb-4d4a-840e-895e75419e25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "77424d75-6e25-4791-a44d-495051f7e89f", "address": "fa:16:3e:a0:a2:82", "network": {"id": "b4ad3a49-46fc-4f87-83ac-2f820e779189", "bridge": "br-int", "label": "tempest-device-tagging-net1-1763764299", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57813123648a4335a97e8fc5c245cc73", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap77424d75-6e", "ovs_interfaceid": "77424d75-6e25-4791-a44d-495051f7e89f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0263e39d-c835-4cf1-b333-265608e81a93", "address": "fa:16:3e:50:0f:6b", "network": {"id": "25259518-16fe-4690-8216-636e994936ba", "bridge": "br-int", "label": "tempest-device-tagging-net2-736260586", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57813123648a4335a97e8fc5c245cc73", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0263e39d-c8", "ovs_interfaceid": "0263e39d-c835-4cf1-b333-265608e81a93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "09135c79-b0df-40af-b05b-2e171390f37f", "address": "fa:16:3e:c4:56:b3", "network": {"id": "25259518-16fe-4690-8216-636e994936ba", "bridge": "br-int", "label": "tempest-device-tagging-net2-736260586", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57813123648a4335a97e8fc5c245cc73", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap09135c79-b0", "ovs_interfaceid": "09135c79-b0df-40af-b05b-2e171390f37f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-11T23:08:20Z,direct_url=,disk_format='qcow2',id=f30640f8-7aca-4300-a085-4706a5209a79,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ce012f9fabdb4ee5a73e212437f59d97',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-11T23:08:23Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'mount_device': '/dev/vda', 'attachment_id': '54269af2-69bc-4c56-b932-8aebd5638326', 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9', 'iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5c45c988-5aa0-400e-ba7a-59581071a2f9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '49a042ba-28ba-4401-9bdf-92f96da8f80e', 'attached_at': '', 'detached_at': '', 'volume_id': '5c45c988-5aa0-400e-ba7a-59581071a2f9', 'serial': '5c45c988-5aa0-400e-ba7a-59581071a2f9'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'volume_type': None}, {'boot_index': 1, 'mount_device': '/dev/vdb', 'attachment_id': '39843094-2973-49b9-856e-02bdec21e8ae', 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c', 'iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '23264eac-8f91-4074-b3b0-51b6cb738b7c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '49a042ba-28ba-4401-9bdf-92f96da8f80e', 'attached_at': '', 'detached_at': '', 'volume_id': '23264eac-8f91-4074-b3b0-51b6cb738b7c', 'serial': '23264eac-8f91-4074-b3b0-51b6cb738b7c'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'volume_type': None}, {'boot_index': 2, 'mount_device': '/dev/vdc', 'attachment_id': 'cd842a96-68b3-48d9-80b9-2c6e0870d43f', 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff', 'iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0001b9c6-a8d0-4709-88d4-b91656096dff', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '49a042ba-28ba-4401-9bdf-92f96da8f80e', 'attached_at': '', 'detached_at': '', 'volume_id': '0001b9c6-a8d0-4709-88d4-b91656096dff', 'serial': '0001b9c6-a8d0-4709-88d4-b91656096dff'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98431) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 11 23:11:13.532134 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-46721677-83c4-4223-b90d-e8a646477900 req-7cadcc3d-9f30-42d2-87f8-ec29e58da81d service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Refreshing network info cache for port 09135c79-b0df-40af-b05b-2e171390f37f {{(pid=98431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 11 23:11:13.535248 np0000002687 nova-compute[98431]: WARNING nova.virt.libvirt.driver [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 11 23:11:13.536950 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='f30640f8-7aca-4300-a085-4706a5209a79', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-55083950', uuid='49a042ba-28ba-4401-9bdf-92f96da8f80e'), owner=OwnerMeta(userid='c853441cf4f34e4d9cd6821201efc91a', username='tempest-TaggedBootDevicesTest-1898457247-project-member', projectid='57813123648a4335a97e8fc5c245cc73', projectname='tempest-TaggedBootDevicesTest-1898457247'), image=ImageMeta(id='f30640f8-7aca-4300-a085-4706a5209a79', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "7808ce0e-ec36-4dfa-84d5-0eb1ce542139", "address": "fa:16:3e:e8:a7:df", "network": {"id": "ef5cc6c6-1b8e-4a88-bf58-ad07356064fc", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1332694516-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57813123648a4335a97e8fc5c245cc73", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7808ce0e-ec", "ovs_interfaceid": "7808ce0e-ec36-4dfa-84d5-0eb1ce542139", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7051cdff-8b40-42d6-9d8a-9b7748621f1f", "address": "fa:16:3e:9f:58:c8", "network": {"id": "b4ad3a49-46fc-4f87-83ac-2f820e779189", "bridge": "br-int", "label": "tempest-device-tagging-net1-1763764299", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.184", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57813123648a4335a97e8fc5c245cc73", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7051cdff-8b", "ovs_interfaceid": "7051cdff-8b40-42d6-9d8a-9b7748621f1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "609ed1b7-9ea3-4ae3-8c37-f0a952a45507", "address": "fa:16:3e:c3:0b:6b", "network": {"id": "b4ad3a49-46fc-4f87-83ac-2f820e779189", "bridge": "br-int", "label": "tempest-device-tagging-net1-1763764299", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.189", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57813123648a4335a97e8fc5c245cc73", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap609ed1b7-9e", "ovs_interfaceid": "609ed1b7-9ea3-4ae3-8c37-f0a952a45507", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b54ddd43-d4cb-4d4a-840e-895e75419e25", "address": "fa:16:3e:b9:2e:2c", "network": {"id": "b4ad3a49-46fc-4f87-83ac-2f820e779189", "bridge": "br-int", "label": "tempest-device-tagging-net1-1763764299", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57813123648a4335a97e8fc5c245cc73", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb54ddd43-d4", "ovs_interfaceid": "b54ddd43-d4cb-4d4a-840e-895e75419e25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "77424d75-6e25-4791-a44d-495051f7e89f", "address": "fa:16:3e:a0:a2:82", "network": {"id": "b4ad3a49-46fc-4f87-83ac-2f820e779189", "bridge": "br-int", "label": "tempest-device-tagging-net1-1763764299", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57813123648a4335a97e8fc5c245cc73", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap77424d75-6e", "ovs_interfaceid": "77424d75-6e25-4791-a44d-495051f7e89f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0263e39d-c835-4cf1-b333-265608e81a93", "address": "fa:16:3e:50:0f:6b", "network": {"id": "25259518-16fe-4690-8216-636e994936ba", "bridge": "br-int", "label": "tempest-device-tagging-net2-736260586", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57813123648a4335a97e8fc5c245cc73", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0263e39d-c8", "ovs_interfaceid": "0263e39d-c835-4cf1-b333-265608e81a93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "09135c79-b0df-40af-b05b-2e171390f37f", "address": "fa:16:3e:c4:56:b3", "network": {"id": "25259518-16fe-4690-8216-636e994936ba", "bridge": "br-int", "label": "tempest-device-tagging-net2-736260586", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57813123648a4335a97e8fc5c245cc73", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap09135c79-b0", "ovs_interfaceid": "09135c79-b0df-40af-b05b-2e171390f37f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1781219473.5361447) {{(pid=98431) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 11 23:11:13.538020 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Searching host: 'np0000002687' for CPU controller through CGroups V1... {{(pid=98431) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 11 23:11:13.538419 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] CPU controller missing on host. {{(pid=98431) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 11 23:11:13.539841 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Searching host: 'np0000002687' for CPU controller through CGroups V2... {{(pid=98431) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 11 23:11:13.540782 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] CPU controller found on host. {{(pid=98431) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 11 23:11:13.541951 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98431) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 11 23:11:13.544536 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-11T23:08:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-11T23:08:20Z,direct_url=,disk_format='qcow2',id=f30640f8-7aca-4300-a085-4706a5209a79,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ce012f9fabdb4ee5a73e212437f59d97',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-11T23:08:23Z,virtual_size=,visibility=), allow threads: True {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 11 23:11:13.544857 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Flavor limits 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 11 23:11:13.544933 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Image limits 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 11 23:11:13.545128 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Flavor pref 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 11 23:11:13.545256 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Image pref 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 11 23:11:13.545393 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 11 23:11:13.545599 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 11 23:11:13.545732 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98431) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 11 23:11:13.545897 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Got 1 possible topologies {{(pid=98431) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 11 23:11:13.546055 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 11 23:11:13.546515 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 11 23:11:13.563650 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Calling os-brick to attach iSCSI Volume {{(pid=98431) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 11 23:11:13.564097 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9', 'iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5c45c988-5aa0-400e-ba7a-59581071a2f9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 11 23:11:13.564629 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 11 23:11:13.565526 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 11 23:11:13.565909 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9', 'iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5c45c988-5aa0-400e-ba7a-59581071a2f9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98431) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 11 23:11:13.577156 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 11 23:11:13.577552 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 11 23:11:13.578081 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 11 23:11:13.578280 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.iscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 11 23:11:13.578968 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 11 23:11:13.578968 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.iscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 11 23:11:13.590473 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 11 23:11:13.590473 np0000002687 nova-compute[98431]: {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:13.594964 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 11 23:11:13.594964 np0000002687 nova-compute[98431]: {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:13.602729 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9] added Jun 11 23:11:13.602729 np0000002687 nova-compute[98431]: stderr=iscsiadm: Config file line 363 does not have value Jun 11 23:11:13.602729 np0000002687 nova-compute[98431]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 11 23:11:13.602729 np0000002687 nova-compute[98431]: iscsiadm: Config file line 363 does not have value Jun 11 23:11:13.602729 np0000002687 nova-compute[98431]: iscsiadm: Config file line 363 does not have value Jun 11 23:11:13.602729 np0000002687 nova-compute[98431]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 11 23:11:13.602729 np0000002687 nova-compute[98431]: {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:13.603024 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98431) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 11 23:11:13.603201 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0248(s), this was the 1st time calling it. {{(pid=98431) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 11 23:11:13.603383 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98431) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 11 23:11:13.608340 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9] added Jun 11 23:11:13.608340 np0000002687 nova-compute[98431]: stderr=iscsiadm: Config file line 363 does not have value Jun 11 23:11:13.608340 np0000002687 nova-compute[98431]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 11 23:11:13.608340 np0000002687 nova-compute[98431]: iscsiadm: Config file line 363 does not have value Jun 11 23:11:13.608340 np0000002687 nova-compute[98431]: iscsiadm: Config file line 363 does not have value Jun 11 23:11:13.608340 np0000002687 nova-compute[98431]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 11 23:11:13.608340 np0000002687 nova-compute[98431]: {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:13.608340 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98431) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 11 23:11:13.608340 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0294(s), this was the 1st time calling it. {{(pid=98431) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 11 23:11:13.608340 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98431) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 11 23:11:13.745138 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-8f2fb268-d31c-40a6-91d5-e83eb47d44e4 req-d908dd93-a039-489f-9c08-51e30bb8d0b3 service nova] Releasing lock "refresh_cache-206476b7-d805-4c6c-b7fb-db8b5c2a94a6" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 11 23:11:14.034723 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [req-46721677-83c4-4223-b90d-e8a646477900 req-7cadcc3d-9f30-42d2-87f8-ec29e58da81d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:11:14.167667 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-9a1b1d47-e44a-4eef-9570-7c76ea8942f7 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] No BDM found with device name vda, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:11:14.167830 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-9a1b1d47-e44a-4eef-9570-7c76ea8942f7 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] No BDM found with device name hda, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:11:14.167988 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-9a1b1d47-e44a-4eef-9570-7c76ea8942f7 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] No VIF found with MAC fa:16:3e:c7:33:6a, not building metadata {{(pid=98431) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13199}} Jun 11 23:11:14.168522 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-9a1b1d47-e44a-4eef-9570-7c76ea8942f7 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 206476b7-d805-4c6c-b7fb-db8b5c2a94a6] Using config drive Jun 11 23:11:14.468938 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98431) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 11 23:11:14.469093 np0000002687 nova-compute[98431]: DEBUG nova.compute.provider_tree [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Inventory has not changed in ProviderTree for provider: e3e65fe2-9de9-4821-8b4a-ccae37c66e25 {{(pid=98431) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 11 23:11:14.523647 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [req-46721677-83c4-4223-b90d-e8a646477900 req-7cadcc3d-9f30-42d2-87f8-ec29e58da81d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:11:14.606266 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.iscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 11 23:11:14.609826 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.iscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 11 23:11:14.628624 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 11 23:11:14.628624 np0000002687 nova-compute[98431]: node.name = iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 Jun 11 23:11:14.628624 np0000002687 nova-compute[98431]: node.tpgt = -1 Jun 11 23:11:14.628624 np0000002687 nova-compute[98431]: node.startup = manual Jun 11 23:11:14.628624 np0000002687 nova-compute[98431]: node.leading_login = No Jun 11 23:11:14.628624 np0000002687 nova-compute[98431]: iface.iscsi_ifacename = default Jun 11 23:11:14.628624 np0000002687 nova-compute[98431]: iface.net_ifacename = Jun 11 23:11:14.628624 np0000002687 nova-compute[98431]: iface.ipaddress = Jun 11 23:11:14.628624 np0000002687 nova-compute[98431]: iface.prefix_len = 0 Jun 11 23:11:14.628624 np0000002687 nova-compute[98431]: iface.hwaddress = Jun 11 23:11:14.628624 np0000002687 nova-compute[98431]: iface.transport_name = tcp Jun 11 23:11:14.628624 np0000002687 nova-compute[98431]: iface.initiatorname = Jun 11 23:11:14.628624 np0000002687 nova-compute[98431]: iface.state = Jun 11 23:11:14.628624 np0000002687 nova-compute[98431]: iface.vlan_id = 0 Jun 11 23:11:14.628624 np0000002687 nova-compute[98431]: iface.vlan_priority = 0 Jun 11 23:11:14.628624 np0000002687 nova-compute[98431]: iface.vlan_state = Jun 11 23:11:14.628624 np0000002687 nova-compute[98431]: iface.iface_num = 0 Jun 11 23:11:14.628624 np0000002687 nova-compute[98431]: iface.mtu = 0 Jun 11 23:11:14.628624 np0000002687 nova-compute[98431]: iface.port = 0 Jun 11 23:11:14.628624 np0000002687 nova-compute[98431]: iface.bootproto = Jun 11 23:11:14.628624 np0000002687 nova-compute[98431]: iface.subnet_mask = Jun 11 23:11:14.628624 np0000002687 nova-compute[98431]: iface.gateway = Jun 11 23:11:14.628624 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id_state = Jun 11 23:11:14.628624 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id = Jun 11 23:11:14.628624 np0000002687 nova-compute[98431]: iface.dhcp_dns = Jun 11 23:11:14.628624 np0000002687 nova-compute[98431]: iface.dhcp_learn_iqn = Jun 11 23:11:14.628624 np0000002687 nova-compute[98431]: iface.dhcp_req_vendor_id_state = Jun 11 23:11:14.628624 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id_state = Jun 11 23:11:14.628624 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id = Jun 11 23:11:14.628624 np0000002687 nova-compute[98431]: iface.dhcp_slp_da = Jun 11 23:11:14.628624 np0000002687 nova-compute[98431]: iface.fragmentation = Jun 11 23:11:14.628624 np0000002687 nova-compute[98431]: iface.gratuitous_arp = Jun 11 23:11:14.628624 np0000002687 nova-compute[98431]: iface.incoming_forwarding = Jun 11 23:11:14.628624 np0000002687 nova-compute[98431]: iface.tos_state = Jun 11 23:11:14.628624 np0000002687 nova-compute[98431]: iface.tos = 0 Jun 11 23:11:14.628624 np0000002687 nova-compute[98431]: iface.ttl = 0 Jun 11 23:11:14.628624 np0000002687 nova-compute[98431]: iface.delayed_ack = Jun 11 23:11:14.628624 np0000002687 nova-compute[98431]: iface.tcp_nagle = Jun 11 23:11:14.628624 np0000002687 nova-compute[98431]: iface.tcp_wsf_state = Jun 11 23:11:14.628624 np0000002687 nova-compute[98431]: iface.tcp_wsf = 0 Jun 11 23:11:14.628624 np0000002687 nova-compute[98431]: iface.tcp_timer_scale = 0 Jun 11 23:11:14.628624 np0000002687 nova-compute[98431]: iface.tcp_timestamp = Jun 11 23:11:14.628624 np0000002687 nova-compute[98431]: iface.redirect = Jun 11 23:11:14.628624 np0000002687 nova-compute[98431]: iface.def_task_mgmt_timeout = 0 Jun 11 23:11:14.628624 np0000002687 nova-compute[98431]: iface.header_digest = Jun 11 23:11:14.628624 np0000002687 nova-compute[98431]: iface.data_digest = Jun 11 23:11:14.628624 np0000002687 nova-compute[98431]: iface.immediate_data = Jun 11 23:11:14.628624 np0000002687 nova-compute[98431]: iface.initial_r2t = Jun 11 23:11:14.628624 np0000002687 nova-compute[98431]: iface.data_seq_inorder = Jun 11 23:11:14.628624 np0000002687 nova-compute[98431]: iface.data_pdu_inorder = Jun 11 23:11:14.628624 np0000002687 nova-compute[98431]: iface.erl = 0 Jun 11 23:11:14.628624 np0000002687 nova-compute[98431]: iface.max_receive_data_len = 0 Jun 11 23:11:14.628624 np0000002687 nova-compute[98431]: iface.first_burst_len = 0 Jun 11 23:11:14.628624 np0000002687 nova-compute[98431]: iface.max_outstanding_r2t = 0 Jun 11 23:11:14.628624 np0000002687 nova-compute[98431]: iface.max_burst_len = 0 Jun 11 23:11:14.628624 np0000002687 nova-compute[98431]: iface.chap_auth = Jun 11 23:11:14.628624 np0000002687 nova-compute[98431]: iface.bidi_chap = Jun 11 23:11:14.628624 np0000002687 nova-compute[98431]: iface.strict_login_compliance = Jun 11 23:11:14.628624 np0000002687 nova-compute[98431]: iface.discovery_auth = Jun 11 23:11:14.628624 np0000002687 nova-compute[98431]: iface.discovery_logout = Jun 11 23:11:14.628624 np0000002687 nova-compute[98431]: node.discovery_address = Jun 11 23:11:14.628624 np0000002687 nova-compute[98431]: node.discovery_port = 0 Jun 11 23:11:14.628624 np0000002687 nova-compute[98431]: node.discovery_type = fw Jun 11 23:11:14.628624 np0000002687 nova-compute[98431]: node.session.initial_cmdsn = 0 Jun 11 23:11:14.628624 np0000002687 nova-compute[98431]: node.session.initial_login_retry_max = 8 Jun 11 23:11:14.628624 np0000002687 nova-compute[98431]: node.session.xmit_thread_priority = 0 Jun 11 23:11:14.628624 np0000002687 nova-compute[98431]: node.session.cmds_max = 128 Jun 11 23:11:14.628624 np0000002687 nova-compute[98431]: node.session.queue_depth = 32 Jun 11 23:11:14.628624 np0000002687 nova-compute[98431]: node.session.nr_sessions = 1 Jun 11 23:11:14.628624 np0000002687 nova-compute[98431]: node.session.auth.authmethod = None Jun 11 23:11:14.628624 np0000002687 nova-compute[98431]: node.session.auth.username = Jun 11 23:11:14.628624 np0000002687 nova-compute[98431]: node.session.auth.password = *** Jun 11 23:11:14.628624 np0000002687 nova-compute[98431]: node.session.auth.username_in = Jun 11 23:11:14.628624 np0000002687 nova-compute[98431]: node.session.auth.password_in = Jun 11 23:11:14.628624 np0000002687 nova-compute[98431]: node.session.auth.chap_algs = SHA256 Jun 11 23:11:14.628624 np0000002687 nova-compute[98431]: node.session.timeo.replacement_timeout = 120 Jun 11 23:11:14.628624 np0000002687 nova-compute[98431]: node.session.err_timeo.abort_timeout = 15 Jun 11 23:11:14.628624 np0000002687 nova-compute[98431]: node.session.err_timeo.lu_reset_timeout = 30 Jun 11 23:11:14.628624 np0000002687 nova-compute[98431]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 11 23:11:14.628624 np0000002687 nova-compute[98431]: node.session.err_timeo.host_reset_timeout = 60 Jun 11 23:11:14.628624 np0000002687 nova-compute[98431]: node.session.iscsi.FastAbort = Yes Jun 11 23:11:14.628624 np0000002687 nova-compute[98431]: node.session.iscsi.InitialR2T = No Jun 11 23:11:14.628624 np0000002687 nova-compute[98431]: node.session.iscsi.ImmediateData = Yes Jun 11 23:11:14.628624 np0000002687 nova-compute[98431]: node.session.iscsi.FirstBurstLength = 262144 Jun 11 23:11:14.628624 np0000002687 nova-compute[98431]: node.session.iscsi.MaxBurstLength = 16776192 Jun 11 23:11:14.628624 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Retain = 0 Jun 11 23:11:14.628624 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Wait = 2 Jun 11 23:11:14.628624 np0000002687 nova-compute[98431]: node.session.iscsi.MaxConnections = 1 Jun 11 23:11:14.628624 np0000002687 nova-compute[98431]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 11 23:11:14.628624 np0000002687 nova-compute[98431]: node.session.iscsi.ERL = 0 Jun 11 23:11:14.628624 np0000002687 nova-compute[98431]: node.session.scan = auto Jun 11 23:11:14.628624 np0000002687 nova-compute[98431]: node.session.reopen_max = 0 Jun 11 23:11:14.628624 np0000002687 nova-compute[98431]: node.conn[0].address = 192.168.40.100 Jun 11 23:11:14.628624 np0000002687 nova-compute[98431]: node.conn[0].port = 3260 Jun 11 23:11:14.628624 np0000002687 nova-compute[98431]: node.conn[0].startup = manual Jun 11 23:11:14.628624 np0000002687 nova-compute[98431]: node.conn[0].tcp.window_size = 524288 Jun 11 23:11:14.628624 np0000002687 nova-compute[98431]: node.conn[0].tcp.type_of_service = 0 Jun 11 23:11:14.628624 np0000002687 nova-compute[98431]: node.conn[0].timeo.logout_timeout = 15 Jun 11 23:11:14.628624 np0000002687 nova-compute[98431]: node.conn[0].timeo.login_timeout = 15 Jun 11 23:11:14.628624 np0000002687 nova-compute[98431]: node.conn[0].timeo.auth_timeout = 45 Jun 11 23:11:14.628624 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_interval = 5 Jun 11 23:11:14.628624 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_timeout = 5 Jun 11 23:11:14.628624 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 11 23:11:14.628624 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 11 23:11:14.628624 np0000002687 nova-compute[98431]: node.conn[0].iscsi.HeaderDigest = None Jun 11 23:11:14.628624 np0000002687 nova-compute[98431]: node.conn[0].iscsi.DataDigest = None Jun 11 23:11:14.628624 np0000002687 nova-compute[98431]: node.conn[0].iscsi.IFMarker = No Jun 11 23:11:14.628624 np0000002687 nova-compute[98431]: node.conn[0].iscsi.OFMarker = No Jun 11 23:11:14.628624 np0000002687 nova-compute[98431]: # END RECORD Jun 11 23:11:14.628624 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:14.631743 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 11 23:11:14.631743 np0000002687 nova-compute[98431]: node.name = iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 Jun 11 23:11:14.631743 np0000002687 nova-compute[98431]: node.tpgt = -1 Jun 11 23:11:14.631743 np0000002687 nova-compute[98431]: node.startup = manual Jun 11 23:11:14.631743 np0000002687 nova-compute[98431]: node.leading_login = No Jun 11 23:11:14.631743 np0000002687 nova-compute[98431]: iface.iscsi_ifacename = default Jun 11 23:11:14.631743 np0000002687 nova-compute[98431]: iface.net_ifacename = Jun 11 23:11:14.631743 np0000002687 nova-compute[98431]: iface.ipaddress = Jun 11 23:11:14.631743 np0000002687 nova-compute[98431]: iface.prefix_len = 0 Jun 11 23:11:14.631743 np0000002687 nova-compute[98431]: iface.hwaddress = Jun 11 23:11:14.631743 np0000002687 nova-compute[98431]: iface.transport_name = tcp Jun 11 23:11:14.631743 np0000002687 nova-compute[98431]: iface.initiatorname = Jun 11 23:11:14.631743 np0000002687 nova-compute[98431]: iface.state = Jun 11 23:11:14.631743 np0000002687 nova-compute[98431]: iface.vlan_id = 0 Jun 11 23:11:14.631743 np0000002687 nova-compute[98431]: iface.vlan_priority = 0 Jun 11 23:11:14.631743 np0000002687 nova-compute[98431]: iface.vlan_state = Jun 11 23:11:14.631743 np0000002687 nova-compute[98431]: iface.iface_num = 0 Jun 11 23:11:14.631743 np0000002687 nova-compute[98431]: iface.mtu = 0 Jun 11 23:11:14.631743 np0000002687 nova-compute[98431]: iface.port = 0 Jun 11 23:11:14.631743 np0000002687 nova-compute[98431]: iface.bootproto = Jun 11 23:11:14.631743 np0000002687 nova-compute[98431]: iface.subnet_mask = Jun 11 23:11:14.631743 np0000002687 nova-compute[98431]: iface.gateway = Jun 11 23:11:14.631743 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id_state = Jun 11 23:11:14.631743 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id = Jun 11 23:11:14.631743 np0000002687 nova-compute[98431]: iface.dhcp_dns = Jun 11 23:11:14.631743 np0000002687 nova-compute[98431]: iface.dhcp_learn_iqn = Jun 11 23:11:14.631743 np0000002687 nova-compute[98431]: iface.dhcp_req_vendor_id_state = Jun 11 23:11:14.631743 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id_state = Jun 11 23:11:14.631743 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id = Jun 11 23:11:14.631743 np0000002687 nova-compute[98431]: iface.dhcp_slp_da = Jun 11 23:11:14.631743 np0000002687 nova-compute[98431]: iface.fragmentation = Jun 11 23:11:14.631743 np0000002687 nova-compute[98431]: iface.gratuitous_arp = Jun 11 23:11:14.631743 np0000002687 nova-compute[98431]: iface.incoming_forwarding = Jun 11 23:11:14.631743 np0000002687 nova-compute[98431]: iface.tos_state = Jun 11 23:11:14.631743 np0000002687 nova-compute[98431]: iface.tos = 0 Jun 11 23:11:14.631743 np0000002687 nova-compute[98431]: iface.ttl = 0 Jun 11 23:11:14.631743 np0000002687 nova-compute[98431]: iface.delayed_ack = Jun 11 23:11:14.631743 np0000002687 nova-compute[98431]: iface.tcp_nagle = Jun 11 23:11:14.631743 np0000002687 nova-compute[98431]: iface.tcp_wsf_state = Jun 11 23:11:14.631743 np0000002687 nova-compute[98431]: iface.tcp_wsf = 0 Jun 11 23:11:14.631743 np0000002687 nova-compute[98431]: iface.tcp_timer_scale = 0 Jun 11 23:11:14.631743 np0000002687 nova-compute[98431]: iface.tcp_timestamp = Jun 11 23:11:14.631743 np0000002687 nova-compute[98431]: iface.redirect = Jun 11 23:11:14.631743 np0000002687 nova-compute[98431]: iface.def_task_mgmt_timeout = 0 Jun 11 23:11:14.631743 np0000002687 nova-compute[98431]: iface.header_digest = Jun 11 23:11:14.631743 np0000002687 nova-compute[98431]: iface.data_digest = Jun 11 23:11:14.631743 np0000002687 nova-compute[98431]: iface.immediate_data = Jun 11 23:11:14.631743 np0000002687 nova-compute[98431]: iface.initial_r2t = Jun 11 23:11:14.631743 np0000002687 nova-compute[98431]: iface.data_seq_inorder = Jun 11 23:11:14.631743 np0000002687 nova-compute[98431]: iface.data_pdu_inorder = Jun 11 23:11:14.631743 np0000002687 nova-compute[98431]: iface.erl = 0 Jun 11 23:11:14.631743 np0000002687 nova-compute[98431]: iface.max_receive_data_len = 0 Jun 11 23:11:14.631743 np0000002687 nova-compute[98431]: iface.first_burst_len = 0 Jun 11 23:11:14.631743 np0000002687 nova-compute[98431]: iface.max_outstanding_r2t = 0 Jun 11 23:11:14.631743 np0000002687 nova-compute[98431]: iface.max_burst_len = 0 Jun 11 23:11:14.631743 np0000002687 nova-compute[98431]: iface.chap_auth = Jun 11 23:11:14.631743 np0000002687 nova-compute[98431]: iface.bidi_chap = Jun 11 23:11:14.631743 np0000002687 nova-compute[98431]: iface.strict_login_compliance = Jun 11 23:11:14.631743 np0000002687 nova-compute[98431]: iface.discovery_auth = Jun 11 23:11:14.631743 np0000002687 nova-compute[98431]: iface.discovery_logout = Jun 11 23:11:14.631743 np0000002687 nova-compute[98431]: node.discovery_address = Jun 11 23:11:14.631743 np0000002687 nova-compute[98431]: node.discovery_port = 0 Jun 11 23:11:14.631743 np0000002687 nova-compute[98431]: node.discovery_type = fw Jun 11 23:11:14.631743 np0000002687 nova-compute[98431]: node.session.initial_cmdsn = 0 Jun 11 23:11:14.631743 np0000002687 nova-compute[98431]: node.session.initial_login_retry_max = 8 Jun 11 23:11:14.631743 np0000002687 nova-compute[98431]: node.session.xmit_thread_priority = 0 Jun 11 23:11:14.631743 np0000002687 nova-compute[98431]: node.session.cmds_max = 128 Jun 11 23:11:14.631743 np0000002687 nova-compute[98431]: node.session.queue_depth = 32 Jun 11 23:11:14.631743 np0000002687 nova-compute[98431]: node.session.nr_sessions = 1 Jun 11 23:11:14.631743 np0000002687 nova-compute[98431]: node.session.auth.authmethod = None Jun 11 23:11:14.631743 np0000002687 nova-compute[98431]: node.session.auth.username = Jun 11 23:11:14.631743 np0000002687 nova-compute[98431]: node.session.auth.password = *** Jun 11 23:11:14.631743 np0000002687 nova-compute[98431]: node.session.auth.username_in = Jun 11 23:11:14.631743 np0000002687 nova-compute[98431]: node.session.auth.password_in = Jun 11 23:11:14.631743 np0000002687 nova-compute[98431]: node.session.auth.chap_algs = SHA256 Jun 11 23:11:14.631743 np0000002687 nova-compute[98431]: node.session.timeo.replacement_timeout = 120 Jun 11 23:11:14.631743 np0000002687 nova-compute[98431]: node.session.err_timeo.abort_timeout = 15 Jun 11 23:11:14.631743 np0000002687 nova-compute[98431]: node.session.err_timeo.lu_reset_timeout = 30 Jun 11 23:11:14.631743 np0000002687 nova-compute[98431]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 11 23:11:14.631743 np0000002687 nova-compute[98431]: node.session.err_timeo.host_reset_timeout = 60 Jun 11 23:11:14.631743 np0000002687 nova-compute[98431]: node.session.iscsi.FastAbort = Yes Jun 11 23:11:14.631743 np0000002687 nova-compute[98431]: node.session.iscsi.InitialR2T = No Jun 11 23:11:14.631743 np0000002687 nova-compute[98431]: node.session.iscsi.ImmediateData = Yes Jun 11 23:11:14.631743 np0000002687 nova-compute[98431]: node.session.iscsi.FirstBurstLength = 262144 Jun 11 23:11:14.631743 np0000002687 nova-compute[98431]: node.session.iscsi.MaxBurstLength = 16776192 Jun 11 23:11:14.631743 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Retain = 0 Jun 11 23:11:14.631743 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Wait = 2 Jun 11 23:11:14.631743 np0000002687 nova-compute[98431]: node.session.iscsi.MaxConnections = 1 Jun 11 23:11:14.631743 np0000002687 nova-compute[98431]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 11 23:11:14.631743 np0000002687 nova-compute[98431]: node.session.iscsi.ERL = 0 Jun 11 23:11:14.631743 np0000002687 nova-compute[98431]: node.session.scan = auto Jun 11 23:11:14.631743 np0000002687 nova-compute[98431]: node.session.reopen_max = 0 Jun 11 23:11:14.631743 np0000002687 nova-compute[98431]: node.conn[0].address = 192.168.50.100 Jun 11 23:11:14.631743 np0000002687 nova-compute[98431]: node.conn[0].port = 3260 Jun 11 23:11:14.631743 np0000002687 nova-compute[98431]: node.conn[0].startup = manual Jun 11 23:11:14.631743 np0000002687 nova-compute[98431]: node.conn[0].tcp.window_size = 524288 Jun 11 23:11:14.631743 np0000002687 nova-compute[98431]: node.conn[0].tcp.type_of_service = 0 Jun 11 23:11:14.631743 np0000002687 nova-compute[98431]: node.conn[0].timeo.logout_timeout = 15 Jun 11 23:11:14.631743 np0000002687 nova-compute[98431]: node.conn[0].timeo.login_timeout = 15 Jun 11 23:11:14.631743 np0000002687 nova-compute[98431]: node.conn[0].timeo.auth_timeout = 45 Jun 11 23:11:14.631743 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_interval = 5 Jun 11 23:11:14.631743 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_timeout = 5 Jun 11 23:11:14.631743 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 11 23:11:14.631743 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 11 23:11:14.631743 np0000002687 nova-compute[98431]: node.conn[0].iscsi.HeaderDigest = None Jun 11 23:11:14.631743 np0000002687 nova-compute[98431]: node.conn[0].iscsi.DataDigest = None Jun 11 23:11:14.631743 np0000002687 nova-compute[98431]: node.conn[0].iscsi.IFMarker = No Jun 11 23:11:14.631743 np0000002687 nova-compute[98431]: node.conn[0].iscsi.OFMarker = No Jun 11 23:11:14.631743 np0000002687 nova-compute[98431]: # END RECORD Jun 11 23:11:14.631743 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:14.643412 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:14.657629 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:14.659753 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:14.659753 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:14.659753 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:11:14.659753 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:14.659753 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:14.659753 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:11:14.678788 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-9a1b1d47-e44a-4eef-9570-7c76ea8942f7 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:11:14.682276 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:14.682276 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:14.682276 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:11:14.682276 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:14.682276 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:14.682276 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:11:14.701378 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9, portal: 192.168.40.100,3260] Jun 11 23:11:14.701378 np0000002687 nova-compute[98431]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9, portal: 192.168.40.100,3260] successful. Jun 11 23:11:14.701378 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:14.722243 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9, portal: 192.168.50.100,3260] Jun 11 23:11:14.722243 np0000002687 nova-compute[98431]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9, portal: 192.168.50.100,3260] successful. Jun 11 23:11:14.722243 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:14.730093 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-46721677-83c4-4223-b90d-e8a646477900 req-7cadcc3d-9f30-42d2-87f8-ec29e58da81d service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Updated VIF entry in instance network info cache for port 09135c79-b0df-40af-b05b-2e171390f37f. {{(pid=98431) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 11 23:11:14.731058 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-46721677-83c4-4223-b90d-e8a646477900 req-7cadcc3d-9f30-42d2-87f8-ec29e58da81d service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Updating instance_info_cache with network_info: [{"id": "7808ce0e-ec36-4dfa-84d5-0eb1ce542139", "address": "fa:16:3e:e8:a7:df", "network": {"id": "ef5cc6c6-1b8e-4a88-bf58-ad07356064fc", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1332694516-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57813123648a4335a97e8fc5c245cc73", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7808ce0e-ec", "ovs_interfaceid": "7808ce0e-ec36-4dfa-84d5-0eb1ce542139", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7051cdff-8b40-42d6-9d8a-9b7748621f1f", "address": "fa:16:3e:9f:58:c8", "network": {"id": "b4ad3a49-46fc-4f87-83ac-2f820e779189", "bridge": "br-int", "label": "tempest-device-tagging-net1-1763764299", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.184", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57813123648a4335a97e8fc5c245cc73", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7051cdff-8b", "ovs_interfaceid": "7051cdff-8b40-42d6-9d8a-9b7748621f1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "609ed1b7-9ea3-4ae3-8c37-f0a952a45507", "address": "fa:16:3e:c3:0b:6b", "network": {"id": "b4ad3a49-46fc-4f87-83ac-2f820e779189", "bridge": "br-int", "label": "tempest-device-tagging-net1-1763764299", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.189", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57813123648a4335a97e8fc5c245cc73", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap609ed1b7-9e", "ovs_interfaceid": "609ed1b7-9ea3-4ae3-8c37-f0a952a45507", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b54ddd43-d4cb-4d4a-840e-895e75419e25", "address": "fa:16:3e:b9:2e:2c", "network": {"id": "b4ad3a49-46fc-4f87-83ac-2f820e779189", "bridge": "br-int", "label": "tempest-device-tagging-net1-1763764299", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57813123648a4335a97e8fc5c245cc73", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb54ddd43-d4", "ovs_interfaceid": "b54ddd43-d4cb-4d4a-840e-895e75419e25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "77424d75-6e25-4791-a44d-495051f7e89f", "address": "fa:16:3e:a0:a2:82", "network": {"id": "b4ad3a49-46fc-4f87-83ac-2f820e779189", "bridge": "br-int", "label": "tempest-device-tagging-net1-1763764299", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57813123648a4335a97e8fc5c245cc73", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap77424d75-6e", "ovs_interfaceid": "77424d75-6e25-4791-a44d-495051f7e89f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0263e39d-c835-4cf1-b333-265608e81a93", "address": "fa:16:3e:50:0f:6b", "network": {"id": "25259518-16fe-4690-8216-636e994936ba", "bridge": "br-int", "label": "tempest-device-tagging-net2-736260586", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57813123648a4335a97e8fc5c245cc73", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0263e39d-c8", "ovs_interfaceid": "0263e39d-c835-4cf1-b333-265608e81a93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "09135c79-b0df-40af-b05b-2e171390f37f", "address": "fa:16:3e:c4:56:b3", "network": {"id": "25259518-16fe-4690-8216-636e994936ba", "bridge": "br-int", "label": "tempest-device-tagging-net2-736260586", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57813123648a4335a97e8fc5c245cc73", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap09135c79-b0", "ovs_interfaceid": "09135c79-b0df-40af-b05b-2e171390f37f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:11:14.733383 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:14.740925 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:14.754562 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:14.754562 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:14.754562 np0000002687 nova-compute[98431]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:14.754562 np0000002687 nova-compute[98431]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:14.754562 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:11:14.755876 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:14.755876 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:14.755876 np0000002687 nova-compute[98431]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:14.755876 np0000002687 nova-compute[98431]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:14.755876 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:11:14.755876 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.177s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 11 23:11:14.755876 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Connected to 192.168.40.100:3260 {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 11 23:11:14.756956 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] HCTL ('9', '-', '-', 0) found on session 7 with lun 0 {{(pid=98431) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 11 23:11:14.757227 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98431) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 11 23:11:14.779156 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Searching for a device in session 7 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98431) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 11 23:11:14.779156 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5c45c988-5aa0-400e-ba7a-59581071a2f9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 11 23:11:14.779156 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:14.779156 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:14.779156 np0000002687 nova-compute[98431]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:14.779156 np0000002687 nova-compute[98431]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:14.779156 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:11:14.779156 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:14.779156 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:14.779156 np0000002687 nova-compute[98431]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:14.779156 np0000002687 nova-compute[98431]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:14.779156 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:11:14.779156 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.201s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 11 23:11:14.779156 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Connected to 192.168.50.100:3260 {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 11 23:11:14.780902 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] HCTL ('10', '-', '-', 0) found on session 8 with lun 0 {{(pid=98431) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 11 23:11:14.780902 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98431) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 11 23:11:14.803397 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Searching for a device in session 8 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98431) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 11 23:11:14.803397 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '5c45c988-5aa0-400e-ba7a-59581071a2f9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 11 23:11:14.887848 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-9a1b1d47-e44a-4eef-9570-7c76ea8942f7 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 206476b7-d805-4c6c-b7fb-db8b5c2a94a6] Creating config drive at /opt/stack/data/nova/instances/206476b7-d805-4c6c-b7fb-db8b5c2a94a6/disk.config Jun 11 23:11:14.901749 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-9a1b1d47-e44a-4eef-9570-7c76ea8942f7 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/206476b7-d805-4c6c-b7fb-db8b5c2a94a6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpc3q390gk {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:11:14.952603 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-9a1b1d47-e44a-4eef-9570-7c76ea8942f7 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/206476b7-d805-4c6c-b7fb-db8b5c2a94a6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpc3q390gk" returned: 0 in 0.051s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:11:14.974038 np0000002687 nova-compute[98431]: DEBUG nova.scheduler.client.report [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Inventory has not changed for provider e3e65fe2-9de9-4821-8b4a-ccae37c66e25 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98431) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 11 23:11:15.234566 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-46721677-83c4-4223-b90d-e8a646477900 req-7cadcc3d-9f30-42d2-87f8-ec29e58da81d service nova] Releasing lock "refresh_cache-49a042ba-28ba-4401-9bdf-92f96da8f80e" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 11 23:11:15.350757 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:15.488045 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.764s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:11:15.488551 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Start building networks asynchronously for instance. {{(pid=98431) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 11 23:11:15.520230 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:15.544966 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:15.548428 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:15.579263 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98431) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 11 23:11:15.683911 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:15.782300 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:15.829042 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-7ba5bacd-4af4-4004-8ce1-3a5d9ac348eb req-e01d96bb-c51d-443e-bcb2-2d4e39964d9d service nova] [instance: 206476b7-d805-4c6c-b7fb-db8b5c2a94a6] Received event network-vif-plugged-4ba0e6d8-03d5-4849-8b1a-ca9b093ff8be {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:11:15.831284 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-7ba5bacd-4af4-4004-8ce1-3a5d9ac348eb req-e01d96bb-c51d-443e-bcb2-2d4e39964d9d service nova] Acquiring lock "206476b7-d805-4c6c-b7fb-db8b5c2a94a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:11:15.835145 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-7ba5bacd-4af4-4004-8ce1-3a5d9ac348eb req-e01d96bb-c51d-443e-bcb2-2d4e39964d9d service nova] Lock "206476b7-d805-4c6c-b7fb-db8b5c2a94a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.002s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:11:15.835701 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-7ba5bacd-4af4-4004-8ce1-3a5d9ac348eb req-e01d96bb-c51d-443e-bcb2-2d4e39964d9d service nova] Lock "206476b7-d805-4c6c-b7fb-db8b5c2a94a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.004s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:11:15.836410 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-7ba5bacd-4af4-4004-8ce1-3a5d9ac348eb req-e01d96bb-c51d-443e-bcb2-2d4e39964d9d service nova] [instance: 206476b7-d805-4c6c-b7fb-db8b5c2a94a6] Processing event network-vif-plugged-4ba0e6d8-03d5-4849-8b1a-ca9b093ff8be {{(pid=98431) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 11 23:11:15.996672 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Allocating IP information in the background. {{(pid=98431) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 11 23:11:15.996932 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] allocate_for_instance() {{(pid=98431) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 11 23:11:15.997432 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:11:15.998073 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:11:16.112831 np0000002687 nova-compute[98431]: DEBUG nova.policy [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '72b6dac5eb744cfba6299636227aa59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaf744af828a4a5eba1e98da63373b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98431) authorize /opt/stack/nova/nova/policy.py:192}} Jun 11 23:11:16.492753 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-9a1b1d47-e44a-4eef-9570-7c76ea8942f7 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 206476b7-d805-4c6c-b7fb-db8b5c2a94a6] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98431) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 11 23:11:16.492753 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Emitting event Started> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:11:16.492753 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 206476b7-d805-4c6c-b7fb-db8b5c2a94a6] VM Started (Lifecycle Event) Jun 11 23:11:16.498319 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-9a1b1d47-e44a-4eef-9570-7c76ea8942f7 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 206476b7-d805-4c6c-b7fb-db8b5c2a94a6] Guest created on hypervisor {{(pid=98431) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}} Jun 11 23:11:16.503756 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 11 23:11:16.511167 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [-] [instance: 206476b7-d805-4c6c-b7fb-db8b5c2a94a6] Instance spawned successfully. Jun 11 23:11:16.513106 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-9a1b1d47-e44a-4eef-9570-7c76ea8942f7 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 206476b7-d805-4c6c-b7fb-db8b5c2a94a6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 11 23:11:16.602414 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Found WWN 3300000008439a8a6 for multipath device dm-3 {{(pid=98431) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 11 23:11:16.603173 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.037s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 11 23:11:16.603173 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] <== connect_volume: return (3038ms) {'type': 'block', 'scsi_wwn': '3300000008439a8a6', 'path': '/dev/dm-3', 'multipath_id': '3300000008439a8a6'} {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 11 23:11:16.605575 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000008439a8a6', 'path': '/dev/dm-3', 'multipath_id': '3300000008439a8a6'} {{(pid=98431) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 11 23:11:16.641646 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Successfully created port: 852fc4ec-82e1-4185-a33c-3c45ff42351e {{(pid=98431) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 11 23:11:16.996688 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 206476b7-d805-4c6c-b7fb-db8b5c2a94a6] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:11:17.000681 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 206476b7-d805-4c6c-b7fb-db8b5c2a94a6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98431) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 11 23:11:17.012030 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Start building block device mappings for instance. {{(pid=98431) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 11 23:11:17.043522 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-9a1b1d47-e44a-4eef-9570-7c76ea8942f7 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 206476b7-d805-4c6c-b7fb-db8b5c2a94a6] Found default for hw_cdrom_bus of ide {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:11:17.043876 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-9a1b1d47-e44a-4eef-9570-7c76ea8942f7 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 206476b7-d805-4c6c-b7fb-db8b5c2a94a6] Found default for hw_disk_bus of virtio {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:11:17.044105 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-9a1b1d47-e44a-4eef-9570-7c76ea8942f7 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 206476b7-d805-4c6c-b7fb-db8b5c2a94a6] Found default for hw_input_bus of None {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:11:17.044389 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-9a1b1d47-e44a-4eef-9570-7c76ea8942f7 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 206476b7-d805-4c6c-b7fb-db8b5c2a94a6] Found default for hw_pointer_model of None {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:11:17.044793 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-9a1b1d47-e44a-4eef-9570-7c76ea8942f7 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 206476b7-d805-4c6c-b7fb-db8b5c2a94a6] Found default for hw_video_model of virtio {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:11:17.045205 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-9a1b1d47-e44a-4eef-9570-7c76ea8942f7 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 206476b7-d805-4c6c-b7fb-db8b5c2a94a6] Found default for hw_vif_model of virtio {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:11:17.073106 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:17.113361 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Calling os-brick to attach iSCSI Volume {{(pid=98431) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 11 23:11:17.114147 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c', 'iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '23264eac-8f91-4074-b3b0-51b6cb738b7c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 11 23:11:17.114147 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 11 23:11:17.114321 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 11 23:11:17.114477 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c', 'iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '23264eac-8f91-4074-b3b0-51b6cb738b7c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98431) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 11 23:11:17.133095 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 11 23:11:17.134620 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 11 23:11:17.134620 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 11 23:11:17.135662 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.iscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 11 23:11:17.135662 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 11 23:11:17.135662 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.iscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 11 23:11:17.151497 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 11 23:11:17.151497 np0000002687 nova-compute[98431]: {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:17.159272 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 11 23:11:17.159272 np0000002687 nova-compute[98431]: {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:17.169722 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c] added Jun 11 23:11:17.169722 np0000002687 nova-compute[98431]: stderr=iscsiadm: Config file line 363 does not have value Jun 11 23:11:17.169722 np0000002687 nova-compute[98431]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 11 23:11:17.169722 np0000002687 nova-compute[98431]: iscsiadm: Config file line 363 does not have value Jun 11 23:11:17.169722 np0000002687 nova-compute[98431]: iscsiadm: Config file line 363 does not have value Jun 11 23:11:17.169722 np0000002687 nova-compute[98431]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 11 23:11:17.169722 np0000002687 nova-compute[98431]: {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:17.170087 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98431) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 11 23:11:17.170426 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0355(s), this was the 1st time calling it. {{(pid=98431) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 11 23:11:17.170665 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98431) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 11 23:11:17.172990 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c] added Jun 11 23:11:17.172990 np0000002687 nova-compute[98431]: stderr=iscsiadm: Config file line 363 does not have value Jun 11 23:11:17.172990 np0000002687 nova-compute[98431]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 11 23:11:17.172990 np0000002687 nova-compute[98431]: iscsiadm: Config file line 363 does not have value Jun 11 23:11:17.172990 np0000002687 nova-compute[98431]: iscsiadm: Config file line 363 does not have value Jun 11 23:11:17.172990 np0000002687 nova-compute[98431]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 11 23:11:17.172990 np0000002687 nova-compute[98431]: {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:17.173287 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98431) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 11 23:11:17.173432 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.038(s), this was the 1st time calling it. {{(pid=98431) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 11 23:11:17.173583 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98431) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 11 23:11:17.343509 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Successfully updated port: 852fc4ec-82e1-4185-a33c-3c45ff42351e {{(pid=98431) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 11 23:11:17.415221 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-342c7544-ed93-46e3-815b-0d403613aae7 req-25902bdd-2e93-4018-886b-7ed66b150d1d service nova] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Received event network-changed-852fc4ec-82e1-4185-a33c-3c45ff42351e {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:11:17.416394 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-342c7544-ed93-46e3-815b-0d403613aae7 req-25902bdd-2e93-4018-886b-7ed66b150d1d service nova] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Refreshing instance network info cache due to event network-changed-852fc4ec-82e1-4185-a33c-3c45ff42351e. {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 11 23:11:17.416394 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-342c7544-ed93-46e3-815b-0d403613aae7 req-25902bdd-2e93-4018-886b-7ed66b150d1d service nova] Acquiring lock "refresh_cache-c82748e6-1c78-4372-ad4b-48d1c6448efa" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 11 23:11:17.416394 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-342c7544-ed93-46e3-815b-0d403613aae7 req-25902bdd-2e93-4018-886b-7ed66b150d1d service nova] Acquired lock "refresh_cache-c82748e6-1c78-4372-ad4b-48d1c6448efa" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 11 23:11:17.417010 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-342c7544-ed93-46e3-815b-0d403613aae7 req-25902bdd-2e93-4018-886b-7ed66b150d1d service nova] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Refreshing network info cache for port 852fc4ec-82e1-4185-a33c-3c45ff42351e {{(pid=98431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 11 23:11:17.504388 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 206476b7-d805-4c6c-b7fb-db8b5c2a94a6] During sync_power_state the instance has a pending task (spawning). Skip. Jun 11 23:11:17.504723 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Emitting event Paused> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:11:17.504919 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 206476b7-d805-4c6c-b7fb-db8b5c2a94a6] VM Paused (Lifecycle Event) Jun 11 23:11:17.529761 np0000002687 nova-compute[98431]: INFO nova.virt.block_device [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Booting with blank volume at /dev/vda Jun 11 23:11:17.564855 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-9a1b1d47-e44a-4eef-9570-7c76ea8942f7 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 206476b7-d805-4c6c-b7fb-db8b5c2a94a6] Took 7.05 seconds to spawn the instance on the hypervisor. Jun 11 23:11:17.565049 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-9a1b1d47-e44a-4eef-9570-7c76ea8942f7 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 206476b7-d805-4c6c-b7fb-db8b5c2a94a6] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:11:17.593674 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:17.602709 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:17.847163 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Acquiring lock "refresh_cache-c82748e6-1c78-4372-ad4b-48d1c6448efa" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 11 23:11:17.922429 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [req-342c7544-ed93-46e3-815b-0d403613aae7 req-25902bdd-2e93-4018-886b-7ed66b150d1d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:11:17.967957 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-4ff532bd-4c72-4ff3-bfc7-dba2f01ab133 req-2d193ec3-f369-4dc3-aa32-c7f32b60eca0 service nova] [instance: 206476b7-d805-4c6c-b7fb-db8b5c2a94a6] Received event network-vif-plugged-4ba0e6d8-03d5-4849-8b1a-ca9b093ff8be {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:11:17.968221 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-4ff532bd-4c72-4ff3-bfc7-dba2f01ab133 req-2d193ec3-f369-4dc3-aa32-c7f32b60eca0 service nova] Acquiring lock "206476b7-d805-4c6c-b7fb-db8b5c2a94a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:11:17.968434 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-4ff532bd-4c72-4ff3-bfc7-dba2f01ab133 req-2d193ec3-f369-4dc3-aa32-c7f32b60eca0 service nova] Lock "206476b7-d805-4c6c-b7fb-db8b5c2a94a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:11:17.968597 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-4ff532bd-4c72-4ff3-bfc7-dba2f01ab133 req-2d193ec3-f369-4dc3-aa32-c7f32b60eca0 service nova] Lock "206476b7-d805-4c6c-b7fb-db8b5c2a94a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:11:17.969822 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-4ff532bd-4c72-4ff3-bfc7-dba2f01ab133 req-2d193ec3-f369-4dc3-aa32-c7f32b60eca0 service nova] [instance: 206476b7-d805-4c6c-b7fb-db8b5c2a94a6] No waiting events found dispatching network-vif-plugged-4ba0e6d8-03d5-4849-8b1a-ca9b093ff8be {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:11:17.969822 np0000002687 nova-compute[98431]: WARNING nova.compute.manager [req-4ff532bd-4c72-4ff3-bfc7-dba2f01ab133 req-2d193ec3-f369-4dc3-aa32-c7f32b60eca0 service nova] [instance: 206476b7-d805-4c6c-b7fb-db8b5c2a94a6] Received unexpected event network-vif-plugged-4ba0e6d8-03d5-4849-8b1a-ca9b093ff8be for instance with vm_state active and task_state None. Jun 11 23:11:18.007701 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 206476b7-d805-4c6c-b7fb-db8b5c2a94a6] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:11:18.010206 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Emitting event Resumed> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:11:18.010336 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 206476b7-d805-4c6c-b7fb-db8b5c2a94a6] VM Resumed (Lifecycle Event) Jun 11 23:11:18.031685 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-342c7544-ed93-46e3-815b-0d403613aae7 req-25902bdd-2e93-4018-886b-7ed66b150d1d service nova] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Instance cache missing network info. {{(pid=98431) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 11 23:11:18.078982 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-9a1b1d47-e44a-4eef-9570-7c76ea8942f7 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 206476b7-d805-4c6c-b7fb-db8b5c2a94a6] Took 15.70 seconds to build instance. Jun 11 23:11:18.173264 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.iscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 11 23:11:18.174552 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.iscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 11 23:11:18.190212 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 11 23:11:18.190212 np0000002687 nova-compute[98431]: node.name = iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c Jun 11 23:11:18.190212 np0000002687 nova-compute[98431]: node.tpgt = -1 Jun 11 23:11:18.190212 np0000002687 nova-compute[98431]: node.startup = manual Jun 11 23:11:18.190212 np0000002687 nova-compute[98431]: node.leading_login = No Jun 11 23:11:18.190212 np0000002687 nova-compute[98431]: iface.iscsi_ifacename = default Jun 11 23:11:18.190212 np0000002687 nova-compute[98431]: iface.net_ifacename = Jun 11 23:11:18.190212 np0000002687 nova-compute[98431]: iface.ipaddress = Jun 11 23:11:18.190212 np0000002687 nova-compute[98431]: iface.prefix_len = 0 Jun 11 23:11:18.190212 np0000002687 nova-compute[98431]: iface.hwaddress = Jun 11 23:11:18.190212 np0000002687 nova-compute[98431]: iface.transport_name = tcp Jun 11 23:11:18.190212 np0000002687 nova-compute[98431]: iface.initiatorname = Jun 11 23:11:18.190212 np0000002687 nova-compute[98431]: iface.state = Jun 11 23:11:18.190212 np0000002687 nova-compute[98431]: iface.vlan_id = 0 Jun 11 23:11:18.190212 np0000002687 nova-compute[98431]: iface.vlan_priority = 0 Jun 11 23:11:18.190212 np0000002687 nova-compute[98431]: iface.vlan_state = Jun 11 23:11:18.190212 np0000002687 nova-compute[98431]: iface.iface_num = 0 Jun 11 23:11:18.190212 np0000002687 nova-compute[98431]: iface.mtu = 0 Jun 11 23:11:18.190212 np0000002687 nova-compute[98431]: iface.port = 0 Jun 11 23:11:18.190212 np0000002687 nova-compute[98431]: iface.bootproto = Jun 11 23:11:18.190212 np0000002687 nova-compute[98431]: iface.subnet_mask = Jun 11 23:11:18.190212 np0000002687 nova-compute[98431]: iface.gateway = Jun 11 23:11:18.190212 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id_state = Jun 11 23:11:18.190212 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id = Jun 11 23:11:18.190212 np0000002687 nova-compute[98431]: iface.dhcp_dns = Jun 11 23:11:18.190212 np0000002687 nova-compute[98431]: iface.dhcp_learn_iqn = Jun 11 23:11:18.190212 np0000002687 nova-compute[98431]: iface.dhcp_req_vendor_id_state = Jun 11 23:11:18.190212 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id_state = Jun 11 23:11:18.190212 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id = Jun 11 23:11:18.190212 np0000002687 nova-compute[98431]: iface.dhcp_slp_da = Jun 11 23:11:18.190212 np0000002687 nova-compute[98431]: iface.fragmentation = Jun 11 23:11:18.190212 np0000002687 nova-compute[98431]: iface.gratuitous_arp = Jun 11 23:11:18.190212 np0000002687 nova-compute[98431]: iface.incoming_forwarding = Jun 11 23:11:18.190212 np0000002687 nova-compute[98431]: iface.tos_state = Jun 11 23:11:18.190212 np0000002687 nova-compute[98431]: iface.tos = 0 Jun 11 23:11:18.190212 np0000002687 nova-compute[98431]: iface.ttl = 0 Jun 11 23:11:18.190212 np0000002687 nova-compute[98431]: iface.delayed_ack = Jun 11 23:11:18.190212 np0000002687 nova-compute[98431]: iface.tcp_nagle = Jun 11 23:11:18.190212 np0000002687 nova-compute[98431]: iface.tcp_wsf_state = Jun 11 23:11:18.190212 np0000002687 nova-compute[98431]: iface.tcp_wsf = 0 Jun 11 23:11:18.190212 np0000002687 nova-compute[98431]: iface.tcp_timer_scale = 0 Jun 11 23:11:18.190212 np0000002687 nova-compute[98431]: iface.tcp_timestamp = Jun 11 23:11:18.190212 np0000002687 nova-compute[98431]: iface.redirect = Jun 11 23:11:18.190212 np0000002687 nova-compute[98431]: iface.def_task_mgmt_timeout = 0 Jun 11 23:11:18.190212 np0000002687 nova-compute[98431]: iface.header_digest = Jun 11 23:11:18.190212 np0000002687 nova-compute[98431]: iface.data_digest = Jun 11 23:11:18.190212 np0000002687 nova-compute[98431]: iface.immediate_data = Jun 11 23:11:18.190212 np0000002687 nova-compute[98431]: iface.initial_r2t = Jun 11 23:11:18.190212 np0000002687 nova-compute[98431]: iface.data_seq_inorder = Jun 11 23:11:18.190212 np0000002687 nova-compute[98431]: iface.data_pdu_inorder = Jun 11 23:11:18.190212 np0000002687 nova-compute[98431]: iface.erl = 0 Jun 11 23:11:18.190212 np0000002687 nova-compute[98431]: iface.max_receive_data_len = 0 Jun 11 23:11:18.190212 np0000002687 nova-compute[98431]: iface.first_burst_len = 0 Jun 11 23:11:18.190212 np0000002687 nova-compute[98431]: iface.max_outstanding_r2t = 0 Jun 11 23:11:18.190212 np0000002687 nova-compute[98431]: iface.max_burst_len = 0 Jun 11 23:11:18.190212 np0000002687 nova-compute[98431]: iface.chap_auth = Jun 11 23:11:18.190212 np0000002687 nova-compute[98431]: iface.bidi_chap = Jun 11 23:11:18.190212 np0000002687 nova-compute[98431]: iface.strict_login_compliance = Jun 11 23:11:18.190212 np0000002687 nova-compute[98431]: iface.discovery_auth = Jun 11 23:11:18.190212 np0000002687 nova-compute[98431]: iface.discovery_logout = Jun 11 23:11:18.190212 np0000002687 nova-compute[98431]: node.discovery_address = Jun 11 23:11:18.190212 np0000002687 nova-compute[98431]: node.discovery_port = 0 Jun 11 23:11:18.190212 np0000002687 nova-compute[98431]: node.discovery_type = fw Jun 11 23:11:18.190212 np0000002687 nova-compute[98431]: node.session.initial_cmdsn = 0 Jun 11 23:11:18.190212 np0000002687 nova-compute[98431]: node.session.initial_login_retry_max = 8 Jun 11 23:11:18.190212 np0000002687 nova-compute[98431]: node.session.xmit_thread_priority = 0 Jun 11 23:11:18.190212 np0000002687 nova-compute[98431]: node.session.cmds_max = 128 Jun 11 23:11:18.190212 np0000002687 nova-compute[98431]: node.session.queue_depth = 32 Jun 11 23:11:18.190212 np0000002687 nova-compute[98431]: node.session.nr_sessions = 1 Jun 11 23:11:18.190212 np0000002687 nova-compute[98431]: node.session.auth.authmethod = None Jun 11 23:11:18.190212 np0000002687 nova-compute[98431]: node.session.auth.username = Jun 11 23:11:18.190212 np0000002687 nova-compute[98431]: node.session.auth.password = *** Jun 11 23:11:18.190212 np0000002687 nova-compute[98431]: node.session.auth.username_in = Jun 11 23:11:18.190212 np0000002687 nova-compute[98431]: node.session.auth.password_in = Jun 11 23:11:18.190212 np0000002687 nova-compute[98431]: node.session.auth.chap_algs = SHA256 Jun 11 23:11:18.190212 np0000002687 nova-compute[98431]: node.session.timeo.replacement_timeout = 120 Jun 11 23:11:18.190212 np0000002687 nova-compute[98431]: node.session.err_timeo.abort_timeout = 15 Jun 11 23:11:18.190212 np0000002687 nova-compute[98431]: node.session.err_timeo.lu_reset_timeout = 30 Jun 11 23:11:18.190212 np0000002687 nova-compute[98431]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 11 23:11:18.190212 np0000002687 nova-compute[98431]: node.session.err_timeo.host_reset_timeout = 60 Jun 11 23:11:18.190212 np0000002687 nova-compute[98431]: node.session.iscsi.FastAbort = Yes Jun 11 23:11:18.190212 np0000002687 nova-compute[98431]: node.session.iscsi.InitialR2T = No Jun 11 23:11:18.190212 np0000002687 nova-compute[98431]: node.session.iscsi.ImmediateData = Yes Jun 11 23:11:18.190212 np0000002687 nova-compute[98431]: node.session.iscsi.FirstBurstLength = 262144 Jun 11 23:11:18.190212 np0000002687 nova-compute[98431]: node.session.iscsi.MaxBurstLength = 16776192 Jun 11 23:11:18.190212 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Retain = 0 Jun 11 23:11:18.190212 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Wait = 2 Jun 11 23:11:18.190212 np0000002687 nova-compute[98431]: node.session.iscsi.MaxConnections = 1 Jun 11 23:11:18.190212 np0000002687 nova-compute[98431]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 11 23:11:18.190212 np0000002687 nova-compute[98431]: node.session.iscsi.ERL = 0 Jun 11 23:11:18.190212 np0000002687 nova-compute[98431]: node.session.scan = auto Jun 11 23:11:18.190212 np0000002687 nova-compute[98431]: node.session.reopen_max = 0 Jun 11 23:11:18.190212 np0000002687 nova-compute[98431]: node.conn[0].address = 192.168.50.100 Jun 11 23:11:18.190212 np0000002687 nova-compute[98431]: node.conn[0].port = 3260 Jun 11 23:11:18.190212 np0000002687 nova-compute[98431]: node.conn[0].startup = manual Jun 11 23:11:18.190212 np0000002687 nova-compute[98431]: node.conn[0].tcp.window_size = 524288 Jun 11 23:11:18.190212 np0000002687 nova-compute[98431]: node.conn[0].tcp.type_of_service = 0 Jun 11 23:11:18.190212 np0000002687 nova-compute[98431]: node.conn[0].timeo.logout_timeout = 15 Jun 11 23:11:18.190212 np0000002687 nova-compute[98431]: node.conn[0].timeo.login_timeout = 15 Jun 11 23:11:18.190212 np0000002687 nova-compute[98431]: node.conn[0].timeo.auth_timeout = 45 Jun 11 23:11:18.190212 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_interval = 5 Jun 11 23:11:18.190212 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_timeout = 5 Jun 11 23:11:18.190212 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 11 23:11:18.190212 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 11 23:11:18.190212 np0000002687 nova-compute[98431]: node.conn[0].iscsi.HeaderDigest = None Jun 11 23:11:18.190212 np0000002687 nova-compute[98431]: node.conn[0].iscsi.DataDigest = None Jun 11 23:11:18.190212 np0000002687 nova-compute[98431]: node.conn[0].iscsi.IFMarker = No Jun 11 23:11:18.190212 np0000002687 nova-compute[98431]: node.conn[0].iscsi.OFMarker = No Jun 11 23:11:18.190212 np0000002687 nova-compute[98431]: # END RECORD Jun 11 23:11:18.190212 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:18.199426 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 11 23:11:18.199426 np0000002687 nova-compute[98431]: node.name = iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c Jun 11 23:11:18.199426 np0000002687 nova-compute[98431]: node.tpgt = -1 Jun 11 23:11:18.199426 np0000002687 nova-compute[98431]: node.startup = manual Jun 11 23:11:18.199426 np0000002687 nova-compute[98431]: node.leading_login = No Jun 11 23:11:18.199426 np0000002687 nova-compute[98431]: iface.iscsi_ifacename = default Jun 11 23:11:18.199426 np0000002687 nova-compute[98431]: iface.net_ifacename = Jun 11 23:11:18.199426 np0000002687 nova-compute[98431]: iface.ipaddress = Jun 11 23:11:18.199426 np0000002687 nova-compute[98431]: iface.prefix_len = 0 Jun 11 23:11:18.199426 np0000002687 nova-compute[98431]: iface.hwaddress = Jun 11 23:11:18.199426 np0000002687 nova-compute[98431]: iface.transport_name = tcp Jun 11 23:11:18.199426 np0000002687 nova-compute[98431]: iface.initiatorname = Jun 11 23:11:18.199426 np0000002687 nova-compute[98431]: iface.state = Jun 11 23:11:18.199426 np0000002687 nova-compute[98431]: iface.vlan_id = 0 Jun 11 23:11:18.199426 np0000002687 nova-compute[98431]: iface.vlan_priority = 0 Jun 11 23:11:18.199426 np0000002687 nova-compute[98431]: iface.vlan_state = Jun 11 23:11:18.199426 np0000002687 nova-compute[98431]: iface.iface_num = 0 Jun 11 23:11:18.199426 np0000002687 nova-compute[98431]: iface.mtu = 0 Jun 11 23:11:18.199426 np0000002687 nova-compute[98431]: iface.port = 0 Jun 11 23:11:18.199426 np0000002687 nova-compute[98431]: iface.bootproto = Jun 11 23:11:18.199426 np0000002687 nova-compute[98431]: iface.subnet_mask = Jun 11 23:11:18.199426 np0000002687 nova-compute[98431]: iface.gateway = Jun 11 23:11:18.199426 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id_state = Jun 11 23:11:18.199426 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id = Jun 11 23:11:18.199426 np0000002687 nova-compute[98431]: iface.dhcp_dns = Jun 11 23:11:18.199426 np0000002687 nova-compute[98431]: iface.dhcp_learn_iqn = Jun 11 23:11:18.199426 np0000002687 nova-compute[98431]: iface.dhcp_req_vendor_id_state = Jun 11 23:11:18.199426 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id_state = Jun 11 23:11:18.199426 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id = Jun 11 23:11:18.199426 np0000002687 nova-compute[98431]: iface.dhcp_slp_da = Jun 11 23:11:18.199426 np0000002687 nova-compute[98431]: iface.fragmentation = Jun 11 23:11:18.199426 np0000002687 nova-compute[98431]: iface.gratuitous_arp = Jun 11 23:11:18.199426 np0000002687 nova-compute[98431]: iface.incoming_forwarding = Jun 11 23:11:18.199426 np0000002687 nova-compute[98431]: iface.tos_state = Jun 11 23:11:18.199426 np0000002687 nova-compute[98431]: iface.tos = 0 Jun 11 23:11:18.199426 np0000002687 nova-compute[98431]: iface.ttl = 0 Jun 11 23:11:18.199426 np0000002687 nova-compute[98431]: iface.delayed_ack = Jun 11 23:11:18.199426 np0000002687 nova-compute[98431]: iface.tcp_nagle = Jun 11 23:11:18.199426 np0000002687 nova-compute[98431]: iface.tcp_wsf_state = Jun 11 23:11:18.199426 np0000002687 nova-compute[98431]: iface.tcp_wsf = 0 Jun 11 23:11:18.199426 np0000002687 nova-compute[98431]: iface.tcp_timer_scale = 0 Jun 11 23:11:18.199426 np0000002687 nova-compute[98431]: iface.tcp_timestamp = Jun 11 23:11:18.199426 np0000002687 nova-compute[98431]: iface.redirect = Jun 11 23:11:18.199426 np0000002687 nova-compute[98431]: iface.def_task_mgmt_timeout = 0 Jun 11 23:11:18.199426 np0000002687 nova-compute[98431]: iface.header_digest = Jun 11 23:11:18.199426 np0000002687 nova-compute[98431]: iface.data_digest = Jun 11 23:11:18.199426 np0000002687 nova-compute[98431]: iface.immediate_data = Jun 11 23:11:18.199426 np0000002687 nova-compute[98431]: iface.initial_r2t = Jun 11 23:11:18.199426 np0000002687 nova-compute[98431]: iface.data_seq_inorder = Jun 11 23:11:18.199426 np0000002687 nova-compute[98431]: iface.data_pdu_inorder = Jun 11 23:11:18.199426 np0000002687 nova-compute[98431]: iface.erl = 0 Jun 11 23:11:18.199426 np0000002687 nova-compute[98431]: iface.max_receive_data_len = 0 Jun 11 23:11:18.199426 np0000002687 nova-compute[98431]: iface.first_burst_len = 0 Jun 11 23:11:18.199426 np0000002687 nova-compute[98431]: iface.max_outstanding_r2t = 0 Jun 11 23:11:18.199426 np0000002687 nova-compute[98431]: iface.max_burst_len = 0 Jun 11 23:11:18.199426 np0000002687 nova-compute[98431]: iface.chap_auth = Jun 11 23:11:18.199426 np0000002687 nova-compute[98431]: iface.bidi_chap = Jun 11 23:11:18.199426 np0000002687 nova-compute[98431]: iface.strict_login_compliance = Jun 11 23:11:18.199426 np0000002687 nova-compute[98431]: iface.discovery_auth = Jun 11 23:11:18.199426 np0000002687 nova-compute[98431]: iface.discovery_logout = Jun 11 23:11:18.199426 np0000002687 nova-compute[98431]: node.discovery_address = Jun 11 23:11:18.199426 np0000002687 nova-compute[98431]: node.discovery_port = 0 Jun 11 23:11:18.199426 np0000002687 nova-compute[98431]: node.discovery_type = fw Jun 11 23:11:18.199426 np0000002687 nova-compute[98431]: node.session.initial_cmdsn = 0 Jun 11 23:11:18.199426 np0000002687 nova-compute[98431]: node.session.initial_login_retry_max = 8 Jun 11 23:11:18.199426 np0000002687 nova-compute[98431]: node.session.xmit_thread_priority = 0 Jun 11 23:11:18.199426 np0000002687 nova-compute[98431]: node.session.cmds_max = 128 Jun 11 23:11:18.199426 np0000002687 nova-compute[98431]: node.session.queue_depth = 32 Jun 11 23:11:18.199426 np0000002687 nova-compute[98431]: node.session.nr_sessions = 1 Jun 11 23:11:18.199426 np0000002687 nova-compute[98431]: node.session.auth.authmethod = None Jun 11 23:11:18.199426 np0000002687 nova-compute[98431]: node.session.auth.username = Jun 11 23:11:18.199426 np0000002687 nova-compute[98431]: node.session.auth.password = *** Jun 11 23:11:18.199426 np0000002687 nova-compute[98431]: node.session.auth.username_in = Jun 11 23:11:18.199426 np0000002687 nova-compute[98431]: node.session.auth.password_in = Jun 11 23:11:18.199426 np0000002687 nova-compute[98431]: node.session.auth.chap_algs = SHA256 Jun 11 23:11:18.199426 np0000002687 nova-compute[98431]: node.session.timeo.replacement_timeout = 120 Jun 11 23:11:18.199426 np0000002687 nova-compute[98431]: node.session.err_timeo.abort_timeout = 15 Jun 11 23:11:18.199426 np0000002687 nova-compute[98431]: node.session.err_timeo.lu_reset_timeout = 30 Jun 11 23:11:18.199426 np0000002687 nova-compute[98431]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 11 23:11:18.199426 np0000002687 nova-compute[98431]: node.session.err_timeo.host_reset_timeout = 60 Jun 11 23:11:18.199426 np0000002687 nova-compute[98431]: node.session.iscsi.FastAbort = Yes Jun 11 23:11:18.199426 np0000002687 nova-compute[98431]: node.session.iscsi.InitialR2T = No Jun 11 23:11:18.199426 np0000002687 nova-compute[98431]: node.session.iscsi.ImmediateData = Yes Jun 11 23:11:18.199426 np0000002687 nova-compute[98431]: node.session.iscsi.FirstBurstLength = 262144 Jun 11 23:11:18.199426 np0000002687 nova-compute[98431]: node.session.iscsi.MaxBurstLength = 16776192 Jun 11 23:11:18.199426 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Retain = 0 Jun 11 23:11:18.199426 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Wait = 2 Jun 11 23:11:18.199426 np0000002687 nova-compute[98431]: node.session.iscsi.MaxConnections = 1 Jun 11 23:11:18.199426 np0000002687 nova-compute[98431]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 11 23:11:18.199426 np0000002687 nova-compute[98431]: node.session.iscsi.ERL = 0 Jun 11 23:11:18.199426 np0000002687 nova-compute[98431]: node.session.scan = auto Jun 11 23:11:18.199426 np0000002687 nova-compute[98431]: node.session.reopen_max = 0 Jun 11 23:11:18.199426 np0000002687 nova-compute[98431]: node.conn[0].address = 192.168.40.100 Jun 11 23:11:18.199426 np0000002687 nova-compute[98431]: node.conn[0].port = 3260 Jun 11 23:11:18.199426 np0000002687 nova-compute[98431]: node.conn[0].startup = manual Jun 11 23:11:18.199426 np0000002687 nova-compute[98431]: node.conn[0].tcp.window_size = 524288 Jun 11 23:11:18.199426 np0000002687 nova-compute[98431]: node.conn[0].tcp.type_of_service = 0 Jun 11 23:11:18.199426 np0000002687 nova-compute[98431]: node.conn[0].timeo.logout_timeout = 15 Jun 11 23:11:18.199426 np0000002687 nova-compute[98431]: node.conn[0].timeo.login_timeout = 15 Jun 11 23:11:18.199426 np0000002687 nova-compute[98431]: node.conn[0].timeo.auth_timeout = 45 Jun 11 23:11:18.199426 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_interval = 5 Jun 11 23:11:18.199426 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_timeout = 5 Jun 11 23:11:18.199426 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 11 23:11:18.199426 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 11 23:11:18.199426 np0000002687 nova-compute[98431]: node.conn[0].iscsi.HeaderDigest = None Jun 11 23:11:18.199426 np0000002687 nova-compute[98431]: node.conn[0].iscsi.DataDigest = None Jun 11 23:11:18.199426 np0000002687 nova-compute[98431]: node.conn[0].iscsi.IFMarker = No Jun 11 23:11:18.199426 np0000002687 nova-compute[98431]: node.conn[0].iscsi.OFMarker = No Jun 11 23:11:18.199426 np0000002687 nova-compute[98431]: # END RECORD Jun 11 23:11:18.199426 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:18.211992 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:18.223135 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:18.236192 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:18.236192 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:18.236192 np0000002687 nova-compute[98431]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:18.236192 np0000002687 nova-compute[98431]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:18.236192 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:11:18.236564 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:18.236564 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:18.236564 np0000002687 nova-compute[98431]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:18.236564 np0000002687 nova-compute[98431]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:18.236564 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:11:18.244692 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-342c7544-ed93-46e3-815b-0d403613aae7 req-25902bdd-2e93-4018-886b-7ed66b150d1d service nova] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Updating instance_info_cache with network_info: [] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:11:18.246085 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:18.246085 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:18.246085 np0000002687 nova-compute[98431]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:18.246085 np0000002687 nova-compute[98431]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:18.246085 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:11:18.246266 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:18.246266 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:18.246266 np0000002687 nova-compute[98431]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:18.246266 np0000002687 nova-compute[98431]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:18.246266 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:11:18.302972 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c, portal: 192.168.50.100,3260] Jun 11 23:11:18.302972 np0000002687 nova-compute[98431]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c, portal: 192.168.50.100,3260] successful. Jun 11 23:11:18.302972 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:18.315376 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c, portal: 192.168.40.100,3260] Jun 11 23:11:18.315376 np0000002687 nova-compute[98431]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c, portal: 192.168.40.100,3260] successful. Jun 11 23:11:18.315376 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:18.316076 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:18.334882 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:18.341479 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:18.341479 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:18.341479 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:18.341479 np0000002687 nova-compute[98431]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:18.341479 np0000002687 nova-compute[98431]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:18.341479 np0000002687 nova-compute[98431]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:18.341479 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:11:18.341712 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:18.341712 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:18.341712 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:18.341712 np0000002687 nova-compute[98431]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:18.341712 np0000002687 nova-compute[98431]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:18.341712 np0000002687 nova-compute[98431]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:18.341712 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:11:18.341969 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.208s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 11 23:11:18.342117 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Connected to 192.168.50.100:3260 {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 11 23:11:18.343298 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] HCTL ('11', '-', '-', 0) found on session 9 with lun 0 {{(pid=98431) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 11 23:11:18.343671 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98431) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 11 23:11:18.354091 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:18.354091 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:18.354091 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:18.354091 np0000002687 nova-compute[98431]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:18.354091 np0000002687 nova-compute[98431]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:18.354091 np0000002687 nova-compute[98431]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:18.354091 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:11:18.354091 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:18.354091 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:18.354091 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:18.354091 np0000002687 nova-compute[98431]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:18.354091 np0000002687 nova-compute[98431]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:18.354091 np0000002687 nova-compute[98431]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:18.354091 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:11:18.354091 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.219s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 11 23:11:18.354545 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Connected to 192.168.40.100:3260 {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 11 23:11:18.356335 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] HCTL ('12', '-', '-', 0) found on session 10 with lun 0 {{(pid=98431) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 11 23:11:18.356335 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98431) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 11 23:11:18.369989 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Searching for a device in session 9 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98431) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 11 23:11:18.370322 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '23264eac-8f91-4074-b3b0-51b6cb738b7c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 11 23:11:18.377056 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Searching for a device in session 10 and hctl ['12', '*', '*', 0] yield: None {{(pid=98431) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 11 23:11:18.513086 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 206476b7-d805-4c6c-b7fb-db8b5c2a94a6] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:11:18.515360 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 206476b7-d805-4c6c-b7fb-db8b5c2a94a6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98431) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 11 23:11:18.583767 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-9a1b1d47-e44a-4eef-9570-7c76ea8942f7 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "206476b7-d805-4c6c-b7fb-db8b5c2a94a6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 17.216s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:11:18.747580 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-342c7544-ed93-46e3-815b-0d403613aae7 req-25902bdd-2e93-4018-886b-7ed66b150d1d service nova] Releasing lock "refresh_cache-c82748e6-1c78-4372-ad4b-48d1c6448efa" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 11 23:11:18.748681 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Acquired lock "refresh_cache-c82748e6-1c78-4372-ad4b-48d1c6448efa" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 11 23:11:18.749791 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Building network info cache for instance {{(pid=98431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 11 23:11:19.330851 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Instance cache missing network info. {{(pid=98431) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 11 23:11:19.378966 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Searching for a device in session 10 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98431) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 11 23:11:19.378966 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '23264eac-8f91-4074-b3b0-51b6cb738b7c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 11 23:11:19.540053 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:11:19.813307 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Updating instance_info_cache with network_info: [{"id": "852fc4ec-82e1-4185-a33c-3c45ff42351e", "address": "fa:16:3e:c6:c6:5b", "network": {"id": "2a770c99-2ec6-4fa2-945b-32830a59e7a7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-137493671-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aaf744af828a4a5eba1e98da63373b2b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap852fc4ec-82", "ovs_interfaceid": "852fc4ec-82e1-4185-a33c-3c45ff42351e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:11:20.052133 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-1411379c-46d2-4394-9f6b-81b9290ab945 req-5a1c88a5-2205-4bf5-a84a-4f9aaeadfa3c service nova] [instance: 206476b7-d805-4c6c-b7fb-db8b5c2a94a6] Received event network-changed-4ba0e6d8-03d5-4849-8b1a-ca9b093ff8be {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:11:20.052839 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-1411379c-46d2-4394-9f6b-81b9290ab945 req-5a1c88a5-2205-4bf5-a84a-4f9aaeadfa3c service nova] [instance: 206476b7-d805-4c6c-b7fb-db8b5c2a94a6] Refreshing instance network info cache due to event network-changed-4ba0e6d8-03d5-4849-8b1a-ca9b093ff8be. {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 11 23:11:20.053066 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-1411379c-46d2-4394-9f6b-81b9290ab945 req-5a1c88a5-2205-4bf5-a84a-4f9aaeadfa3c service nova] Acquiring lock "refresh_cache-206476b7-d805-4c6c-b7fb-db8b5c2a94a6" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 11 23:11:20.053202 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-1411379c-46d2-4394-9f6b-81b9290ab945 req-5a1c88a5-2205-4bf5-a84a-4f9aaeadfa3c service nova] Acquired lock "refresh_cache-206476b7-d805-4c6c-b7fb-db8b5c2a94a6" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 11 23:11:20.053344 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-1411379c-46d2-4394-9f6b-81b9290ab945 req-5a1c88a5-2205-4bf5-a84a-4f9aaeadfa3c service nova] [instance: 206476b7-d805-4c6c-b7fb-db8b5c2a94a6] Refreshing network info cache for port 4ba0e6d8-03d5-4849-8b1a-ca9b093ff8be {{(pid=98431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 11 23:11:20.152623 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Found WWN 330000000e04af478 for multipath device dm-6 {{(pid=98431) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 11 23:11:20.152888 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.039s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 11 23:11:20.153155 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] <== connect_volume: return (3039ms) {'type': 'block', 'scsi_wwn': '330000000e04af478', 'path': '/dev/dm-6', 'multipath_id': '330000000e04af478'} {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 11 23:11:20.153270 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000e04af478', 'path': '/dev/dm-6', 'multipath_id': '330000000e04af478'} {{(pid=98431) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 11 23:11:20.315172 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Releasing lock "refresh_cache-c82748e6-1c78-4372-ad4b-48d1c6448efa" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 11 23:11:20.315367 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Instance network_info: |[{"id": "852fc4ec-82e1-4185-a33c-3c45ff42351e", "address": "fa:16:3e:c6:c6:5b", "network": {"id": "2a770c99-2ec6-4fa2-945b-32830a59e7a7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-137493671-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aaf744af828a4a5eba1e98da63373b2b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap852fc4ec-82", "ovs_interfaceid": "852fc4ec-82e1-4185-a33c-3c45ff42351e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98431) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 11 23:11:20.557520 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [req-1411379c-46d2-4394-9f6b-81b9290ab945 req-5a1c88a5-2205-4bf5-a84a-4f9aaeadfa3c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:11:20.663417 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Calling os-brick to attach iSCSI Volume {{(pid=98431) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 11 23:11:20.663795 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff', 'iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0001b9c6-a8d0-4709-88d4-b91656096dff', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 11 23:11:20.663981 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 11 23:11:20.664352 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 11 23:11:20.664713 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff', 'iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0001b9c6-a8d0-4709-88d4-b91656096dff', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98431) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 11 23:11:20.678535 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 11 23:11:20.680001 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 11 23:11:20.681892 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 11 23:11:20.681892 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.iscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 11 23:11:20.681892 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 11 23:11:20.682121 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.iscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 11 23:11:20.699240 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 11 23:11:20.699240 np0000002687 nova-compute[98431]: {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:20.701662 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 11 23:11:20.701662 np0000002687 nova-compute[98431]: {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:20.713435 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff] added Jun 11 23:11:20.713435 np0000002687 nova-compute[98431]: stderr=iscsiadm: Config file line 363 does not have value Jun 11 23:11:20.713435 np0000002687 nova-compute[98431]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 11 23:11:20.713435 np0000002687 nova-compute[98431]: iscsiadm: Config file line 363 does not have value Jun 11 23:11:20.713435 np0000002687 nova-compute[98431]: iscsiadm: Config file line 363 does not have value Jun 11 23:11:20.713435 np0000002687 nova-compute[98431]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 11 23:11:20.713435 np0000002687 nova-compute[98431]: {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:20.713852 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98431) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 11 23:11:20.713852 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0325(s), this was the 1st time calling it. {{(pid=98431) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 11 23:11:20.715132 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98431) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 11 23:11:20.724349 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff] added Jun 11 23:11:20.724349 np0000002687 nova-compute[98431]: stderr=iscsiadm: Config file line 363 does not have value Jun 11 23:11:20.724349 np0000002687 nova-compute[98431]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 11 23:11:20.724349 np0000002687 nova-compute[98431]: iscsiadm: Config file line 363 does not have value Jun 11 23:11:20.724349 np0000002687 nova-compute[98431]: iscsiadm: Config file line 363 does not have value Jun 11 23:11:20.724349 np0000002687 nova-compute[98431]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 11 23:11:20.724349 np0000002687 nova-compute[98431]: {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:20.724349 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98431) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 11 23:11:20.724349 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0414(s), this was the 1st time calling it. {{(pid=98431) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 11 23:11:20.724349 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98431) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 11 23:11:21.006316 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [req-1411379c-46d2-4394-9f6b-81b9290ab945 req-5a1c88a5-2205-4bf5-a84a-4f9aaeadfa3c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:11:21.101166 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.209', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000002687', 'execute': None}" {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 11 23:11:21.113944 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.scaleio [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98431) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 11 23:11:21.139597 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Running cmd (subprocess): nvme version {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:11:21.169924 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] 'nvme version' failed. Not Retrying. {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 11 23:11:21.171038 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.nvmeof [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] nvme not present on system {{(pid=98431) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 11 23:11:21.182242 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.lightos [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98431) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 11 23:11:21.184927 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.lightos [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Current host hostNQN and IP(s) are ['10.4.3.209', 'fe80::f816:3eff:fea3:3707', '192.168.40.6', 'fe80::f816:3eff:fe06:bdab', '192.168.50.6', 'fe80::f816:3eff:fe7a:46f2', '192.168.10.6', 'fe80::f816:3eff:fe13:793b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::38fa:21ff:fe6c:3746', 'fe80::fc16:3eff:fe6c:eb30', 'fe80::20a8:54ff:fe51:da0a', 'fe80::fc16:3eff:feb5:6ffd', 'fe80::4cb3:64ff:fe13:8a75', 'fe80::fc16:3eff:fe8e:8922', 'fe80::4c61:61ff:fe7d:90dc', 'fe80::fc16:3eff:fe77:488d', 'fe80::9469:f2ff:feae:5824', 'fe80::fc16:3eff:febd:951', 'fe80::84b1:8fff:fe59:2d4f', 'fe80::fc16:3eff:fedc:9cb5', 'fe80::f489:94ff:fe75:ec8a', 'fe80::fc16:3eff:fe8a:95c7', 'fe80::fc16:3eff:fec7:336a'] Jun 11 23:11:21.184927 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.lightos [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98431) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 11 23:11:21.184927 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.lightos [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] LIGHTOS: no hostnqn found. {{(pid=98431) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 11 23:11:21.184927 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] <== get_connector_properties: return (82ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.209', 'host': 'np0000002687', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:798b370f1cc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad465dfe-0ed1-4637-98c3-ddaebebd61a4', 'nvme_native_multipath': False} {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 11 23:11:21.184927 np0000002687 nova-compute[98431]: DEBUG nova.virt.block_device [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Updating existing volume attachment record: 825dbf91-4e42-4e4f-af09-fb1a8f94b5f9 {{(pid=98431) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 11 23:11:21.222953 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-1411379c-46d2-4394-9f6b-81b9290ab945 req-5a1c88a5-2205-4bf5-a84a-4f9aaeadfa3c service nova] [instance: 206476b7-d805-4c6c-b7fb-db8b5c2a94a6] Updated VIF entry in instance network info cache for port 4ba0e6d8-03d5-4849-8b1a-ca9b093ff8be. {{(pid=98431) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 11 23:11:21.224075 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-1411379c-46d2-4394-9f6b-81b9290ab945 req-5a1c88a5-2205-4bf5-a84a-4f9aaeadfa3c service nova] [instance: 206476b7-d805-4c6c-b7fb-db8b5c2a94a6] Updating instance_info_cache with network_info: [{"id": "4ba0e6d8-03d5-4849-8b1a-ca9b093ff8be", "address": "fa:16:3e:c7:33:6a", "network": {"id": "17593db3-c22d-4354-ab29-933b1c6a5c3a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1094286565-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "81fd45f475a04e5c8e9bd9deb7ad4c1e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ba0e6d8-03", "ovs_interfaceid": "4ba0e6d8-03d5-4849-8b1a-ca9b093ff8be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:11:21.361714 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-c6ff320a-0a6f-4b1f-93c2-7758a3217053 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Acquiring lock "8ffa4bbe-7ead-4029-aba5-28f031f6e784" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:11:21.362068 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-c6ff320a-0a6f-4b1f-93c2-7758a3217053 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "8ffa4bbe-7ead-4029-aba5-28f031f6e784" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:11:21.715502 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.iscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 11 23:11:21.724092 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.iscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 11 23:11:21.726525 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 11 23:11:21.726525 np0000002687 nova-compute[98431]: node.name = iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff Jun 11 23:11:21.726525 np0000002687 nova-compute[98431]: node.tpgt = -1 Jun 11 23:11:21.726525 np0000002687 nova-compute[98431]: node.startup = manual Jun 11 23:11:21.726525 np0000002687 nova-compute[98431]: node.leading_login = No Jun 11 23:11:21.726525 np0000002687 nova-compute[98431]: iface.iscsi_ifacename = default Jun 11 23:11:21.726525 np0000002687 nova-compute[98431]: iface.net_ifacename = Jun 11 23:11:21.726525 np0000002687 nova-compute[98431]: iface.ipaddress = Jun 11 23:11:21.726525 np0000002687 nova-compute[98431]: iface.prefix_len = 0 Jun 11 23:11:21.726525 np0000002687 nova-compute[98431]: iface.hwaddress = Jun 11 23:11:21.726525 np0000002687 nova-compute[98431]: iface.transport_name = tcp Jun 11 23:11:21.726525 np0000002687 nova-compute[98431]: iface.initiatorname = Jun 11 23:11:21.726525 np0000002687 nova-compute[98431]: iface.state = Jun 11 23:11:21.726525 np0000002687 nova-compute[98431]: iface.vlan_id = 0 Jun 11 23:11:21.726525 np0000002687 nova-compute[98431]: iface.vlan_priority = 0 Jun 11 23:11:21.726525 np0000002687 nova-compute[98431]: iface.vlan_state = Jun 11 23:11:21.726525 np0000002687 nova-compute[98431]: iface.iface_num = 0 Jun 11 23:11:21.726525 np0000002687 nova-compute[98431]: iface.mtu = 0 Jun 11 23:11:21.726525 np0000002687 nova-compute[98431]: iface.port = 0 Jun 11 23:11:21.726525 np0000002687 nova-compute[98431]: iface.bootproto = Jun 11 23:11:21.726525 np0000002687 nova-compute[98431]: iface.subnet_mask = Jun 11 23:11:21.726525 np0000002687 nova-compute[98431]: iface.gateway = Jun 11 23:11:21.726525 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id_state = Jun 11 23:11:21.726525 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id = Jun 11 23:11:21.726525 np0000002687 nova-compute[98431]: iface.dhcp_dns = Jun 11 23:11:21.726525 np0000002687 nova-compute[98431]: iface.dhcp_learn_iqn = Jun 11 23:11:21.726525 np0000002687 nova-compute[98431]: iface.dhcp_req_vendor_id_state = Jun 11 23:11:21.726525 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id_state = Jun 11 23:11:21.726525 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id = Jun 11 23:11:21.726525 np0000002687 nova-compute[98431]: iface.dhcp_slp_da = Jun 11 23:11:21.726525 np0000002687 nova-compute[98431]: iface.fragmentation = Jun 11 23:11:21.726525 np0000002687 nova-compute[98431]: iface.gratuitous_arp = Jun 11 23:11:21.726525 np0000002687 nova-compute[98431]: iface.incoming_forwarding = Jun 11 23:11:21.726525 np0000002687 nova-compute[98431]: iface.tos_state = Jun 11 23:11:21.726525 np0000002687 nova-compute[98431]: iface.tos = 0 Jun 11 23:11:21.726525 np0000002687 nova-compute[98431]: iface.ttl = 0 Jun 11 23:11:21.726525 np0000002687 nova-compute[98431]: iface.delayed_ack = Jun 11 23:11:21.726525 np0000002687 nova-compute[98431]: iface.tcp_nagle = Jun 11 23:11:21.726525 np0000002687 nova-compute[98431]: iface.tcp_wsf_state = Jun 11 23:11:21.726525 np0000002687 nova-compute[98431]: iface.tcp_wsf = 0 Jun 11 23:11:21.726525 np0000002687 nova-compute[98431]: iface.tcp_timer_scale = 0 Jun 11 23:11:21.726525 np0000002687 nova-compute[98431]: iface.tcp_timestamp = Jun 11 23:11:21.726525 np0000002687 nova-compute[98431]: iface.redirect = Jun 11 23:11:21.726525 np0000002687 nova-compute[98431]: iface.def_task_mgmt_timeout = 0 Jun 11 23:11:21.726525 np0000002687 nova-compute[98431]: iface.header_digest = Jun 11 23:11:21.726525 np0000002687 nova-compute[98431]: iface.data_digest = Jun 11 23:11:21.726525 np0000002687 nova-compute[98431]: iface.immediate_data = Jun 11 23:11:21.726525 np0000002687 nova-compute[98431]: iface.initial_r2t = Jun 11 23:11:21.726525 np0000002687 nova-compute[98431]: iface.data_seq_inorder = Jun 11 23:11:21.726525 np0000002687 nova-compute[98431]: iface.data_pdu_inorder = Jun 11 23:11:21.726525 np0000002687 nova-compute[98431]: iface.erl = 0 Jun 11 23:11:21.726525 np0000002687 nova-compute[98431]: iface.max_receive_data_len = 0 Jun 11 23:11:21.726525 np0000002687 nova-compute[98431]: iface.first_burst_len = 0 Jun 11 23:11:21.726525 np0000002687 nova-compute[98431]: iface.max_outstanding_r2t = 0 Jun 11 23:11:21.726525 np0000002687 nova-compute[98431]: iface.max_burst_len = 0 Jun 11 23:11:21.726525 np0000002687 nova-compute[98431]: iface.chap_auth = Jun 11 23:11:21.726525 np0000002687 nova-compute[98431]: iface.bidi_chap = Jun 11 23:11:21.726525 np0000002687 nova-compute[98431]: iface.strict_login_compliance = Jun 11 23:11:21.726525 np0000002687 nova-compute[98431]: iface.discovery_auth = Jun 11 23:11:21.726525 np0000002687 nova-compute[98431]: iface.discovery_logout = Jun 11 23:11:21.726525 np0000002687 nova-compute[98431]: node.discovery_address = Jun 11 23:11:21.726525 np0000002687 nova-compute[98431]: node.discovery_port = 0 Jun 11 23:11:21.726525 np0000002687 nova-compute[98431]: node.discovery_type = fw Jun 11 23:11:21.726525 np0000002687 nova-compute[98431]: node.session.initial_cmdsn = 0 Jun 11 23:11:21.726525 np0000002687 nova-compute[98431]: node.session.initial_login_retry_max = 8 Jun 11 23:11:21.726525 np0000002687 nova-compute[98431]: node.session.xmit_thread_priority = 0 Jun 11 23:11:21.726525 np0000002687 nova-compute[98431]: node.session.cmds_max = 128 Jun 11 23:11:21.726525 np0000002687 nova-compute[98431]: node.session.queue_depth = 32 Jun 11 23:11:21.726525 np0000002687 nova-compute[98431]: node.session.nr_sessions = 1 Jun 11 23:11:21.726525 np0000002687 nova-compute[98431]: node.session.auth.authmethod = None Jun 11 23:11:21.726525 np0000002687 nova-compute[98431]: node.session.auth.username = Jun 11 23:11:21.726525 np0000002687 nova-compute[98431]: node.session.auth.password = *** Jun 11 23:11:21.726525 np0000002687 nova-compute[98431]: node.session.auth.username_in = Jun 11 23:11:21.726525 np0000002687 nova-compute[98431]: node.session.auth.password_in = Jun 11 23:11:21.726525 np0000002687 nova-compute[98431]: node.session.auth.chap_algs = SHA256 Jun 11 23:11:21.726525 np0000002687 nova-compute[98431]: node.session.timeo.replacement_timeout = 120 Jun 11 23:11:21.726525 np0000002687 nova-compute[98431]: node.session.err_timeo.abort_timeout = 15 Jun 11 23:11:21.726525 np0000002687 nova-compute[98431]: node.session.err_timeo.lu_reset_timeout = 30 Jun 11 23:11:21.726525 np0000002687 nova-compute[98431]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 11 23:11:21.726525 np0000002687 nova-compute[98431]: node.session.err_timeo.host_reset_timeout = 60 Jun 11 23:11:21.726525 np0000002687 nova-compute[98431]: node.session.iscsi.FastAbort = Yes Jun 11 23:11:21.726525 np0000002687 nova-compute[98431]: node.session.iscsi.InitialR2T = No Jun 11 23:11:21.726525 np0000002687 nova-compute[98431]: node.session.iscsi.ImmediateData = Yes Jun 11 23:11:21.726525 np0000002687 nova-compute[98431]: node.session.iscsi.FirstBurstLength = 262144 Jun 11 23:11:21.726525 np0000002687 nova-compute[98431]: node.session.iscsi.MaxBurstLength = 16776192 Jun 11 23:11:21.726525 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Retain = 0 Jun 11 23:11:21.726525 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Wait = 2 Jun 11 23:11:21.726525 np0000002687 nova-compute[98431]: node.session.iscsi.MaxConnections = 1 Jun 11 23:11:21.726525 np0000002687 nova-compute[98431]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 11 23:11:21.726525 np0000002687 nova-compute[98431]: node.session.iscsi.ERL = 0 Jun 11 23:11:21.726525 np0000002687 nova-compute[98431]: node.session.scan = auto Jun 11 23:11:21.726525 np0000002687 nova-compute[98431]: node.session.reopen_max = 0 Jun 11 23:11:21.726525 np0000002687 nova-compute[98431]: node.conn[0].address = 192.168.40.100 Jun 11 23:11:21.726525 np0000002687 nova-compute[98431]: node.conn[0].port = 3260 Jun 11 23:11:21.726525 np0000002687 nova-compute[98431]: node.conn[0].startup = manual Jun 11 23:11:21.726525 np0000002687 nova-compute[98431]: node.conn[0].tcp.window_size = 524288 Jun 11 23:11:21.726525 np0000002687 nova-compute[98431]: node.conn[0].tcp.type_of_service = 0 Jun 11 23:11:21.726525 np0000002687 nova-compute[98431]: node.conn[0].timeo.logout_timeout = 15 Jun 11 23:11:21.726525 np0000002687 nova-compute[98431]: node.conn[0].timeo.login_timeout = 15 Jun 11 23:11:21.726525 np0000002687 nova-compute[98431]: node.conn[0].timeo.auth_timeout = 45 Jun 11 23:11:21.726525 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_interval = 5 Jun 11 23:11:21.726525 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_timeout = 5 Jun 11 23:11:21.726525 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 11 23:11:21.726525 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 11 23:11:21.726525 np0000002687 nova-compute[98431]: node.conn[0].iscsi.HeaderDigest = None Jun 11 23:11:21.726525 np0000002687 nova-compute[98431]: node.conn[0].iscsi.DataDigest = None Jun 11 23:11:21.726525 np0000002687 nova-compute[98431]: node.conn[0].iscsi.IFMarker = No Jun 11 23:11:21.726525 np0000002687 nova-compute[98431]: node.conn[0].iscsi.OFMarker = No Jun 11 23:11:21.726525 np0000002687 nova-compute[98431]: # END RECORD Jun 11 23:11:21.726525 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:21.728380 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-1411379c-46d2-4394-9f6b-81b9290ab945 req-5a1c88a5-2205-4bf5-a84a-4f9aaeadfa3c service nova] Releasing lock "refresh_cache-206476b7-d805-4c6c-b7fb-db8b5c2a94a6" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 11 23:11:21.739318 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 11 23:11:21.739318 np0000002687 nova-compute[98431]: node.name = iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff Jun 11 23:11:21.739318 np0000002687 nova-compute[98431]: node.tpgt = -1 Jun 11 23:11:21.739318 np0000002687 nova-compute[98431]: node.startup = manual Jun 11 23:11:21.739318 np0000002687 nova-compute[98431]: node.leading_login = No Jun 11 23:11:21.739318 np0000002687 nova-compute[98431]: iface.iscsi_ifacename = default Jun 11 23:11:21.739318 np0000002687 nova-compute[98431]: iface.net_ifacename = Jun 11 23:11:21.739318 np0000002687 nova-compute[98431]: iface.ipaddress = Jun 11 23:11:21.739318 np0000002687 nova-compute[98431]: iface.prefix_len = 0 Jun 11 23:11:21.739318 np0000002687 nova-compute[98431]: iface.hwaddress = Jun 11 23:11:21.739318 np0000002687 nova-compute[98431]: iface.transport_name = tcp Jun 11 23:11:21.739318 np0000002687 nova-compute[98431]: iface.initiatorname = Jun 11 23:11:21.739318 np0000002687 nova-compute[98431]: iface.state = Jun 11 23:11:21.739318 np0000002687 nova-compute[98431]: iface.vlan_id = 0 Jun 11 23:11:21.739318 np0000002687 nova-compute[98431]: iface.vlan_priority = 0 Jun 11 23:11:21.739318 np0000002687 nova-compute[98431]: iface.vlan_state = Jun 11 23:11:21.739318 np0000002687 nova-compute[98431]: iface.iface_num = 0 Jun 11 23:11:21.739318 np0000002687 nova-compute[98431]: iface.mtu = 0 Jun 11 23:11:21.739318 np0000002687 nova-compute[98431]: iface.port = 0 Jun 11 23:11:21.739318 np0000002687 nova-compute[98431]: iface.bootproto = Jun 11 23:11:21.739318 np0000002687 nova-compute[98431]: iface.subnet_mask = Jun 11 23:11:21.739318 np0000002687 nova-compute[98431]: iface.gateway = Jun 11 23:11:21.739318 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id_state = Jun 11 23:11:21.739318 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id = Jun 11 23:11:21.739318 np0000002687 nova-compute[98431]: iface.dhcp_dns = Jun 11 23:11:21.739318 np0000002687 nova-compute[98431]: iface.dhcp_learn_iqn = Jun 11 23:11:21.739318 np0000002687 nova-compute[98431]: iface.dhcp_req_vendor_id_state = Jun 11 23:11:21.739318 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id_state = Jun 11 23:11:21.739318 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id = Jun 11 23:11:21.739318 np0000002687 nova-compute[98431]: iface.dhcp_slp_da = Jun 11 23:11:21.739318 np0000002687 nova-compute[98431]: iface.fragmentation = Jun 11 23:11:21.739318 np0000002687 nova-compute[98431]: iface.gratuitous_arp = Jun 11 23:11:21.739318 np0000002687 nova-compute[98431]: iface.incoming_forwarding = Jun 11 23:11:21.739318 np0000002687 nova-compute[98431]: iface.tos_state = Jun 11 23:11:21.739318 np0000002687 nova-compute[98431]: iface.tos = 0 Jun 11 23:11:21.739318 np0000002687 nova-compute[98431]: iface.ttl = 0 Jun 11 23:11:21.739318 np0000002687 nova-compute[98431]: iface.delayed_ack = Jun 11 23:11:21.739318 np0000002687 nova-compute[98431]: iface.tcp_nagle = Jun 11 23:11:21.739318 np0000002687 nova-compute[98431]: iface.tcp_wsf_state = Jun 11 23:11:21.739318 np0000002687 nova-compute[98431]: iface.tcp_wsf = 0 Jun 11 23:11:21.739318 np0000002687 nova-compute[98431]: iface.tcp_timer_scale = 0 Jun 11 23:11:21.739318 np0000002687 nova-compute[98431]: iface.tcp_timestamp = Jun 11 23:11:21.739318 np0000002687 nova-compute[98431]: iface.redirect = Jun 11 23:11:21.739318 np0000002687 nova-compute[98431]: iface.def_task_mgmt_timeout = 0 Jun 11 23:11:21.739318 np0000002687 nova-compute[98431]: iface.header_digest = Jun 11 23:11:21.739318 np0000002687 nova-compute[98431]: iface.data_digest = Jun 11 23:11:21.739318 np0000002687 nova-compute[98431]: iface.immediate_data = Jun 11 23:11:21.739318 np0000002687 nova-compute[98431]: iface.initial_r2t = Jun 11 23:11:21.739318 np0000002687 nova-compute[98431]: iface.data_seq_inorder = Jun 11 23:11:21.739318 np0000002687 nova-compute[98431]: iface.data_pdu_inorder = Jun 11 23:11:21.739318 np0000002687 nova-compute[98431]: iface.erl = 0 Jun 11 23:11:21.739318 np0000002687 nova-compute[98431]: iface.max_receive_data_len = 0 Jun 11 23:11:21.739318 np0000002687 nova-compute[98431]: iface.first_burst_len = 0 Jun 11 23:11:21.739318 np0000002687 nova-compute[98431]: iface.max_outstanding_r2t = 0 Jun 11 23:11:21.739318 np0000002687 nova-compute[98431]: iface.max_burst_len = 0 Jun 11 23:11:21.739318 np0000002687 nova-compute[98431]: iface.chap_auth = Jun 11 23:11:21.739318 np0000002687 nova-compute[98431]: iface.bidi_chap = Jun 11 23:11:21.739318 np0000002687 nova-compute[98431]: iface.strict_login_compliance = Jun 11 23:11:21.739318 np0000002687 nova-compute[98431]: iface.discovery_auth = Jun 11 23:11:21.739318 np0000002687 nova-compute[98431]: iface.discovery_logout = Jun 11 23:11:21.739318 np0000002687 nova-compute[98431]: node.discovery_address = Jun 11 23:11:21.739318 np0000002687 nova-compute[98431]: node.discovery_port = 0 Jun 11 23:11:21.739318 np0000002687 nova-compute[98431]: node.discovery_type = fw Jun 11 23:11:21.739318 np0000002687 nova-compute[98431]: node.session.initial_cmdsn = 0 Jun 11 23:11:21.739318 np0000002687 nova-compute[98431]: node.session.initial_login_retry_max = 8 Jun 11 23:11:21.739318 np0000002687 nova-compute[98431]: node.session.xmit_thread_priority = 0 Jun 11 23:11:21.739318 np0000002687 nova-compute[98431]: node.session.cmds_max = 128 Jun 11 23:11:21.739318 np0000002687 nova-compute[98431]: node.session.queue_depth = 32 Jun 11 23:11:21.739318 np0000002687 nova-compute[98431]: node.session.nr_sessions = 1 Jun 11 23:11:21.739318 np0000002687 nova-compute[98431]: node.session.auth.authmethod = None Jun 11 23:11:21.739318 np0000002687 nova-compute[98431]: node.session.auth.username = Jun 11 23:11:21.739318 np0000002687 nova-compute[98431]: node.session.auth.password = *** Jun 11 23:11:21.739318 np0000002687 nova-compute[98431]: node.session.auth.username_in = Jun 11 23:11:21.739318 np0000002687 nova-compute[98431]: node.session.auth.password_in = Jun 11 23:11:21.739318 np0000002687 nova-compute[98431]: node.session.auth.chap_algs = SHA256 Jun 11 23:11:21.739318 np0000002687 nova-compute[98431]: node.session.timeo.replacement_timeout = 120 Jun 11 23:11:21.739318 np0000002687 nova-compute[98431]: node.session.err_timeo.abort_timeout = 15 Jun 11 23:11:21.739318 np0000002687 nova-compute[98431]: node.session.err_timeo.lu_reset_timeout = 30 Jun 11 23:11:21.739318 np0000002687 nova-compute[98431]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 11 23:11:21.739318 np0000002687 nova-compute[98431]: node.session.err_timeo.host_reset_timeout = 60 Jun 11 23:11:21.739318 np0000002687 nova-compute[98431]: node.session.iscsi.FastAbort = Yes Jun 11 23:11:21.739318 np0000002687 nova-compute[98431]: node.session.iscsi.InitialR2T = No Jun 11 23:11:21.739318 np0000002687 nova-compute[98431]: node.session.iscsi.ImmediateData = Yes Jun 11 23:11:21.739318 np0000002687 nova-compute[98431]: node.session.iscsi.FirstBurstLength = 262144 Jun 11 23:11:21.739318 np0000002687 nova-compute[98431]: node.session.iscsi.MaxBurstLength = 16776192 Jun 11 23:11:21.739318 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Retain = 0 Jun 11 23:11:21.739318 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Wait = 2 Jun 11 23:11:21.739318 np0000002687 nova-compute[98431]: node.session.iscsi.MaxConnections = 1 Jun 11 23:11:21.739318 np0000002687 nova-compute[98431]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 11 23:11:21.739318 np0000002687 nova-compute[98431]: node.session.iscsi.ERL = 0 Jun 11 23:11:21.739318 np0000002687 nova-compute[98431]: node.session.scan = auto Jun 11 23:11:21.739318 np0000002687 nova-compute[98431]: node.session.reopen_max = 0 Jun 11 23:11:21.739318 np0000002687 nova-compute[98431]: node.conn[0].address = 192.168.50.100 Jun 11 23:11:21.739318 np0000002687 nova-compute[98431]: node.conn[0].port = 3260 Jun 11 23:11:21.739318 np0000002687 nova-compute[98431]: node.conn[0].startup = manual Jun 11 23:11:21.739318 np0000002687 nova-compute[98431]: node.conn[0].tcp.window_size = 524288 Jun 11 23:11:21.739318 np0000002687 nova-compute[98431]: node.conn[0].tcp.type_of_service = 0 Jun 11 23:11:21.739318 np0000002687 nova-compute[98431]: node.conn[0].timeo.logout_timeout = 15 Jun 11 23:11:21.739318 np0000002687 nova-compute[98431]: node.conn[0].timeo.login_timeout = 15 Jun 11 23:11:21.739318 np0000002687 nova-compute[98431]: node.conn[0].timeo.auth_timeout = 45 Jun 11 23:11:21.739318 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_interval = 5 Jun 11 23:11:21.739318 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_timeout = 5 Jun 11 23:11:21.739318 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 11 23:11:21.739318 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 11 23:11:21.739318 np0000002687 nova-compute[98431]: node.conn[0].iscsi.HeaderDigest = None Jun 11 23:11:21.739318 np0000002687 nova-compute[98431]: node.conn[0].iscsi.DataDigest = None Jun 11 23:11:21.739318 np0000002687 nova-compute[98431]: node.conn[0].iscsi.IFMarker = No Jun 11 23:11:21.739318 np0000002687 nova-compute[98431]: node.conn[0].iscsi.OFMarker = No Jun 11 23:11:21.739318 np0000002687 nova-compute[98431]: # END RECORD Jun 11 23:11:21.739318 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:21.746149 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:21.753677 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:21.761265 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:21.761265 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:21.761265 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:21.761265 np0000002687 nova-compute[98431]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:21.761265 np0000002687 nova-compute[98431]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:21.761265 np0000002687 nova-compute[98431]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:21.761265 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:11:21.761265 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:21.761265 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:21.761265 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:21.761265 np0000002687 nova-compute[98431]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:21.761265 np0000002687 nova-compute[98431]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:21.761265 np0000002687 nova-compute[98431]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:21.761265 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:11:21.771690 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:21.771690 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:21.771690 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:21.771690 np0000002687 nova-compute[98431]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:21.771690 np0000002687 nova-compute[98431]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:21.771690 np0000002687 nova-compute[98431]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:21.771690 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:11:21.772510 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:21.772510 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:21.772510 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:21.772510 np0000002687 nova-compute[98431]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:21.772510 np0000002687 nova-compute[98431]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:21.772510 np0000002687 nova-compute[98431]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:21.772510 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:11:21.805090 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff, portal: 192.168.40.100,3260] Jun 11 23:11:21.805090 np0000002687 nova-compute[98431]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff, portal: 192.168.40.100,3260] successful. Jun 11 23:11:21.805090 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:21.811208 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff, portal: 192.168.50.100,3260] Jun 11 23:11:21.811208 np0000002687 nova-compute[98431]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff, portal: 192.168.50.100,3260] successful. Jun 11 23:11:21.811208 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:21.818880 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:21.823713 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:21.838856 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:21.838856 np0000002687 nova-compute[98431]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:11:21.838856 np0000002687 nova-compute[98431]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:11:21.838856 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:21.838856 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:21.838856 np0000002687 nova-compute[98431]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:21.838856 np0000002687 nova-compute[98431]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:21.838856 np0000002687 nova-compute[98431]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:21.838856 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:11:21.838856 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:21.838856 np0000002687 nova-compute[98431]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:11:21.838856 np0000002687 nova-compute[98431]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:11:21.838856 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:21.838856 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:21.838856 np0000002687 nova-compute[98431]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:21.838856 np0000002687 nova-compute[98431]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:21.838856 np0000002687 nova-compute[98431]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:21.838856 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:11:21.838856 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.157s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 11 23:11:21.838856 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Connected to 192.168.40.100:3260 {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 11 23:11:21.839626 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] HCTL ('13', '-', '-', 0) found on session 11 with lun 0 {{(pid=98431) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 11 23:11:21.839626 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98431) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 11 23:11:21.845064 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:21.845064 np0000002687 nova-compute[98431]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:11:21.845064 np0000002687 nova-compute[98431]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:11:21.845064 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:21.845064 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:21.845064 np0000002687 nova-compute[98431]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:21.845064 np0000002687 nova-compute[98431]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:21.845064 np0000002687 nova-compute[98431]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:21.845064 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:11:21.845512 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:21.845512 np0000002687 nova-compute[98431]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:11:21.845512 np0000002687 nova-compute[98431]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:11:21.845512 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:21.845512 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:21.845512 np0000002687 nova-compute[98431]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:21.845512 np0000002687 nova-compute[98431]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:21.845512 np0000002687 nova-compute[98431]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:21.845512 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:11:21.845512 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.164s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 11 23:11:21.845512 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Connected to 192.168.50.100:3260 {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 11 23:11:21.846328 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] HCTL ('14', '-', '-', 0) found on session 12 with lun 0 {{(pid=98431) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 11 23:11:21.846519 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98431) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 11 23:11:21.853786 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Searching for a device in session 11 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98431) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 11 23:11:21.853786 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0001b9c6-a8d0-4709-88d4-b91656096dff', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 11 23:11:21.863317 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Searching for a device in session 12 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98431) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 11 23:11:21.864284 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '0001b9c6-a8d0-4709-88d4-b91656096dff', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 11 23:11:21.864542 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-c6ff320a-0a6f-4b1f-93c2-7758a3217053 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 8ffa4bbe-7ead-4029-aba5-28f031f6e784] Starting instance... {{(pid=98431) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 11 23:11:22.416816 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-c6ff320a-0a6f-4b1f-93c2-7758a3217053 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:11:22.417218 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-c6ff320a-0a6f-4b1f-93c2-7758a3217053 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:11:22.420292 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-c6ff320a-0a6f-4b1f-93c2-7758a3217053 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98431) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 11 23:11:22.420446 np0000002687 nova-compute[98431]: INFO nova.compute.claims [None req-c6ff320a-0a6f-4b1f-93c2-7758a3217053 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 8ffa4bbe-7ead-4029-aba5-28f031f6e784] Claim successful on node np0000002687 Jun 11 23:11:22.595391 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:22.603918 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:22.683444 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98431) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 11 23:11:23.313536 np0000002687 nova-compute[98431]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0004045840000799217 future=) submitted to {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:11:23.313956 np0000002687 nova-compute[98431]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:11:23.314647 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Emitting event Stopped> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:11:23.314841 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 689e510d-e0a4-4d6a-958e-9acfaebedc87] VM Stopped (Lifecycle Event) Jun 11 23:11:23.335560 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Start spawning the instance on the hypervisor. {{(pid=98431) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 11 23:11:23.336427 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Creating instance directory {{(pid=98431) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}} Jun 11 23:11:23.336664 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Creating image(s) Jun 11 23:11:23.336949 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Did not create local disks {{(pid=98431) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}} Jun 11 23:11:23.337146 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Ensure instance console log exists: /opt/stack/data/nova/instances/c82748e6-1c78-4372-ad4b-48d1c6448efa/console.log {{(pid=98431) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}} Jun 11 23:11:23.337280 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:11:23.337468 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:11:23.337557 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:11:23.338097 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Start _get_guest_xml network_info=[{"id": "852fc4ec-82e1-4185-a33c-3c45ff42351e", "address": "fa:16:3e:c6:c6:5b", "network": {"id": "2a770c99-2ec6-4fa2-945b-32830a59e7a7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-137493671-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aaf744af828a4a5eba1e98da63373b2b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap852fc4ec-82", "ovs_interfaceid": "852fc4ec-82e1-4185-a33c-3c45ff42351e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-11T23:08:20Z,direct_url=,disk_format='qcow2',id=f30640f8-7aca-4300-a085-4706a5209a79,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ce012f9fabdb4ee5a73e212437f59d97',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-11T23:08:23Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'mount_device': '/dev/vda', 'attachment_id': '825dbf91-4e42-4e4f-af09-fb1a8f94b5f9', 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea', 'iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5498d0af-4b75-4132-b06e-56f2b5b013ea', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'c82748e6-1c78-4372-ad4b-48d1c6448efa', 'attached_at': '', 'detached_at': '', 'volume_id': '5498d0af-4b75-4132-b06e-56f2b5b013ea', 'serial': '5498d0af-4b75-4132-b06e-56f2b5b013ea'}, 'disk_bus': 'virtio', 'delete_on_termination': True, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98431) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 11 23:11:23.340982 np0000002687 nova-compute[98431]: WARNING nova.virt.libvirt.driver [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 11 23:11:23.340982 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='f30640f8-7aca-4300-a085-4706a5209a79', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-28433977', uuid='c82748e6-1c78-4372-ad4b-48d1c6448efa'), owner=OwnerMeta(userid='72b6dac5eb744cfba6299636227aa59b', username='tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member', projectid='aaf744af828a4a5eba1e98da63373b2b', projectname='tempest-ServerBootFromVolumeStableRescueTest-539499192'), image=ImageMeta(id='f30640f8-7aca-4300-a085-4706a5209a79', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "852fc4ec-82e1-4185-a33c-3c45ff42351e", "address": "fa:16:3e:c6:c6:5b", "network": {"id": "2a770c99-2ec6-4fa2-945b-32830a59e7a7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-137493671-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aaf744af828a4a5eba1e98da63373b2b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap852fc4ec-82", "ovs_interfaceid": "852fc4ec-82e1-4185-a33c-3c45ff42351e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1781219483.3406918) {{(pid=98431) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 11 23:11:23.341953 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Searching host: 'np0000002687' for CPU controller through CGroups V1... {{(pid=98431) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 11 23:11:23.342235 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] CPU controller missing on host. {{(pid=98431) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 11 23:11:23.342926 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Searching host: 'np0000002687' for CPU controller through CGroups V2... {{(pid=98431) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 11 23:11:23.343086 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] CPU controller found on host. {{(pid=98431) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 11 23:11:23.343874 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98431) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 11 23:11:23.344147 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-11T23:08:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-11T23:08:20Z,direct_url=,disk_format='qcow2',id=f30640f8-7aca-4300-a085-4706a5209a79,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ce012f9fabdb4ee5a73e212437f59d97',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-11T23:08:23Z,virtual_size=,visibility=), allow threads: True {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 11 23:11:23.344271 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Flavor limits 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 11 23:11:23.344357 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Image limits 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 11 23:11:23.344466 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Flavor pref 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 11 23:11:23.344553 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Image pref 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 11 23:11:23.344893 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 11 23:11:23.344893 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 11 23:11:23.344893 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98431) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 11 23:11:23.345256 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Got 1 possible topologies {{(pid=98431) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 11 23:11:23.345256 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 11 23:11:23.345256 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 11 23:11:23.379494 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.volume.iscsi [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Calling os-brick to attach iSCSI Volume {{(pid=98431) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 11 23:11:23.379494 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea', 'iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5498d0af-4b75-4132-b06e-56f2b5b013ea', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 11 23:11:23.379494 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 11 23:11:23.436734 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:23.709594 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Found WWN 33000000048acda8e for multipath device dm-7 {{(pid=98431) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 11 23:11:23.710045 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.046s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 11 23:11:23.710635 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] <== connect_volume: return (3046ms) {'type': 'block', 'scsi_wwn': '33000000048acda8e', 'path': '/dev/dm-7', 'multipath_id': '33000000048acda8e'} {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 11 23:11:23.710635 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000048acda8e', 'path': '/dev/dm-7', 'multipath_id': '33000000048acda8e'} {{(pid=98431) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 11 23:11:23.711285 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.332s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 11 23:11:23.711721 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea', 'iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5498d0af-4b75-4132-b06e-56f2b5b013ea', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98431) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 11 23:11:23.728138 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 11 23:11:23.731260 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 11 23:11:23.731260 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 11 23:11:23.731547 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.iscsi [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 11 23:11:23.733238 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 11 23:11:23.733238 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.iscsi [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 11 23:11:23.749679 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 11 23:11:23.749679 np0000002687 nova-compute[98431]: {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:23.757598 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 11 23:11:23.757598 np0000002687 nova-compute[98431]: {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:23.764538 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea] added Jun 11 23:11:23.764538 np0000002687 nova-compute[98431]: stderr=iscsiadm: Config file line 363 does not have value Jun 11 23:11:23.764538 np0000002687 nova-compute[98431]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 11 23:11:23.764538 np0000002687 nova-compute[98431]: iscsiadm: Config file line 363 does not have value Jun 11 23:11:23.764538 np0000002687 nova-compute[98431]: iscsiadm: Config file line 363 does not have value Jun 11 23:11:23.764538 np0000002687 nova-compute[98431]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 11 23:11:23.764538 np0000002687 nova-compute[98431]: {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:23.774481 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98431) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 11 23:11:23.776097 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea] added Jun 11 23:11:23.776097 np0000002687 nova-compute[98431]: stderr=iscsiadm: Config file line 363 does not have value Jun 11 23:11:23.776097 np0000002687 nova-compute[98431]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 11 23:11:23.776097 np0000002687 nova-compute[98431]: iscsiadm: Config file line 363 does not have value Jun 11 23:11:23.776097 np0000002687 nova-compute[98431]: iscsiadm: Config file line 363 does not have value Jun 11 23:11:23.776097 np0000002687 nova-compute[98431]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 11 23:11:23.776097 np0000002687 nova-compute[98431]: {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:23.776740 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98431) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 11 23:11:23.777347 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0434(s), this was the 1st time calling it. {{(pid=98431) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 11 23:11:23.777589 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0439(s), this was the 1st time calling it. {{(pid=98431) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 11 23:11:23.777700 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98431) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 11 23:11:23.778281 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98431) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 11 23:11:23.819131 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 689e510d-e0a4-4d6a-958e-9acfaebedc87] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:11:24.215673 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-c6ff320a-0a6f-4b1f-93c2-7758a3217053 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98431) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 11 23:11:24.215913 np0000002687 nova-compute[98431]: DEBUG nova.compute.provider_tree [None req-c6ff320a-0a6f-4b1f-93c2-7758a3217053 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Inventory has not changed in ProviderTree for provider: e3e65fe2-9de9-4821-8b4a-ccae37c66e25 {{(pid=98431) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 11 23:11:24.224244 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-11T23:10:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-55083950',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='tempest-device-tagging-server-55083950',id=9,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLYbs7b2G1by6R+g1Ak7OKaDEL6OFRfafy/x8MG8Yw4C/HTCI/qxvrM+UbOFbanu5A5mHNVFjkvtwtnsinV4q+nEVUROe2gWmd2XwuNmh27iXsdrupk64B9jYKvtsxBMlg==',key_name='tempest-keypair-900197797',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='57813123648a4335a97e8fc5c245cc73',ramdisk_id='',reservation_id='r-qvvw2lad',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1898457247',owner_user_name='tempest-TaggedBootDevicesTest-1898457247-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-11T23:10:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c853441cf4f34e4d9cd6821201efc91a',uuid=49a042ba-28ba-4401-9bdf-92f96da8f80e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7808ce0e-ec36-4dfa-84d5-0eb1ce542139", "address": "fa:16:3e:e8:a7:df", "network": {"id": "ef5cc6c6-1b8e-4a88-bf58-ad07356064fc", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1332694516-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57813123648a4335a97e8fc5c245cc73", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7808ce0e-ec", "ovs_interfaceid": "7808ce0e-ec36-4dfa-84d5-0eb1ce542139", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98431) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 11 23:11:24.224604 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Converting VIF {"id": "7808ce0e-ec36-4dfa-84d5-0eb1ce542139", "address": "fa:16:3e:e8:a7:df", "network": {"id": "ef5cc6c6-1b8e-4a88-bf58-ad07356064fc", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1332694516-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57813123648a4335a97e8fc5c245cc73", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7808ce0e-ec", "ovs_interfaceid": "7808ce0e-ec36-4dfa-84d5-0eb1ce542139", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:11:24.225855 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:a7:df,bridge_name='br-int',has_traffic_filtering=True,id=7808ce0e-ec36-4dfa-84d5-0eb1ce542139,network=Network(ef5cc6c6-1b8e-4a88-bf58-ad07356064fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7808ce0e-ec') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:11:24.227680 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-11T23:10:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-55083950',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='tempest-device-tagging-server-55083950',id=9,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLYbs7b2G1by6R+g1Ak7OKaDEL6OFRfafy/x8MG8Yw4C/HTCI/qxvrM+UbOFbanu5A5mHNVFjkvtwtnsinV4q+nEVUROe2gWmd2XwuNmh27iXsdrupk64B9jYKvtsxBMlg==',key_name='tempest-keypair-900197797',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='57813123648a4335a97e8fc5c245cc73',ramdisk_id='',reservation_id='r-qvvw2lad',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1898457247',owner_user_name='tempest-TaggedBootDevicesTest-1898457247-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-11T23:10:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c853441cf4f34e4d9cd6821201efc91a',uuid=49a042ba-28ba-4401-9bdf-92f96da8f80e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7051cdff-8b40-42d6-9d8a-9b7748621f1f", "address": "fa:16:3e:9f:58:c8", "network": {"id": "b4ad3a49-46fc-4f87-83ac-2f820e779189", "bridge": "br-int", "label": "tempest-device-tagging-net1-1763764299", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.184", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57813123648a4335a97e8fc5c245cc73", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7051cdff-8b", "ovs_interfaceid": "7051cdff-8b40-42d6-9d8a-9b7748621f1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98431) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 11 23:11:24.227959 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Converting VIF {"id": "7051cdff-8b40-42d6-9d8a-9b7748621f1f", "address": "fa:16:3e:9f:58:c8", "network": {"id": "b4ad3a49-46fc-4f87-83ac-2f820e779189", "bridge": "br-int", "label": "tempest-device-tagging-net1-1763764299", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.184", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57813123648a4335a97e8fc5c245cc73", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7051cdff-8b", "ovs_interfaceid": "7051cdff-8b40-42d6-9d8a-9b7748621f1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:11:24.228492 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:58:c8,bridge_name='br-int',has_traffic_filtering=True,id=7051cdff-8b40-42d6-9d8a-9b7748621f1f,network=Network(b4ad3a49-46fc-4f87-83ac-2f820e779189),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7051cdff-8b') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:11:24.229556 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-11T23:10:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-55083950',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='tempest-device-tagging-server-55083950',id=9,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLYbs7b2G1by6R+g1Ak7OKaDEL6OFRfafy/x8MG8Yw4C/HTCI/qxvrM+UbOFbanu5A5mHNVFjkvtwtnsinV4q+nEVUROe2gWmd2XwuNmh27iXsdrupk64B9jYKvtsxBMlg==',key_name='tempest-keypair-900197797',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='57813123648a4335a97e8fc5c245cc73',ramdisk_id='',reservation_id='r-qvvw2lad',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1898457247',owner_user_name='tempest-TaggedBootDevicesTest-1898457247-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-11T23:10:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c853441cf4f34e4d9cd6821201efc91a',uuid=49a042ba-28ba-4401-9bdf-92f96da8f80e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "609ed1b7-9ea3-4ae3-8c37-f0a952a45507", "address": "fa:16:3e:c3:0b:6b", "network": {"id": "b4ad3a49-46fc-4f87-83ac-2f820e779189", "bridge": "br-int", "label": "tempest-device-tagging-net1-1763764299", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.189", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57813123648a4335a97e8fc5c245cc73", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap609ed1b7-9e", "ovs_interfaceid": "609ed1b7-9ea3-4ae3-8c37-f0a952a45507", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98431) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 11 23:11:24.229820 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Converting VIF {"id": "609ed1b7-9ea3-4ae3-8c37-f0a952a45507", "address": "fa:16:3e:c3:0b:6b", "network": {"id": "b4ad3a49-46fc-4f87-83ac-2f820e779189", "bridge": "br-int", "label": "tempest-device-tagging-net1-1763764299", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.189", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57813123648a4335a97e8fc5c245cc73", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap609ed1b7-9e", "ovs_interfaceid": "609ed1b7-9ea3-4ae3-8c37-f0a952a45507", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:11:24.230294 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:0b:6b,bridge_name='br-int',has_traffic_filtering=True,id=609ed1b7-9ea3-4ae3-8c37-f0a952a45507,network=Network(b4ad3a49-46fc-4f87-83ac-2f820e779189),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap609ed1b7-9e') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:11:24.231067 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-11T23:10:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-55083950',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='tempest-device-tagging-server-55083950',id=9,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLYbs7b2G1by6R+g1Ak7OKaDEL6OFRfafy/x8MG8Yw4C/HTCI/qxvrM+UbOFbanu5A5mHNVFjkvtwtnsinV4q+nEVUROe2gWmd2XwuNmh27iXsdrupk64B9jYKvtsxBMlg==',key_name='tempest-keypair-900197797',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='57813123648a4335a97e8fc5c245cc73',ramdisk_id='',reservation_id='r-qvvw2lad',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1898457247',owner_user_name='tempest-TaggedBootDevicesTest-1898457247-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-11T23:10:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c853441cf4f34e4d9cd6821201efc91a',uuid=49a042ba-28ba-4401-9bdf-92f96da8f80e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b54ddd43-d4cb-4d4a-840e-895e75419e25", "address": "fa:16:3e:b9:2e:2c", "network": {"id": "b4ad3a49-46fc-4f87-83ac-2f820e779189", "bridge": "br-int", "label": "tempest-device-tagging-net1-1763764299", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57813123648a4335a97e8fc5c245cc73", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb54ddd43-d4", "ovs_interfaceid": "b54ddd43-d4cb-4d4a-840e-895e75419e25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98431) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 11 23:11:24.231293 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Converting VIF {"id": "b54ddd43-d4cb-4d4a-840e-895e75419e25", "address": "fa:16:3e:b9:2e:2c", "network": {"id": "b4ad3a49-46fc-4f87-83ac-2f820e779189", "bridge": "br-int", "label": "tempest-device-tagging-net1-1763764299", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57813123648a4335a97e8fc5c245cc73", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb54ddd43-d4", "ovs_interfaceid": "b54ddd43-d4cb-4d4a-840e-895e75419e25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:11:24.231998 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:2e:2c,bridge_name='br-int',has_traffic_filtering=True,id=b54ddd43-d4cb-4d4a-840e-895e75419e25,network=Network(b4ad3a49-46fc-4f87-83ac-2f820e779189),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb54ddd43-d4') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:11:24.232788 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-11T23:10:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-55083950',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='tempest-device-tagging-server-55083950',id=9,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLYbs7b2G1by6R+g1Ak7OKaDEL6OFRfafy/x8MG8Yw4C/HTCI/qxvrM+UbOFbanu5A5mHNVFjkvtwtnsinV4q+nEVUROe2gWmd2XwuNmh27iXsdrupk64B9jYKvtsxBMlg==',key_name='tempest-keypair-900197797',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='57813123648a4335a97e8fc5c245cc73',ramdisk_id='',reservation_id='r-qvvw2lad',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1898457247',owner_user_name='tempest-TaggedBootDevicesTest-1898457247-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-11T23:10:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c853441cf4f34e4d9cd6821201efc91a',uuid=49a042ba-28ba-4401-9bdf-92f96da8f80e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "77424d75-6e25-4791-a44d-495051f7e89f", "address": "fa:16:3e:a0:a2:82", "network": {"id": "b4ad3a49-46fc-4f87-83ac-2f820e779189", "bridge": "br-int", "label": "tempest-device-tagging-net1-1763764299", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57813123648a4335a97e8fc5c245cc73", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap77424d75-6e", "ovs_interfaceid": "77424d75-6e25-4791-a44d-495051f7e89f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98431) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 11 23:11:24.233021 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Converting VIF {"id": "77424d75-6e25-4791-a44d-495051f7e89f", "address": "fa:16:3e:a0:a2:82", "network": {"id": "b4ad3a49-46fc-4f87-83ac-2f820e779189", "bridge": "br-int", "label": "tempest-device-tagging-net1-1763764299", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57813123648a4335a97e8fc5c245cc73", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap77424d75-6e", "ovs_interfaceid": "77424d75-6e25-4791-a44d-495051f7e89f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:11:24.233551 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:a2:82,bridge_name='br-int',has_traffic_filtering=True,id=77424d75-6e25-4791-a44d-495051f7e89f,network=Network(b4ad3a49-46fc-4f87-83ac-2f820e779189),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77424d75-6e') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:11:24.234320 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-11T23:10:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-55083950',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='tempest-device-tagging-server-55083950',id=9,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLYbs7b2G1by6R+g1Ak7OKaDEL6OFRfafy/x8MG8Yw4C/HTCI/qxvrM+UbOFbanu5A5mHNVFjkvtwtnsinV4q+nEVUROe2gWmd2XwuNmh27iXsdrupk64B9jYKvtsxBMlg==',key_name='tempest-keypair-900197797',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='57813123648a4335a97e8fc5c245cc73',ramdisk_id='',reservation_id='r-qvvw2lad',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1898457247',owner_user_name='tempest-TaggedBootDevicesTest-1898457247-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-11T23:10:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c853441cf4f34e4d9cd6821201efc91a',uuid=49a042ba-28ba-4401-9bdf-92f96da8f80e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0263e39d-c835-4cf1-b333-265608e81a93", "address": "fa:16:3e:50:0f:6b", "network": {"id": "25259518-16fe-4690-8216-636e994936ba", "bridge": "br-int", "label": "tempest-device-tagging-net2-736260586", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57813123648a4335a97e8fc5c245cc73", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0263e39d-c8", "ovs_interfaceid": "0263e39d-c835-4cf1-b333-265608e81a93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98431) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 11 23:11:24.234560 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Converting VIF {"id": "0263e39d-c835-4cf1-b333-265608e81a93", "address": "fa:16:3e:50:0f:6b", "network": {"id": "25259518-16fe-4690-8216-636e994936ba", "bridge": "br-int", "label": "tempest-device-tagging-net2-736260586", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57813123648a4335a97e8fc5c245cc73", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0263e39d-c8", "ovs_interfaceid": "0263e39d-c835-4cf1-b333-265608e81a93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:11:24.235025 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:0f:6b,bridge_name='br-int',has_traffic_filtering=True,id=0263e39d-c835-4cf1-b333-265608e81a93,network=Network(25259518-16fe-4690-8216-636e994936ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0263e39d-c8') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:11:24.235783 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-11T23:10:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-55083950',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='tempest-device-tagging-server-55083950',id=9,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLYbs7b2G1by6R+g1Ak7OKaDEL6OFRfafy/x8MG8Yw4C/HTCI/qxvrM+UbOFbanu5A5mHNVFjkvtwtnsinV4q+nEVUROe2gWmd2XwuNmh27iXsdrupk64B9jYKvtsxBMlg==',key_name='tempest-keypair-900197797',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='57813123648a4335a97e8fc5c245cc73',ramdisk_id='',reservation_id='r-qvvw2lad',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1898457247',owner_user_name='tempest-TaggedBootDevicesTest-1898457247-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-11T23:10:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c853441cf4f34e4d9cd6821201efc91a',uuid=49a042ba-28ba-4401-9bdf-92f96da8f80e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "09135c79-b0df-40af-b05b-2e171390f37f", "address": "fa:16:3e:c4:56:b3", "network": {"id": "25259518-16fe-4690-8216-636e994936ba", "bridge": "br-int", "label": "tempest-device-tagging-net2-736260586", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57813123648a4335a97e8fc5c245cc73", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap09135c79-b0", "ovs_interfaceid": "09135c79-b0df-40af-b05b-2e171390f37f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98431) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 11 23:11:24.236020 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Converting VIF {"id": "09135c79-b0df-40af-b05b-2e171390f37f", "address": "fa:16:3e:c4:56:b3", "network": {"id": "25259518-16fe-4690-8216-636e994936ba", "bridge": "br-int", "label": "tempest-device-tagging-net2-736260586", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57813123648a4335a97e8fc5c245cc73", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap09135c79-b0", "ovs_interfaceid": "09135c79-b0df-40af-b05b-2e171390f37f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:11:24.236816 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:56:b3,bridge_name='br-int',has_traffic_filtering=True,id=09135c79-b0df-40af-b05b-2e171390f37f,network=Network(25259518-16fe-4690-8216-636e994936ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09135c79-b0') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:11:24.237578 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Lazy-loading 'pci_devices' on Instance uuid 49a042ba-28ba-4401-9bdf-92f96da8f80e {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:11:24.719219 np0000002687 nova-compute[98431]: DEBUG nova.scheduler.client.report [None req-c6ff320a-0a6f-4b1f-93c2-7758a3217053 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Inventory has not changed for provider e3e65fe2-9de9-4821-8b4a-ccae37c66e25 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98431) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] End _get_guest_xml xml= Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: 49a042ba-28ba-4401-9bdf-92f96da8f80e Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: instance-00000009 Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: 196608 Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: 1 Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: tempest-device-tagging-server-55083950 Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: 2026-06-11 23:11:13 Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: 192 Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: 1 Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: 0 Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: 0 Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: 1 Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: True Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: bare Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: qcow2 Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: 1 Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: 0 Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: virtio Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: tempest-TaggedBootDevicesTest-1898457247-project-member Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: tempest-TaggedBootDevicesTest-1898457247 Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: OpenStack Foundation Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: OpenStack Nova Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: 33.1.0 Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: 49a042ba-28ba-4401-9bdf-92f96da8f80e Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: 49a042ba-28ba-4401-9bdf-92f96da8f80e Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Virtual Machine Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: hvm Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: 128 Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: 1 Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Nehalem Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: 5c45c988-5aa0-400e-ba7a-59581071a2f9 Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: 23264eac-8f91-4074-b3b0-51b6cb738b7c Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: 0001b9c6-a8d0-4709-88d4-b91656096dff Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: /dev/urandom Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: Jun 11 23:11:24.740620 np0000002687 nova-compute[98431]: {{(pid=98431) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 11 23:11:24.747537 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Preparing to wait for external event network-vif-plugged-7808ce0e-ec36-4dfa-84d5-0eb1ce542139 {{(pid=98431) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 11 23:11:24.747537 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Acquiring lock "49a042ba-28ba-4401-9bdf-92f96da8f80e-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:11:24.747537 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Lock "49a042ba-28ba-4401-9bdf-92f96da8f80e-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:11:24.747537 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Lock "49a042ba-28ba-4401-9bdf-92f96da8f80e-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:11:24.747537 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Preparing to wait for external event network-vif-plugged-7051cdff-8b40-42d6-9d8a-9b7748621f1f {{(pid=98431) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 11 23:11:24.747537 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Acquiring lock "49a042ba-28ba-4401-9bdf-92f96da8f80e-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:11:24.747537 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Lock "49a042ba-28ba-4401-9bdf-92f96da8f80e-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:11:24.747537 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Lock "49a042ba-28ba-4401-9bdf-92f96da8f80e-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:11:24.747537 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Preparing to wait for external event network-vif-plugged-609ed1b7-9ea3-4ae3-8c37-f0a952a45507 {{(pid=98431) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 11 23:11:24.747537 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Acquiring lock "49a042ba-28ba-4401-9bdf-92f96da8f80e-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:11:24.747537 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Lock "49a042ba-28ba-4401-9bdf-92f96da8f80e-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:11:24.747537 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Lock "49a042ba-28ba-4401-9bdf-92f96da8f80e-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:11:24.747537 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Preparing to wait for external event network-vif-plugged-b54ddd43-d4cb-4d4a-840e-895e75419e25 {{(pid=98431) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 11 23:11:24.747537 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Acquiring lock "49a042ba-28ba-4401-9bdf-92f96da8f80e-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:11:24.747537 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Lock "49a042ba-28ba-4401-9bdf-92f96da8f80e-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:11:24.747537 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Lock "49a042ba-28ba-4401-9bdf-92f96da8f80e-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:11:24.747537 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Preparing to wait for external event network-vif-plugged-77424d75-6e25-4791-a44d-495051f7e89f {{(pid=98431) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 11 23:11:24.747537 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Acquiring lock "49a042ba-28ba-4401-9bdf-92f96da8f80e-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:11:24.747537 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Lock "49a042ba-28ba-4401-9bdf-92f96da8f80e-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:11:24.747537 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Lock "49a042ba-28ba-4401-9bdf-92f96da8f80e-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:11:24.747537 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Preparing to wait for external event network-vif-plugged-0263e39d-c835-4cf1-b333-265608e81a93 {{(pid=98431) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 11 23:11:24.748815 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Acquiring lock "49a042ba-28ba-4401-9bdf-92f96da8f80e-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:11:24.748815 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Lock "49a042ba-28ba-4401-9bdf-92f96da8f80e-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:11:24.748815 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Lock "49a042ba-28ba-4401-9bdf-92f96da8f80e-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:11:24.748815 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Preparing to wait for external event network-vif-plugged-09135c79-b0df-40af-b05b-2e171390f37f {{(pid=98431) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 11 23:11:24.748815 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Acquiring lock "49a042ba-28ba-4401-9bdf-92f96da8f80e-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:11:24.748815 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Lock "49a042ba-28ba-4401-9bdf-92f96da8f80e-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:11:24.748815 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Lock "49a042ba-28ba-4401-9bdf-92f96da8f80e-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:11:24.749193 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-11T23:10:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-55083950',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='tempest-device-tagging-server-55083950',id=9,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLYbs7b2G1by6R+g1Ak7OKaDEL6OFRfafy/x8MG8Yw4C/HTCI/qxvrM+UbOFbanu5A5mHNVFjkvtwtnsinV4q+nEVUROe2gWmd2XwuNmh27iXsdrupk64B9jYKvtsxBMlg==',key_name='tempest-keypair-900197797',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='57813123648a4335a97e8fc5c245cc73',ramdisk_id='',reservation_id='r-qvvw2lad',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1898457247',owner_user_name='tempest-TaggedBootDevicesTest-1898457247-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-11T23:10:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c853441cf4f34e4d9cd6821201efc91a',uuid=49a042ba-28ba-4401-9bdf-92f96da8f80e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7808ce0e-ec36-4dfa-84d5-0eb1ce542139", "address": "fa:16:3e:e8:a7:df", "network": {"id": "ef5cc6c6-1b8e-4a88-bf58-ad07356064fc", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1332694516-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57813123648a4335a97e8fc5c245cc73", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7808ce0e-ec", "ovs_interfaceid": "7808ce0e-ec36-4dfa-84d5-0eb1ce542139", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 11 23:11:24.749193 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Converting VIF {"id": "7808ce0e-ec36-4dfa-84d5-0eb1ce542139", "address": "fa:16:3e:e8:a7:df", "network": {"id": "ef5cc6c6-1b8e-4a88-bf58-ad07356064fc", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1332694516-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57813123648a4335a97e8fc5c245cc73", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7808ce0e-ec", "ovs_interfaceid": "7808ce0e-ec36-4dfa-84d5-0eb1ce542139", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:11:24.749565 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:a7:df,bridge_name='br-int',has_traffic_filtering=True,id=7808ce0e-ec36-4dfa-84d5-0eb1ce542139,network=Network(ef5cc6c6-1b8e-4a88-bf58-ad07356064fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7808ce0e-ec') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:11:24.750157 np0000002687 nova-compute[98431]: DEBUG os_vif [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:a7:df,bridge_name='br-int',has_traffic_filtering=True,id=7808ce0e-ec36-4dfa-84d5-0eb1ce542139,network=Network(ef5cc6c6-1b8e-4a88-bf58-ad07356064fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7808ce0e-ec') {{(pid=98431) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 11 23:11:24.754262 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:24.754600 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:11:24.754846 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 11 23:11:24.758107 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:24.758273 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b9b728a7-23f9-553b-bada-b47d2fd6a9b8', '_type': 'linux-noop'}}, row=False) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:11:24.761313 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:24.763063 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:11:24.766974 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:24.767497 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7808ce0e-ec, may_exist=True, interface_attrs={}) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:11:24.767946 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7808ce0e-ec, col_values=(('qos', UUID('b0c6f5fa-4b7d-4884-95fa-d118bb4986b7')),), if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:11:24.768166 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7808ce0e-ec, col_values=(('external_ids', {'iface-id': '7808ce0e-ec36-4dfa-84d5-0eb1ce542139', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e8:a7:df', 'vm-uuid': '49a042ba-28ba-4401-9bdf-92f96da8f80e'}),), if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:11:24.771203 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:24.772997 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:11:24.778235 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:24.779062 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.iscsi [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 11 23:11:24.779106 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.iscsi [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 11 23:11:24.779998 np0000002687 nova-compute[98431]: INFO os_vif [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:a7:df,bridge_name='br-int',has_traffic_filtering=True,id=7808ce0e-ec36-4dfa-84d5-0eb1ce542139,network=Network(ef5cc6c6-1b8e-4a88-bf58-ad07356064fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7808ce0e-ec') Jun 11 23:11:24.780620 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-11T23:10:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-55083950',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='tempest-device-tagging-server-55083950',id=9,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLYbs7b2G1by6R+g1Ak7OKaDEL6OFRfafy/x8MG8Yw4C/HTCI/qxvrM+UbOFbanu5A5mHNVFjkvtwtnsinV4q+nEVUROe2gWmd2XwuNmh27iXsdrupk64B9jYKvtsxBMlg==',key_name='tempest-keypair-900197797',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='57813123648a4335a97e8fc5c245cc73',ramdisk_id='',reservation_id='r-qvvw2lad',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1898457247',owner_user_name='tempest-TaggedBootDevicesTest-1898457247-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-11T23:10:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c853441cf4f34e4d9cd6821201efc91a',uuid=49a042ba-28ba-4401-9bdf-92f96da8f80e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7051cdff-8b40-42d6-9d8a-9b7748621f1f", "address": "fa:16:3e:9f:58:c8", "network": {"id": "b4ad3a49-46fc-4f87-83ac-2f820e779189", "bridge": "br-int", "label": "tempest-device-tagging-net1-1763764299", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.184", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57813123648a4335a97e8fc5c245cc73", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7051cdff-8b", "ovs_interfaceid": "7051cdff-8b40-42d6-9d8a-9b7748621f1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98431) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 11 23:11:24.780787 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Converting VIF {"id": "7051cdff-8b40-42d6-9d8a-9b7748621f1f", "address": "fa:16:3e:9f:58:c8", "network": {"id": "b4ad3a49-46fc-4f87-83ac-2f820e779189", "bridge": "br-int", "label": "tempest-device-tagging-net1-1763764299", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.184", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57813123648a4335a97e8fc5c245cc73", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7051cdff-8b", "ovs_interfaceid": "7051cdff-8b40-42d6-9d8a-9b7748621f1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:11:24.781289 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:58:c8,bridge_name='br-int',has_traffic_filtering=True,id=7051cdff-8b40-42d6-9d8a-9b7748621f1f,network=Network(b4ad3a49-46fc-4f87-83ac-2f820e779189),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7051cdff-8b') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:11:24.781599 np0000002687 nova-compute[98431]: DEBUG os_vif [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:58:c8,bridge_name='br-int',has_traffic_filtering=True,id=7051cdff-8b40-42d6-9d8a-9b7748621f1f,network=Network(b4ad3a49-46fc-4f87-83ac-2f820e779189),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7051cdff-8b') {{(pid=98431) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 11 23:11:24.781842 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:24.783732 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:11:24.783732 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 11 23:11:24.783732 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:24.783732 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '56ca6b65-16c2-58b8-ad55-e63a87a38f10', '_type': 'linux-noop'}}, row=False) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:11:24.783732 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:24.784715 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:11:24.790679 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:24.796340 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:24.796340 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7051cdff-8b, may_exist=True, interface_attrs={}) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:11:24.796340 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7051cdff-8b, col_values=(('qos', UUID('f7ca9608-f29e-4463-b22f-de0a6317ee43')),), if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:11:24.796340 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7051cdff-8b, col_values=(('external_ids', {'iface-id': '7051cdff-8b40-42d6-9d8a-9b7748621f1f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9f:58:c8', 'vm-uuid': '49a042ba-28ba-4401-9bdf-92f96da8f80e'}),), if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:11:24.796340 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:24.797276 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:11:24.803553 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 11 23:11:24.803553 np0000002687 nova-compute[98431]: node.name = iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea Jun 11 23:11:24.803553 np0000002687 nova-compute[98431]: node.tpgt = -1 Jun 11 23:11:24.803553 np0000002687 nova-compute[98431]: node.startup = manual Jun 11 23:11:24.803553 np0000002687 nova-compute[98431]: node.leading_login = No Jun 11 23:11:24.803553 np0000002687 nova-compute[98431]: iface.iscsi_ifacename = default Jun 11 23:11:24.803553 np0000002687 nova-compute[98431]: iface.net_ifacename = Jun 11 23:11:24.803553 np0000002687 nova-compute[98431]: iface.ipaddress = Jun 11 23:11:24.803553 np0000002687 nova-compute[98431]: iface.prefix_len = 0 Jun 11 23:11:24.803553 np0000002687 nova-compute[98431]: iface.hwaddress = Jun 11 23:11:24.803553 np0000002687 nova-compute[98431]: iface.transport_name = tcp Jun 11 23:11:24.803553 np0000002687 nova-compute[98431]: iface.initiatorname = Jun 11 23:11:24.803553 np0000002687 nova-compute[98431]: iface.state = Jun 11 23:11:24.803553 np0000002687 nova-compute[98431]: iface.vlan_id = 0 Jun 11 23:11:24.803553 np0000002687 nova-compute[98431]: iface.vlan_priority = 0 Jun 11 23:11:24.803553 np0000002687 nova-compute[98431]: iface.vlan_state = Jun 11 23:11:24.803553 np0000002687 nova-compute[98431]: iface.iface_num = 0 Jun 11 23:11:24.803553 np0000002687 nova-compute[98431]: iface.mtu = 0 Jun 11 23:11:24.803553 np0000002687 nova-compute[98431]: iface.port = 0 Jun 11 23:11:24.803553 np0000002687 nova-compute[98431]: iface.bootproto = Jun 11 23:11:24.803553 np0000002687 nova-compute[98431]: iface.subnet_mask = Jun 11 23:11:24.803553 np0000002687 nova-compute[98431]: iface.gateway = Jun 11 23:11:24.803553 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id_state = Jun 11 23:11:24.803553 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id = Jun 11 23:11:24.803553 np0000002687 nova-compute[98431]: iface.dhcp_dns = Jun 11 23:11:24.803553 np0000002687 nova-compute[98431]: iface.dhcp_learn_iqn = Jun 11 23:11:24.803553 np0000002687 nova-compute[98431]: iface.dhcp_req_vendor_id_state = Jun 11 23:11:24.803553 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id_state = Jun 11 23:11:24.803553 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id = Jun 11 23:11:24.803553 np0000002687 nova-compute[98431]: iface.dhcp_slp_da = Jun 11 23:11:24.803553 np0000002687 nova-compute[98431]: iface.fragmentation = Jun 11 23:11:24.803553 np0000002687 nova-compute[98431]: iface.gratuitous_arp = Jun 11 23:11:24.803553 np0000002687 nova-compute[98431]: iface.incoming_forwarding = Jun 11 23:11:24.803553 np0000002687 nova-compute[98431]: iface.tos_state = Jun 11 23:11:24.803553 np0000002687 nova-compute[98431]: iface.tos = 0 Jun 11 23:11:24.803553 np0000002687 nova-compute[98431]: iface.ttl = 0 Jun 11 23:11:24.803553 np0000002687 nova-compute[98431]: iface.delayed_ack = Jun 11 23:11:24.803553 np0000002687 nova-compute[98431]: iface.tcp_nagle = Jun 11 23:11:24.803553 np0000002687 nova-compute[98431]: iface.tcp_wsf_state = Jun 11 23:11:24.803553 np0000002687 nova-compute[98431]: iface.tcp_wsf = 0 Jun 11 23:11:24.803553 np0000002687 nova-compute[98431]: iface.tcp_timer_scale = 0 Jun 11 23:11:24.803553 np0000002687 nova-compute[98431]: iface.tcp_timestamp = Jun 11 23:11:24.803553 np0000002687 nova-compute[98431]: iface.redirect = Jun 11 23:11:24.803553 np0000002687 nova-compute[98431]: iface.def_task_mgmt_timeout = 0 Jun 11 23:11:24.803553 np0000002687 nova-compute[98431]: iface.header_digest = Jun 11 23:11:24.803553 np0000002687 nova-compute[98431]: iface.data_digest = Jun 11 23:11:24.803553 np0000002687 nova-compute[98431]: iface.immediate_data = Jun 11 23:11:24.803553 np0000002687 nova-compute[98431]: iface.initial_r2t = Jun 11 23:11:24.803553 np0000002687 nova-compute[98431]: iface.data_seq_inorder = Jun 11 23:11:24.803553 np0000002687 nova-compute[98431]: iface.data_pdu_inorder = Jun 11 23:11:24.803553 np0000002687 nova-compute[98431]: iface.erl = 0 Jun 11 23:11:24.803553 np0000002687 nova-compute[98431]: iface.max_receive_data_len = 0 Jun 11 23:11:24.803553 np0000002687 nova-compute[98431]: iface.first_burst_len = 0 Jun 11 23:11:24.803553 np0000002687 nova-compute[98431]: iface.max_outstanding_r2t = 0 Jun 11 23:11:24.803553 np0000002687 nova-compute[98431]: iface.max_burst_len = 0 Jun 11 23:11:24.803553 np0000002687 nova-compute[98431]: iface.chap_auth = Jun 11 23:11:24.803553 np0000002687 nova-compute[98431]: iface.bidi_chap = Jun 11 23:11:24.803553 np0000002687 nova-compute[98431]: iface.strict_login_compliance = Jun 11 23:11:24.803553 np0000002687 nova-compute[98431]: iface.discovery_auth = Jun 11 23:11:24.803553 np0000002687 nova-compute[98431]: iface.discovery_logout = Jun 11 23:11:24.803553 np0000002687 nova-compute[98431]: node.discovery_address = Jun 11 23:11:24.803553 np0000002687 nova-compute[98431]: node.discovery_port = 0 Jun 11 23:11:24.803553 np0000002687 nova-compute[98431]: node.discovery_type = fw Jun 11 23:11:24.803553 np0000002687 nova-compute[98431]: node.session.initial_cmdsn = 0 Jun 11 23:11:24.803553 np0000002687 nova-compute[98431]: node.session.initial_login_retry_max = 8 Jun 11 23:11:24.803553 np0000002687 nova-compute[98431]: node.session.xmit_thread_priority = 0 Jun 11 23:11:24.803553 np0000002687 nova-compute[98431]: node.session.cmds_max = 128 Jun 11 23:11:24.803553 np0000002687 nova-compute[98431]: node.session.queue_depth = 32 Jun 11 23:11:24.803553 np0000002687 nova-compute[98431]: node.session.nr_sessions = 1 Jun 11 23:11:24.803553 np0000002687 nova-compute[98431]: node.session.auth.authmethod = None Jun 11 23:11:24.803553 np0000002687 nova-compute[98431]: node.session.auth.username = Jun 11 23:11:24.803553 np0000002687 nova-compute[98431]: node.session.auth.password = *** Jun 11 23:11:24.803553 np0000002687 nova-compute[98431]: node.session.auth.username_in = Jun 11 23:11:24.803553 np0000002687 nova-compute[98431]: node.session.auth.password_in = Jun 11 23:11:24.803553 np0000002687 nova-compute[98431]: node.session.auth.chap_algs = SHA256 Jun 11 23:11:24.803553 np0000002687 nova-compute[98431]: node.session.timeo.replacement_timeout = 120 Jun 11 23:11:24.803553 np0000002687 nova-compute[98431]: node.session.err_timeo.abort_timeout = 15 Jun 11 23:11:24.803553 np0000002687 nova-compute[98431]: node.session.err_timeo.lu_reset_timeout = 30 Jun 11 23:11:24.803553 np0000002687 nova-compute[98431]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 11 23:11:24.803553 np0000002687 nova-compute[98431]: node.session.err_timeo.host_reset_timeout = 60 Jun 11 23:11:24.803553 np0000002687 nova-compute[98431]: node.session.iscsi.FastAbort = Yes Jun 11 23:11:24.803553 np0000002687 nova-compute[98431]: node.session.iscsi.InitialR2T = No Jun 11 23:11:24.803553 np0000002687 nova-compute[98431]: node.session.iscsi.ImmediateData = Yes Jun 11 23:11:24.803553 np0000002687 nova-compute[98431]: node.session.iscsi.FirstBurstLength = 262144 Jun 11 23:11:24.803553 np0000002687 nova-compute[98431]: node.session.iscsi.MaxBurstLength = 16776192 Jun 11 23:11:24.803553 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Retain = 0 Jun 11 23:11:24.803553 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Wait = 2 Jun 11 23:11:24.803553 np0000002687 nova-compute[98431]: node.session.iscsi.MaxConnections = 1 Jun 11 23:11:24.803553 np0000002687 nova-compute[98431]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 11 23:11:24.803553 np0000002687 nova-compute[98431]: node.session.iscsi.ERL = 0 Jun 11 23:11:24.803553 np0000002687 nova-compute[98431]: node.session.scan = auto Jun 11 23:11:24.803553 np0000002687 nova-compute[98431]: node.session.reopen_max = 0 Jun 11 23:11:24.803553 np0000002687 nova-compute[98431]: node.conn[0].address = 192.168.50.100 Jun 11 23:11:24.803553 np0000002687 nova-compute[98431]: node.conn[0].port = 3260 Jun 11 23:11:24.803553 np0000002687 nova-compute[98431]: node.conn[0].startup = manual Jun 11 23:11:24.803553 np0000002687 nova-compute[98431]: node.conn[0].tcp.window_size = 524288 Jun 11 23:11:24.803553 np0000002687 nova-compute[98431]: node.conn[0].tcp.type_of_service = 0 Jun 11 23:11:24.803553 np0000002687 nova-compute[98431]: node.conn[0].timeo.logout_timeout = 15 Jun 11 23:11:24.803553 np0000002687 nova-compute[98431]: node.conn[0].timeo.login_timeout = 15 Jun 11 23:11:24.803553 np0000002687 nova-compute[98431]: node.conn[0].timeo.auth_timeout = 45 Jun 11 23:11:24.803553 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_interval = 5 Jun 11 23:11:24.803553 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_timeout = 5 Jun 11 23:11:24.803553 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 11 23:11:24.803553 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 11 23:11:24.803553 np0000002687 nova-compute[98431]: node.conn[0].iscsi.HeaderDigest = None Jun 11 23:11:24.803553 np0000002687 nova-compute[98431]: node.conn[0].iscsi.DataDigest = None Jun 11 23:11:24.803553 np0000002687 nova-compute[98431]: node.conn[0].iscsi.IFMarker = No Jun 11 23:11:24.803553 np0000002687 nova-compute[98431]: node.conn[0].iscsi.OFMarker = No Jun 11 23:11:24.803553 np0000002687 nova-compute[98431]: # END RECORD Jun 11 23:11:24.803553 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:24.812524 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:24.814954 np0000002687 nova-compute[98431]: INFO os_vif [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:58:c8,bridge_name='br-int',has_traffic_filtering=True,id=7051cdff-8b40-42d6-9d8a-9b7748621f1f,network=Network(b4ad3a49-46fc-4f87-83ac-2f820e779189),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7051cdff-8b') Jun 11 23:11:24.816783 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-11T23:10:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-55083950',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='tempest-device-tagging-server-55083950',id=9,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLYbs7b2G1by6R+g1Ak7OKaDEL6OFRfafy/x8MG8Yw4C/HTCI/qxvrM+UbOFbanu5A5mHNVFjkvtwtnsinV4q+nEVUROe2gWmd2XwuNmh27iXsdrupk64B9jYKvtsxBMlg==',key_name='tempest-keypair-900197797',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='57813123648a4335a97e8fc5c245cc73',ramdisk_id='',reservation_id='r-qvvw2lad',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1898457247',owner_user_name='tempest-TaggedBootDevicesTest-1898457247-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-11T23:10:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c853441cf4f34e4d9cd6821201efc91a',uuid=49a042ba-28ba-4401-9bdf-92f96da8f80e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "609ed1b7-9ea3-4ae3-8c37-f0a952a45507", "address": "fa:16:3e:c3:0b:6b", "network": {"id": "b4ad3a49-46fc-4f87-83ac-2f820e779189", "bridge": "br-int", "label": "tempest-device-tagging-net1-1763764299", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.189", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57813123648a4335a97e8fc5c245cc73", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap609ed1b7-9e", "ovs_interfaceid": "609ed1b7-9ea3-4ae3-8c37-f0a952a45507", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98431) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 11 23:11:24.817015 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Converting VIF {"id": "609ed1b7-9ea3-4ae3-8c37-f0a952a45507", "address": "fa:16:3e:c3:0b:6b", "network": {"id": "b4ad3a49-46fc-4f87-83ac-2f820e779189", "bridge": "br-int", "label": "tempest-device-tagging-net1-1763764299", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.189", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57813123648a4335a97e8fc5c245cc73", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap609ed1b7-9e", "ovs_interfaceid": "609ed1b7-9ea3-4ae3-8c37-f0a952a45507", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:11:24.817623 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:0b:6b,bridge_name='br-int',has_traffic_filtering=True,id=609ed1b7-9ea3-4ae3-8c37-f0a952a45507,network=Network(b4ad3a49-46fc-4f87-83ac-2f820e779189),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap609ed1b7-9e') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:11:24.818141 np0000002687 nova-compute[98431]: DEBUG os_vif [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:0b:6b,bridge_name='br-int',has_traffic_filtering=True,id=609ed1b7-9ea3-4ae3-8c37-f0a952a45507,network=Network(b4ad3a49-46fc-4f87-83ac-2f820e779189),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap609ed1b7-9e') {{(pid=98431) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 11 23:11:24.818522 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:24.818819 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:11:24.819047 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 11 23:11:24.820824 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 11 23:11:24.820824 np0000002687 nova-compute[98431]: node.name = iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea Jun 11 23:11:24.820824 np0000002687 nova-compute[98431]: node.tpgt = -1 Jun 11 23:11:24.820824 np0000002687 nova-compute[98431]: node.startup = manual Jun 11 23:11:24.820824 np0000002687 nova-compute[98431]: node.leading_login = No Jun 11 23:11:24.820824 np0000002687 nova-compute[98431]: iface.iscsi_ifacename = default Jun 11 23:11:24.820824 np0000002687 nova-compute[98431]: iface.net_ifacename = Jun 11 23:11:24.820824 np0000002687 nova-compute[98431]: iface.ipaddress = Jun 11 23:11:24.820824 np0000002687 nova-compute[98431]: iface.prefix_len = 0 Jun 11 23:11:24.820824 np0000002687 nova-compute[98431]: iface.hwaddress = Jun 11 23:11:24.820824 np0000002687 nova-compute[98431]: iface.transport_name = tcp Jun 11 23:11:24.820824 np0000002687 nova-compute[98431]: iface.initiatorname = Jun 11 23:11:24.820824 np0000002687 nova-compute[98431]: iface.state = Jun 11 23:11:24.820824 np0000002687 nova-compute[98431]: iface.vlan_id = 0 Jun 11 23:11:24.820824 np0000002687 nova-compute[98431]: iface.vlan_priority = 0 Jun 11 23:11:24.820824 np0000002687 nova-compute[98431]: iface.vlan_state = Jun 11 23:11:24.820824 np0000002687 nova-compute[98431]: iface.iface_num = 0 Jun 11 23:11:24.820824 np0000002687 nova-compute[98431]: iface.mtu = 0 Jun 11 23:11:24.820824 np0000002687 nova-compute[98431]: iface.port = 0 Jun 11 23:11:24.820824 np0000002687 nova-compute[98431]: iface.bootproto = Jun 11 23:11:24.820824 np0000002687 nova-compute[98431]: iface.subnet_mask = Jun 11 23:11:24.820824 np0000002687 nova-compute[98431]: iface.gateway = Jun 11 23:11:24.820824 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id_state = Jun 11 23:11:24.820824 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id = Jun 11 23:11:24.820824 np0000002687 nova-compute[98431]: iface.dhcp_dns = Jun 11 23:11:24.820824 np0000002687 nova-compute[98431]: iface.dhcp_learn_iqn = Jun 11 23:11:24.820824 np0000002687 nova-compute[98431]: iface.dhcp_req_vendor_id_state = Jun 11 23:11:24.820824 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id_state = Jun 11 23:11:24.820824 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id = Jun 11 23:11:24.820824 np0000002687 nova-compute[98431]: iface.dhcp_slp_da = Jun 11 23:11:24.820824 np0000002687 nova-compute[98431]: iface.fragmentation = Jun 11 23:11:24.820824 np0000002687 nova-compute[98431]: iface.gratuitous_arp = Jun 11 23:11:24.820824 np0000002687 nova-compute[98431]: iface.incoming_forwarding = Jun 11 23:11:24.820824 np0000002687 nova-compute[98431]: iface.tos_state = Jun 11 23:11:24.820824 np0000002687 nova-compute[98431]: iface.tos = 0 Jun 11 23:11:24.820824 np0000002687 nova-compute[98431]: iface.ttl = 0 Jun 11 23:11:24.820824 np0000002687 nova-compute[98431]: iface.delayed_ack = Jun 11 23:11:24.820824 np0000002687 nova-compute[98431]: iface.tcp_nagle = Jun 11 23:11:24.820824 np0000002687 nova-compute[98431]: iface.tcp_wsf_state = Jun 11 23:11:24.820824 np0000002687 nova-compute[98431]: iface.tcp_wsf = 0 Jun 11 23:11:24.820824 np0000002687 nova-compute[98431]: iface.tcp_timer_scale = 0 Jun 11 23:11:24.820824 np0000002687 nova-compute[98431]: iface.tcp_timestamp = Jun 11 23:11:24.820824 np0000002687 nova-compute[98431]: iface.redirect = Jun 11 23:11:24.820824 np0000002687 nova-compute[98431]: iface.def_task_mgmt_timeout = 0 Jun 11 23:11:24.820824 np0000002687 nova-compute[98431]: iface.header_digest = Jun 11 23:11:24.820824 np0000002687 nova-compute[98431]: iface.data_digest = Jun 11 23:11:24.820824 np0000002687 nova-compute[98431]: iface.immediate_data = Jun 11 23:11:24.820824 np0000002687 nova-compute[98431]: iface.initial_r2t = Jun 11 23:11:24.820824 np0000002687 nova-compute[98431]: iface.data_seq_inorder = Jun 11 23:11:24.820824 np0000002687 nova-compute[98431]: iface.data_pdu_inorder = Jun 11 23:11:24.820824 np0000002687 nova-compute[98431]: iface.erl = 0 Jun 11 23:11:24.820824 np0000002687 nova-compute[98431]: iface.max_receive_data_len = 0 Jun 11 23:11:24.820824 np0000002687 nova-compute[98431]: iface.first_burst_len = 0 Jun 11 23:11:24.820824 np0000002687 nova-compute[98431]: iface.max_outstanding_r2t = 0 Jun 11 23:11:24.820824 np0000002687 nova-compute[98431]: iface.max_burst_len = 0 Jun 11 23:11:24.820824 np0000002687 nova-compute[98431]: iface.chap_auth = Jun 11 23:11:24.820824 np0000002687 nova-compute[98431]: iface.bidi_chap = Jun 11 23:11:24.820824 np0000002687 nova-compute[98431]: iface.strict_login_compliance = Jun 11 23:11:24.820824 np0000002687 nova-compute[98431]: iface.discovery_auth = Jun 11 23:11:24.820824 np0000002687 nova-compute[98431]: iface.discovery_logout = Jun 11 23:11:24.820824 np0000002687 nova-compute[98431]: node.discovery_address = Jun 11 23:11:24.820824 np0000002687 nova-compute[98431]: node.discovery_port = 0 Jun 11 23:11:24.820824 np0000002687 nova-compute[98431]: node.discovery_type = fw Jun 11 23:11:24.820824 np0000002687 nova-compute[98431]: node.session.initial_cmdsn = 0 Jun 11 23:11:24.820824 np0000002687 nova-compute[98431]: node.session.initial_login_retry_max = 8 Jun 11 23:11:24.820824 np0000002687 nova-compute[98431]: node.session.xmit_thread_priority = 0 Jun 11 23:11:24.820824 np0000002687 nova-compute[98431]: node.session.cmds_max = 128 Jun 11 23:11:24.820824 np0000002687 nova-compute[98431]: node.session.queue_depth = 32 Jun 11 23:11:24.820824 np0000002687 nova-compute[98431]: node.session.nr_sessions = 1 Jun 11 23:11:24.820824 np0000002687 nova-compute[98431]: node.session.auth.authmethod = None Jun 11 23:11:24.820824 np0000002687 nova-compute[98431]: node.session.auth.username = Jun 11 23:11:24.820824 np0000002687 nova-compute[98431]: node.session.auth.password = *** Jun 11 23:11:24.820824 np0000002687 nova-compute[98431]: node.session.auth.username_in = Jun 11 23:11:24.820824 np0000002687 nova-compute[98431]: node.session.auth.password_in = Jun 11 23:11:24.820824 np0000002687 nova-compute[98431]: node.session.auth.chap_algs = SHA256 Jun 11 23:11:24.820824 np0000002687 nova-compute[98431]: node.session.timeo.replacement_timeout = 120 Jun 11 23:11:24.820824 np0000002687 nova-compute[98431]: node.session.err_timeo.abort_timeout = 15 Jun 11 23:11:24.820824 np0000002687 nova-compute[98431]: node.session.err_timeo.lu_reset_timeout = 30 Jun 11 23:11:24.820824 np0000002687 nova-compute[98431]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 11 23:11:24.820824 np0000002687 nova-compute[98431]: node.session.err_timeo.host_reset_timeout = 60 Jun 11 23:11:24.820824 np0000002687 nova-compute[98431]: node.session.iscsi.FastAbort = Yes Jun 11 23:11:24.820824 np0000002687 nova-compute[98431]: node.session.iscsi.InitialR2T = No Jun 11 23:11:24.820824 np0000002687 nova-compute[98431]: node.session.iscsi.ImmediateData = Yes Jun 11 23:11:24.820824 np0000002687 nova-compute[98431]: node.session.iscsi.FirstBurstLength = 262144 Jun 11 23:11:24.820824 np0000002687 nova-compute[98431]: node.session.iscsi.MaxBurstLength = 16776192 Jun 11 23:11:24.820824 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Retain = 0 Jun 11 23:11:24.820824 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Wait = 2 Jun 11 23:11:24.820824 np0000002687 nova-compute[98431]: node.session.iscsi.MaxConnections = 1 Jun 11 23:11:24.820824 np0000002687 nova-compute[98431]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 11 23:11:24.820824 np0000002687 nova-compute[98431]: node.session.iscsi.ERL = 0 Jun 11 23:11:24.820824 np0000002687 nova-compute[98431]: node.session.scan = auto Jun 11 23:11:24.820824 np0000002687 nova-compute[98431]: node.session.reopen_max = 0 Jun 11 23:11:24.820824 np0000002687 nova-compute[98431]: node.conn[0].address = 192.168.40.100 Jun 11 23:11:24.820824 np0000002687 nova-compute[98431]: node.conn[0].port = 3260 Jun 11 23:11:24.820824 np0000002687 nova-compute[98431]: node.conn[0].startup = manual Jun 11 23:11:24.820824 np0000002687 nova-compute[98431]: node.conn[0].tcp.window_size = 524288 Jun 11 23:11:24.820824 np0000002687 nova-compute[98431]: node.conn[0].tcp.type_of_service = 0 Jun 11 23:11:24.820824 np0000002687 nova-compute[98431]: node.conn[0].timeo.logout_timeout = 15 Jun 11 23:11:24.820824 np0000002687 nova-compute[98431]: node.conn[0].timeo.login_timeout = 15 Jun 11 23:11:24.820824 np0000002687 nova-compute[98431]: node.conn[0].timeo.auth_timeout = 45 Jun 11 23:11:24.820824 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_interval = 5 Jun 11 23:11:24.820824 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_timeout = 5 Jun 11 23:11:24.820824 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 11 23:11:24.820824 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 11 23:11:24.820824 np0000002687 nova-compute[98431]: node.conn[0].iscsi.HeaderDigest = None Jun 11 23:11:24.820824 np0000002687 nova-compute[98431]: node.conn[0].iscsi.DataDigest = None Jun 11 23:11:24.820824 np0000002687 nova-compute[98431]: node.conn[0].iscsi.IFMarker = No Jun 11 23:11:24.820824 np0000002687 nova-compute[98431]: node.conn[0].iscsi.OFMarker = No Jun 11 23:11:24.820824 np0000002687 nova-compute[98431]: # END RECORD Jun 11 23:11:24.820824 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:24.825005 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:24.825005 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e199a00f-1c93-5806-aac0-c221f894ff99', '_type': 'linux-noop'}}, row=False) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:11:24.826155 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:24.826155 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:11:24.832219 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:24.840501 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:24.844949 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:24.846058 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:24.846300 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap609ed1b7-9e, may_exist=True, interface_attrs={}) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:11:24.847280 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap609ed1b7-9e, col_values=(('qos', UUID('5b673243-1d64-457a-85fe-15561dbcd8cb')),), if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:11:24.847611 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap609ed1b7-9e, col_values=(('external_ids', {'iface-id': '609ed1b7-9ea3-4ae3-8c37-f0a952a45507', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c3:0b:6b', 'vm-uuid': '49a042ba-28ba-4401-9bdf-92f96da8f80e'}),), if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:11:24.848540 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:24.849898 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:11:24.866205 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:24.866205 np0000002687 nova-compute[98431]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:11:24.866205 np0000002687 nova-compute[98431]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:11:24.866205 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:24.866205 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:24.866205 np0000002687 nova-compute[98431]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:24.866205 np0000002687 nova-compute[98431]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:24.866205 np0000002687 nova-compute[98431]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:24.866205 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:11:24.866205 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:24.866205 np0000002687 nova-compute[98431]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:11:24.866205 np0000002687 nova-compute[98431]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:11:24.866205 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:24.866205 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:24.866205 np0000002687 nova-compute[98431]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:24.866205 np0000002687 nova-compute[98431]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:24.866205 np0000002687 nova-compute[98431]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:24.866205 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:11:24.872329 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:24.873528 np0000002687 nova-compute[98431]: INFO os_vif [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:0b:6b,bridge_name='br-int',has_traffic_filtering=True,id=609ed1b7-9ea3-4ae3-8c37-f0a952a45507,network=Network(b4ad3a49-46fc-4f87-83ac-2f820e779189),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap609ed1b7-9e') Jun 11 23:11:24.874996 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-11T23:10:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-55083950',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='tempest-device-tagging-server-55083950',id=9,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLYbs7b2G1by6R+g1Ak7OKaDEL6OFRfafy/x8MG8Yw4C/HTCI/qxvrM+UbOFbanu5A5mHNVFjkvtwtnsinV4q+nEVUROe2gWmd2XwuNmh27iXsdrupk64B9jYKvtsxBMlg==',key_name='tempest-keypair-900197797',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='57813123648a4335a97e8fc5c245cc73',ramdisk_id='',reservation_id='r-qvvw2lad',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1898457247',owner_user_name='tempest-TaggedBootDevicesTest-1898457247-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-11T23:10:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c853441cf4f34e4d9cd6821201efc91a',uuid=49a042ba-28ba-4401-9bdf-92f96da8f80e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b54ddd43-d4cb-4d4a-840e-895e75419e25", "address": "fa:16:3e:b9:2e:2c", "network": {"id": "b4ad3a49-46fc-4f87-83ac-2f820e779189", "bridge": "br-int", "label": "tempest-device-tagging-net1-1763764299", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57813123648a4335a97e8fc5c245cc73", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb54ddd43-d4", "ovs_interfaceid": "b54ddd43-d4cb-4d4a-840e-895e75419e25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 11 23:11:24.876474 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Converting VIF {"id": "b54ddd43-d4cb-4d4a-840e-895e75419e25", "address": "fa:16:3e:b9:2e:2c", "network": {"id": "b4ad3a49-46fc-4f87-83ac-2f820e779189", "bridge": "br-int", "label": "tempest-device-tagging-net1-1763764299", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57813123648a4335a97e8fc5c245cc73", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb54ddd43-d4", "ovs_interfaceid": "b54ddd43-d4cb-4d4a-840e-895e75419e25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:11:24.876474 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:2e:2c,bridge_name='br-int',has_traffic_filtering=True,id=b54ddd43-d4cb-4d4a-840e-895e75419e25,network=Network(b4ad3a49-46fc-4f87-83ac-2f820e779189),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb54ddd43-d4') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:11:24.876474 np0000002687 nova-compute[98431]: DEBUG os_vif [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:2e:2c,bridge_name='br-int',has_traffic_filtering=True,id=b54ddd43-d4cb-4d4a-840e-895e75419e25,network=Network(b4ad3a49-46fc-4f87-83ac-2f820e779189),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb54ddd43-d4') {{(pid=98431) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 11 23:11:24.877939 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:24.877939 np0000002687 nova-compute[98431]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:11:24.877939 np0000002687 nova-compute[98431]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:11:24.877939 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:24.877939 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:24.877939 np0000002687 nova-compute[98431]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:24.877939 np0000002687 nova-compute[98431]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:24.877939 np0000002687 nova-compute[98431]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:24.877939 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:11:24.880427 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:24.880427 np0000002687 nova-compute[98431]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:11:24.880427 np0000002687 nova-compute[98431]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:11:24.880427 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:24.880427 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:24.880427 np0000002687 nova-compute[98431]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:24.880427 np0000002687 nova-compute[98431]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:24.880427 np0000002687 nova-compute[98431]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:24.880427 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:11:24.880427 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:24.882247 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:11:24.882442 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 11 23:11:24.884302 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:24.884302 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f084d2a9-2b12-5a27-9537-4be0565b5a02', '_type': 'linux-noop'}}, row=False) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:11:24.885779 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:24.885779 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:11:24.900825 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:24.907167 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:24.907167 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb54ddd43-d4, may_exist=True, interface_attrs={}) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:11:24.907167 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb54ddd43-d4, col_values=(('qos', UUID('f8e72589-46ab-491b-8a31-d3c42522c31d')),), if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:11:24.907167 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb54ddd43-d4, col_values=(('external_ids', {'iface-id': 'b54ddd43-d4cb-4d4a-840e-895e75419e25', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b9:2e:2c', 'vm-uuid': '49a042ba-28ba-4401-9bdf-92f96da8f80e'}),), if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:11:24.911404 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:24.913872 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:11:24.927354 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea, portal: 192.168.50.100,3260] Jun 11 23:11:24.927354 np0000002687 nova-compute[98431]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea, portal: 192.168.50.100,3260] successful. Jun 11 23:11:24.927354 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:24.932792 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:24.935065 np0000002687 nova-compute[98431]: INFO os_vif [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:2e:2c,bridge_name='br-int',has_traffic_filtering=True,id=b54ddd43-d4cb-4d4a-840e-895e75419e25,network=Network(b4ad3a49-46fc-4f87-83ac-2f820e779189),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb54ddd43-d4') Jun 11 23:11:24.936107 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-11T23:10:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-55083950',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='tempest-device-tagging-server-55083950',id=9,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLYbs7b2G1by6R+g1Ak7OKaDEL6OFRfafy/x8MG8Yw4C/HTCI/qxvrM+UbOFbanu5A5mHNVFjkvtwtnsinV4q+nEVUROe2gWmd2XwuNmh27iXsdrupk64B9jYKvtsxBMlg==',key_name='tempest-keypair-900197797',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='57813123648a4335a97e8fc5c245cc73',ramdisk_id='',reservation_id='r-qvvw2lad',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1898457247',owner_user_name='tempest-TaggedBootDevicesTest-1898457247-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-11T23:10:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c853441cf4f34e4d9cd6821201efc91a',uuid=49a042ba-28ba-4401-9bdf-92f96da8f80e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "77424d75-6e25-4791-a44d-495051f7e89f", "address": "fa:16:3e:a0:a2:82", "network": {"id": "b4ad3a49-46fc-4f87-83ac-2f820e779189", "bridge": "br-int", "label": "tempest-device-tagging-net1-1763764299", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57813123648a4335a97e8fc5c245cc73", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap77424d75-6e", "ovs_interfaceid": "77424d75-6e25-4791-a44d-495051f7e89f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 11 23:11:24.936970 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Converting VIF {"id": "77424d75-6e25-4791-a44d-495051f7e89f", "address": "fa:16:3e:a0:a2:82", "network": {"id": "b4ad3a49-46fc-4f87-83ac-2f820e779189", "bridge": "br-int", "label": "tempest-device-tagging-net1-1763764299", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57813123648a4335a97e8fc5c245cc73", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap77424d75-6e", "ovs_interfaceid": "77424d75-6e25-4791-a44d-495051f7e89f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:11:24.937654 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:a2:82,bridge_name='br-int',has_traffic_filtering=True,id=77424d75-6e25-4791-a44d-495051f7e89f,network=Network(b4ad3a49-46fc-4f87-83ac-2f820e779189),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77424d75-6e') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:11:24.938321 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea, portal: 192.168.40.100,3260] Jun 11 23:11:24.938321 np0000002687 nova-compute[98431]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea, portal: 192.168.40.100,3260] successful. Jun 11 23:11:24.938321 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:24.938945 np0000002687 nova-compute[98431]: DEBUG os_vif [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:a2:82,bridge_name='br-int',has_traffic_filtering=True,id=77424d75-6e25-4791-a44d-495051f7e89f,network=Network(b4ad3a49-46fc-4f87-83ac-2f820e779189),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77424d75-6e') {{(pid=98431) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 11 23:11:24.939310 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:24.940171 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:11:24.941259 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 11 23:11:24.942994 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:24.944900 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '72d51b76-3555-51e8-af72-dbdf34d7d9e3', '_type': 'linux-noop'}}, row=False) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:11:24.947282 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:24.948634 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:11:24.950545 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:24.966305 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:24.975280 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:24.977022 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:24.977247 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap77424d75-6e, may_exist=True, interface_attrs={}) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:11:24.979418 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:24.979418 np0000002687 nova-compute[98431]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:11:24.979418 np0000002687 nova-compute[98431]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:11:24.979418 np0000002687 nova-compute[98431]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:11:24.979418 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:11:24.979418 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:24.979418 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:24.979418 np0000002687 nova-compute[98431]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:24.979418 np0000002687 nova-compute[98431]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:24.979418 np0000002687 nova-compute[98431]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:24.979418 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:11:24.979826 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap77424d75-6e, col_values=(('qos', UUID('a2611f05-da5e-42ca-80f3-0e6625818de3')),), if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:11:24.980137 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap77424d75-6e, col_values=(('external_ids', {'iface-id': '77424d75-6e25-4791-a44d-495051f7e89f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a0:a2:82', 'vm-uuid': '49a042ba-28ba-4401-9bdf-92f96da8f80e'}),), if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:11:24.980652 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:24.980652 np0000002687 nova-compute[98431]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:11:24.980652 np0000002687 nova-compute[98431]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:11:24.980652 np0000002687 nova-compute[98431]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:11:24.980652 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:11:24.980652 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:24.980652 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:24.980652 np0000002687 nova-compute[98431]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:24.980652 np0000002687 nova-compute[98431]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:24.980652 np0000002687 nova-compute[98431]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:24.980652 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:11:24.981770 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.249s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 11 23:11:24.981770 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Connected to 192.168.50.100:3260 {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 11 23:11:24.983335 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] HCTL ('15', '-', '-', 0) found on session 13 with lun 0 {{(pid=98431) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 11 23:11:24.983335 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98431) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 11 23:11:24.983335 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:24.984931 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:11:24.998053 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:24.998053 np0000002687 nova-compute[98431]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:11:24.998053 np0000002687 nova-compute[98431]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:11:24.998053 np0000002687 nova-compute[98431]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:11:24.998053 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:11:24.998053 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:24.998053 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:24.998053 np0000002687 nova-compute[98431]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:24.998053 np0000002687 nova-compute[98431]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:24.998053 np0000002687 nova-compute[98431]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:24.998053 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:11:24.999869 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:24.999869 np0000002687 nova-compute[98431]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:11:24.999869 np0000002687 nova-compute[98431]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:11:24.999869 np0000002687 nova-compute[98431]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:11:24.999869 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:11:24.999869 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:24.999869 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:24.999869 np0000002687 nova-compute[98431]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:24.999869 np0000002687 nova-compute[98431]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:24.999869 np0000002687 nova-compute[98431]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:24.999869 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:11:24.999869 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.269s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 11 23:11:24.999869 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Connected to 192.168.40.100:3260 {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 11 23:11:25.000433 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] HCTL ('16', '-', '-', 0) found on session 14 with lun 0 {{(pid=98431) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 11 23:11:25.000566 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98431) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 11 23:11:25.009479 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Searching for a device in session 13 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=98431) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 11 23:11:25.010614 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '5498d0af-4b75-4132-b06e-56f2b5b013ea', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 11 23:11:25.011963 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:25.014261 np0000002687 nova-compute[98431]: INFO os_vif [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:a2:82,bridge_name='br-int',has_traffic_filtering=True,id=77424d75-6e25-4791-a44d-495051f7e89f,network=Network(b4ad3a49-46fc-4f87-83ac-2f820e779189),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77424d75-6e') Jun 11 23:11:25.014261 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-11T23:10:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-55083950',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='tempest-device-tagging-server-55083950',id=9,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLYbs7b2G1by6R+g1Ak7OKaDEL6OFRfafy/x8MG8Yw4C/HTCI/qxvrM+UbOFbanu5A5mHNVFjkvtwtnsinV4q+nEVUROe2gWmd2XwuNmh27iXsdrupk64B9jYKvtsxBMlg==',key_name='tempest-keypair-900197797',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='57813123648a4335a97e8fc5c245cc73',ramdisk_id='',reservation_id='r-qvvw2lad',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1898457247',owner_user_name='tempest-TaggedBootDevicesTest-1898457247-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-11T23:10:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c853441cf4f34e4d9cd6821201efc91a',uuid=49a042ba-28ba-4401-9bdf-92f96da8f80e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0263e39d-c835-4cf1-b333-265608e81a93", "address": "fa:16:3e:50:0f:6b", "network": {"id": "25259518-16fe-4690-8216-636e994936ba", "bridge": "br-int", "label": "tempest-device-tagging-net2-736260586", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57813123648a4335a97e8fc5c245cc73", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0263e39d-c8", "ovs_interfaceid": "0263e39d-c835-4cf1-b333-265608e81a93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 11 23:11:25.014261 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Converting VIF {"id": "0263e39d-c835-4cf1-b333-265608e81a93", "address": "fa:16:3e:50:0f:6b", "network": {"id": "25259518-16fe-4690-8216-636e994936ba", "bridge": "br-int", "label": "tempest-device-tagging-net2-736260586", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57813123648a4335a97e8fc5c245cc73", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0263e39d-c8", "ovs_interfaceid": "0263e39d-c835-4cf1-b333-265608e81a93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:11:25.015116 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:0f:6b,bridge_name='br-int',has_traffic_filtering=True,id=0263e39d-c835-4cf1-b333-265608e81a93,network=Network(25259518-16fe-4690-8216-636e994936ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0263e39d-c8') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:11:25.015116 np0000002687 nova-compute[98431]: DEBUG os_vif [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:0f:6b,bridge_name='br-int',has_traffic_filtering=True,id=0263e39d-c835-4cf1-b333-265608e81a93,network=Network(25259518-16fe-4690-8216-636e994936ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0263e39d-c8') {{(pid=98431) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 11 23:11:25.015116 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:25.015116 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:11:25.015116 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 11 23:11:25.016618 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:25.016738 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0d393e17-a7e4-52bf-97aa-b339fd8df709', '_type': 'linux-noop'}}, row=False) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:11:25.017471 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:25.018069 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:11:25.021597 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Searching for a device in session 14 and hctl ['16', '*', '*', 0] yield: None {{(pid=98431) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 11 23:11:25.050489 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:25.054409 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:25.054601 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0263e39d-c8, may_exist=True, interface_attrs={}) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:11:25.055341 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0263e39d-c8, col_values=(('qos', UUID('abdf5859-2564-489d-8496-17620b3c2ed0')),), if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:11:25.056556 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0263e39d-c8, col_values=(('external_ids', {'iface-id': '0263e39d-c835-4cf1-b333-265608e81a93', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:50:0f:6b', 'vm-uuid': '49a042ba-28ba-4401-9bdf-92f96da8f80e'}),), if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:11:25.057368 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:25.058675 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:11:25.101706 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:25.103429 np0000002687 nova-compute[98431]: INFO os_vif [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:0f:6b,bridge_name='br-int',has_traffic_filtering=True,id=0263e39d-c835-4cf1-b333-265608e81a93,network=Network(25259518-16fe-4690-8216-636e994936ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0263e39d-c8') Jun 11 23:11:25.103429 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-11T23:10:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-55083950',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='tempest-device-tagging-server-55083950',id=9,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLYbs7b2G1by6R+g1Ak7OKaDEL6OFRfafy/x8MG8Yw4C/HTCI/qxvrM+UbOFbanu5A5mHNVFjkvtwtnsinV4q+nEVUROe2gWmd2XwuNmh27iXsdrupk64B9jYKvtsxBMlg==',key_name='tempest-keypair-900197797',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='57813123648a4335a97e8fc5c245cc73',ramdisk_id='',reservation_id='r-qvvw2lad',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1898457247',owner_user_name='tempest-TaggedBootDevicesTest-1898457247-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-11T23:10:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c853441cf4f34e4d9cd6821201efc91a',uuid=49a042ba-28ba-4401-9bdf-92f96da8f80e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "09135c79-b0df-40af-b05b-2e171390f37f", "address": "fa:16:3e:c4:56:b3", "network": {"id": "25259518-16fe-4690-8216-636e994936ba", "bridge": "br-int", "label": "tempest-device-tagging-net2-736260586", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57813123648a4335a97e8fc5c245cc73", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap09135c79-b0", "ovs_interfaceid": "09135c79-b0df-40af-b05b-2e171390f37f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 11 23:11:25.103736 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Converting VIF {"id": "09135c79-b0df-40af-b05b-2e171390f37f", "address": "fa:16:3e:c4:56:b3", "network": {"id": "25259518-16fe-4690-8216-636e994936ba", "bridge": "br-int", "label": "tempest-device-tagging-net2-736260586", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57813123648a4335a97e8fc5c245cc73", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap09135c79-b0", "ovs_interfaceid": "09135c79-b0df-40af-b05b-2e171390f37f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:11:25.104839 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:56:b3,bridge_name='br-int',has_traffic_filtering=True,id=09135c79-b0df-40af-b05b-2e171390f37f,network=Network(25259518-16fe-4690-8216-636e994936ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09135c79-b0') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:11:25.104839 np0000002687 nova-compute[98431]: DEBUG os_vif [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:56:b3,bridge_name='br-int',has_traffic_filtering=True,id=09135c79-b0df-40af-b05b-2e171390f37f,network=Network(25259518-16fe-4690-8216-636e994936ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09135c79-b0') {{(pid=98431) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 11 23:11:25.104839 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:25.104839 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:11:25.105106 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 11 23:11:25.107694 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:25.107914 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fa00d23e-40c7-5fd2-8e6c-9ad309fec738', '_type': 'linux-noop'}}, row=False) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:11:25.110067 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:25.110067 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:11:25.154934 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:25.158210 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:25.158845 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap09135c79-b0, may_exist=True, interface_attrs={}) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:11:25.158845 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap09135c79-b0, col_values=(('qos', UUID('e72af38d-2dae-4c5c-8cde-ea0c52e0076b')),), if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:11:25.159032 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap09135c79-b0, col_values=(('external_ids', {'iface-id': '09135c79-b0df-40af-b05b-2e171390f37f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c4:56:b3', 'vm-uuid': '49a042ba-28ba-4401-9bdf-92f96da8f80e'}),), if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:11:25.162826 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:25.162826 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:11:25.205161 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:25.207687 np0000002687 nova-compute[98431]: INFO os_vif [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:56:b3,bridge_name='br-int',has_traffic_filtering=True,id=09135c79-b0df-40af-b05b-2e171390f37f,network=Network(25259518-16fe-4690-8216-636e994936ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09135c79-b0') Jun 11 23:11:25.229183 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-c6ff320a-0a6f-4b1f-93c2-7758a3217053 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.812s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:11:25.230568 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-c6ff320a-0a6f-4b1f-93c2-7758a3217053 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 8ffa4bbe-7ead-4029-aba5-28f031f6e784] Start building networks asynchronously for instance. {{(pid=98431) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 11 23:11:25.738083 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-c6ff320a-0a6f-4b1f-93c2-7758a3217053 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 8ffa4bbe-7ead-4029-aba5-28f031f6e784] Allocating IP information in the background. {{(pid=98431) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 11 23:11:25.739223 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-c6ff320a-0a6f-4b1f-93c2-7758a3217053 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 8ffa4bbe-7ead-4029-aba5-28f031f6e784] allocate_for_instance() {{(pid=98431) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 11 23:11:25.739653 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-c6ff320a-0a6f-4b1f-93c2-7758a3217053 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:11:25.740211 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-c6ff320a-0a6f-4b1f-93c2-7758a3217053 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:11:25.837479 np0000002687 nova-compute[98431]: DEBUG nova.policy [None req-c6ff320a-0a6f-4b1f-93c2-7758a3217053 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c17e84202f404c3c8e73292bb59d7b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fd45f475a04e5c8e9bd9deb7ad4c1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98431) authorize /opt/stack/nova/nova/policy.py:192}} Jun 11 23:11:26.021650 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Searching for a device in session 14 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98431) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 11 23:11:26.021650 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5498d0af-4b75-4132-b06e-56f2b5b013ea', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 11 23:11:26.241098 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-c6ff320a-0a6f-4b1f-93c2-7758a3217053 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 8ffa4bbe-7ead-4029-aba5-28f031f6e784] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 11 23:11:26.330281 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:26.545430 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-c6ff320a-0a6f-4b1f-93c2-7758a3217053 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 8ffa4bbe-7ead-4029-aba5-28f031f6e784] Successfully created port: 591ff615-4a02-4f43-a49b-7f4052a8ed27 {{(pid=98431) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 11 23:11:26.732687 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] No BDM found with device name hda, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:11:26.733623 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:11:26.733623 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] No VIF found with MAC fa:16:3e:e8:a7:df, not building metadata {{(pid=98431) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13199}} Jun 11 23:11:26.733623 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] No VIF found with MAC fa:16:3e:a0:a2:82, not building metadata {{(pid=98431) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13199}} Jun 11 23:11:26.734444 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Using config drive Jun 11 23:11:26.749003 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-c6ff320a-0a6f-4b1f-93c2-7758a3217053 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 8ffa4bbe-7ead-4029-aba5-28f031f6e784] Start building block device mappings for instance. {{(pid=98431) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 11 23:11:26.752655 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Found WWN 330000000b5e39cd6 for multipath device dm-8 {{(pid=98431) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 11 23:11:26.752781 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.042s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 11 23:11:26.753052 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] <== connect_volume: return (3374ms) {'type': 'block', 'scsi_wwn': '330000000b5e39cd6', 'path': '/dev/dm-8', 'multipath_id': '330000000b5e39cd6'} {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 11 23:11:26.753222 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.volume.iscsi [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000b5e39cd6', 'path': '/dev/dm-8', 'multipath_id': '330000000b5e39cd6'} {{(pid=98431) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 11 23:11:27.100998 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-c6ff320a-0a6f-4b1f-93c2-7758a3217053 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 8ffa4bbe-7ead-4029-aba5-28f031f6e784] Successfully updated port: 591ff615-4a02-4f43-a49b-7f4052a8ed27 {{(pid=98431) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 11 23:11:27.166139 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-e7ba24e9-80ea-4804-963e-1f4f4c3d3a89 req-2a237bac-2f0f-42d6-b75a-f0e873790273 service nova] [instance: 8ffa4bbe-7ead-4029-aba5-28f031f6e784] Received event network-changed-591ff615-4a02-4f43-a49b-7f4052a8ed27 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:11:27.166617 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-e7ba24e9-80ea-4804-963e-1f4f4c3d3a89 req-2a237bac-2f0f-42d6-b75a-f0e873790273 service nova] [instance: 8ffa4bbe-7ead-4029-aba5-28f031f6e784] Refreshing instance network info cache due to event network-changed-591ff615-4a02-4f43-a49b-7f4052a8ed27. {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 11 23:11:27.166817 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-e7ba24e9-80ea-4804-963e-1f4f4c3d3a89 req-2a237bac-2f0f-42d6-b75a-f0e873790273 service nova] Acquiring lock "refresh_cache-8ffa4bbe-7ead-4029-aba5-28f031f6e784" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 11 23:11:27.166995 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-e7ba24e9-80ea-4804-963e-1f4f4c3d3a89 req-2a237bac-2f0f-42d6-b75a-f0e873790273 service nova] Acquired lock "refresh_cache-8ffa4bbe-7ead-4029-aba5-28f031f6e784" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 11 23:11:27.167071 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-e7ba24e9-80ea-4804-963e-1f4f4c3d3a89 req-2a237bac-2f0f-42d6-b75a-f0e873790273 service nova] [instance: 8ffa4bbe-7ead-4029-aba5-28f031f6e784] Refreshing network info cache for port 591ff615-4a02-4f43-a49b-7f4052a8ed27 {{(pid=98431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 11 23:11:27.242259 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:11:27.268195 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-11T23:11:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-28433977',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='tempest-serverbootfromvolumestablerescuetest-server-28433977',id=11,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aaf744af828a4a5eba1e98da63373b2b',ramdisk_id='',reservation_id='r-mqq12a2i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-539499192',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-11T23:11:17Z,user_data=None,user_id='72b6dac5eb744cfba6299636227aa59b',uuid=c82748e6-1c78-4372-ad4b-48d1c6448efa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "852fc4ec-82e1-4185-a33c-3c45ff42351e", "address": "fa:16:3e:c6:c6:5b", "network": {"id": "2a770c99-2ec6-4fa2-945b-32830a59e7a7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-137493671-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aaf744af828a4a5eba1e98da63373b2b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap852fc4ec-82", "ovs_interfaceid": "852fc4ec-82e1-4185-a33c-3c45ff42351e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98431) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 11 23:11:27.268399 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Converting VIF {"id": "852fc4ec-82e1-4185-a33c-3c45ff42351e", "address": "fa:16:3e:c6:c6:5b", "network": {"id": "2a770c99-2ec6-4fa2-945b-32830a59e7a7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-137493671-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aaf744af828a4a5eba1e98da63373b2b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap852fc4ec-82", "ovs_interfaceid": "852fc4ec-82e1-4185-a33c-3c45ff42351e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:11:27.273488 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:c6:5b,bridge_name='br-int',has_traffic_filtering=True,id=852fc4ec-82e1-4185-a33c-3c45ff42351e,network=Network(2a770c99-2ec6-4fa2-945b-32830a59e7a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap852fc4ec-82') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:11:27.275980 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lazy-loading 'pci_devices' on Instance uuid c82748e6-1c78-4372-ad4b-48d1c6448efa {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:11:27.417282 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Creating config drive at /opt/stack/data/nova/instances/49a042ba-28ba-4401-9bdf-92f96da8f80e/disk.config Jun 11 23:11:27.421905 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/49a042ba-28ba-4401-9bdf-92f96da8f80e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpo50787i5 {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:11:27.461864 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/49a042ba-28ba-4401-9bdf-92f96da8f80e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpo50787i5" returned: 0 in 0.038s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:11:27.599506 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:27.606147 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-c6ff320a-0a6f-4b1f-93c2-7758a3217053 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Acquiring lock "refresh_cache-8ffa4bbe-7ead-4029-aba5-28f031f6e784" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 11 23:11:27.671966 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [req-e7ba24e9-80ea-4804-963e-1f4f4c3d3a89 req-2a237bac-2f0f-42d6-b75a-f0e873790273 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:11:27.762882 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-c6ff320a-0a6f-4b1f-93c2-7758a3217053 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 8ffa4bbe-7ead-4029-aba5-28f031f6e784] Start spawning the instance on the hypervisor. {{(pid=98431) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 11 23:11:27.764444 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-c6ff320a-0a6f-4b1f-93c2-7758a3217053 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 8ffa4bbe-7ead-4029-aba5-28f031f6e784] Creating instance directory {{(pid=98431) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}} Jun 11 23:11:27.764818 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-c6ff320a-0a6f-4b1f-93c2-7758a3217053 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 8ffa4bbe-7ead-4029-aba5-28f031f6e784] Creating image(s) Jun 11 23:11:27.766510 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-c6ff320a-0a6f-4b1f-93c2-7758a3217053 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Acquiring lock "/opt/stack/data/nova/instances/8ffa4bbe-7ead-4029-aba5-28f031f6e784/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:11:27.767109 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-c6ff320a-0a6f-4b1f-93c2-7758a3217053 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "/opt/stack/data/nova/instances/8ffa4bbe-7ead-4029-aba5-28f031f6e784/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:11:27.769129 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-c6ff320a-0a6f-4b1f-93c2-7758a3217053 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "/opt/stack/data/nova/instances/8ffa4bbe-7ead-4029-aba5-28f031f6e784/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.002s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:11:27.771404 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-c6ff320a-0a6f-4b1f-93c2-7758a3217053 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:11:27.776509 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-c6ff320a-0a6f-4b1f-93c2-7758a3217053 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:11:27.780830 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-c6ff320a-0a6f-4b1f-93c2-7758a3217053 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:11:27.801820 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] End _get_guest_xml xml= Jun 11 23:11:27.801820 np0000002687 nova-compute[98431]: c82748e6-1c78-4372-ad4b-48d1c6448efa Jun 11 23:11:27.801820 np0000002687 nova-compute[98431]: instance-0000000b Jun 11 23:11:27.801820 np0000002687 nova-compute[98431]: 196608 Jun 11 23:11:27.801820 np0000002687 nova-compute[98431]: 1 Jun 11 23:11:27.801820 np0000002687 nova-compute[98431]: Jun 11 23:11:27.801820 np0000002687 nova-compute[98431]: Jun 11 23:11:27.801820 np0000002687 nova-compute[98431]: Jun 11 23:11:27.801820 np0000002687 nova-compute[98431]: tempest-ServerBootFromVolumeStableRescueTest-server-28433977 Jun 11 23:11:27.801820 np0000002687 nova-compute[98431]: 2026-06-11 23:11:23 Jun 11 23:11:27.801820 np0000002687 nova-compute[98431]: Jun 11 23:11:27.801820 np0000002687 nova-compute[98431]: 192 Jun 11 23:11:27.801820 np0000002687 nova-compute[98431]: 1 Jun 11 23:11:27.801820 np0000002687 nova-compute[98431]: 0 Jun 11 23:11:27.801820 np0000002687 nova-compute[98431]: 0 Jun 11 23:11:27.801820 np0000002687 nova-compute[98431]: 1 Jun 11 23:11:27.801820 np0000002687 nova-compute[98431]: Jun 11 23:11:27.801820 np0000002687 nova-compute[98431]: True Jun 11 23:11:27.801820 np0000002687 nova-compute[98431]: Jun 11 23:11:27.801820 np0000002687 nova-compute[98431]: Jun 11 23:11:27.801820 np0000002687 nova-compute[98431]: Jun 11 23:11:27.801820 np0000002687 nova-compute[98431]: bare Jun 11 23:11:27.801820 np0000002687 nova-compute[98431]: qcow2 Jun 11 23:11:27.801820 np0000002687 nova-compute[98431]: 1 Jun 11 23:11:27.801820 np0000002687 nova-compute[98431]: 0 Jun 11 23:11:27.801820 np0000002687 nova-compute[98431]: Jun 11 23:11:27.801820 np0000002687 nova-compute[98431]: virtio Jun 11 23:11:27.801820 np0000002687 nova-compute[98431]: Jun 11 23:11:27.801820 np0000002687 nova-compute[98431]: Jun 11 23:11:27.801820 np0000002687 nova-compute[98431]: Jun 11 23:11:27.801820 np0000002687 nova-compute[98431]: tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member Jun 11 23:11:27.801820 np0000002687 nova-compute[98431]: tempest-ServerBootFromVolumeStableRescueTest-539499192 Jun 11 23:11:27.801820 np0000002687 nova-compute[98431]: Jun 11 23:11:27.801820 np0000002687 nova-compute[98431]: Jun 11 23:11:27.801820 np0000002687 nova-compute[98431]: Jun 11 23:11:27.801820 np0000002687 nova-compute[98431]: Jun 11 23:11:27.801820 np0000002687 nova-compute[98431]: Jun 11 23:11:27.801820 np0000002687 nova-compute[98431]: Jun 11 23:11:27.801820 np0000002687 nova-compute[98431]: Jun 11 23:11:27.801820 np0000002687 nova-compute[98431]: Jun 11 23:11:27.801820 np0000002687 nova-compute[98431]: Jun 11 23:11:27.801820 np0000002687 nova-compute[98431]: Jun 11 23:11:27.801820 np0000002687 nova-compute[98431]: Jun 11 23:11:27.801820 np0000002687 nova-compute[98431]: OpenStack Foundation Jun 11 23:11:27.801820 np0000002687 nova-compute[98431]: OpenStack Nova Jun 11 23:11:27.801820 np0000002687 nova-compute[98431]: 33.1.0 Jun 11 23:11:27.801820 np0000002687 nova-compute[98431]: c82748e6-1c78-4372-ad4b-48d1c6448efa Jun 11 23:11:27.801820 np0000002687 nova-compute[98431]: c82748e6-1c78-4372-ad4b-48d1c6448efa Jun 11 23:11:27.801820 np0000002687 nova-compute[98431]: Virtual Machine Jun 11 23:11:27.801820 np0000002687 nova-compute[98431]: Jun 11 23:11:27.801820 np0000002687 nova-compute[98431]: Jun 11 23:11:27.801820 np0000002687 nova-compute[98431]: Jun 11 23:11:27.801820 np0000002687 nova-compute[98431]: hvm Jun 11 23:11:27.801820 np0000002687 nova-compute[98431]: Jun 11 23:11:27.801820 np0000002687 nova-compute[98431]: Jun 11 23:11:27.801820 np0000002687 nova-compute[98431]: Jun 11 23:11:27.801820 np0000002687 nova-compute[98431]: Jun 11 23:11:27.801820 np0000002687 nova-compute[98431]: Jun 11 23:11:27.801820 np0000002687 nova-compute[98431]: Jun 11 23:11:27.801820 np0000002687 nova-compute[98431]: 128 Jun 11 23:11:27.801820 np0000002687 nova-compute[98431]: Jun 11 23:11:27.801820 np0000002687 nova-compute[98431]: Jun 11 23:11:27.801820 np0000002687 nova-compute[98431]: Jun 11 23:11:27.801820 np0000002687 nova-compute[98431]: 1 Jun 11 23:11:27.801820 np0000002687 nova-compute[98431]: Jun 11 23:11:27.801820 np0000002687 nova-compute[98431]: Jun 11 23:11:27.801820 np0000002687 nova-compute[98431]: Nehalem Jun 11 23:11:27.801820 np0000002687 nova-compute[98431]: Jun 11 23:11:27.801820 np0000002687 nova-compute[98431]: Jun 11 23:11:27.801820 np0000002687 nova-compute[98431]: Jun 11 23:11:27.801820 np0000002687 nova-compute[98431]: Jun 11 23:11:27.801820 np0000002687 nova-compute[98431]: Jun 11 23:11:27.801820 np0000002687 nova-compute[98431]: Jun 11 23:11:27.801820 np0000002687 nova-compute[98431]: Jun 11 23:11:27.801820 np0000002687 nova-compute[98431]: Jun 11 23:11:27.801820 np0000002687 nova-compute[98431]: Jun 11 23:11:27.801820 np0000002687 nova-compute[98431]: Jun 11 23:11:27.801820 np0000002687 nova-compute[98431]: Jun 11 23:11:27.801820 np0000002687 nova-compute[98431]: Jun 11 23:11:27.801820 np0000002687 nova-compute[98431]: Jun 11 23:11:27.801820 np0000002687 nova-compute[98431]: 5498d0af-4b75-4132-b06e-56f2b5b013ea Jun 11 23:11:27.801820 np0000002687 nova-compute[98431]: Jun 11 23:11:27.801820 np0000002687 nova-compute[98431]: Jun 11 23:11:27.801820 np0000002687 nova-compute[98431]: Jun 11 23:11:27.801820 np0000002687 nova-compute[98431]: Jun 11 23:11:27.801820 np0000002687 nova-compute[98431]: Jun 11 23:11:27.801820 np0000002687 nova-compute[98431]: Jun 11 23:11:27.801820 np0000002687 nova-compute[98431]: Jun 11 23:11:27.801820 np0000002687 nova-compute[98431]: Jun 11 23:11:27.801820 np0000002687 nova-compute[98431]: Jun 11 23:11:27.801820 np0000002687 nova-compute[98431]: Jun 11 23:11:27.801820 np0000002687 nova-compute[98431]: Jun 11 23:11:27.801820 np0000002687 nova-compute[98431]: Jun 11 23:11:27.801820 np0000002687 nova-compute[98431]: Jun 11 23:11:27.801820 np0000002687 nova-compute[98431]: Jun 11 23:11:27.801820 np0000002687 nova-compute[98431]: /dev/urandom Jun 11 23:11:27.801820 np0000002687 nova-compute[98431]: Jun 11 23:11:27.801820 np0000002687 nova-compute[98431]: Jun 11 23:11:27.801820 np0000002687 nova-compute[98431]: Jun 11 23:11:27.801820 np0000002687 nova-compute[98431]: Jun 11 23:11:27.801820 np0000002687 nova-compute[98431]: Jun 11 23:11:27.801820 np0000002687 nova-compute[98431]: Jun 11 23:11:27.801820 np0000002687 nova-compute[98431]: Jun 11 23:11:27.801820 np0000002687 nova-compute[98431]: {{(pid=98431) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 11 23:11:27.809075 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-e7ba24e9-80ea-4804-963e-1f4f4c3d3a89 req-2a237bac-2f0f-42d6-b75a-f0e873790273 service nova] [instance: 8ffa4bbe-7ead-4029-aba5-28f031f6e784] Instance cache missing network info. {{(pid=98431) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 11 23:11:27.809510 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Preparing to wait for external event network-vif-plugged-852fc4ec-82e1-4185-a33c-3c45ff42351e {{(pid=98431) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 11 23:11:27.809823 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Acquiring lock "c82748e6-1c78-4372-ad4b-48d1c6448efa-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:11:27.811950 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lock "c82748e6-1c78-4372-ad4b-48d1c6448efa-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:11:27.811950 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lock "c82748e6-1c78-4372-ad4b-48d1c6448efa-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:11:27.815854 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-11T23:11:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-28433977',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='tempest-serverbootfromvolumestablerescuetest-server-28433977',id=11,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aaf744af828a4a5eba1e98da63373b2b',ramdisk_id='',reservation_id='r-mqq12a2i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-539499192',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-11T23:11:17Z,user_data=None,user_id='72b6dac5eb744cfba6299636227aa59b',uuid=c82748e6-1c78-4372-ad4b-48d1c6448efa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "852fc4ec-82e1-4185-a33c-3c45ff42351e", "address": "fa:16:3e:c6:c6:5b", "network": {"id": "2a770c99-2ec6-4fa2-945b-32830a59e7a7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-137493671-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aaf744af828a4a5eba1e98da63373b2b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap852fc4ec-82", "ovs_interfaceid": "852fc4ec-82e1-4185-a33c-3c45ff42351e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 11 23:11:27.816254 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Converting VIF {"id": "852fc4ec-82e1-4185-a33c-3c45ff42351e", "address": "fa:16:3e:c6:c6:5b", "network": {"id": "2a770c99-2ec6-4fa2-945b-32830a59e7a7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-137493671-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aaf744af828a4a5eba1e98da63373b2b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap852fc4ec-82", "ovs_interfaceid": "852fc4ec-82e1-4185-a33c-3c45ff42351e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:11:27.817580 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:c6:5b,bridge_name='br-int',has_traffic_filtering=True,id=852fc4ec-82e1-4185-a33c-3c45ff42351e,network=Network(2a770c99-2ec6-4fa2-945b-32830a59e7a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap852fc4ec-82') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:11:27.817957 np0000002687 nova-compute[98431]: DEBUG os_vif [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:c6:5b,bridge_name='br-int',has_traffic_filtering=True,id=852fc4ec-82e1-4185-a33c-3c45ff42351e,network=Network(2a770c99-2ec6-4fa2-945b-32830a59e7a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap852fc4ec-82') {{(pid=98431) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 11 23:11:27.818603 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:27.820014 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:11:27.820103 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 11 23:11:27.826786 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:27.827177 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4cb36eac-e086-581d-b466-1b326580ce69', '_type': 'linux-noop'}}, row=False) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:11:27.830397 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:27.831002 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:11:27.874697 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-c6ff320a-0a6f-4b1f-93c2-7758a3217053 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json" returned: 0 in 0.095s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:11:27.875179 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-c6ff320a-0a6f-4b1f-93c2-7758a3217053 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Acquiring lock "d2c441059b2992961b5de03c05b32d04aff77cb1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:11:27.876129 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-c6ff320a-0a6f-4b1f-93c2-7758a3217053 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "d2c441059b2992961b5de03c05b32d04aff77cb1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:11:27.877088 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-c6ff320a-0a6f-4b1f-93c2-7758a3217053 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:11:27.885410 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:27.886771 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-c6ff320a-0a6f-4b1f-93c2-7758a3217053 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:11:27.888657 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-c6ff320a-0a6f-4b1f-93c2-7758a3217053 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:11:27.908024 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:27.911485 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap852fc4ec-82, may_exist=True, interface_attrs={}) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:11:27.911485 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap852fc4ec-82, col_values=(('qos', UUID('0cd33629-2980-48f5-b2ed-1bcfdd2f291f')),), if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:11:27.913330 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap852fc4ec-82, col_values=(('external_ids', {'iface-id': '852fc4ec-82e1-4185-a33c-3c45ff42351e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c6:c6:5b', 'vm-uuid': 'c82748e6-1c78-4372-ad4b-48d1c6448efa'}),), if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:11:27.916964 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:27.918095 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:11:27.981521 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:27.987198 np0000002687 nova-compute[98431]: INFO os_vif [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:c6:5b,bridge_name='br-int',has_traffic_filtering=True,id=852fc4ec-82e1-4185-a33c-3c45ff42351e,network=Network(2a770c99-2ec6-4fa2-945b-32830a59e7a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap852fc4ec-82') Jun 11 23:11:27.988476 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-c6ff320a-0a6f-4b1f-93c2-7758a3217053 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json" returned: 0 in 0.100s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:11:27.989070 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-c6ff320a-0a6f-4b1f-93c2-7758a3217053 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1,backing_fmt=raw /opt/stack/data/nova/instances/8ffa4bbe-7ead-4029-aba5-28f031f6e784/disk 1073741824 {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:11:28.035831 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:28.065256 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-c6ff320a-0a6f-4b1f-93c2-7758a3217053 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1,backing_fmt=raw /opt/stack/data/nova/instances/8ffa4bbe-7ead-4029-aba5-28f031f6e784/disk 1073741824" returned: 0 in 0.076s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:11:28.066044 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-c6ff320a-0a6f-4b1f-93c2-7758a3217053 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "d2c441059b2992961b5de03c05b32d04aff77cb1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.190s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:11:28.067268 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-c6ff320a-0a6f-4b1f-93c2-7758a3217053 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:11:28.112017 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:28.165862 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-c6ff320a-0a6f-4b1f-93c2-7758a3217053 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json" returned: 0 in 0.098s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:11:28.166736 np0000002687 nova-compute[98431]: DEBUG nova.virt.disk.api [None req-c6ff320a-0a6f-4b1f-93c2-7758a3217053 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8ffa4bbe-7ead-4029-aba5-28f031f6e784/disk. size=1073741824 {{(pid=98431) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 11 23:11:28.167091 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-c6ff320a-0a6f-4b1f-93c2-7758a3217053 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ffa4bbe-7ead-4029-aba5-28f031f6e784/disk --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:11:28.200591 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-e7ba24e9-80ea-4804-963e-1f4f4c3d3a89 req-2a237bac-2f0f-42d6-b75a-f0e873790273 service nova] [instance: 8ffa4bbe-7ead-4029-aba5-28f031f6e784] Updating instance_info_cache with network_info: [] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:11:28.219770 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:28.315707 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-c6ff320a-0a6f-4b1f-93c2-7758a3217053 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ffa4bbe-7ead-4029-aba5-28f031f6e784/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:11:28.316727 np0000002687 nova-compute[98431]: DEBUG nova.virt.disk.api [None req-c6ff320a-0a6f-4b1f-93c2-7758a3217053 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Cannot resize image /opt/stack/data/nova/instances/8ffa4bbe-7ead-4029-aba5-28f031f6e784/disk to a smaller size. {{(pid=98431) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 11 23:11:28.316727 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-c6ff320a-0a6f-4b1f-93c2-7758a3217053 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 8ffa4bbe-7ead-4029-aba5-28f031f6e784] Created local disks {{(pid=98431) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}} Jun 11 23:11:28.316727 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-c6ff320a-0a6f-4b1f-93c2-7758a3217053 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 8ffa4bbe-7ead-4029-aba5-28f031f6e784] Ensure instance console log exists: /opt/stack/data/nova/instances/8ffa4bbe-7ead-4029-aba5-28f031f6e784/console.log {{(pid=98431) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}} Jun 11 23:11:28.317059 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-c6ff320a-0a6f-4b1f-93c2-7758a3217053 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:11:28.317301 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-c6ff320a-0a6f-4b1f-93c2-7758a3217053 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:11:28.317510 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-c6ff320a-0a6f-4b1f-93c2-7758a3217053 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:11:28.352674 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:28.397295 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:28.419828 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:28.473279 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:28.522342 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:28.568305 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:28.593500 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:28.600205 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:28.636336 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:28.655625 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:28.689675 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:28.706265 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-e7ba24e9-80ea-4804-963e-1f4f4c3d3a89 req-2a237bac-2f0f-42d6-b75a-f0e873790273 service nova] Releasing lock "refresh_cache-8ffa4bbe-7ead-4029-aba5-28f031f6e784" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 11 23:11:28.706676 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-c6ff320a-0a6f-4b1f-93c2-7758a3217053 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Acquired lock "refresh_cache-8ffa4bbe-7ead-4029-aba5-28f031f6e784" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 11 23:11:28.707595 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-c6ff320a-0a6f-4b1f-93c2-7758a3217053 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 8ffa4bbe-7ead-4029-aba5-28f031f6e784] Building network info cache for instance {{(pid=98431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 11 23:11:28.761223 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:28.767698 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-cefd2b14-c4da-47c7-8f09-90487a20defb req-44e5ed9b-b8d0-44fc-a4a0-afdb1622ab67 service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Received event network-vif-plugged-7051cdff-8b40-42d6-9d8a-9b7748621f1f {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:11:28.768374 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-cefd2b14-c4da-47c7-8f09-90487a20defb req-44e5ed9b-b8d0-44fc-a4a0-afdb1622ab67 service nova] Acquiring lock "49a042ba-28ba-4401-9bdf-92f96da8f80e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:11:28.770211 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-cefd2b14-c4da-47c7-8f09-90487a20defb req-44e5ed9b-b8d0-44fc-a4a0-afdb1622ab67 service nova] Lock "49a042ba-28ba-4401-9bdf-92f96da8f80e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:11:28.770380 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-cefd2b14-c4da-47c7-8f09-90487a20defb req-44e5ed9b-b8d0-44fc-a4a0-afdb1622ab67 service nova] Lock "49a042ba-28ba-4401-9bdf-92f96da8f80e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.002s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:11:28.770555 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-cefd2b14-c4da-47c7-8f09-90487a20defb req-44e5ed9b-b8d0-44fc-a4a0-afdb1622ab67 service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Processing event network-vif-plugged-7051cdff-8b40-42d6-9d8a-9b7748621f1f {{(pid=98431) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 11 23:11:28.824527 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:28.827757 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:28.832550 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:28.968013 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:28.981039 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:29.016284 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:29.176897 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:29.312827 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-923fad97-ec70-4a22-9a9b-7dbffe80c473 req-eb4f5d58-ae1d-4a0b-97c4-cc3668c7207d service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Received event network-vif-plugged-609ed1b7-9ea3-4ae3-8c37-f0a952a45507 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:11:29.312827 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-923fad97-ec70-4a22-9a9b-7dbffe80c473 req-eb4f5d58-ae1d-4a0b-97c4-cc3668c7207d service nova] Acquiring lock "49a042ba-28ba-4401-9bdf-92f96da8f80e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:11:29.312827 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-923fad97-ec70-4a22-9a9b-7dbffe80c473 req-eb4f5d58-ae1d-4a0b-97c4-cc3668c7207d service nova] Lock "49a042ba-28ba-4401-9bdf-92f96da8f80e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:11:29.312827 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-923fad97-ec70-4a22-9a9b-7dbffe80c473 req-eb4f5d58-ae1d-4a0b-97c4-cc3668c7207d service nova] Lock "49a042ba-28ba-4401-9bdf-92f96da8f80e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:11:29.312827 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-923fad97-ec70-4a22-9a9b-7dbffe80c473 req-eb4f5d58-ae1d-4a0b-97c4-cc3668c7207d service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Processing event network-vif-plugged-609ed1b7-9ea3-4ae3-8c37-f0a952a45507 {{(pid=98431) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 11 23:11:29.312827 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-923fad97-ec70-4a22-9a9b-7dbffe80c473 req-eb4f5d58-ae1d-4a0b-97c4-cc3668c7207d service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Received event network-vif-plugged-609ed1b7-9ea3-4ae3-8c37-f0a952a45507 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:11:29.312827 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-923fad97-ec70-4a22-9a9b-7dbffe80c473 req-eb4f5d58-ae1d-4a0b-97c4-cc3668c7207d service nova] Acquiring lock "49a042ba-28ba-4401-9bdf-92f96da8f80e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:11:29.312827 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-923fad97-ec70-4a22-9a9b-7dbffe80c473 req-eb4f5d58-ae1d-4a0b-97c4-cc3668c7207d service nova] Lock "49a042ba-28ba-4401-9bdf-92f96da8f80e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:11:29.313121 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-923fad97-ec70-4a22-9a9b-7dbffe80c473 req-eb4f5d58-ae1d-4a0b-97c4-cc3668c7207d service nova] Lock "49a042ba-28ba-4401-9bdf-92f96da8f80e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:11:29.313121 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-923fad97-ec70-4a22-9a9b-7dbffe80c473 req-eb4f5d58-ae1d-4a0b-97c4-cc3668c7207d service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] No event matching network-vif-plugged-609ed1b7-9ea3-4ae3-8c37-f0a952a45507 in dict_keys([('network-vif-plugged', '7808ce0e-ec36-4dfa-84d5-0eb1ce542139'), ('network-vif-plugged', 'b54ddd43-d4cb-4d4a-840e-895e75419e25'), ('network-vif-plugged', '77424d75-6e25-4791-a44d-495051f7e89f'), ('network-vif-plugged', '0263e39d-c835-4cf1-b333-265608e81a93'), ('network-vif-plugged', '09135c79-b0df-40af-b05b-2e171390f37f')]) {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jun 11 23:11:29.313293 np0000002687 nova-compute[98431]: WARNING nova.compute.manager [req-923fad97-ec70-4a22-9a9b-7dbffe80c473 req-eb4f5d58-ae1d-4a0b-97c4-cc3668c7207d service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Received unexpected event network-vif-plugged-609ed1b7-9ea3-4ae3-8c37-f0a952a45507 for instance with vm_state building and task_state spawning. Jun 11 23:11:29.366297 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:29.373768 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:29.377547 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:29.381250 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-c6ff320a-0a6f-4b1f-93c2-7758a3217053 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 8ffa4bbe-7ead-4029-aba5-28f031f6e784] Instance cache missing network info. {{(pid=98431) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 11 23:11:29.405553 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:29.412093 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:29.566220 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] No BDM found with device name hda, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:11:29.566966 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] No BDM found with device name vda, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:11:29.566966 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] No VIF found with MAC fa:16:3e:c6:c6:5b, not building metadata {{(pid=98431) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13199}} Jun 11 23:11:29.567289 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Using config drive Jun 11 23:11:29.820305 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:29.830723 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:29.853047 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-c6ff320a-0a6f-4b1f-93c2-7758a3217053 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:11:30.030197 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:30.035807 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-c6ff320a-0a6f-4b1f-93c2-7758a3217053 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 8ffa4bbe-7ead-4029-aba5-28f031f6e784] Updating instance_info_cache with network_info: [{"id": "591ff615-4a02-4f43-a49b-7f4052a8ed27", "address": "fa:16:3e:61:b7:fd", "network": {"id": "17593db3-c22d-4354-ab29-933b1c6a5c3a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1094286565-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "81fd45f475a04e5c8e9bd9deb7ad4c1e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap591ff615-4a", "ovs_interfaceid": "591ff615-4a02-4f43-a49b-7f4052a8ed27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:11:30.038685 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:30.077267 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:11:30.238909 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:30.244694 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Creating config drive at /opt/stack/data/nova/instances/c82748e6-1c78-4372-ad4b-48d1c6448efa/disk.config Jun 11 23:11:30.248951 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/c82748e6-1c78-4372-ad4b-48d1c6448efa/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmptz5f6y8n {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:11:30.249297 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:30.295257 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/c82748e6-1c78-4372-ad4b-48d1c6448efa/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmptz5f6y8n" returned: 0 in 0.045s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:11:30.338929 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Emitting event Started> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:11:30.339368 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] VM Started (Lifecycle Event) Jun 11 23:11:30.537854 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-c6ff320a-0a6f-4b1f-93c2-7758a3217053 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Releasing lock "refresh_cache-8ffa4bbe-7ead-4029-aba5-28f031f6e784" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 11 23:11:30.538309 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-c6ff320a-0a6f-4b1f-93c2-7758a3217053 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 8ffa4bbe-7ead-4029-aba5-28f031f6e784] Instance network_info: |[{"id": "591ff615-4a02-4f43-a49b-7f4052a8ed27", "address": "fa:16:3e:61:b7:fd", "network": {"id": "17593db3-c22d-4354-ab29-933b1c6a5c3a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1094286565-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "81fd45f475a04e5c8e9bd9deb7ad4c1e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap591ff615-4a", "ovs_interfaceid": "591ff615-4a02-4f43-a49b-7f4052a8ed27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98431) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 11 23:11:30.540663 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-c6ff320a-0a6f-4b1f-93c2-7758a3217053 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 8ffa4bbe-7ead-4029-aba5-28f031f6e784] Start _get_guest_xml network_info=[{"id": "591ff615-4a02-4f43-a49b-7f4052a8ed27", "address": "fa:16:3e:61:b7:fd", "network": {"id": "17593db3-c22d-4354-ab29-933b1c6a5c3a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1094286565-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "81fd45f475a04e5c8e9bd9deb7ad4c1e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap591ff615-4a", "ovs_interfaceid": "591ff615-4a02-4f43-a49b-7f4052a8ed27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-11T23:08:20Z,direct_url=,disk_format='qcow2',id=f30640f8-7aca-4300-a085-4706a5209a79,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ce012f9fabdb4ee5a73e212437f59d97',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-11T23:08:23Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'image_id': 'f30640f8-7aca-4300-a085-4706a5209a79'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98431) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 11 23:11:30.545661 np0000002687 nova-compute[98431]: WARNING nova.virt.libvirt.driver [None req-c6ff320a-0a6f-4b1f-93c2-7758a3217053 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 11 23:11:30.546895 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-c6ff320a-0a6f-4b1f-93c2-7758a3217053 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='f30640f8-7aca-4300-a085-4706a5209a79', instance_meta=NovaInstanceMeta(name='multiattach-server-1', uuid='8ffa4bbe-7ead-4029-aba5-28f031f6e784'), owner=OwnerMeta(userid='c17e84202f404c3c8e73292bb59d7b27', username='tempest-AttachVolumeMultiAttachTest-1514006700-project-member', projectid='81fd45f475a04e5c8e9bd9deb7ad4c1e', projectname='tempest-AttachVolumeMultiAttachTest-1514006700'), image=ImageMeta(id='f30640f8-7aca-4300-a085-4706a5209a79', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "591ff615-4a02-4f43-a49b-7f4052a8ed27", "address": "fa:16:3e:61:b7:fd", "network": {"id": "17593db3-c22d-4354-ab29-933b1c6a5c3a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1094286565-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "81fd45f475a04e5c8e9bd9deb7ad4c1e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap591ff615-4a", "ovs_interfaceid": "591ff615-4a02-4f43-a49b-7f4052a8ed27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1781219490.5463774) {{(pid=98431) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 11 23:11:30.548354 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-c6ff320a-0a6f-4b1f-93c2-7758a3217053 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Searching host: 'np0000002687' for CPU controller through CGroups V1... {{(pid=98431) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 11 23:11:30.548869 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-c6ff320a-0a6f-4b1f-93c2-7758a3217053 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] CPU controller missing on host. {{(pid=98431) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 11 23:11:30.553630 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-c6ff320a-0a6f-4b1f-93c2-7758a3217053 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Searching host: 'np0000002687' for CPU controller through CGroups V2... {{(pid=98431) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 11 23:11:30.554484 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-c6ff320a-0a6f-4b1f-93c2-7758a3217053 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] CPU controller found on host. {{(pid=98431) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 11 23:11:30.555334 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-c6ff320a-0a6f-4b1f-93c2-7758a3217053 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98431) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 11 23:11:30.555729 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-c6ff320a-0a6f-4b1f-93c2-7758a3217053 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-11T23:08:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-11T23:08:20Z,direct_url=,disk_format='qcow2',id=f30640f8-7aca-4300-a085-4706a5209a79,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ce012f9fabdb4ee5a73e212437f59d97',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-11T23:08:23Z,virtual_size=,visibility=), allow threads: True {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 11 23:11:30.556043 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-c6ff320a-0a6f-4b1f-93c2-7758a3217053 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Flavor limits 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 11 23:11:30.556126 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-c6ff320a-0a6f-4b1f-93c2-7758a3217053 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Image limits 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 11 23:11:30.556320 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-c6ff320a-0a6f-4b1f-93c2-7758a3217053 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Flavor pref 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 11 23:11:30.556537 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-c6ff320a-0a6f-4b1f-93c2-7758a3217053 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Image pref 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 11 23:11:30.556586 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-c6ff320a-0a6f-4b1f-93c2-7758a3217053 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 11 23:11:30.556855 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-c6ff320a-0a6f-4b1f-93c2-7758a3217053 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 11 23:11:30.557716 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-c6ff320a-0a6f-4b1f-93c2-7758a3217053 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98431) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 11 23:11:30.557898 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-c6ff320a-0a6f-4b1f-93c2-7758a3217053 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Got 1 possible topologies {{(pid=98431) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 11 23:11:30.558048 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-c6ff320a-0a6f-4b1f-93c2-7758a3217053 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 11 23:11:30.558217 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-c6ff320a-0a6f-4b1f-93c2-7758a3217053 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 11 23:11:30.576024 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-c6ff320a-0a6f-4b1f-93c2-7758a3217053 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-11T23:11:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='multiattach-server-1',id=12,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHngWA9S/0M7yAiCaKN7wJ0iqGBq18p6o1N91kfGTes8iMQtxmsCxH/Iqg51e2HEWFsjD10S17Kahb+vCzu07nJJQGe3fNUonThwHNf0exiWq4jZuXjSZtHJPO0dbow48A==',key_name='tempest-keypair-1974490716',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='81fd45f475a04e5c8e9bd9deb7ad4c1e',ramdisk_id='',reservation_id='r-lq2f0fi1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1514006700',owner_user_name='tempest-AttachVolumeMultiAttachTest-1514006700-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-11T23:11:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c17e84202f404c3c8e73292bb59d7b27',uuid=8ffa4bbe-7ead-4029-aba5-28f031f6e784,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "591ff615-4a02-4f43-a49b-7f4052a8ed27", "address": "fa:16:3e:61:b7:fd", "network": {"id": "17593db3-c22d-4354-ab29-933b1c6a5c3a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1094286565-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "81fd45f475a04e5c8e9bd9deb7ad4c1e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap591ff615-4a", "ovs_interfaceid": "591ff615-4a02-4f43-a49b-7f4052a8ed27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98431) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 11 23:11:30.576238 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-c6ff320a-0a6f-4b1f-93c2-7758a3217053 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Converting VIF {"id": "591ff615-4a02-4f43-a49b-7f4052a8ed27", "address": "fa:16:3e:61:b7:fd", "network": {"id": "17593db3-c22d-4354-ab29-933b1c6a5c3a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1094286565-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "81fd45f475a04e5c8e9bd9deb7ad4c1e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap591ff615-4a", "ovs_interfaceid": "591ff615-4a02-4f43-a49b-7f4052a8ed27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:11:30.577143 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-c6ff320a-0a6f-4b1f-93c2-7758a3217053 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:b7:fd,bridge_name='br-int',has_traffic_filtering=True,id=591ff615-4a02-4f43-a49b-7f4052a8ed27,network=Network(17593db3-c22d-4354-ab29-933b1c6a5c3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap591ff615-4a') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:11:30.577889 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-c6ff320a-0a6f-4b1f-93c2-7758a3217053 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lazy-loading 'pci_devices' on Instance uuid 8ffa4bbe-7ead-4029-aba5-28f031f6e784 {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:11:30.646785 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:30.662635 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:30.690658 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:30.694656 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:30.806045 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:30.832624 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:30.837032 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:30.845829 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:11:30.848028 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Emitting event Paused> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:11:30.848173 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] VM Paused (Lifecycle Event) Jun 11 23:11:30.920748 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-a51962d9-1c75-4daf-af7e-bef071467d31 req-0254a1c4-68b2-44ed-acc3-eb4baa0da071 service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Received event network-vif-plugged-7051cdff-8b40-42d6-9d8a-9b7748621f1f {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:11:30.920748 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-a51962d9-1c75-4daf-af7e-bef071467d31 req-0254a1c4-68b2-44ed-acc3-eb4baa0da071 service nova] Acquiring lock "49a042ba-28ba-4401-9bdf-92f96da8f80e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:11:30.920748 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-a51962d9-1c75-4daf-af7e-bef071467d31 req-0254a1c4-68b2-44ed-acc3-eb4baa0da071 service nova] Lock "49a042ba-28ba-4401-9bdf-92f96da8f80e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:11:30.922354 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-a51962d9-1c75-4daf-af7e-bef071467d31 req-0254a1c4-68b2-44ed-acc3-eb4baa0da071 service nova] Lock "49a042ba-28ba-4401-9bdf-92f96da8f80e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:11:30.922452 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-a51962d9-1c75-4daf-af7e-bef071467d31 req-0254a1c4-68b2-44ed-acc3-eb4baa0da071 service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] No event matching network-vif-plugged-7051cdff-8b40-42d6-9d8a-9b7748621f1f in dict_keys([('network-vif-plugged', '7808ce0e-ec36-4dfa-84d5-0eb1ce542139'), ('network-vif-plugged', 'b54ddd43-d4cb-4d4a-840e-895e75419e25'), ('network-vif-plugged', '77424d75-6e25-4791-a44d-495051f7e89f'), ('network-vif-plugged', '0263e39d-c835-4cf1-b333-265608e81a93'), ('network-vif-plugged', '09135c79-b0df-40af-b05b-2e171390f37f')]) {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jun 11 23:11:30.922616 np0000002687 nova-compute[98431]: WARNING nova.compute.manager [req-a51962d9-1c75-4daf-af7e-bef071467d31 req-0254a1c4-68b2-44ed-acc3-eb4baa0da071 service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Received unexpected event network-vif-plugged-7051cdff-8b40-42d6-9d8a-9b7748621f1f for instance with vm_state building and task_state spawning. Jun 11 23:11:30.922836 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-a51962d9-1c75-4daf-af7e-bef071467d31 req-0254a1c4-68b2-44ed-acc3-eb4baa0da071 service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Received event network-vif-plugged-0263e39d-c835-4cf1-b333-265608e81a93 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:11:30.922836 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-a51962d9-1c75-4daf-af7e-bef071467d31 req-0254a1c4-68b2-44ed-acc3-eb4baa0da071 service nova] Acquiring lock "49a042ba-28ba-4401-9bdf-92f96da8f80e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:11:30.923479 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-a51962d9-1c75-4daf-af7e-bef071467d31 req-0254a1c4-68b2-44ed-acc3-eb4baa0da071 service nova] Lock "49a042ba-28ba-4401-9bdf-92f96da8f80e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:11:30.923742 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-a51962d9-1c75-4daf-af7e-bef071467d31 req-0254a1c4-68b2-44ed-acc3-eb4baa0da071 service nova] Lock "49a042ba-28ba-4401-9bdf-92f96da8f80e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:11:30.923823 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-a51962d9-1c75-4daf-af7e-bef071467d31 req-0254a1c4-68b2-44ed-acc3-eb4baa0da071 service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Processing event network-vif-plugged-0263e39d-c835-4cf1-b333-265608e81a93 {{(pid=98431) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 11 23:11:30.924057 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-a51962d9-1c75-4daf-af7e-bef071467d31 req-0254a1c4-68b2-44ed-acc3-eb4baa0da071 service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Received event network-vif-plugged-0263e39d-c835-4cf1-b333-265608e81a93 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:11:30.924244 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-a51962d9-1c75-4daf-af7e-bef071467d31 req-0254a1c4-68b2-44ed-acc3-eb4baa0da071 service nova] Acquiring lock "49a042ba-28ba-4401-9bdf-92f96da8f80e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:11:30.924469 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-a51962d9-1c75-4daf-af7e-bef071467d31 req-0254a1c4-68b2-44ed-acc3-eb4baa0da071 service nova] Lock "49a042ba-28ba-4401-9bdf-92f96da8f80e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:11:30.924665 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-a51962d9-1c75-4daf-af7e-bef071467d31 req-0254a1c4-68b2-44ed-acc3-eb4baa0da071 service nova] Lock "49a042ba-28ba-4401-9bdf-92f96da8f80e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:11:30.925003 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-a51962d9-1c75-4daf-af7e-bef071467d31 req-0254a1c4-68b2-44ed-acc3-eb4baa0da071 service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] No event matching network-vif-plugged-0263e39d-c835-4cf1-b333-265608e81a93 in dict_keys([('network-vif-plugged', '7808ce0e-ec36-4dfa-84d5-0eb1ce542139'), ('network-vif-plugged', 'b54ddd43-d4cb-4d4a-840e-895e75419e25'), ('network-vif-plugged', '77424d75-6e25-4791-a44d-495051f7e89f'), ('network-vif-plugged', '09135c79-b0df-40af-b05b-2e171390f37f')]) {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jun 11 23:11:30.925226 np0000002687 nova-compute[98431]: WARNING nova.compute.manager [req-a51962d9-1c75-4daf-af7e-bef071467d31 req-0254a1c4-68b2-44ed-acc3-eb4baa0da071 service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Received unexpected event network-vif-plugged-0263e39d-c835-4cf1-b333-265608e81a93 for instance with vm_state building and task_state spawning. Jun 11 23:11:30.951027 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:31.006305 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:31.009134 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:31.082468 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-c6ff320a-0a6f-4b1f-93c2-7758a3217053 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 8ffa4bbe-7ead-4029-aba5-28f031f6e784] End _get_guest_xml xml= Jun 11 23:11:31.082468 np0000002687 nova-compute[98431]: 8ffa4bbe-7ead-4029-aba5-28f031f6e784 Jun 11 23:11:31.082468 np0000002687 nova-compute[98431]: instance-0000000c Jun 11 23:11:31.082468 np0000002687 nova-compute[98431]: 196608 Jun 11 23:11:31.082468 np0000002687 nova-compute[98431]: 1 Jun 11 23:11:31.082468 np0000002687 nova-compute[98431]: Jun 11 23:11:31.082468 np0000002687 nova-compute[98431]: Jun 11 23:11:31.082468 np0000002687 nova-compute[98431]: Jun 11 23:11:31.082468 np0000002687 nova-compute[98431]: multiattach-server-1 Jun 11 23:11:31.082468 np0000002687 nova-compute[98431]: 2026-06-11 23:11:30 Jun 11 23:11:31.082468 np0000002687 nova-compute[98431]: Jun 11 23:11:31.082468 np0000002687 nova-compute[98431]: 192 Jun 11 23:11:31.082468 np0000002687 nova-compute[98431]: 1 Jun 11 23:11:31.082468 np0000002687 nova-compute[98431]: 0 Jun 11 23:11:31.082468 np0000002687 nova-compute[98431]: 0 Jun 11 23:11:31.082468 np0000002687 nova-compute[98431]: 1 Jun 11 23:11:31.082468 np0000002687 nova-compute[98431]: Jun 11 23:11:31.082468 np0000002687 nova-compute[98431]: True Jun 11 23:11:31.082468 np0000002687 nova-compute[98431]: Jun 11 23:11:31.082468 np0000002687 nova-compute[98431]: Jun 11 23:11:31.082468 np0000002687 nova-compute[98431]: Jun 11 23:11:31.082468 np0000002687 nova-compute[98431]: bare Jun 11 23:11:31.082468 np0000002687 nova-compute[98431]: qcow2 Jun 11 23:11:31.082468 np0000002687 nova-compute[98431]: 1 Jun 11 23:11:31.082468 np0000002687 nova-compute[98431]: 0 Jun 11 23:11:31.082468 np0000002687 nova-compute[98431]: Jun 11 23:11:31.082468 np0000002687 nova-compute[98431]: virtio Jun 11 23:11:31.082468 np0000002687 nova-compute[98431]: Jun 11 23:11:31.082468 np0000002687 nova-compute[98431]: Jun 11 23:11:31.082468 np0000002687 nova-compute[98431]: Jun 11 23:11:31.082468 np0000002687 nova-compute[98431]: tempest-AttachVolumeMultiAttachTest-1514006700-project-member Jun 11 23:11:31.082468 np0000002687 nova-compute[98431]: tempest-AttachVolumeMultiAttachTest-1514006700 Jun 11 23:11:31.082468 np0000002687 nova-compute[98431]: Jun 11 23:11:31.082468 np0000002687 nova-compute[98431]: Jun 11 23:11:31.082468 np0000002687 nova-compute[98431]: Jun 11 23:11:31.082468 np0000002687 nova-compute[98431]: Jun 11 23:11:31.082468 np0000002687 nova-compute[98431]: Jun 11 23:11:31.082468 np0000002687 nova-compute[98431]: Jun 11 23:11:31.082468 np0000002687 nova-compute[98431]: Jun 11 23:11:31.082468 np0000002687 nova-compute[98431]: Jun 11 23:11:31.082468 np0000002687 nova-compute[98431]: Jun 11 23:11:31.082468 np0000002687 nova-compute[98431]: Jun 11 23:11:31.082468 np0000002687 nova-compute[98431]: Jun 11 23:11:31.082468 np0000002687 nova-compute[98431]: OpenStack Foundation Jun 11 23:11:31.082468 np0000002687 nova-compute[98431]: OpenStack Nova Jun 11 23:11:31.082468 np0000002687 nova-compute[98431]: 33.1.0 Jun 11 23:11:31.082468 np0000002687 nova-compute[98431]: 8ffa4bbe-7ead-4029-aba5-28f031f6e784 Jun 11 23:11:31.082468 np0000002687 nova-compute[98431]: 8ffa4bbe-7ead-4029-aba5-28f031f6e784 Jun 11 23:11:31.082468 np0000002687 nova-compute[98431]: Virtual Machine Jun 11 23:11:31.082468 np0000002687 nova-compute[98431]: Jun 11 23:11:31.082468 np0000002687 nova-compute[98431]: Jun 11 23:11:31.082468 np0000002687 nova-compute[98431]: Jun 11 23:11:31.082468 np0000002687 nova-compute[98431]: hvm Jun 11 23:11:31.082468 np0000002687 nova-compute[98431]: Jun 11 23:11:31.082468 np0000002687 nova-compute[98431]: Jun 11 23:11:31.082468 np0000002687 nova-compute[98431]: Jun 11 23:11:31.082468 np0000002687 nova-compute[98431]: Jun 11 23:11:31.082468 np0000002687 nova-compute[98431]: Jun 11 23:11:31.082468 np0000002687 nova-compute[98431]: Jun 11 23:11:31.082468 np0000002687 nova-compute[98431]: 128 Jun 11 23:11:31.082468 np0000002687 nova-compute[98431]: Jun 11 23:11:31.082468 np0000002687 nova-compute[98431]: Jun 11 23:11:31.082468 np0000002687 nova-compute[98431]: Jun 11 23:11:31.082468 np0000002687 nova-compute[98431]: 1 Jun 11 23:11:31.082468 np0000002687 nova-compute[98431]: Jun 11 23:11:31.082468 np0000002687 nova-compute[98431]: Jun 11 23:11:31.082468 np0000002687 nova-compute[98431]: Nehalem Jun 11 23:11:31.082468 np0000002687 nova-compute[98431]: Jun 11 23:11:31.082468 np0000002687 nova-compute[98431]: Jun 11 23:11:31.082468 np0000002687 nova-compute[98431]: Jun 11 23:11:31.082468 np0000002687 nova-compute[98431]: Jun 11 23:11:31.082468 np0000002687 nova-compute[98431]: Jun 11 23:11:31.082468 np0000002687 nova-compute[98431]: Jun 11 23:11:31.082468 np0000002687 nova-compute[98431]: Jun 11 23:11:31.082468 np0000002687 nova-compute[98431]: Jun 11 23:11:31.082468 np0000002687 nova-compute[98431]: Jun 11 23:11:31.082468 np0000002687 nova-compute[98431]: Jun 11 23:11:31.082468 np0000002687 nova-compute[98431]: Jun 11 23:11:31.082468 np0000002687 nova-compute[98431]: Jun 11 23:11:31.082468 np0000002687 nova-compute[98431]: Jun 11 23:11:31.082468 np0000002687 nova-compute[98431]: Jun 11 23:11:31.082468 np0000002687 nova-compute[98431]: Jun 11 23:11:31.082468 np0000002687 nova-compute[98431]: Jun 11 23:11:31.082468 np0000002687 nova-compute[98431]: Jun 11 23:11:31.082468 np0000002687 nova-compute[98431]: Jun 11 23:11:31.082468 np0000002687 nova-compute[98431]: Jun 11 23:11:31.082468 np0000002687 nova-compute[98431]: Jun 11 23:11:31.082468 np0000002687 nova-compute[98431]: Jun 11 23:11:31.082468 np0000002687 nova-compute[98431]: Jun 11 23:11:31.082468 np0000002687 nova-compute[98431]: Jun 11 23:11:31.082468 np0000002687 nova-compute[98431]: Jun 11 23:11:31.082468 np0000002687 nova-compute[98431]: Jun 11 23:11:31.082468 np0000002687 nova-compute[98431]: Jun 11 23:11:31.082468 np0000002687 nova-compute[98431]: /dev/urandom Jun 11 23:11:31.082468 np0000002687 nova-compute[98431]: Jun 11 23:11:31.082468 np0000002687 nova-compute[98431]: Jun 11 23:11:31.082468 np0000002687 nova-compute[98431]: Jun 11 23:11:31.082468 np0000002687 nova-compute[98431]: Jun 11 23:11:31.082468 np0000002687 nova-compute[98431]: Jun 11 23:11:31.082468 np0000002687 nova-compute[98431]: Jun 11 23:11:31.082468 np0000002687 nova-compute[98431]: Jun 11 23:11:31.082468 np0000002687 nova-compute[98431]: {{(pid=98431) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 11 23:11:31.085832 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-c6ff320a-0a6f-4b1f-93c2-7758a3217053 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 8ffa4bbe-7ead-4029-aba5-28f031f6e784] Preparing to wait for external event network-vif-plugged-591ff615-4a02-4f43-a49b-7f4052a8ed27 {{(pid=98431) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 11 23:11:31.085832 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-c6ff320a-0a6f-4b1f-93c2-7758a3217053 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Acquiring lock "8ffa4bbe-7ead-4029-aba5-28f031f6e784-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:11:31.085832 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-c6ff320a-0a6f-4b1f-93c2-7758a3217053 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "8ffa4bbe-7ead-4029-aba5-28f031f6e784-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:11:31.085832 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-c6ff320a-0a6f-4b1f-93c2-7758a3217053 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "8ffa4bbe-7ead-4029-aba5-28f031f6e784-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:11:31.089153 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-c6ff320a-0a6f-4b1f-93c2-7758a3217053 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-11T23:11:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='multiattach-server-1',id=12,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHngWA9S/0M7yAiCaKN7wJ0iqGBq18p6o1N91kfGTes8iMQtxmsCxH/Iqg51e2HEWFsjD10S17Kahb+vCzu07nJJQGe3fNUonThwHNf0exiWq4jZuXjSZtHJPO0dbow48A==',key_name='tempest-keypair-1974490716',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='81fd45f475a04e5c8e9bd9deb7ad4c1e',ramdisk_id='',reservation_id='r-lq2f0fi1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1514006700',owner_user_name='tempest-AttachVolumeMultiAttachTest-1514006700-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-11T23:11:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c17e84202f404c3c8e73292bb59d7b27',uuid=8ffa4bbe-7ead-4029-aba5-28f031f6e784,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "591ff615-4a02-4f43-a49b-7f4052a8ed27", "address": "fa:16:3e:61:b7:fd", "network": {"id": "17593db3-c22d-4354-ab29-933b1c6a5c3a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1094286565-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "81fd45f475a04e5c8e9bd9deb7ad4c1e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap591ff615-4a", "ovs_interfaceid": "591ff615-4a02-4f43-a49b-7f4052a8ed27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 11 23:11:31.089153 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-c6ff320a-0a6f-4b1f-93c2-7758a3217053 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Converting VIF {"id": "591ff615-4a02-4f43-a49b-7f4052a8ed27", "address": "fa:16:3e:61:b7:fd", "network": {"id": "17593db3-c22d-4354-ab29-933b1c6a5c3a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1094286565-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "81fd45f475a04e5c8e9bd9deb7ad4c1e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap591ff615-4a", "ovs_interfaceid": "591ff615-4a02-4f43-a49b-7f4052a8ed27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:11:31.089153 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-c6ff320a-0a6f-4b1f-93c2-7758a3217053 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:b7:fd,bridge_name='br-int',has_traffic_filtering=True,id=591ff615-4a02-4f43-a49b-7f4052a8ed27,network=Network(17593db3-c22d-4354-ab29-933b1c6a5c3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap591ff615-4a') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:11:31.093348 np0000002687 nova-compute[98431]: DEBUG os_vif [None req-c6ff320a-0a6f-4b1f-93c2-7758a3217053 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:b7:fd,bridge_name='br-int',has_traffic_filtering=True,id=591ff615-4a02-4f43-a49b-7f4052a8ed27,network=Network(17593db3-c22d-4354-ab29-933b1c6a5c3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap591ff615-4a') {{(pid=98431) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 11 23:11:31.093941 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:31.094369 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:11:31.094559 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 11 23:11:31.096068 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:31.096212 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5113b84a-42e3-5787-b41f-f8d88af91f7e', '_type': 'linux-noop'}}, row=False) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:11:31.099318 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:11:31.106071 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:31.106755 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap591ff615-4a, may_exist=True, interface_attrs={}) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:11:31.106843 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap591ff615-4a, col_values=(('qos', UUID('2f2b6402-4527-45ab-8d00-cbb8e634372a')),), if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:11:31.107040 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap591ff615-4a, col_values=(('external_ids', {'iface-id': '591ff615-4a02-4f43-a49b-7f4052a8ed27', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:61:b7:fd', 'vm-uuid': '8ffa4bbe-7ead-4029-aba5-28f031f6e784'}),), if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:11:31.110364 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:31.112709 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:11:31.120245 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:31.123132 np0000002687 nova-compute[98431]: INFO os_vif [None req-c6ff320a-0a6f-4b1f-93c2-7758a3217053 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:b7:fd,bridge_name='br-int',has_traffic_filtering=True,id=591ff615-4a02-4f43-a49b-7f4052a8ed27,network=Network(17593db3-c22d-4354-ab29-933b1c6a5c3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap591ff615-4a') Jun 11 23:11:31.217680 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:31.226311 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:31.353484 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:11:31.356970 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98431) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 11 23:11:31.454605 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-6439ee01-f7a1-4766-acfe-6ecaaa4df365 req-a25cc26d-ec27-435f-889b-2ca785697a6b service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Received event network-vif-plugged-b54ddd43-d4cb-4d4a-840e-895e75419e25 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:11:31.454605 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-6439ee01-f7a1-4766-acfe-6ecaaa4df365 req-a25cc26d-ec27-435f-889b-2ca785697a6b service nova] Acquiring lock "49a042ba-28ba-4401-9bdf-92f96da8f80e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:11:31.454605 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-6439ee01-f7a1-4766-acfe-6ecaaa4df365 req-a25cc26d-ec27-435f-889b-2ca785697a6b service nova] Lock "49a042ba-28ba-4401-9bdf-92f96da8f80e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:11:31.454605 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-6439ee01-f7a1-4766-acfe-6ecaaa4df365 req-a25cc26d-ec27-435f-889b-2ca785697a6b service nova] Lock "49a042ba-28ba-4401-9bdf-92f96da8f80e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:11:31.454605 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-6439ee01-f7a1-4766-acfe-6ecaaa4df365 req-a25cc26d-ec27-435f-889b-2ca785697a6b service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Processing event network-vif-plugged-b54ddd43-d4cb-4d4a-840e-895e75419e25 {{(pid=98431) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 11 23:11:31.454605 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-6439ee01-f7a1-4766-acfe-6ecaaa4df365 req-a25cc26d-ec27-435f-889b-2ca785697a6b service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Received event network-vif-plugged-b54ddd43-d4cb-4d4a-840e-895e75419e25 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:11:31.454605 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-6439ee01-f7a1-4766-acfe-6ecaaa4df365 req-a25cc26d-ec27-435f-889b-2ca785697a6b service nova] Acquiring lock "49a042ba-28ba-4401-9bdf-92f96da8f80e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:11:31.454605 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-6439ee01-f7a1-4766-acfe-6ecaaa4df365 req-a25cc26d-ec27-435f-889b-2ca785697a6b service nova] Lock "49a042ba-28ba-4401-9bdf-92f96da8f80e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:11:31.455058 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-6439ee01-f7a1-4766-acfe-6ecaaa4df365 req-a25cc26d-ec27-435f-889b-2ca785697a6b service nova] Lock "49a042ba-28ba-4401-9bdf-92f96da8f80e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:11:31.455058 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-6439ee01-f7a1-4766-acfe-6ecaaa4df365 req-a25cc26d-ec27-435f-889b-2ca785697a6b service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] No event matching network-vif-plugged-b54ddd43-d4cb-4d4a-840e-895e75419e25 in dict_keys([('network-vif-plugged', '7808ce0e-ec36-4dfa-84d5-0eb1ce542139'), ('network-vif-plugged', '77424d75-6e25-4791-a44d-495051f7e89f'), ('network-vif-plugged', '09135c79-b0df-40af-b05b-2e171390f37f')]) {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jun 11 23:11:31.455058 np0000002687 nova-compute[98431]: WARNING nova.compute.manager [req-6439ee01-f7a1-4766-acfe-6ecaaa4df365 req-a25cc26d-ec27-435f-889b-2ca785697a6b service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Received unexpected event network-vif-plugged-b54ddd43-d4cb-4d4a-840e-895e75419e25 for instance with vm_state building and task_state spawning. Jun 11 23:11:31.636958 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-2eea4a7e-5981-48f2-9bea-ea9a6b7878cd req-2adb69a0-7583-4221-a767-d494a3c93fdf service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Received event network-vif-plugged-7808ce0e-ec36-4dfa-84d5-0eb1ce542139 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:11:31.640261 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-2eea4a7e-5981-48f2-9bea-ea9a6b7878cd req-2adb69a0-7583-4221-a767-d494a3c93fdf service nova] Acquiring lock "49a042ba-28ba-4401-9bdf-92f96da8f80e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:11:31.640621 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-2eea4a7e-5981-48f2-9bea-ea9a6b7878cd req-2adb69a0-7583-4221-a767-d494a3c93fdf service nova] Lock "49a042ba-28ba-4401-9bdf-92f96da8f80e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:11:31.640621 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-2eea4a7e-5981-48f2-9bea-ea9a6b7878cd req-2adb69a0-7583-4221-a767-d494a3c93fdf service nova] Lock "49a042ba-28ba-4401-9bdf-92f96da8f80e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:11:31.640794 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-2eea4a7e-5981-48f2-9bea-ea9a6b7878cd req-2adb69a0-7583-4221-a767-d494a3c93fdf service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Processing event network-vif-plugged-7808ce0e-ec36-4dfa-84d5-0eb1ce542139 {{(pid=98431) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 11 23:11:31.736647 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Acquiring lock "7609742e-a3a2-4be2-ba02-227efb2101e1" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:11:31.736882 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Lock "7609742e-a3a2-4be2-ba02-227efb2101e1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:11:31.860163 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] During sync_power_state the instance has a pending task (spawning). Skip. Jun 11 23:11:31.908833 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Emitting event Started> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:11:31.909023 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] VM Started (Lifecycle Event) Jun 11 23:11:32.239791 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Starting instance... {{(pid=98431) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 11 23:11:32.414404 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:11:32.416112 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Emitting event Paused> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:11:32.418850 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] VM Paused (Lifecycle Event) Jun 11 23:11:32.601422 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:32.646114 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-c6ff320a-0a6f-4b1f-93c2-7758a3217053 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] No BDM found with device name vda, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:11:32.646230 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-c6ff320a-0a6f-4b1f-93c2-7758a3217053 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] No BDM found with device name hda, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:11:32.646346 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-c6ff320a-0a6f-4b1f-93c2-7758a3217053 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] No VIF found with MAC fa:16:3e:61:b7:fd, not building metadata {{(pid=98431) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13199}} Jun 11 23:11:32.646820 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-c6ff320a-0a6f-4b1f-93c2-7758a3217053 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 8ffa4bbe-7ead-4029-aba5-28f031f6e784] Using config drive Jun 11 23:11:32.807332 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:11:32.807688 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:11:32.810679 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98431) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 11 23:11:32.810840 np0000002687 nova-compute[98431]: INFO nova.compute.claims [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Claim successful on node np0000002687 Jun 11 23:11:32.921403 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:11:32.925047 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98431) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 11 23:11:32.987573 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-e220ca5f-61f1-46af-9fc5-6d59fdbfff66 req-e6bb66fa-4888-4d9d-aacd-a9f6d2197dbf service nova] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Received event network-vif-plugged-852fc4ec-82e1-4185-a33c-3c45ff42351e {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:11:32.987573 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-e220ca5f-61f1-46af-9fc5-6d59fdbfff66 req-e6bb66fa-4888-4d9d-aacd-a9f6d2197dbf service nova] Acquiring lock "c82748e6-1c78-4372-ad4b-48d1c6448efa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:11:32.987573 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-e220ca5f-61f1-46af-9fc5-6d59fdbfff66 req-e6bb66fa-4888-4d9d-aacd-a9f6d2197dbf service nova] Lock "c82748e6-1c78-4372-ad4b-48d1c6448efa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:11:32.987573 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-e220ca5f-61f1-46af-9fc5-6d59fdbfff66 req-e6bb66fa-4888-4d9d-aacd-a9f6d2197dbf service nova] Lock "c82748e6-1c78-4372-ad4b-48d1c6448efa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:11:32.987573 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-e220ca5f-61f1-46af-9fc5-6d59fdbfff66 req-e6bb66fa-4888-4d9d-aacd-a9f6d2197dbf service nova] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Processing event network-vif-plugged-852fc4ec-82e1-4185-a33c-3c45ff42351e {{(pid=98431) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 11 23:11:32.987573 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-e220ca5f-61f1-46af-9fc5-6d59fdbfff66 req-e6bb66fa-4888-4d9d-aacd-a9f6d2197dbf service nova] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Received event network-vif-plugged-852fc4ec-82e1-4185-a33c-3c45ff42351e {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:11:32.987573 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-e220ca5f-61f1-46af-9fc5-6d59fdbfff66 req-e6bb66fa-4888-4d9d-aacd-a9f6d2197dbf service nova] Acquiring lock "c82748e6-1c78-4372-ad4b-48d1c6448efa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:11:32.987573 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-e220ca5f-61f1-46af-9fc5-6d59fdbfff66 req-e6bb66fa-4888-4d9d-aacd-a9f6d2197dbf service nova] Lock "c82748e6-1c78-4372-ad4b-48d1c6448efa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:11:32.987573 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-e220ca5f-61f1-46af-9fc5-6d59fdbfff66 req-e6bb66fa-4888-4d9d-aacd-a9f6d2197dbf service nova] Lock "c82748e6-1c78-4372-ad4b-48d1c6448efa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:11:32.987573 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-e220ca5f-61f1-46af-9fc5-6d59fdbfff66 req-e6bb66fa-4888-4d9d-aacd-a9f6d2197dbf service nova] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] No waiting events found dispatching network-vif-plugged-852fc4ec-82e1-4185-a33c-3c45ff42351e {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:11:32.987573 np0000002687 nova-compute[98431]: WARNING nova.compute.manager [req-e220ca5f-61f1-46af-9fc5-6d59fdbfff66 req-e6bb66fa-4888-4d9d-aacd-a9f6d2197dbf service nova] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Received unexpected event network-vif-plugged-852fc4ec-82e1-4185-a33c-3c45ff42351e for instance with vm_state building and task_state spawning. Jun 11 23:11:32.988007 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=98431) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 11 23:11:32.996482 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Guest created on hypervisor {{(pid=98431) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}} Jun 11 23:11:32.998187 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [-] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Instance spawned successfully. Jun 11 23:11:32.998620 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 11 23:11:33.153814 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-c6ff320a-0a6f-4b1f-93c2-7758a3217053 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:11:33.277165 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-c6ff320a-0a6f-4b1f-93c2-7758a3217053 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 8ffa4bbe-7ead-4029-aba5-28f031f6e784] Creating config drive at /opt/stack/data/nova/instances/8ffa4bbe-7ead-4029-aba5-28f031f6e784/disk.config Jun 11 23:11:33.280988 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-c6ff320a-0a6f-4b1f-93c2-7758a3217053 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/8ffa4bbe-7ead-4029-aba5-28f031f6e784/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp5o8a0zya {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:11:33.318634 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-c6ff320a-0a6f-4b1f-93c2-7758a3217053 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/8ffa4bbe-7ead-4029-aba5-28f031f6e784/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp5o8a0zya" returned: 0 in 0.037s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:11:33.426838 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] During sync_power_state the instance has a pending task (spawning). Skip. Jun 11 23:11:33.429505 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Emitting event Resumed> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:11:33.429505 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] VM Resumed (Lifecycle Event) Jun 11 23:11:33.507467 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Found default for hw_cdrom_bus of ide {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:11:33.507467 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Found default for hw_disk_bus of virtio {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:11:33.507467 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Found default for hw_input_bus of None {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:11:33.507467 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Found default for hw_pointer_model of None {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:11:33.507467 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Found default for hw_video_model of virtio {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:11:33.507467 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Found default for hw_vif_model of virtio {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:11:33.706387 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-b2262b7a-1c3e-4b0d-b100-adcb39fe3dd3 req-676f7b1b-2f50-46ee-81ef-5c720fb94f12 service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Received event network-vif-plugged-7808ce0e-ec36-4dfa-84d5-0eb1ce542139 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:11:33.707457 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-b2262b7a-1c3e-4b0d-b100-adcb39fe3dd3 req-676f7b1b-2f50-46ee-81ef-5c720fb94f12 service nova] Acquiring lock "49a042ba-28ba-4401-9bdf-92f96da8f80e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:11:33.707457 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-b2262b7a-1c3e-4b0d-b100-adcb39fe3dd3 req-676f7b1b-2f50-46ee-81ef-5c720fb94f12 service nova] Lock "49a042ba-28ba-4401-9bdf-92f96da8f80e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:11:33.707457 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-b2262b7a-1c3e-4b0d-b100-adcb39fe3dd3 req-676f7b1b-2f50-46ee-81ef-5c720fb94f12 service nova] Lock "49a042ba-28ba-4401-9bdf-92f96da8f80e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:11:33.707457 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-b2262b7a-1c3e-4b0d-b100-adcb39fe3dd3 req-676f7b1b-2f50-46ee-81ef-5c720fb94f12 service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] No event matching network-vif-plugged-7808ce0e-ec36-4dfa-84d5-0eb1ce542139 in dict_keys([('network-vif-plugged', '77424d75-6e25-4791-a44d-495051f7e89f'), ('network-vif-plugged', '09135c79-b0df-40af-b05b-2e171390f37f')]) {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jun 11 23:11:33.707457 np0000002687 nova-compute[98431]: WARNING nova.compute.manager [req-b2262b7a-1c3e-4b0d-b100-adcb39fe3dd3 req-676f7b1b-2f50-46ee-81ef-5c720fb94f12 service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Received unexpected event network-vif-plugged-7808ce0e-ec36-4dfa-84d5-0eb1ce542139 for instance with vm_state building and task_state spawning. Jun 11 23:11:33.707874 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-b2262b7a-1c3e-4b0d-b100-adcb39fe3dd3 req-676f7b1b-2f50-46ee-81ef-5c720fb94f12 service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Received event network-vif-plugged-77424d75-6e25-4791-a44d-495051f7e89f {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:11:33.707874 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-b2262b7a-1c3e-4b0d-b100-adcb39fe3dd3 req-676f7b1b-2f50-46ee-81ef-5c720fb94f12 service nova] Acquiring lock "49a042ba-28ba-4401-9bdf-92f96da8f80e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:11:33.708521 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-b2262b7a-1c3e-4b0d-b100-adcb39fe3dd3 req-676f7b1b-2f50-46ee-81ef-5c720fb94f12 service nova] Lock "49a042ba-28ba-4401-9bdf-92f96da8f80e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:11:33.708867 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-b2262b7a-1c3e-4b0d-b100-adcb39fe3dd3 req-676f7b1b-2f50-46ee-81ef-5c720fb94f12 service nova] Lock "49a042ba-28ba-4401-9bdf-92f96da8f80e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:11:33.709115 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-b2262b7a-1c3e-4b0d-b100-adcb39fe3dd3 req-676f7b1b-2f50-46ee-81ef-5c720fb94f12 service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Processing event network-vif-plugged-77424d75-6e25-4791-a44d-495051f7e89f {{(pid=98431) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 11 23:11:33.709298 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-b2262b7a-1c3e-4b0d-b100-adcb39fe3dd3 req-676f7b1b-2f50-46ee-81ef-5c720fb94f12 service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Received event network-vif-plugged-77424d75-6e25-4791-a44d-495051f7e89f {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:11:33.709452 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-b2262b7a-1c3e-4b0d-b100-adcb39fe3dd3 req-676f7b1b-2f50-46ee-81ef-5c720fb94f12 service nova] Acquiring lock "49a042ba-28ba-4401-9bdf-92f96da8f80e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:11:33.710862 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-b2262b7a-1c3e-4b0d-b100-adcb39fe3dd3 req-676f7b1b-2f50-46ee-81ef-5c720fb94f12 service nova] Lock "49a042ba-28ba-4401-9bdf-92f96da8f80e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:11:33.710862 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-b2262b7a-1c3e-4b0d-b100-adcb39fe3dd3 req-676f7b1b-2f50-46ee-81ef-5c720fb94f12 service nova] Lock "49a042ba-28ba-4401-9bdf-92f96da8f80e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:11:33.710862 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-b2262b7a-1c3e-4b0d-b100-adcb39fe3dd3 req-676f7b1b-2f50-46ee-81ef-5c720fb94f12 service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] No event matching network-vif-plugged-77424d75-6e25-4791-a44d-495051f7e89f in dict_keys([('network-vif-plugged', '09135c79-b0df-40af-b05b-2e171390f37f')]) {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jun 11 23:11:33.710862 np0000002687 nova-compute[98431]: WARNING nova.compute.manager [req-b2262b7a-1c3e-4b0d-b100-adcb39fe3dd3 req-676f7b1b-2f50-46ee-81ef-5c720fb94f12 service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Received unexpected event network-vif-plugged-77424d75-6e25-4791-a44d-495051f7e89f for instance with vm_state building and task_state spawning. Jun 11 23:11:33.710862 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-b2262b7a-1c3e-4b0d-b100-adcb39fe3dd3 req-676f7b1b-2f50-46ee-81ef-5c720fb94f12 service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Received event network-vif-plugged-09135c79-b0df-40af-b05b-2e171390f37f {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:11:33.710862 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-b2262b7a-1c3e-4b0d-b100-adcb39fe3dd3 req-676f7b1b-2f50-46ee-81ef-5c720fb94f12 service nova] Acquiring lock "49a042ba-28ba-4401-9bdf-92f96da8f80e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:11:33.710862 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-b2262b7a-1c3e-4b0d-b100-adcb39fe3dd3 req-676f7b1b-2f50-46ee-81ef-5c720fb94f12 service nova] Lock "49a042ba-28ba-4401-9bdf-92f96da8f80e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:11:33.710862 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-b2262b7a-1c3e-4b0d-b100-adcb39fe3dd3 req-676f7b1b-2f50-46ee-81ef-5c720fb94f12 service nova] Lock "49a042ba-28ba-4401-9bdf-92f96da8f80e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:11:33.710862 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-b2262b7a-1c3e-4b0d-b100-adcb39fe3dd3 req-676f7b1b-2f50-46ee-81ef-5c720fb94f12 service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Processing event network-vif-plugged-09135c79-b0df-40af-b05b-2e171390f37f {{(pid=98431) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 11 23:11:33.710862 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-b2262b7a-1c3e-4b0d-b100-adcb39fe3dd3 req-676f7b1b-2f50-46ee-81ef-5c720fb94f12 service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Received event network-vif-plugged-09135c79-b0df-40af-b05b-2e171390f37f {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:11:33.710862 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-b2262b7a-1c3e-4b0d-b100-adcb39fe3dd3 req-676f7b1b-2f50-46ee-81ef-5c720fb94f12 service nova] Acquiring lock "49a042ba-28ba-4401-9bdf-92f96da8f80e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:11:33.710862 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-b2262b7a-1c3e-4b0d-b100-adcb39fe3dd3 req-676f7b1b-2f50-46ee-81ef-5c720fb94f12 service nova] Lock "49a042ba-28ba-4401-9bdf-92f96da8f80e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:11:33.711413 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-b2262b7a-1c3e-4b0d-b100-adcb39fe3dd3 req-676f7b1b-2f50-46ee-81ef-5c720fb94f12 service nova] Lock "49a042ba-28ba-4401-9bdf-92f96da8f80e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:11:33.711731 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Instance event wait completed in 3 seconds for network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged {{(pid=98431) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 11 23:11:33.712075 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-b2262b7a-1c3e-4b0d-b100-adcb39fe3dd3 req-676f7b1b-2f50-46ee-81ef-5c720fb94f12 service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] No waiting events found dispatching network-vif-plugged-09135c79-b0df-40af-b05b-2e171390f37f {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:11:33.712143 np0000002687 nova-compute[98431]: WARNING nova.compute.manager [req-b2262b7a-1c3e-4b0d-b100-adcb39fe3dd3 req-676f7b1b-2f50-46ee-81ef-5c720fb94f12 service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Received unexpected event network-vif-plugged-09135c79-b0df-40af-b05b-2e171390f37f for instance with vm_state building and task_state spawning. Jun 11 23:11:33.722255 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Guest created on hypervisor {{(pid=98431) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}} Jun 11 23:11:33.727837 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [-] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Instance spawned successfully. Jun 11 23:11:33.727837 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 11 23:11:33.831175 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:33.859704 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:33.936825 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:11:33.939160 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98431) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 11 23:11:33.997616 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:34.017327 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Took 10.68 seconds to spawn the instance on the hypervisor. Jun 11 23:11:34.017327 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:11:34.078672 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:34.084297 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:34.243819 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Found default for hw_cdrom_bus of ide {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:11:34.243974 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Found default for hw_disk_bus of virtio {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:11:34.244339 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Found default for hw_input_bus of None {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:11:34.244602 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Found default for hw_pointer_model of None {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:11:34.246269 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Found default for hw_video_model of virtio {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:11:34.246532 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Found default for hw_vif_model of virtio {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:11:34.443882 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] During sync_power_state the instance has a pending task (spawning). Skip. Jun 11 23:11:34.444653 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Emitting event Resumed> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:11:34.444859 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] VM Resumed (Lifecycle Event) Jun 11 23:11:34.541890 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Took 21.93 seconds to build instance. Jun 11 23:11:34.938830 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Took 30.31 seconds to spawn the instance on the hypervisor. Jun 11 23:11:34.938830 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:11:34.955686 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:11:34.962770 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98431) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 11 23:11:34.964934 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98431) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 11 23:11:34.966206 np0000002687 nova-compute[98431]: DEBUG nova.compute.provider_tree [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Inventory has not changed in ProviderTree for provider: e3e65fe2-9de9-4821-8b4a-ccae37c66e25 {{(pid=98431) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 11 23:11:35.044227 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-746e7bec-161b-409e-8d47-ee51458011d5 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lock "c82748e6-1c78-4372-ad4b-48d1c6448efa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 23.452s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:11:35.085785 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-c61bf6f6-7ee7-44a7-8149-10bb4ba99a89 req-1a2ca96a-7afb-4ea3-9d00-df33ab430187 service nova] [instance: 8ffa4bbe-7ead-4029-aba5-28f031f6e784] Received event network-vif-plugged-591ff615-4a02-4f43-a49b-7f4052a8ed27 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:11:35.086093 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-c61bf6f6-7ee7-44a7-8149-10bb4ba99a89 req-1a2ca96a-7afb-4ea3-9d00-df33ab430187 service nova] Acquiring lock "8ffa4bbe-7ead-4029-aba5-28f031f6e784-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:11:35.086299 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-c61bf6f6-7ee7-44a7-8149-10bb4ba99a89 req-1a2ca96a-7afb-4ea3-9d00-df33ab430187 service nova] Lock "8ffa4bbe-7ead-4029-aba5-28f031f6e784-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:11:35.088436 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-c61bf6f6-7ee7-44a7-8149-10bb4ba99a89 req-1a2ca96a-7afb-4ea3-9d00-df33ab430187 service nova] Lock "8ffa4bbe-7ead-4029-aba5-28f031f6e784-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:11:35.088575 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-c61bf6f6-7ee7-44a7-8149-10bb4ba99a89 req-1a2ca96a-7afb-4ea3-9d00-df33ab430187 service nova] [instance: 8ffa4bbe-7ead-4029-aba5-28f031f6e784] Processing event network-vif-plugged-591ff615-4a02-4f43-a49b-7f4052a8ed27 {{(pid=98431) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 11 23:11:35.088778 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-c61bf6f6-7ee7-44a7-8149-10bb4ba99a89 req-1a2ca96a-7afb-4ea3-9d00-df33ab430187 service nova] [instance: 8ffa4bbe-7ead-4029-aba5-28f031f6e784] Received event network-vif-plugged-591ff615-4a02-4f43-a49b-7f4052a8ed27 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:11:35.088976 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-c61bf6f6-7ee7-44a7-8149-10bb4ba99a89 req-1a2ca96a-7afb-4ea3-9d00-df33ab430187 service nova] Acquiring lock "8ffa4bbe-7ead-4029-aba5-28f031f6e784-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:11:35.089137 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-c61bf6f6-7ee7-44a7-8149-10bb4ba99a89 req-1a2ca96a-7afb-4ea3-9d00-df33ab430187 service nova] Lock "8ffa4bbe-7ead-4029-aba5-28f031f6e784-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:11:35.089275 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-c61bf6f6-7ee7-44a7-8149-10bb4ba99a89 req-1a2ca96a-7afb-4ea3-9d00-df33ab430187 service nova] Lock "8ffa4bbe-7ead-4029-aba5-28f031f6e784-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:11:35.089417 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-c61bf6f6-7ee7-44a7-8149-10bb4ba99a89 req-1a2ca96a-7afb-4ea3-9d00-df33ab430187 service nova] [instance: 8ffa4bbe-7ead-4029-aba5-28f031f6e784] No waiting events found dispatching network-vif-plugged-591ff615-4a02-4f43-a49b-7f4052a8ed27 {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:11:35.089551 np0000002687 nova-compute[98431]: WARNING nova.compute.manager [req-c61bf6f6-7ee7-44a7-8149-10bb4ba99a89 req-1a2ca96a-7afb-4ea3-9d00-df33ab430187 service nova] [instance: 8ffa4bbe-7ead-4029-aba5-28f031f6e784] Received unexpected event network-vif-plugged-591ff615-4a02-4f43-a49b-7f4052a8ed27 for instance with vm_state building and task_state spawning. Jun 11 23:11:35.090057 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-c6ff320a-0a6f-4b1f-93c2-7758a3217053 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 8ffa4bbe-7ead-4029-aba5-28f031f6e784] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98431) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 11 23:11:35.093855 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-c6ff320a-0a6f-4b1f-93c2-7758a3217053 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 8ffa4bbe-7ead-4029-aba5-28f031f6e784] Guest created on hypervisor {{(pid=98431) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}} Jun 11 23:11:35.098350 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [-] [instance: 8ffa4bbe-7ead-4029-aba5-28f031f6e784] Instance spawned successfully. Jun 11 23:11:35.098824 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-c6ff320a-0a6f-4b1f-93c2-7758a3217053 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 8ffa4bbe-7ead-4029-aba5-28f031f6e784] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 11 23:11:35.453214 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Took 46.85 seconds to build instance. Jun 11 23:11:35.472519 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] During sync_power_state the instance has a pending task (spawning). Skip. Jun 11 23:11:35.473890 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Emitting event Started> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:11:35.474467 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 8ffa4bbe-7ead-4029-aba5-28f031f6e784] VM Started (Lifecycle Event) Jun 11 23:11:35.479387 np0000002687 nova-compute[98431]: DEBUG nova.scheduler.client.report [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Inventory has not changed for provider e3e65fe2-9de9-4821-8b4a-ccae37c66e25 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98431) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 11 23:11:35.612870 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-c6ff320a-0a6f-4b1f-93c2-7758a3217053 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 8ffa4bbe-7ead-4029-aba5-28f031f6e784] Found default for hw_cdrom_bus of ide {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:11:35.612870 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-c6ff320a-0a6f-4b1f-93c2-7758a3217053 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 8ffa4bbe-7ead-4029-aba5-28f031f6e784] Found default for hw_disk_bus of virtio {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:11:35.612870 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-c6ff320a-0a6f-4b1f-93c2-7758a3217053 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 8ffa4bbe-7ead-4029-aba5-28f031f6e784] Found default for hw_input_bus of None {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:11:35.612870 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-c6ff320a-0a6f-4b1f-93c2-7758a3217053 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 8ffa4bbe-7ead-4029-aba5-28f031f6e784] Found default for hw_pointer_model of None {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:11:35.612870 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-c6ff320a-0a6f-4b1f-93c2-7758a3217053 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 8ffa4bbe-7ead-4029-aba5-28f031f6e784] Found default for hw_video_model of virtio {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:11:35.612870 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-c6ff320a-0a6f-4b1f-93c2-7758a3217053 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 8ffa4bbe-7ead-4029-aba5-28f031f6e784] Found default for hw_vif_model of virtio {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:11:35.955215 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Lock "49a042ba-28ba-4401-9bdf-92f96da8f80e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 48.368s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:11:35.986649 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 8ffa4bbe-7ead-4029-aba5-28f031f6e784] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:11:35.989935 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 8ffa4bbe-7ead-4029-aba5-28f031f6e784] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98431) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 11 23:11:35.997138 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.189s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:11:35.997632 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Start building networks asynchronously for instance. {{(pid=98431) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 11 23:11:36.109104 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:36.119385 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-c6ff320a-0a6f-4b1f-93c2-7758a3217053 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 8ffa4bbe-7ead-4029-aba5-28f031f6e784] Took 8.36 seconds to spawn the instance on the hypervisor. Jun 11 23:11:36.119503 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-c6ff320a-0a6f-4b1f-93c2-7758a3217053 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 8ffa4bbe-7ead-4029-aba5-28f031f6e784] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:11:36.494561 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 8ffa4bbe-7ead-4029-aba5-28f031f6e784] During sync_power_state the instance has a pending task (spawning). Skip. Jun 11 23:11:36.494781 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Emitting event Paused> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:11:36.494917 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 8ffa4bbe-7ead-4029-aba5-28f031f6e784] VM Paused (Lifecycle Event) Jun 11 23:11:36.508747 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Allocating IP information in the background. {{(pid=98431) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 11 23:11:36.508974 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] allocate_for_instance() {{(pid=98431) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 11 23:11:36.509151 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:11:36.509401 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:11:36.600915 np0000002687 nova-compute[98431]: DEBUG nova.policy [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2b37a00a21a249339e412bcde7a87f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f47df2e0374879b837bc7431326e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98431) authorize /opt/stack/nova/nova/policy.py:192}} Jun 11 23:11:36.634256 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-c6ff320a-0a6f-4b1f-93c2-7758a3217053 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 8ffa4bbe-7ead-4029-aba5-28f031f6e784] Took 14.27 seconds to build instance. Jun 11 23:11:36.711831 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Rescuing Jun 11 23:11:36.711831 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Acquiring lock "refresh_cache-c82748e6-1c78-4372-ad4b-48d1c6448efa" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 11 23:11:36.711831 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Acquired lock "refresh_cache-c82748e6-1c78-4372-ad4b-48d1c6448efa" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 11 23:11:36.711831 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Building network info cache for instance {{(pid=98431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 11 23:11:37.000310 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 8ffa4bbe-7ead-4029-aba5-28f031f6e784] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:11:37.001835 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Emitting event Resumed> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:11:37.001992 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 8ffa4bbe-7ead-4029-aba5-28f031f6e784] VM Resumed (Lifecycle Event) Jun 11 23:11:37.012759 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 11 23:11:37.136446 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-c6ff320a-0a6f-4b1f-93c2-7758a3217053 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "8ffa4bbe-7ead-4029-aba5-28f031f6e784" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 15.774s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:11:37.211682 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:11:37.242674 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-da14763d-cfe1-44ae-a545-8dcdcc4d9778 req-d9494512-9afe-4970-817b-0a4ae070b166 service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Received event network-changed-7808ce0e-ec36-4dfa-84d5-0eb1ce542139 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:11:37.246107 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-da14763d-cfe1-44ae-a545-8dcdcc4d9778 req-d9494512-9afe-4970-817b-0a4ae070b166 service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Refreshing instance network info cache due to event network-changed-7808ce0e-ec36-4dfa-84d5-0eb1ce542139. {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 11 23:11:37.246107 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-da14763d-cfe1-44ae-a545-8dcdcc4d9778 req-d9494512-9afe-4970-817b-0a4ae070b166 service nova] Acquiring lock "refresh_cache-49a042ba-28ba-4401-9bdf-92f96da8f80e" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 11 23:11:37.246107 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-da14763d-cfe1-44ae-a545-8dcdcc4d9778 req-d9494512-9afe-4970-817b-0a4ae070b166 service nova] Acquired lock "refresh_cache-49a042ba-28ba-4401-9bdf-92f96da8f80e" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 11 23:11:37.246107 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-da14763d-cfe1-44ae-a545-8dcdcc4d9778 req-d9494512-9afe-4970-817b-0a4ae070b166 service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Refreshing network info cache for port 7808ce0e-ec36-4dfa-84d5-0eb1ce542139 {{(pid=98431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 11 23:11:37.259186 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-a4dcde52-06c6-4e6f-a517-9a1a79803692 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Acquiring lock "36688d94-68d3-4ae3-989a-b391d7ee4ad9" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:11:37.259684 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-a4dcde52-06c6-4e6f-a517-9a1a79803692 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Lock "36688d94-68d3-4ae3-989a-b391d7ee4ad9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:11:37.298408 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Successfully created port: a1e7aeff-5992-43be-bb2c-d504e7019c64 {{(pid=98431) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 11 23:11:37.506813 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 8ffa4bbe-7ead-4029-aba5-28f031f6e784] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:11:37.510221 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 8ffa4bbe-7ead-4029-aba5-28f031f6e784] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98431) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 11 23:11:37.521986 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Start building block device mappings for instance. {{(pid=98431) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 11 23:11:37.606558 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:37.642954 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:11:37.748930 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [req-da14763d-cfe1-44ae-a545-8dcdcc4d9778 req-d9494512-9afe-4970-817b-0a4ae070b166 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:11:37.766907 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-a4dcde52-06c6-4e6f-a517-9a1a79803692 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Lazy-loading 'flavor' on Instance uuid 36688d94-68d3-4ae3-989a-b391d7ee4ad9 {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:11:37.842373 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Updating instance_info_cache with network_info: [{"id": "852fc4ec-82e1-4185-a33c-3c45ff42351e", "address": "fa:16:3e:c6:c6:5b", "network": {"id": "2a770c99-2ec6-4fa2-945b-32830a59e7a7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-137493671-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aaf744af828a4a5eba1e98da63373b2b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap852fc4ec-82", "ovs_interfaceid": "852fc4ec-82e1-4185-a33c-3c45ff42351e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:11:38.040324 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Successfully updated port: a1e7aeff-5992-43be-bb2c-d504e7019c64 {{(pid=98431) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 11 23:11:38.135370 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-b59fbf2e-4bd6-41d8-952e-b2676ad854d8 req-b39263ba-cedc-4235-9be8-392b8ada6fda service nova] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Received event network-changed-a1e7aeff-5992-43be-bb2c-d504e7019c64 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:11:38.135370 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-b59fbf2e-4bd6-41d8-952e-b2676ad854d8 req-b39263ba-cedc-4235-9be8-392b8ada6fda service nova] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Refreshing instance network info cache due to event network-changed-a1e7aeff-5992-43be-bb2c-d504e7019c64. {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 11 23:11:38.135490 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-b59fbf2e-4bd6-41d8-952e-b2676ad854d8 req-b39263ba-cedc-4235-9be8-392b8ada6fda service nova] Acquiring lock "refresh_cache-7609742e-a3a2-4be2-ba02-227efb2101e1" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 11 23:11:38.135605 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-b59fbf2e-4bd6-41d8-952e-b2676ad854d8 req-b39263ba-cedc-4235-9be8-392b8ada6fda service nova] Acquired lock "refresh_cache-7609742e-a3a2-4be2-ba02-227efb2101e1" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 11 23:11:38.136108 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-b59fbf2e-4bd6-41d8-952e-b2676ad854d8 req-b39263ba-cedc-4235-9be8-392b8ada6fda service nova] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Refreshing network info cache for port a1e7aeff-5992-43be-bb2c-d504e7019c64 {{(pid=98431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 11 23:11:38.306334 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [req-da14763d-cfe1-44ae-a545-8dcdcc4d9778 req-d9494512-9afe-4970-817b-0a4ae070b166 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:11:38.345004 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Releasing lock "refresh_cache-c82748e6-1c78-4372-ad4b-48d1c6448efa" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 11 23:11:38.502814 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-da14763d-cfe1-44ae-a545-8dcdcc4d9778 req-d9494512-9afe-4970-817b-0a4ae070b166 service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Updated VIF entry in instance network info cache for port 7808ce0e-ec36-4dfa-84d5-0eb1ce542139. {{(pid=98431) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 11 23:11:38.503250 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-da14763d-cfe1-44ae-a545-8dcdcc4d9778 req-d9494512-9afe-4970-817b-0a4ae070b166 service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Updating instance_info_cache with network_info: [{"id": "7808ce0e-ec36-4dfa-84d5-0eb1ce542139", "address": "fa:16:3e:e8:a7:df", "network": {"id": "ef5cc6c6-1b8e-4a88-bf58-ad07356064fc", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1332694516-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57813123648a4335a97e8fc5c245cc73", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7808ce0e-ec", "ovs_interfaceid": "7808ce0e-ec36-4dfa-84d5-0eb1ce542139", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7051cdff-8b40-42d6-9d8a-9b7748621f1f", "address": "fa:16:3e:9f:58:c8", "network": {"id": "b4ad3a49-46fc-4f87-83ac-2f820e779189", "bridge": "br-int", "label": "tempest-device-tagging-net1-1763764299", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.184", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57813123648a4335a97e8fc5c245cc73", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7051cdff-8b", "ovs_interfaceid": "7051cdff-8b40-42d6-9d8a-9b7748621f1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "609ed1b7-9ea3-4ae3-8c37-f0a952a45507", "address": "fa:16:3e:c3:0b:6b", "network": {"id": "b4ad3a49-46fc-4f87-83ac-2f820e779189", "bridge": "br-int", "label": "tempest-device-tagging-net1-1763764299", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.189", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57813123648a4335a97e8fc5c245cc73", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap609ed1b7-9e", "ovs_interfaceid": "609ed1b7-9ea3-4ae3-8c37-f0a952a45507", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b54ddd43-d4cb-4d4a-840e-895e75419e25", "address": "fa:16:3e:b9:2e:2c", "network": {"id": "b4ad3a49-46fc-4f87-83ac-2f820e779189", "bridge": "br-int", "label": "tempest-device-tagging-net1-1763764299", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57813123648a4335a97e8fc5c245cc73", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb54ddd43-d4", "ovs_interfaceid": "b54ddd43-d4cb-4d4a-840e-895e75419e25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "77424d75-6e25-4791-a44d-495051f7e89f", "address": "fa:16:3e:a0:a2:82", "network": {"id": "b4ad3a49-46fc-4f87-83ac-2f820e779189", "bridge": "br-int", "label": "tempest-device-tagging-net1-1763764299", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57813123648a4335a97e8fc5c245cc73", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap77424d75-6e", "ovs_interfaceid": "77424d75-6e25-4791-a44d-495051f7e89f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0263e39d-c835-4cf1-b333-265608e81a93", "address": "fa:16:3e:50:0f:6b", "network": {"id": "25259518-16fe-4690-8216-636e994936ba", "bridge": "br-int", "label": "tempest-device-tagging-net2-736260586", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57813123648a4335a97e8fc5c245cc73", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0263e39d-c8", "ovs_interfaceid": "0263e39d-c835-4cf1-b333-265608e81a93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "09135c79-b0df-40af-b05b-2e171390f37f", "address": "fa:16:3e:c4:56:b3", "network": {"id": "25259518-16fe-4690-8216-636e994936ba", "bridge": "br-int", "label": "tempest-device-tagging-net2-736260586", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57813123648a4335a97e8fc5c245cc73", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap09135c79-b0", "ovs_interfaceid": "09135c79-b0df-40af-b05b-2e171390f37f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:11:38.540916 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Start spawning the instance on the hypervisor. {{(pid=98431) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 11 23:11:38.540916 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Creating instance directory {{(pid=98431) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}} Jun 11 23:11:38.540916 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Creating image(s) Jun 11 23:11:38.543027 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Acquiring lock "/opt/stack/data/nova/instances/7609742e-a3a2-4be2-ba02-227efb2101e1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:11:38.543539 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Lock "/opt/stack/data/nova/instances/7609742e-a3a2-4be2-ba02-227efb2101e1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:11:38.546455 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Acquiring lock "refresh_cache-7609742e-a3a2-4be2-ba02-227efb2101e1" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 11 23:11:38.546455 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Lock "/opt/stack/data/nova/instances/7609742e-a3a2-4be2-ba02-227efb2101e1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:11:38.546455 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:11:38.550966 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:11:38.552664 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:11:38.620611 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-1e278fde-de9a-4693-b87b-2d4c3c4e1fa3 req-8e8dd604-d7a3-41f9-8683-1b309e7ea643 service nova] [instance: 206476b7-d805-4c6c-b7fb-db8b5c2a94a6] Received event network-changed-4ba0e6d8-03d5-4849-8b1a-ca9b093ff8be {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:11:38.621375 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-1e278fde-de9a-4693-b87b-2d4c3c4e1fa3 req-8e8dd604-d7a3-41f9-8683-1b309e7ea643 service nova] [instance: 206476b7-d805-4c6c-b7fb-db8b5c2a94a6] Refreshing instance network info cache due to event network-changed-4ba0e6d8-03d5-4849-8b1a-ca9b093ff8be. {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 11 23:11:38.621750 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-1e278fde-de9a-4693-b87b-2d4c3c4e1fa3 req-8e8dd604-d7a3-41f9-8683-1b309e7ea643 service nova] Acquiring lock "refresh_cache-206476b7-d805-4c6c-b7fb-db8b5c2a94a6" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 11 23:11:38.621974 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-1e278fde-de9a-4693-b87b-2d4c3c4e1fa3 req-8e8dd604-d7a3-41f9-8683-1b309e7ea643 service nova] Acquired lock "refresh_cache-206476b7-d805-4c6c-b7fb-db8b5c2a94a6" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 11 23:11:38.622488 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-1e278fde-de9a-4693-b87b-2d4c3c4e1fa3 req-8e8dd604-d7a3-41f9-8683-1b309e7ea643 service nova] [instance: 206476b7-d805-4c6c-b7fb-db8b5c2a94a6] Refreshing network info cache for port 4ba0e6d8-03d5-4849-8b1a-ca9b093ff8be {{(pid=98431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 11 23:11:38.641601 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json" returned: 0 in 0.089s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:11:38.642059 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Acquiring lock "d2c441059b2992961b5de03c05b32d04aff77cb1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:11:38.643169 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Lock "d2c441059b2992961b5de03c05b32d04aff77cb1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:11:38.644660 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:11:38.648916 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:11:38.649996 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:11:38.650267 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [req-b59fbf2e-4bd6-41d8-952e-b2676ad854d8 req-b39263ba-cedc-4235-9be8-392b8ada6fda service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:11:38.747927 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json" returned: 0 in 0.096s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:11:38.747927 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1,backing_fmt=raw /opt/stack/data/nova/instances/7609742e-a3a2-4be2-ba02-227efb2101e1/disk 1073741824 {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:11:38.761075 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-b59fbf2e-4bd6-41d8-952e-b2676ad854d8 req-b39263ba-cedc-4235-9be8-392b8ada6fda service nova] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Instance cache missing network info. {{(pid=98431) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 11 23:11:38.777175 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-a4dcde52-06c6-4e6f-a517-9a1a79803692 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Lock "36688d94-68d3-4ae3-989a-b391d7ee4ad9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.518s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:11:38.797264 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1,backing_fmt=raw /opt/stack/data/nova/instances/7609742e-a3a2-4be2-ba02-227efb2101e1/disk 1073741824" returned: 0 in 0.051s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:11:38.798463 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Lock "d2c441059b2992961b5de03c05b32d04aff77cb1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.155s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:11:38.798463 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:11:38.895789 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json" returned: 0 in 0.097s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:11:38.897450 np0000002687 nova-compute[98431]: DEBUG nova.virt.disk.api [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7609742e-a3a2-4be2-ba02-227efb2101e1/disk. size=1073741824 {{(pid=98431) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 11 23:11:38.897450 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7609742e-a3a2-4be2-ba02-227efb2101e1/disk --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:11:38.976390 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7609742e-a3a2-4be2-ba02-227efb2101e1/disk --force-share --output=json" returned: 0 in 0.079s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:11:38.976829 np0000002687 nova-compute[98431]: DEBUG nova.virt.disk.api [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Cannot resize image /opt/stack/data/nova/instances/7609742e-a3a2-4be2-ba02-227efb2101e1/disk to a smaller size. {{(pid=98431) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 11 23:11:38.977914 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Created local disks {{(pid=98431) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}} Jun 11 23:11:38.978117 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Ensure instance console log exists: /opt/stack/data/nova/instances/7609742e-a3a2-4be2-ba02-227efb2101e1/console.log {{(pid=98431) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}} Jun 11 23:11:38.979216 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:11:38.979582 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:11:38.979753 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:11:39.005637 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-da14763d-cfe1-44ae-a545-8dcdcc4d9778 req-d9494512-9afe-4970-817b-0a4ae070b166 service nova] Releasing lock "refresh_cache-49a042ba-28ba-4401-9bdf-92f96da8f80e" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 11 23:11:39.010553 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-b59fbf2e-4bd6-41d8-952e-b2676ad854d8 req-b39263ba-cedc-4235-9be8-392b8ada6fda service nova] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Updating instance_info_cache with network_info: [] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:11:39.126666 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [req-1e278fde-de9a-4693-b87b-2d4c3c4e1fa3 req-8e8dd604-d7a3-41f9-8683-1b309e7ea643 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:11:39.511875 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [req-1e278fde-de9a-4693-b87b-2d4c3c4e1fa3 req-8e8dd604-d7a3-41f9-8683-1b309e7ea643 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:11:39.513205 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-b59fbf2e-4bd6-41d8-952e-b2676ad854d8 req-b39263ba-cedc-4235-9be8-392b8ada6fda service nova] Releasing lock "refresh_cache-7609742e-a3a2-4be2-ba02-227efb2101e1" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 11 23:11:39.513909 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Acquired lock "refresh_cache-7609742e-a3a2-4be2-ba02-227efb2101e1" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 11 23:11:39.515199 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Building network info cache for instance {{(pid=98431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 11 23:11:39.523945 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-092b94e8-8497-429c-9c05-fa43dcb87fac tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] Acquiring lock "73abd331-0bbf-432e-be1c-308801a5429f" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:11:39.524156 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-092b94e8-8497-429c-9c05-fa43dcb87fac tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] Lock "73abd331-0bbf-432e-be1c-308801a5429f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:11:39.698747 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-1e278fde-de9a-4693-b87b-2d4c3c4e1fa3 req-8e8dd604-d7a3-41f9-8683-1b309e7ea643 service nova] [instance: 206476b7-d805-4c6c-b7fb-db8b5c2a94a6] Updated VIF entry in instance network info cache for port 4ba0e6d8-03d5-4849-8b1a-ca9b093ff8be. {{(pid=98431) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 11 23:11:39.699000 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-1e278fde-de9a-4693-b87b-2d4c3c4e1fa3 req-8e8dd604-d7a3-41f9-8683-1b309e7ea643 service nova] [instance: 206476b7-d805-4c6c-b7fb-db8b5c2a94a6] Updating instance_info_cache with network_info: [{"id": "4ba0e6d8-03d5-4849-8b1a-ca9b093ff8be", "address": "fa:16:3e:c7:33:6a", "network": {"id": "17593db3-c22d-4354-ab29-933b1c6a5c3a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1094286565-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "81fd45f475a04e5c8e9bd9deb7ad4c1e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ba0e6d8-03", "ovs_interfaceid": "4ba0e6d8-03d5-4849-8b1a-ca9b093ff8be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:11:40.004770 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:40.014379 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:40.032360 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-092b94e8-8497-429c-9c05-fa43dcb87fac tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] Lazy-loading 'flavor' on Instance uuid 73abd331-0bbf-432e-be1c-308801a5429f {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:11:40.033950 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:40.107724 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Instance cache missing network info. {{(pid=98431) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 11 23:11:40.201350 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-1e278fde-de9a-4693-b87b-2d4c3c4e1fa3 req-8e8dd604-d7a3-41f9-8683-1b309e7ea643 service nova] Releasing lock "refresh_cache-206476b7-d805-4c6c-b7fb-db8b5c2a94a6" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 11 23:11:40.231722 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:40.238700 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:40.264344 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-10ad490d-7376-4368-a05e-d5a256d7964b req-41334ff5-ff96-4a41-a7a8-c3768a2a042c service nova] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Received event network-vif-unplugged-852fc4ec-82e1-4185-a33c-3c45ff42351e {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:11:40.264344 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-10ad490d-7376-4368-a05e-d5a256d7964b req-41334ff5-ff96-4a41-a7a8-c3768a2a042c service nova] Acquiring lock "c82748e6-1c78-4372-ad4b-48d1c6448efa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:11:40.264454 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-10ad490d-7376-4368-a05e-d5a256d7964b req-41334ff5-ff96-4a41-a7a8-c3768a2a042c service nova] Lock "c82748e6-1c78-4372-ad4b-48d1c6448efa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:11:40.265013 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-10ad490d-7376-4368-a05e-d5a256d7964b req-41334ff5-ff96-4a41-a7a8-c3768a2a042c service nova] Lock "c82748e6-1c78-4372-ad4b-48d1c6448efa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:11:40.265013 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-10ad490d-7376-4368-a05e-d5a256d7964b req-41334ff5-ff96-4a41-a7a8-c3768a2a042c service nova] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] No waiting events found dispatching network-vif-unplugged-852fc4ec-82e1-4185-a33c-3c45ff42351e {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:11:40.265013 np0000002687 nova-compute[98431]: WARNING nova.compute.manager [req-10ad490d-7376-4368-a05e-d5a256d7964b req-41334ff5-ff96-4a41-a7a8-c3768a2a042c service nova] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Received unexpected event network-vif-unplugged-852fc4ec-82e1-4185-a33c-3c45ff42351e for instance with vm_state active and task_state rescuing. Jun 11 23:11:40.335513 np0000002687 nova-compute[98431]: DEBUG nova.utils [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Queued Task(fn=>, remaining_delay=14.999599341000021 future=) {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:11:40.336542 np0000002687 nova-compute[98431]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=14.99870782700009 future=) {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:11:40.336771 np0000002687 nova-compute[98431]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=14.998302329000126 future=) {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:11:40.339572 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [-] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Instance destroyed successfully. Jun 11 23:11:40.341050 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lazy-loading 'numa_topology' on Instance uuid c82748e6-1c78-4372-ad4b-48d1c6448efa {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:11:40.356201 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-a4dcde52-06c6-4e6f-a517-9a1a79803692 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Acquiring lock "36688d94-68d3-4ae3-989a-b391d7ee4ad9" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:11:40.356727 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-a4dcde52-06c6-4e6f-a517-9a1a79803692 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Lock "36688d94-68d3-4ae3-989a-b391d7ee4ad9" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:11:40.357042 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-a4dcde52-06c6-4e6f-a517-9a1a79803692 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] [instance: 36688d94-68d3-4ae3-989a-b391d7ee4ad9] Attaching volume 6eb3ee75-92d8-430f-86ea-31edf88d1ae8 to /dev/sdc Jun 11 23:11:40.361477 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:11:40.428326 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-a4dcde52-06c6-4e6f-a517-9a1a79803692 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.209', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000002687', 'execute': None}" {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 11 23:11:40.447332 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.scaleio [None req-a4dcde52-06c6-4e6f-a517-9a1a79803692 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98431) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 11 23:11:40.478981 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-a4dcde52-06c6-4e6f-a517-9a1a79803692 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Running cmd (subprocess): nvme version {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:11:40.511465 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-922d3cd0-d5df-4bc5-b3ee-9cdfb633df77 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Acquiring lock "206476b7-d805-4c6c-b7fb-db8b5c2a94a6" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:11:40.511878 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-922d3cd0-d5df-4bc5-b3ee-9cdfb633df77 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "206476b7-d805-4c6c-b7fb-db8b5c2a94a6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:11:40.519523 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-a4dcde52-06c6-4e6f-a517-9a1a79803692 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] 'nvme version' failed. Not Retrying. {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 11 23:11:40.520916 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a4dcde52-06c6-4e6f-a517-9a1a79803692 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] nvme not present on system {{(pid=98431) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 11 23:11:40.531180 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.lightos [None req-a4dcde52-06c6-4e6f-a517-9a1a79803692 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98431) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 11 23:11:40.533557 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.lightos [None req-a4dcde52-06c6-4e6f-a517-9a1a79803692 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Current host hostNQN and IP(s) are ['10.4.3.209', 'fe80::f816:3eff:fea3:3707', '192.168.40.6', 'fe80::f816:3eff:fe06:bdab', '192.168.50.6', 'fe80::f816:3eff:fe7a:46f2', '192.168.10.6', 'fe80::f816:3eff:fe13:793b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::38fa:21ff:fe6c:3746', 'fe80::fc16:3eff:fe6c:eb30', 'fe80::20a8:54ff:fe51:da0a', 'fe80::fc16:3eff:feb5:6ffd', 'fe80::4cb3:64ff:fe13:8a75', 'fe80::fc16:3eff:fe8e:8922', 'fe80::4c61:61ff:fe7d:90dc', 'fe80::fc16:3eff:fe77:488d', 'fe80::9469:f2ff:feae:5824', 'fe80::fc16:3eff:febd:951', 'fe80::84b1:8fff:fe59:2d4f', 'fe80::fc16:3eff:fedc:9cb5', 'fe80::f489:94ff:fe75:ec8a', 'fe80::fc16:3eff:fe8a:95c7', 'fe80::fc16:3eff:fec7:336a', 'fe80::fc16:3eff:fee8:a7df', 'fe80::fc16:3eff:fe9f:58c8', 'fe80::a002:b5ff:fe03:ad7e', 'fe80::fc16:3eff:fec3:b6b', 'fe80::fc16:3eff:feb9:2e2c', 'fe80::fc16:3eff:fea0:a282', 'fe80::fc16:3eff:fe50:f6b', 'fe80::7cd4:d5ff:feac:3f7f', 'fe80::fc16:3eff:fec4:56b3', 'fe80::78a9:34ff:febb:750c', 'fe80::fc16:3eff:fe61:b7fd'] Jun 11 23:11:40.537444 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.lightos [None req-a4dcde52-06c6-4e6f-a517-9a1a79803692 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98431) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 11 23:11:40.537444 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.lightos [None req-a4dcde52-06c6-4e6f-a517-9a1a79803692 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] LIGHTOS: no hostnqn found. {{(pid=98431) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 11 23:11:40.537444 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-a4dcde52-06c6-4e6f-a517-9a1a79803692 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] <== get_connector_properties: return (105ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.209', 'host': 'np0000002687', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:798b370f1cc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad465dfe-0ed1-4637-98c3-ddaebebd61a4', 'nvme_native_multipath': False} {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 11 23:11:40.539203 np0000002687 nova-compute[98431]: DEBUG nova.virt.block_device [None req-a4dcde52-06c6-4e6f-a517-9a1a79803692 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] [instance: 36688d94-68d3-4ae3-989a-b391d7ee4ad9] Updating existing volume attachment record: 3f00384c-7dda-46a0-85f0-46c188282164 {{(pid=98431) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 11 23:11:40.572528 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Updating instance_info_cache with network_info: [{"id": "a1e7aeff-5992-43be-bb2c-d504e7019c64", "address": "fa:16:3e:1d:f7:18", "network": {"id": "710d3c5f-1a08-4a35-b3e1-e59f427989c2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2068802531-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62f47df2e0374879b837bc7431326e62", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1e7aeff-59", "ovs_interfaceid": "a1e7aeff-5992-43be-bb2c-d504e7019c64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:11:40.735276 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-f6aec025-29ca-41fd-b726-df268c090c4c req-52ab3752-f5e5-4dde-8fb4-d949e6c22fdb service nova] [instance: 8ffa4bbe-7ead-4029-aba5-28f031f6e784] Received event network-changed-591ff615-4a02-4f43-a49b-7f4052a8ed27 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:11:40.735459 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-f6aec025-29ca-41fd-b726-df268c090c4c req-52ab3752-f5e5-4dde-8fb4-d949e6c22fdb service nova] [instance: 8ffa4bbe-7ead-4029-aba5-28f031f6e784] Refreshing instance network info cache due to event network-changed-591ff615-4a02-4f43-a49b-7f4052a8ed27. {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 11 23:11:40.735577 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-f6aec025-29ca-41fd-b726-df268c090c4c req-52ab3752-f5e5-4dde-8fb4-d949e6c22fdb service nova] Acquiring lock "refresh_cache-8ffa4bbe-7ead-4029-aba5-28f031f6e784" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 11 23:11:40.735703 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-f6aec025-29ca-41fd-b726-df268c090c4c req-52ab3752-f5e5-4dde-8fb4-d949e6c22fdb service nova] Acquired lock "refresh_cache-8ffa4bbe-7ead-4029-aba5-28f031f6e784" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 11 23:11:40.735831 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-f6aec025-29ca-41fd-b726-df268c090c4c req-52ab3752-f5e5-4dde-8fb4-d949e6c22fdb service nova] [instance: 8ffa4bbe-7ead-4029-aba5-28f031f6e784] Refreshing network info cache for port 591ff615-4a02-4f43-a49b-7f4052a8ed27 {{(pid=98431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 11 23:11:40.846944 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Attempting a stable device rescue Jun 11 23:11:40.968913 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=98431) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4640}} Jun 11 23:11:40.974336 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Instance directory exists: not creating {{(pid=98431) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5217}} Jun 11 23:11:40.974711 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Creating image(s) Jun 11 23:11:40.975530 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Acquiring lock "/opt/stack/data/nova/instances/c82748e6-1c78-4372-ad4b-48d1c6448efa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:11:40.975740 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lock "/opt/stack/data/nova/instances/c82748e6-1c78-4372-ad4b-48d1c6448efa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:11:40.976251 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lock "/opt/stack/data/nova/instances/c82748e6-1c78-4372-ad4b-48d1c6448efa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:11:40.976463 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lazy-loading 'trusted_certs' on Instance uuid c82748e6-1c78-4372-ad4b-48d1c6448efa {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:11:41.018782 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-922d3cd0-d5df-4bc5-b3ee-9cdfb633df77 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lazy-loading 'flavor' on Instance uuid 206476b7-d805-4c6c-b7fb-db8b5c2a94a6 {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:11:41.044078 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-092b94e8-8497-429c-9c05-fa43dcb87fac tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] Lock "73abd331-0bbf-432e-be1c-308801a5429f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.520s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:11:41.073210 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Releasing lock "refresh_cache-7609742e-a3a2-4be2-ba02-227efb2101e1" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 11 23:11:41.073526 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Instance network_info: |[{"id": "a1e7aeff-5992-43be-bb2c-d504e7019c64", "address": "fa:16:3e:1d:f7:18", "network": {"id": "710d3c5f-1a08-4a35-b3e1-e59f427989c2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2068802531-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62f47df2e0374879b837bc7431326e62", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1e7aeff-59", "ovs_interfaceid": "a1e7aeff-5992-43be-bb2c-d504e7019c64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98431) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 11 23:11:41.075814 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Start _get_guest_xml network_info=[{"id": "a1e7aeff-5992-43be-bb2c-d504e7019c64", "address": "fa:16:3e:1d:f7:18", "network": {"id": "710d3c5f-1a08-4a35-b3e1-e59f427989c2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2068802531-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62f47df2e0374879b837bc7431326e62", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1e7aeff-59", "ovs_interfaceid": "a1e7aeff-5992-43be-bb2c-d504e7019c64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-11T23:08:20Z,direct_url=,disk_format='qcow2',id=f30640f8-7aca-4300-a085-4706a5209a79,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ce012f9fabdb4ee5a73e212437f59d97',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-11T23:08:23Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'image_id': 'f30640f8-7aca-4300-a085-4706a5209a79'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98431) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 11 23:11:41.077655 np0000002687 nova-compute[98431]: WARNING nova.virt.libvirt.driver [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 11 23:11:41.079209 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='f30640f8-7aca-4300-a085-4706a5209a79', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherB-server-872787611', uuid='7609742e-a3a2-4be2-ba02-227efb2101e1'), owner=OwnerMeta(userid='2b37a00a21a249339e412bcde7a87f82', username='tempest-ServerActionsTestOtherB-1260316994-project-member', projectid='62f47df2e0374879b837bc7431326e62', projectname='tempest-ServerActionsTestOtherB-1260316994'), image=ImageMeta(id='f30640f8-7aca-4300-a085-4706a5209a79', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "a1e7aeff-5992-43be-bb2c-d504e7019c64", "address": "fa:16:3e:1d:f7:18", "network": {"id": "710d3c5f-1a08-4a35-b3e1-e59f427989c2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2068802531-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62f47df2e0374879b837bc7431326e62", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1e7aeff-59", "ovs_interfaceid": "a1e7aeff-5992-43be-bb2c-d504e7019c64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1781219501.07854) {{(pid=98431) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 11 23:11:41.080625 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Searching host: 'np0000002687' for CPU controller through CGroups V1... {{(pid=98431) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 11 23:11:41.081253 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] CPU controller missing on host. {{(pid=98431) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 11 23:11:41.082075 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Searching host: 'np0000002687' for CPU controller through CGroups V2... {{(pid=98431) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 11 23:11:41.082294 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] CPU controller found on host. {{(pid=98431) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 11 23:11:41.083517 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98431) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 11 23:11:41.083964 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-11T23:08:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-11T23:08:20Z,direct_url=,disk_format='qcow2',id=f30640f8-7aca-4300-a085-4706a5209a79,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ce012f9fabdb4ee5a73e212437f59d97',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-11T23:08:23Z,virtual_size=,visibility=), allow threads: True {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 11 23:11:41.084130 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Flavor limits 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 11 23:11:41.084251 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Image limits 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 11 23:11:41.084432 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Flavor pref 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 11 23:11:41.084541 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Image pref 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 11 23:11:41.084682 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 11 23:11:41.084906 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 11 23:11:41.085043 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98431) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 11 23:11:41.085186 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Got 1 possible topologies {{(pid=98431) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 11 23:11:41.085377 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 11 23:11:41.085533 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 11 23:11:41.099293 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-11T23:11:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-872787611',display_name='tempest-ServerActionsTestOtherB-server-872787611',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='tempest-serveractionstestotherb-server-872787611',id=13,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE8GCNW5zoKlPJg2gDz6psGsk5eAwUwS5EcLVqi+Ws93aBM9mzyZ9OA4e5k8HR4bk5PDkKar3oCgqC2LYEZaaYcONGX+UXm8H5giZlXKo/6E9eZdQg2l6SXnZTdbPKM4Aw==',key_name='tempest-keypair-1789476090',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62f47df2e0374879b837bc7431326e62',ramdisk_id='',reservation_id='r-92sxxj92',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1260316994',owner_user_name='tempest-ServerActionsTestOtherB-1260316994-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-11T23:11:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2b37a00a21a249339e412bcde7a87f82',uuid=7609742e-a3a2-4be2-ba02-227efb2101e1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a1e7aeff-5992-43be-bb2c-d504e7019c64", "address": "fa:16:3e:1d:f7:18", "network": {"id": "710d3c5f-1a08-4a35-b3e1-e59f427989c2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2068802531-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62f47df2e0374879b837bc7431326e62", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1e7aeff-59", "ovs_interfaceid": "a1e7aeff-5992-43be-bb2c-d504e7019c64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98431) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 11 23:11:41.099513 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Converting VIF {"id": "a1e7aeff-5992-43be-bb2c-d504e7019c64", "address": "fa:16:3e:1d:f7:18", "network": {"id": "710d3c5f-1a08-4a35-b3e1-e59f427989c2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2068802531-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62f47df2e0374879b837bc7431326e62", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1e7aeff-59", "ovs_interfaceid": "a1e7aeff-5992-43be-bb2c-d504e7019c64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:11:41.099973 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:f7:18,bridge_name='br-int',has_traffic_filtering=True,id=a1e7aeff-5992-43be-bb2c-d504e7019c64,network=Network(710d3c5f-1a08-4a35-b3e1-e59f427989c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1e7aeff-59') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:11:41.100532 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Lazy-loading 'pci_devices' on Instance uuid 7609742e-a3a2-4be2-ba02-227efb2101e1 {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:11:41.111197 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:41.122548 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4dcde52-06c6-4e6f-a517-9a1a79803692 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] [instance: 36688d94-68d3-4ae3-989a-b391d7ee4ad9] Calling os-brick to attach iSCSI Volume {{(pid=98431) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 11 23:11:41.122989 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4dcde52-06c6-4e6f-a517-9a1a79803692 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6eb3ee75-92d8-430f-86ea-31edf88d1ae8', 'iqn.2023-03.storpool.com:os--volume-6eb3ee75-92d8-430f-86ea-31edf88d1ae8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6eb3ee75-92d8-430f-86ea-31edf88d1ae8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6eb3ee75-92d8-430f-86ea-31edf88d1ae8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 11 23:11:41.123128 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-a4dcde52-06c6-4e6f-a517-9a1a79803692 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 11 23:11:41.123543 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-a4dcde52-06c6-4e6f-a517-9a1a79803692 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 11 23:11:41.123738 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-a4dcde52-06c6-4e6f-a517-9a1a79803692 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6eb3ee75-92d8-430f-86ea-31edf88d1ae8', 'iqn.2023-03.storpool.com:os--volume-6eb3ee75-92d8-430f-86ea-31edf88d1ae8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6eb3ee75-92d8-430f-86ea-31edf88d1ae8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6eb3ee75-92d8-430f-86ea-31edf88d1ae8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98431) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 11 23:11:41.136718 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-a4dcde52-06c6-4e6f-a517-9a1a79803692 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6eb3ee75-92d8-430f-86ea-31edf88d1ae8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 11 23:11:41.137562 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-a4dcde52-06c6-4e6f-a517-9a1a79803692 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6eb3ee75-92d8-430f-86ea-31edf88d1ae8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 11 23:11:41.138411 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-a4dcde52-06c6-4e6f-a517-9a1a79803692 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6eb3ee75-92d8-430f-86ea-31edf88d1ae8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 11 23:11:41.138919 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.iscsi [None req-a4dcde52-06c6-4e6f-a517-9a1a79803692 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 11 23:11:41.139190 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-a4dcde52-06c6-4e6f-a517-9a1a79803692 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6eb3ee75-92d8-430f-86ea-31edf88d1ae8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 11 23:11:41.139421 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.iscsi [None req-a4dcde52-06c6-4e6f-a517-9a1a79803692 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 11 23:11:41.154470 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4dcde52-06c6-4e6f-a517-9a1a79803692 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 11 23:11:41.154470 np0000002687 nova-compute[98431]: {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:41.160753 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4dcde52-06c6-4e6f-a517-9a1a79803692 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 11 23:11:41.160753 np0000002687 nova-compute[98431]: {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:41.168554 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4dcde52-06c6-4e6f-a517-9a1a79803692 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-6eb3ee75-92d8-430f-86ea-31edf88d1ae8] added Jun 11 23:11:41.168554 np0000002687 nova-compute[98431]: stderr=iscsiadm: Config file line 363 does not have value Jun 11 23:11:41.168554 np0000002687 nova-compute[98431]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 11 23:11:41.168554 np0000002687 nova-compute[98431]: iscsiadm: Config file line 363 does not have value Jun 11 23:11:41.168554 np0000002687 nova-compute[98431]: iscsiadm: Config file line 363 does not have value Jun 11 23:11:41.168554 np0000002687 nova-compute[98431]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 11 23:11:41.168554 np0000002687 nova-compute[98431]: {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:41.168808 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4dcde52-06c6-4e6f-a517-9a1a79803692 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98431) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 11 23:11:41.169299 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-a4dcde52-06c6-4e6f-a517-9a1a79803692 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0295(s), this was the 1st time calling it. {{(pid=98431) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 11 23:11:41.169299 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-a4dcde52-06c6-4e6f-a517-9a1a79803692 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98431) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 11 23:11:41.174264 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4dcde52-06c6-4e6f-a517-9a1a79803692 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-6eb3ee75-92d8-430f-86ea-31edf88d1ae8] added Jun 11 23:11:41.174264 np0000002687 nova-compute[98431]: stderr=iscsiadm: Config file line 363 does not have value Jun 11 23:11:41.174264 np0000002687 nova-compute[98431]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 11 23:11:41.174264 np0000002687 nova-compute[98431]: iscsiadm: Config file line 363 does not have value Jun 11 23:11:41.174264 np0000002687 nova-compute[98431]: iscsiadm: Config file line 363 does not have value Jun 11 23:11:41.174264 np0000002687 nova-compute[98431]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 11 23:11:41.174264 np0000002687 nova-compute[98431]: {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:41.174545 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4dcde52-06c6-4e6f-a517-9a1a79803692 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98431) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 11 23:11:41.174834 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-a4dcde52-06c6-4e6f-a517-9a1a79803692 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.036(s), this was the 1st time calling it. {{(pid=98431) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 11 23:11:41.174913 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-a4dcde52-06c6-4e6f-a517-9a1a79803692 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98431) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 11 23:11:41.238139 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [req-f6aec025-29ca-41fd-b726-df268c090c4c req-52ab3752-f5e5-4dde-8fb4-d949e6c22fdb service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:11:41.478361 np0000002687 nova-compute[98431]: DEBUG nova.objects.base [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs {{(pid=98431) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 11 23:11:41.478667 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Acquiring lock "58eb9156b3d6fed8e4ee712ab780f370ef149b12" by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:11:41.479125 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lock "58eb9156b3d6fed8e4ee712ab780f370ef149b12" acquired by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:11:41.604289 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] End _get_guest_xml xml= Jun 11 23:11:41.604289 np0000002687 nova-compute[98431]: 7609742e-a3a2-4be2-ba02-227efb2101e1 Jun 11 23:11:41.604289 np0000002687 nova-compute[98431]: instance-0000000d Jun 11 23:11:41.604289 np0000002687 nova-compute[98431]: 196608 Jun 11 23:11:41.604289 np0000002687 nova-compute[98431]: 1 Jun 11 23:11:41.604289 np0000002687 nova-compute[98431]: Jun 11 23:11:41.604289 np0000002687 nova-compute[98431]: Jun 11 23:11:41.604289 np0000002687 nova-compute[98431]: Jun 11 23:11:41.604289 np0000002687 nova-compute[98431]: tempest-ServerActionsTestOtherB-server-872787611 Jun 11 23:11:41.604289 np0000002687 nova-compute[98431]: 2026-06-11 23:11:41 Jun 11 23:11:41.604289 np0000002687 nova-compute[98431]: Jun 11 23:11:41.604289 np0000002687 nova-compute[98431]: 192 Jun 11 23:11:41.604289 np0000002687 nova-compute[98431]: 1 Jun 11 23:11:41.604289 np0000002687 nova-compute[98431]: 0 Jun 11 23:11:41.604289 np0000002687 nova-compute[98431]: 0 Jun 11 23:11:41.604289 np0000002687 nova-compute[98431]: 1 Jun 11 23:11:41.604289 np0000002687 nova-compute[98431]: Jun 11 23:11:41.604289 np0000002687 nova-compute[98431]: True Jun 11 23:11:41.604289 np0000002687 nova-compute[98431]: Jun 11 23:11:41.604289 np0000002687 nova-compute[98431]: Jun 11 23:11:41.604289 np0000002687 nova-compute[98431]: Jun 11 23:11:41.604289 np0000002687 nova-compute[98431]: bare Jun 11 23:11:41.604289 np0000002687 nova-compute[98431]: qcow2 Jun 11 23:11:41.604289 np0000002687 nova-compute[98431]: 1 Jun 11 23:11:41.604289 np0000002687 nova-compute[98431]: 0 Jun 11 23:11:41.604289 np0000002687 nova-compute[98431]: Jun 11 23:11:41.604289 np0000002687 nova-compute[98431]: virtio Jun 11 23:11:41.604289 np0000002687 nova-compute[98431]: Jun 11 23:11:41.604289 np0000002687 nova-compute[98431]: Jun 11 23:11:41.604289 np0000002687 nova-compute[98431]: Jun 11 23:11:41.604289 np0000002687 nova-compute[98431]: tempest-ServerActionsTestOtherB-1260316994-project-member Jun 11 23:11:41.604289 np0000002687 nova-compute[98431]: tempest-ServerActionsTestOtherB-1260316994 Jun 11 23:11:41.604289 np0000002687 nova-compute[98431]: Jun 11 23:11:41.604289 np0000002687 nova-compute[98431]: Jun 11 23:11:41.604289 np0000002687 nova-compute[98431]: Jun 11 23:11:41.604289 np0000002687 nova-compute[98431]: Jun 11 23:11:41.604289 np0000002687 nova-compute[98431]: Jun 11 23:11:41.604289 np0000002687 nova-compute[98431]: Jun 11 23:11:41.604289 np0000002687 nova-compute[98431]: Jun 11 23:11:41.604289 np0000002687 nova-compute[98431]: Jun 11 23:11:41.604289 np0000002687 nova-compute[98431]: Jun 11 23:11:41.604289 np0000002687 nova-compute[98431]: Jun 11 23:11:41.604289 np0000002687 nova-compute[98431]: Jun 11 23:11:41.604289 np0000002687 nova-compute[98431]: OpenStack Foundation Jun 11 23:11:41.604289 np0000002687 nova-compute[98431]: OpenStack Nova Jun 11 23:11:41.604289 np0000002687 nova-compute[98431]: 33.1.0 Jun 11 23:11:41.604289 np0000002687 nova-compute[98431]: 7609742e-a3a2-4be2-ba02-227efb2101e1 Jun 11 23:11:41.604289 np0000002687 nova-compute[98431]: 7609742e-a3a2-4be2-ba02-227efb2101e1 Jun 11 23:11:41.604289 np0000002687 nova-compute[98431]: Virtual Machine Jun 11 23:11:41.604289 np0000002687 nova-compute[98431]: Jun 11 23:11:41.604289 np0000002687 nova-compute[98431]: Jun 11 23:11:41.604289 np0000002687 nova-compute[98431]: Jun 11 23:11:41.604289 np0000002687 nova-compute[98431]: hvm Jun 11 23:11:41.604289 np0000002687 nova-compute[98431]: Jun 11 23:11:41.604289 np0000002687 nova-compute[98431]: Jun 11 23:11:41.604289 np0000002687 nova-compute[98431]: Jun 11 23:11:41.604289 np0000002687 nova-compute[98431]: Jun 11 23:11:41.604289 np0000002687 nova-compute[98431]: Jun 11 23:11:41.604289 np0000002687 nova-compute[98431]: Jun 11 23:11:41.604289 np0000002687 nova-compute[98431]: 128 Jun 11 23:11:41.604289 np0000002687 nova-compute[98431]: Jun 11 23:11:41.604289 np0000002687 nova-compute[98431]: Jun 11 23:11:41.604289 np0000002687 nova-compute[98431]: Jun 11 23:11:41.604289 np0000002687 nova-compute[98431]: 1 Jun 11 23:11:41.604289 np0000002687 nova-compute[98431]: Jun 11 23:11:41.604289 np0000002687 nova-compute[98431]: Jun 11 23:11:41.604289 np0000002687 nova-compute[98431]: Nehalem Jun 11 23:11:41.604289 np0000002687 nova-compute[98431]: Jun 11 23:11:41.604289 np0000002687 nova-compute[98431]: Jun 11 23:11:41.604289 np0000002687 nova-compute[98431]: Jun 11 23:11:41.604289 np0000002687 nova-compute[98431]: Jun 11 23:11:41.604289 np0000002687 nova-compute[98431]: Jun 11 23:11:41.604289 np0000002687 nova-compute[98431]: Jun 11 23:11:41.604289 np0000002687 nova-compute[98431]: Jun 11 23:11:41.604289 np0000002687 nova-compute[98431]: Jun 11 23:11:41.604289 np0000002687 nova-compute[98431]: Jun 11 23:11:41.604289 np0000002687 nova-compute[98431]: Jun 11 23:11:41.604289 np0000002687 nova-compute[98431]: Jun 11 23:11:41.604289 np0000002687 nova-compute[98431]: Jun 11 23:11:41.604289 np0000002687 nova-compute[98431]: Jun 11 23:11:41.604289 np0000002687 nova-compute[98431]: Jun 11 23:11:41.604289 np0000002687 nova-compute[98431]: Jun 11 23:11:41.604289 np0000002687 nova-compute[98431]: Jun 11 23:11:41.604289 np0000002687 nova-compute[98431]: Jun 11 23:11:41.604289 np0000002687 nova-compute[98431]: Jun 11 23:11:41.604289 np0000002687 nova-compute[98431]: Jun 11 23:11:41.604289 np0000002687 nova-compute[98431]: Jun 11 23:11:41.604289 np0000002687 nova-compute[98431]: Jun 11 23:11:41.604289 np0000002687 nova-compute[98431]: Jun 11 23:11:41.604289 np0000002687 nova-compute[98431]: Jun 11 23:11:41.604289 np0000002687 nova-compute[98431]: Jun 11 23:11:41.604289 np0000002687 nova-compute[98431]: Jun 11 23:11:41.604289 np0000002687 nova-compute[98431]: Jun 11 23:11:41.604289 np0000002687 nova-compute[98431]: /dev/urandom Jun 11 23:11:41.604289 np0000002687 nova-compute[98431]: Jun 11 23:11:41.604289 np0000002687 nova-compute[98431]: Jun 11 23:11:41.604289 np0000002687 nova-compute[98431]: Jun 11 23:11:41.604289 np0000002687 nova-compute[98431]: Jun 11 23:11:41.604289 np0000002687 nova-compute[98431]: Jun 11 23:11:41.604289 np0000002687 nova-compute[98431]: Jun 11 23:11:41.604289 np0000002687 nova-compute[98431]: Jun 11 23:11:41.604289 np0000002687 nova-compute[98431]: {{(pid=98431) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 11 23:11:41.606627 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Preparing to wait for external event network-vif-plugged-a1e7aeff-5992-43be-bb2c-d504e7019c64 {{(pid=98431) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 11 23:11:41.606627 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Acquiring lock "7609742e-a3a2-4be2-ba02-227efb2101e1-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:11:41.606627 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Lock "7609742e-a3a2-4be2-ba02-227efb2101e1-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:11:41.606627 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Lock "7609742e-a3a2-4be2-ba02-227efb2101e1-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:11:41.606627 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-11T23:11:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-872787611',display_name='tempest-ServerActionsTestOtherB-server-872787611',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='tempest-serveractionstestotherb-server-872787611',id=13,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE8GCNW5zoKlPJg2gDz6psGsk5eAwUwS5EcLVqi+Ws93aBM9mzyZ9OA4e5k8HR4bk5PDkKar3oCgqC2LYEZaaYcONGX+UXm8H5giZlXKo/6E9eZdQg2l6SXnZTdbPKM4Aw==',key_name='tempest-keypair-1789476090',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62f47df2e0374879b837bc7431326e62',ramdisk_id='',reservation_id='r-92sxxj92',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1260316994',owner_user_name='tempest-ServerActionsTestOtherB-1260316994-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-11T23:11:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2b37a00a21a249339e412bcde7a87f82',uuid=7609742e-a3a2-4be2-ba02-227efb2101e1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a1e7aeff-5992-43be-bb2c-d504e7019c64", "address": "fa:16:3e:1d:f7:18", "network": {"id": "710d3c5f-1a08-4a35-b3e1-e59f427989c2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2068802531-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62f47df2e0374879b837bc7431326e62", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1e7aeff-59", "ovs_interfaceid": "a1e7aeff-5992-43be-bb2c-d504e7019c64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 11 23:11:41.606627 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Converting VIF {"id": "a1e7aeff-5992-43be-bb2c-d504e7019c64", "address": "fa:16:3e:1d:f7:18", "network": {"id": "710d3c5f-1a08-4a35-b3e1-e59f427989c2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2068802531-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62f47df2e0374879b837bc7431326e62", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1e7aeff-59", "ovs_interfaceid": "a1e7aeff-5992-43be-bb2c-d504e7019c64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:11:41.609130 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:f7:18,bridge_name='br-int',has_traffic_filtering=True,id=a1e7aeff-5992-43be-bb2c-d504e7019c64,network=Network(710d3c5f-1a08-4a35-b3e1-e59f427989c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1e7aeff-59') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:11:41.609130 np0000002687 nova-compute[98431]: DEBUG os_vif [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:f7:18,bridge_name='br-int',has_traffic_filtering=True,id=a1e7aeff-5992-43be-bb2c-d504e7019c64,network=Network(710d3c5f-1a08-4a35-b3e1-e59f427989c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1e7aeff-59') {{(pid=98431) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 11 23:11:41.609130 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:41.609249 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:11:41.609565 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 11 23:11:41.610980 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:41.611190 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '101d37d4-89c4-59c2-8f44-98622c0abb71', '_type': 'linux-noop'}}, row=False) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:11:41.613606 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:41.615170 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:11:41.620185 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:41.624147 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:41.624506 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa1e7aeff-59, may_exist=True, interface_attrs={}) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:11:41.624851 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa1e7aeff-59, col_values=(('qos', UUID('959156b2-e964-4dec-b084-5379d28bdb08')),), if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:11:41.625027 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa1e7aeff-59, col_values=(('external_ids', {'iface-id': 'a1e7aeff-5992-43be-bb2c-d504e7019c64', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1d:f7:18', 'vm-uuid': '7609742e-a3a2-4be2-ba02-227efb2101e1'}),), if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:11:41.625913 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:41.627005 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:11:41.638407 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:41.639602 np0000002687 nova-compute[98431]: INFO os_vif [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:f7:18,bridge_name='br-int',has_traffic_filtering=True,id=a1e7aeff-5992-43be-bb2c-d504e7019c64,network=Network(710d3c5f-1a08-4a35-b3e1-e59f427989c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1e7aeff-59') Jun 11 23:11:41.654108 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [req-f6aec025-29ca-41fd-b726-df268c090c4c req-52ab3752-f5e5-4dde-8fb4-d949e6c22fdb service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:11:41.823248 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-f6aec025-29ca-41fd-b726-df268c090c4c req-52ab3752-f5e5-4dde-8fb4-d949e6c22fdb service nova] [instance: 8ffa4bbe-7ead-4029-aba5-28f031f6e784] Updated VIF entry in instance network info cache for port 591ff615-4a02-4f43-a49b-7f4052a8ed27. {{(pid=98431) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 11 23:11:41.823523 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-f6aec025-29ca-41fd-b726-df268c090c4c req-52ab3752-f5e5-4dde-8fb4-d949e6c22fdb service nova] [instance: 8ffa4bbe-7ead-4029-aba5-28f031f6e784] Updating instance_info_cache with network_info: [{"id": "591ff615-4a02-4f43-a49b-7f4052a8ed27", "address": "fa:16:3e:61:b7:fd", "network": {"id": "17593db3-c22d-4354-ab29-933b1c6a5c3a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1094286565-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "81fd45f475a04e5c8e9bd9deb7ad4c1e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap591ff615-4a", "ovs_interfaceid": "591ff615-4a02-4f43-a49b-7f4052a8ed27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:11:42.024821 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-922d3cd0-d5df-4bc5-b3ee-9cdfb633df77 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "206476b7-d805-4c6c-b7fb-db8b5c2a94a6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.513s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:11:42.169600 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.iscsi [None req-a4dcde52-06c6-4e6f-a517-9a1a79803692 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 11 23:11:42.173025 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-092b94e8-8497-429c-9c05-fa43dcb87fac tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] Acquiring lock "73abd331-0bbf-432e-be1c-308801a5429f" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:11:42.173025 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-092b94e8-8497-429c-9c05-fa43dcb87fac tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] Lock "73abd331-0bbf-432e-be1c-308801a5429f" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:11:42.173025 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-092b94e8-8497-429c-9c05-fa43dcb87fac tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] [instance: 73abd331-0bbf-432e-be1c-308801a5429f] Attaching volume b6e44a36-048b-41a3-8639-4ee7e1b0122f to /dev/vdb Jun 11 23:11:42.176189 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.iscsi [None req-a4dcde52-06c6-4e6f-a517-9a1a79803692 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 11 23:11:42.184575 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4dcde52-06c6-4e6f-a517-9a1a79803692 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 11 23:11:42.184575 np0000002687 nova-compute[98431]: node.name = iqn.2023-03.storpool.com:os--volume-6eb3ee75-92d8-430f-86ea-31edf88d1ae8 Jun 11 23:11:42.184575 np0000002687 nova-compute[98431]: node.tpgt = -1 Jun 11 23:11:42.184575 np0000002687 nova-compute[98431]: node.startup = manual Jun 11 23:11:42.184575 np0000002687 nova-compute[98431]: node.leading_login = No Jun 11 23:11:42.184575 np0000002687 nova-compute[98431]: iface.iscsi_ifacename = default Jun 11 23:11:42.184575 np0000002687 nova-compute[98431]: iface.net_ifacename = Jun 11 23:11:42.184575 np0000002687 nova-compute[98431]: iface.ipaddress = Jun 11 23:11:42.184575 np0000002687 nova-compute[98431]: iface.prefix_len = 0 Jun 11 23:11:42.184575 np0000002687 nova-compute[98431]: iface.hwaddress = Jun 11 23:11:42.184575 np0000002687 nova-compute[98431]: iface.transport_name = tcp Jun 11 23:11:42.184575 np0000002687 nova-compute[98431]: iface.initiatorname = Jun 11 23:11:42.184575 np0000002687 nova-compute[98431]: iface.state = Jun 11 23:11:42.184575 np0000002687 nova-compute[98431]: iface.vlan_id = 0 Jun 11 23:11:42.184575 np0000002687 nova-compute[98431]: iface.vlan_priority = 0 Jun 11 23:11:42.184575 np0000002687 nova-compute[98431]: iface.vlan_state = Jun 11 23:11:42.184575 np0000002687 nova-compute[98431]: iface.iface_num = 0 Jun 11 23:11:42.184575 np0000002687 nova-compute[98431]: iface.mtu = 0 Jun 11 23:11:42.184575 np0000002687 nova-compute[98431]: iface.port = 0 Jun 11 23:11:42.184575 np0000002687 nova-compute[98431]: iface.bootproto = Jun 11 23:11:42.184575 np0000002687 nova-compute[98431]: iface.subnet_mask = Jun 11 23:11:42.184575 np0000002687 nova-compute[98431]: iface.gateway = Jun 11 23:11:42.184575 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id_state = Jun 11 23:11:42.184575 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id = Jun 11 23:11:42.184575 np0000002687 nova-compute[98431]: iface.dhcp_dns = Jun 11 23:11:42.184575 np0000002687 nova-compute[98431]: iface.dhcp_learn_iqn = Jun 11 23:11:42.184575 np0000002687 nova-compute[98431]: iface.dhcp_req_vendor_id_state = Jun 11 23:11:42.184575 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id_state = Jun 11 23:11:42.184575 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id = Jun 11 23:11:42.184575 np0000002687 nova-compute[98431]: iface.dhcp_slp_da = Jun 11 23:11:42.184575 np0000002687 nova-compute[98431]: iface.fragmentation = Jun 11 23:11:42.184575 np0000002687 nova-compute[98431]: iface.gratuitous_arp = Jun 11 23:11:42.184575 np0000002687 nova-compute[98431]: iface.incoming_forwarding = Jun 11 23:11:42.184575 np0000002687 nova-compute[98431]: iface.tos_state = Jun 11 23:11:42.184575 np0000002687 nova-compute[98431]: iface.tos = 0 Jun 11 23:11:42.184575 np0000002687 nova-compute[98431]: iface.ttl = 0 Jun 11 23:11:42.184575 np0000002687 nova-compute[98431]: iface.delayed_ack = Jun 11 23:11:42.184575 np0000002687 nova-compute[98431]: iface.tcp_nagle = Jun 11 23:11:42.184575 np0000002687 nova-compute[98431]: iface.tcp_wsf_state = Jun 11 23:11:42.184575 np0000002687 nova-compute[98431]: iface.tcp_wsf = 0 Jun 11 23:11:42.184575 np0000002687 nova-compute[98431]: iface.tcp_timer_scale = 0 Jun 11 23:11:42.184575 np0000002687 nova-compute[98431]: iface.tcp_timestamp = Jun 11 23:11:42.184575 np0000002687 nova-compute[98431]: iface.redirect = Jun 11 23:11:42.184575 np0000002687 nova-compute[98431]: iface.def_task_mgmt_timeout = 0 Jun 11 23:11:42.184575 np0000002687 nova-compute[98431]: iface.header_digest = Jun 11 23:11:42.184575 np0000002687 nova-compute[98431]: iface.data_digest = Jun 11 23:11:42.184575 np0000002687 nova-compute[98431]: iface.immediate_data = Jun 11 23:11:42.184575 np0000002687 nova-compute[98431]: iface.initial_r2t = Jun 11 23:11:42.184575 np0000002687 nova-compute[98431]: iface.data_seq_inorder = Jun 11 23:11:42.184575 np0000002687 nova-compute[98431]: iface.data_pdu_inorder = Jun 11 23:11:42.184575 np0000002687 nova-compute[98431]: iface.erl = 0 Jun 11 23:11:42.184575 np0000002687 nova-compute[98431]: iface.max_receive_data_len = 0 Jun 11 23:11:42.184575 np0000002687 nova-compute[98431]: iface.first_burst_len = 0 Jun 11 23:11:42.184575 np0000002687 nova-compute[98431]: iface.max_outstanding_r2t = 0 Jun 11 23:11:42.184575 np0000002687 nova-compute[98431]: iface.max_burst_len = 0 Jun 11 23:11:42.184575 np0000002687 nova-compute[98431]: iface.chap_auth = Jun 11 23:11:42.184575 np0000002687 nova-compute[98431]: iface.bidi_chap = Jun 11 23:11:42.184575 np0000002687 nova-compute[98431]: iface.strict_login_compliance = Jun 11 23:11:42.184575 np0000002687 nova-compute[98431]: iface.discovery_auth = Jun 11 23:11:42.184575 np0000002687 nova-compute[98431]: iface.discovery_logout = Jun 11 23:11:42.184575 np0000002687 nova-compute[98431]: node.discovery_address = Jun 11 23:11:42.184575 np0000002687 nova-compute[98431]: node.discovery_port = 0 Jun 11 23:11:42.184575 np0000002687 nova-compute[98431]: node.discovery_type = fw Jun 11 23:11:42.184575 np0000002687 nova-compute[98431]: node.session.initial_cmdsn = 0 Jun 11 23:11:42.184575 np0000002687 nova-compute[98431]: node.session.initial_login_retry_max = 8 Jun 11 23:11:42.184575 np0000002687 nova-compute[98431]: node.session.xmit_thread_priority = 0 Jun 11 23:11:42.184575 np0000002687 nova-compute[98431]: node.session.cmds_max = 128 Jun 11 23:11:42.184575 np0000002687 nova-compute[98431]: node.session.queue_depth = 32 Jun 11 23:11:42.184575 np0000002687 nova-compute[98431]: node.session.nr_sessions = 1 Jun 11 23:11:42.184575 np0000002687 nova-compute[98431]: node.session.auth.authmethod = None Jun 11 23:11:42.184575 np0000002687 nova-compute[98431]: node.session.auth.username = Jun 11 23:11:42.184575 np0000002687 nova-compute[98431]: node.session.auth.password = *** Jun 11 23:11:42.184575 np0000002687 nova-compute[98431]: node.session.auth.username_in = Jun 11 23:11:42.184575 np0000002687 nova-compute[98431]: node.session.auth.password_in = Jun 11 23:11:42.184575 np0000002687 nova-compute[98431]: node.session.auth.chap_algs = SHA256 Jun 11 23:11:42.184575 np0000002687 nova-compute[98431]: node.session.timeo.replacement_timeout = 120 Jun 11 23:11:42.184575 np0000002687 nova-compute[98431]: node.session.err_timeo.abort_timeout = 15 Jun 11 23:11:42.184575 np0000002687 nova-compute[98431]: node.session.err_timeo.lu_reset_timeout = 30 Jun 11 23:11:42.184575 np0000002687 nova-compute[98431]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 11 23:11:42.184575 np0000002687 nova-compute[98431]: node.session.err_timeo.host_reset_timeout = 60 Jun 11 23:11:42.184575 np0000002687 nova-compute[98431]: node.session.iscsi.FastAbort = Yes Jun 11 23:11:42.184575 np0000002687 nova-compute[98431]: node.session.iscsi.InitialR2T = No Jun 11 23:11:42.184575 np0000002687 nova-compute[98431]: node.session.iscsi.ImmediateData = Yes Jun 11 23:11:42.184575 np0000002687 nova-compute[98431]: node.session.iscsi.FirstBurstLength = 262144 Jun 11 23:11:42.184575 np0000002687 nova-compute[98431]: node.session.iscsi.MaxBurstLength = 16776192 Jun 11 23:11:42.184575 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Retain = 0 Jun 11 23:11:42.184575 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Wait = 2 Jun 11 23:11:42.184575 np0000002687 nova-compute[98431]: node.session.iscsi.MaxConnections = 1 Jun 11 23:11:42.184575 np0000002687 nova-compute[98431]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 11 23:11:42.184575 np0000002687 nova-compute[98431]: node.session.iscsi.ERL = 0 Jun 11 23:11:42.184575 np0000002687 nova-compute[98431]: node.session.scan = auto Jun 11 23:11:42.184575 np0000002687 nova-compute[98431]: node.session.reopen_max = 0 Jun 11 23:11:42.184575 np0000002687 nova-compute[98431]: node.conn[0].address = 192.168.40.100 Jun 11 23:11:42.184575 np0000002687 nova-compute[98431]: node.conn[0].port = 3260 Jun 11 23:11:42.184575 np0000002687 nova-compute[98431]: node.conn[0].startup = manual Jun 11 23:11:42.184575 np0000002687 nova-compute[98431]: node.conn[0].tcp.window_size = 524288 Jun 11 23:11:42.184575 np0000002687 nova-compute[98431]: node.conn[0].tcp.type_of_service = 0 Jun 11 23:11:42.184575 np0000002687 nova-compute[98431]: node.conn[0].timeo.logout_timeout = 15 Jun 11 23:11:42.184575 np0000002687 nova-compute[98431]: node.conn[0].timeo.login_timeout = 15 Jun 11 23:11:42.184575 np0000002687 nova-compute[98431]: node.conn[0].timeo.auth_timeout = 45 Jun 11 23:11:42.184575 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_interval = 5 Jun 11 23:11:42.184575 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_timeout = 5 Jun 11 23:11:42.184575 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 11 23:11:42.184575 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 11 23:11:42.184575 np0000002687 nova-compute[98431]: node.conn[0].iscsi.HeaderDigest = None Jun 11 23:11:42.184575 np0000002687 nova-compute[98431]: node.conn[0].iscsi.DataDigest = None Jun 11 23:11:42.184575 np0000002687 nova-compute[98431]: node.conn[0].iscsi.IFMarker = No Jun 11 23:11:42.184575 np0000002687 nova-compute[98431]: node.conn[0].iscsi.OFMarker = No Jun 11 23:11:42.184575 np0000002687 nova-compute[98431]: # END RECORD Jun 11 23:11:42.184575 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:42.199633 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4dcde52-06c6-4e6f-a517-9a1a79803692 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 11 23:11:42.199633 np0000002687 nova-compute[98431]: node.name = iqn.2023-03.storpool.com:os--volume-6eb3ee75-92d8-430f-86ea-31edf88d1ae8 Jun 11 23:11:42.199633 np0000002687 nova-compute[98431]: node.tpgt = -1 Jun 11 23:11:42.199633 np0000002687 nova-compute[98431]: node.startup = manual Jun 11 23:11:42.199633 np0000002687 nova-compute[98431]: node.leading_login = No Jun 11 23:11:42.199633 np0000002687 nova-compute[98431]: iface.iscsi_ifacename = default Jun 11 23:11:42.199633 np0000002687 nova-compute[98431]: iface.net_ifacename = Jun 11 23:11:42.199633 np0000002687 nova-compute[98431]: iface.ipaddress = Jun 11 23:11:42.199633 np0000002687 nova-compute[98431]: iface.prefix_len = 0 Jun 11 23:11:42.199633 np0000002687 nova-compute[98431]: iface.hwaddress = Jun 11 23:11:42.199633 np0000002687 nova-compute[98431]: iface.transport_name = tcp Jun 11 23:11:42.199633 np0000002687 nova-compute[98431]: iface.initiatorname = Jun 11 23:11:42.199633 np0000002687 nova-compute[98431]: iface.state = Jun 11 23:11:42.199633 np0000002687 nova-compute[98431]: iface.vlan_id = 0 Jun 11 23:11:42.199633 np0000002687 nova-compute[98431]: iface.vlan_priority = 0 Jun 11 23:11:42.199633 np0000002687 nova-compute[98431]: iface.vlan_state = Jun 11 23:11:42.199633 np0000002687 nova-compute[98431]: iface.iface_num = 0 Jun 11 23:11:42.199633 np0000002687 nova-compute[98431]: iface.mtu = 0 Jun 11 23:11:42.199633 np0000002687 nova-compute[98431]: iface.port = 0 Jun 11 23:11:42.199633 np0000002687 nova-compute[98431]: iface.bootproto = Jun 11 23:11:42.199633 np0000002687 nova-compute[98431]: iface.subnet_mask = Jun 11 23:11:42.199633 np0000002687 nova-compute[98431]: iface.gateway = Jun 11 23:11:42.199633 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id_state = Jun 11 23:11:42.199633 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id = Jun 11 23:11:42.199633 np0000002687 nova-compute[98431]: iface.dhcp_dns = Jun 11 23:11:42.199633 np0000002687 nova-compute[98431]: iface.dhcp_learn_iqn = Jun 11 23:11:42.199633 np0000002687 nova-compute[98431]: iface.dhcp_req_vendor_id_state = Jun 11 23:11:42.199633 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id_state = Jun 11 23:11:42.199633 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id = Jun 11 23:11:42.199633 np0000002687 nova-compute[98431]: iface.dhcp_slp_da = Jun 11 23:11:42.199633 np0000002687 nova-compute[98431]: iface.fragmentation = Jun 11 23:11:42.199633 np0000002687 nova-compute[98431]: iface.gratuitous_arp = Jun 11 23:11:42.199633 np0000002687 nova-compute[98431]: iface.incoming_forwarding = Jun 11 23:11:42.199633 np0000002687 nova-compute[98431]: iface.tos_state = Jun 11 23:11:42.199633 np0000002687 nova-compute[98431]: iface.tos = 0 Jun 11 23:11:42.199633 np0000002687 nova-compute[98431]: iface.ttl = 0 Jun 11 23:11:42.199633 np0000002687 nova-compute[98431]: iface.delayed_ack = Jun 11 23:11:42.199633 np0000002687 nova-compute[98431]: iface.tcp_nagle = Jun 11 23:11:42.199633 np0000002687 nova-compute[98431]: iface.tcp_wsf_state = Jun 11 23:11:42.199633 np0000002687 nova-compute[98431]: iface.tcp_wsf = 0 Jun 11 23:11:42.199633 np0000002687 nova-compute[98431]: iface.tcp_timer_scale = 0 Jun 11 23:11:42.199633 np0000002687 nova-compute[98431]: iface.tcp_timestamp = Jun 11 23:11:42.199633 np0000002687 nova-compute[98431]: iface.redirect = Jun 11 23:11:42.199633 np0000002687 nova-compute[98431]: iface.def_task_mgmt_timeout = 0 Jun 11 23:11:42.199633 np0000002687 nova-compute[98431]: iface.header_digest = Jun 11 23:11:42.199633 np0000002687 nova-compute[98431]: iface.data_digest = Jun 11 23:11:42.199633 np0000002687 nova-compute[98431]: iface.immediate_data = Jun 11 23:11:42.199633 np0000002687 nova-compute[98431]: iface.initial_r2t = Jun 11 23:11:42.199633 np0000002687 nova-compute[98431]: iface.data_seq_inorder = Jun 11 23:11:42.199633 np0000002687 nova-compute[98431]: iface.data_pdu_inorder = Jun 11 23:11:42.199633 np0000002687 nova-compute[98431]: iface.erl = 0 Jun 11 23:11:42.199633 np0000002687 nova-compute[98431]: iface.max_receive_data_len = 0 Jun 11 23:11:42.199633 np0000002687 nova-compute[98431]: iface.first_burst_len = 0 Jun 11 23:11:42.199633 np0000002687 nova-compute[98431]: iface.max_outstanding_r2t = 0 Jun 11 23:11:42.199633 np0000002687 nova-compute[98431]: iface.max_burst_len = 0 Jun 11 23:11:42.199633 np0000002687 nova-compute[98431]: iface.chap_auth = Jun 11 23:11:42.199633 np0000002687 nova-compute[98431]: iface.bidi_chap = Jun 11 23:11:42.199633 np0000002687 nova-compute[98431]: iface.strict_login_compliance = Jun 11 23:11:42.199633 np0000002687 nova-compute[98431]: iface.discovery_auth = Jun 11 23:11:42.199633 np0000002687 nova-compute[98431]: iface.discovery_logout = Jun 11 23:11:42.199633 np0000002687 nova-compute[98431]: node.discovery_address = Jun 11 23:11:42.199633 np0000002687 nova-compute[98431]: node.discovery_port = 0 Jun 11 23:11:42.199633 np0000002687 nova-compute[98431]: node.discovery_type = fw Jun 11 23:11:42.199633 np0000002687 nova-compute[98431]: node.session.initial_cmdsn = 0 Jun 11 23:11:42.199633 np0000002687 nova-compute[98431]: node.session.initial_login_retry_max = 8 Jun 11 23:11:42.199633 np0000002687 nova-compute[98431]: node.session.xmit_thread_priority = 0 Jun 11 23:11:42.199633 np0000002687 nova-compute[98431]: node.session.cmds_max = 128 Jun 11 23:11:42.199633 np0000002687 nova-compute[98431]: node.session.queue_depth = 32 Jun 11 23:11:42.199633 np0000002687 nova-compute[98431]: node.session.nr_sessions = 1 Jun 11 23:11:42.199633 np0000002687 nova-compute[98431]: node.session.auth.authmethod = None Jun 11 23:11:42.199633 np0000002687 nova-compute[98431]: node.session.auth.username = Jun 11 23:11:42.199633 np0000002687 nova-compute[98431]: node.session.auth.password = *** Jun 11 23:11:42.199633 np0000002687 nova-compute[98431]: node.session.auth.username_in = Jun 11 23:11:42.199633 np0000002687 nova-compute[98431]: node.session.auth.password_in = Jun 11 23:11:42.199633 np0000002687 nova-compute[98431]: node.session.auth.chap_algs = SHA256 Jun 11 23:11:42.199633 np0000002687 nova-compute[98431]: node.session.timeo.replacement_timeout = 120 Jun 11 23:11:42.199633 np0000002687 nova-compute[98431]: node.session.err_timeo.abort_timeout = 15 Jun 11 23:11:42.199633 np0000002687 nova-compute[98431]: node.session.err_timeo.lu_reset_timeout = 30 Jun 11 23:11:42.199633 np0000002687 nova-compute[98431]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 11 23:11:42.199633 np0000002687 nova-compute[98431]: node.session.err_timeo.host_reset_timeout = 60 Jun 11 23:11:42.199633 np0000002687 nova-compute[98431]: node.session.iscsi.FastAbort = Yes Jun 11 23:11:42.199633 np0000002687 nova-compute[98431]: node.session.iscsi.InitialR2T = No Jun 11 23:11:42.199633 np0000002687 nova-compute[98431]: node.session.iscsi.ImmediateData = Yes Jun 11 23:11:42.199633 np0000002687 nova-compute[98431]: node.session.iscsi.FirstBurstLength = 262144 Jun 11 23:11:42.199633 np0000002687 nova-compute[98431]: node.session.iscsi.MaxBurstLength = 16776192 Jun 11 23:11:42.199633 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Retain = 0 Jun 11 23:11:42.199633 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Wait = 2 Jun 11 23:11:42.199633 np0000002687 nova-compute[98431]: node.session.iscsi.MaxConnections = 1 Jun 11 23:11:42.199633 np0000002687 nova-compute[98431]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 11 23:11:42.199633 np0000002687 nova-compute[98431]: node.session.iscsi.ERL = 0 Jun 11 23:11:42.199633 np0000002687 nova-compute[98431]: node.session.scan = auto Jun 11 23:11:42.199633 np0000002687 nova-compute[98431]: node.session.reopen_max = 0 Jun 11 23:11:42.199633 np0000002687 nova-compute[98431]: node.conn[0].address = 192.168.50.100 Jun 11 23:11:42.199633 np0000002687 nova-compute[98431]: node.conn[0].port = 3260 Jun 11 23:11:42.199633 np0000002687 nova-compute[98431]: node.conn[0].startup = manual Jun 11 23:11:42.199633 np0000002687 nova-compute[98431]: node.conn[0].tcp.window_size = 524288 Jun 11 23:11:42.199633 np0000002687 nova-compute[98431]: node.conn[0].tcp.type_of_service = 0 Jun 11 23:11:42.199633 np0000002687 nova-compute[98431]: node.conn[0].timeo.logout_timeout = 15 Jun 11 23:11:42.199633 np0000002687 nova-compute[98431]: node.conn[0].timeo.login_timeout = 15 Jun 11 23:11:42.199633 np0000002687 nova-compute[98431]: node.conn[0].timeo.auth_timeout = 45 Jun 11 23:11:42.199633 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_interval = 5 Jun 11 23:11:42.199633 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_timeout = 5 Jun 11 23:11:42.199633 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 11 23:11:42.199633 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 11 23:11:42.199633 np0000002687 nova-compute[98431]: node.conn[0].iscsi.HeaderDigest = None Jun 11 23:11:42.199633 np0000002687 nova-compute[98431]: node.conn[0].iscsi.DataDigest = None Jun 11 23:11:42.199633 np0000002687 nova-compute[98431]: node.conn[0].iscsi.IFMarker = No Jun 11 23:11:42.199633 np0000002687 nova-compute[98431]: node.conn[0].iscsi.OFMarker = No Jun 11 23:11:42.199633 np0000002687 nova-compute[98431]: # END RECORD Jun 11 23:11:42.199633 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:42.207594 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4dcde52-06c6-4e6f-a517-9a1a79803692 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:42.216477 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4dcde52-06c6-4e6f-a517-9a1a79803692 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:42.227475 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4dcde52-06c6-4e6f-a517-9a1a79803692 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:42.227475 np0000002687 nova-compute[98431]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:11:42.227475 np0000002687 nova-compute[98431]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:11:42.227475 np0000002687 nova-compute[98431]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:11:42.227475 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:11:42.227475 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:42.227475 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:42.227475 np0000002687 nova-compute[98431]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:42.227475 np0000002687 nova-compute[98431]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:42.227475 np0000002687 nova-compute[98431]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:42.227475 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:11:42.227475 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4dcde52-06c6-4e6f-a517-9a1a79803692 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:42.227475 np0000002687 nova-compute[98431]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:11:42.227475 np0000002687 nova-compute[98431]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:11:42.227475 np0000002687 nova-compute[98431]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:11:42.227475 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:11:42.227475 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:42.227475 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:42.227475 np0000002687 nova-compute[98431]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:42.227475 np0000002687 nova-compute[98431]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:42.227475 np0000002687 nova-compute[98431]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:42.227475 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:11:42.240456 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4dcde52-06c6-4e6f-a517-9a1a79803692 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:42.240456 np0000002687 nova-compute[98431]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:11:42.240456 np0000002687 nova-compute[98431]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:11:42.240456 np0000002687 nova-compute[98431]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:11:42.240456 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:11:42.240456 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:42.240456 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:42.240456 np0000002687 nova-compute[98431]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:42.240456 np0000002687 nova-compute[98431]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:42.240456 np0000002687 nova-compute[98431]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:42.240456 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:11:42.241277 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4dcde52-06c6-4e6f-a517-9a1a79803692 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:42.241277 np0000002687 nova-compute[98431]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:11:42.241277 np0000002687 nova-compute[98431]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:11:42.241277 np0000002687 nova-compute[98431]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:11:42.241277 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:11:42.241277 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:42.241277 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:42.241277 np0000002687 nova-compute[98431]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:42.241277 np0000002687 nova-compute[98431]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:42.241277 np0000002687 nova-compute[98431]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:42.241277 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:11:42.282195 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4dcde52-06c6-4e6f-a517-9a1a79803692 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6eb3ee75-92d8-430f-86ea-31edf88d1ae8, portal: 192.168.40.100,3260] Jun 11 23:11:42.282195 np0000002687 nova-compute[98431]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6eb3ee75-92d8-430f-86ea-31edf88d1ae8, portal: 192.168.40.100,3260] successful. Jun 11 23:11:42.282195 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:42.291209 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4dcde52-06c6-4e6f-a517-9a1a79803692 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6eb3ee75-92d8-430f-86ea-31edf88d1ae8, portal: 192.168.50.100,3260] Jun 11 23:11:42.291209 np0000002687 nova-compute[98431]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6eb3ee75-92d8-430f-86ea-31edf88d1ae8, portal: 192.168.50.100,3260] successful. Jun 11 23:11:42.291209 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:42.298132 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4dcde52-06c6-4e6f-a517-9a1a79803692 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:42.306780 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4dcde52-06c6-4e6f-a517-9a1a79803692 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:42.318616 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4dcde52-06c6-4e6f-a517-9a1a79803692 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:42.318616 np0000002687 nova-compute[98431]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:11:42.318616 np0000002687 nova-compute[98431]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:11:42.318616 np0000002687 nova-compute[98431]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:11:42.318616 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:11:42.318616 np0000002687 nova-compute[98431]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6eb3ee75-92d8-430f-86ea-31edf88d1ae8 (non-flash) Jun 11 23:11:42.318616 np0000002687 nova-compute[98431]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6eb3ee75-92d8-430f-86ea-31edf88d1ae8 (non-flash) Jun 11 23:11:42.318616 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:42.318616 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:42.318616 np0000002687 nova-compute[98431]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:42.318616 np0000002687 nova-compute[98431]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:42.318616 np0000002687 nova-compute[98431]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:42.318616 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:11:42.319050 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4dcde52-06c6-4e6f-a517-9a1a79803692 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:42.319050 np0000002687 nova-compute[98431]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:11:42.319050 np0000002687 nova-compute[98431]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:11:42.319050 np0000002687 nova-compute[98431]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:11:42.319050 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:11:42.319050 np0000002687 nova-compute[98431]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6eb3ee75-92d8-430f-86ea-31edf88d1ae8 (non-flash) Jun 11 23:11:42.319050 np0000002687 nova-compute[98431]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6eb3ee75-92d8-430f-86ea-31edf88d1ae8 (non-flash) Jun 11 23:11:42.319050 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:42.319050 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:42.319050 np0000002687 nova-compute[98431]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:42.319050 np0000002687 nova-compute[98431]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:42.319050 np0000002687 nova-compute[98431]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:42.319050 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:11:42.319050 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-a4dcde52-06c6-4e6f-a517-9a1a79803692 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6eb3ee75-92d8-430f-86ea-31edf88d1ae8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.180s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 11 23:11:42.319321 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4dcde52-06c6-4e6f-a517-9a1a79803692 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Connected to 192.168.40.100:3260 {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 11 23:11:42.320702 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-a4dcde52-06c6-4e6f-a517-9a1a79803692 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] HCTL ('17', '-', '-', 0) found on session 15 with lun 0 {{(pid=98431) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 11 23:11:42.320852 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-a4dcde52-06c6-4e6f-a517-9a1a79803692 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Scanning host 17 c: -, t: -, l: 0) {{(pid=98431) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 11 23:11:42.325790 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-f6aec025-29ca-41fd-b726-df268c090c4c req-52ab3752-f5e5-4dde-8fb4-d949e6c22fdb service nova] Releasing lock "refresh_cache-8ffa4bbe-7ead-4029-aba5-28f031f6e784" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 11 23:11:42.333941 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4dcde52-06c6-4e6f-a517-9a1a79803692 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:42.333941 np0000002687 nova-compute[98431]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:11:42.333941 np0000002687 nova-compute[98431]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:11:42.333941 np0000002687 nova-compute[98431]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:11:42.333941 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:11:42.333941 np0000002687 nova-compute[98431]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6eb3ee75-92d8-430f-86ea-31edf88d1ae8 (non-flash) Jun 11 23:11:42.333941 np0000002687 nova-compute[98431]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6eb3ee75-92d8-430f-86ea-31edf88d1ae8 (non-flash) Jun 11 23:11:42.333941 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:42.333941 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:42.333941 np0000002687 nova-compute[98431]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:42.333941 np0000002687 nova-compute[98431]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:42.333941 np0000002687 nova-compute[98431]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:42.333941 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:11:42.333941 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4dcde52-06c6-4e6f-a517-9a1a79803692 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:42.333941 np0000002687 nova-compute[98431]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:11:42.333941 np0000002687 nova-compute[98431]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:11:42.333941 np0000002687 nova-compute[98431]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:11:42.333941 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:11:42.333941 np0000002687 nova-compute[98431]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6eb3ee75-92d8-430f-86ea-31edf88d1ae8 (non-flash) Jun 11 23:11:42.333941 np0000002687 nova-compute[98431]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6eb3ee75-92d8-430f-86ea-31edf88d1ae8 (non-flash) Jun 11 23:11:42.333941 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:42.333941 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:42.333941 np0000002687 nova-compute[98431]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:42.333941 np0000002687 nova-compute[98431]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:42.333941 np0000002687 nova-compute[98431]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:42.333941 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:11:42.334441 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-a4dcde52-06c6-4e6f-a517-9a1a79803692 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6eb3ee75-92d8-430f-86ea-31edf88d1ae8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.196s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 11 23:11:42.334441 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4dcde52-06c6-4e6f-a517-9a1a79803692 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Connected to 192.168.50.100:3260 {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 11 23:11:42.335845 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-a4dcde52-06c6-4e6f-a517-9a1a79803692 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] HCTL ('18', '-', '-', 0) found on session 16 with lun 0 {{(pid=98431) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 11 23:11:42.335976 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-a4dcde52-06c6-4e6f-a517-9a1a79803692 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Scanning host 18 c: -, t: -, l: 0) {{(pid=98431) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 11 23:11:42.342483 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-a4dcde52-06c6-4e6f-a517-9a1a79803692 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Searching for a device in session 15 and hctl ['17', '*', '*', 0] yield: sdl {{(pid=98431) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 11 23:11:42.342709 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4dcde52-06c6-4e6f-a517-9a1a79803692 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6eb3ee75-92d8-430f-86ea-31edf88d1ae8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6eb3ee75-92d8-430f-86ea-31edf88d1ae8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 11 23:11:42.356924 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-a4dcde52-06c6-4e6f-a517-9a1a79803692 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Searching for a device in session 16 and hctl ['18', '*', '*', 0] yield: sdm {{(pid=98431) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 11 23:11:42.357364 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4dcde52-06c6-4e6f-a517-9a1a79803692 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6eb3ee75-92d8-430f-86ea-31edf88d1ae8', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '6eb3ee75-92d8-430f-86ea-31edf88d1ae8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 11 23:11:42.360921 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-3fb98611-49b1-46a9-8902-cf7bd9252cad req-ee6ce5a1-16c3-4543-a3c4-18761b04a8a1 service nova] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Received event network-vif-unplugged-852fc4ec-82e1-4185-a33c-3c45ff42351e {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:11:42.360921 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-3fb98611-49b1-46a9-8902-cf7bd9252cad req-ee6ce5a1-16c3-4543-a3c4-18761b04a8a1 service nova] Acquiring lock "c82748e6-1c78-4372-ad4b-48d1c6448efa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:11:42.361004 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-3fb98611-49b1-46a9-8902-cf7bd9252cad req-ee6ce5a1-16c3-4543-a3c4-18761b04a8a1 service nova] Lock "c82748e6-1c78-4372-ad4b-48d1c6448efa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:11:42.365358 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-3fb98611-49b1-46a9-8902-cf7bd9252cad req-ee6ce5a1-16c3-4543-a3c4-18761b04a8a1 service nova] Lock "c82748e6-1c78-4372-ad4b-48d1c6448efa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:11:42.365619 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-3fb98611-49b1-46a9-8902-cf7bd9252cad req-ee6ce5a1-16c3-4543-a3c4-18761b04a8a1 service nova] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] No waiting events found dispatching network-vif-unplugged-852fc4ec-82e1-4185-a33c-3c45ff42351e {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:11:42.365998 np0000002687 nova-compute[98431]: WARNING nova.compute.manager [req-3fb98611-49b1-46a9-8902-cf7bd9252cad req-ee6ce5a1-16c3-4543-a3c4-18761b04a8a1 service nova] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Received unexpected event network-vif-unplugged-852fc4ec-82e1-4185-a33c-3c45ff42351e for instance with vm_state active and task_state rescuing. Jun 11 23:11:42.367305 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-092b94e8-8497-429c-9c05-fa43dcb87fac tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.209', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000002687', 'execute': None}" {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 11 23:11:42.380995 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.scaleio [None req-092b94e8-8497-429c-9c05-fa43dcb87fac tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98431) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 11 23:11:42.403944 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:11:42.405783 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-092b94e8-8497-429c-9c05-fa43dcb87fac tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] Running cmd (subprocess): nvme version {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:11:42.408523 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:11:42.408973 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/58eb9156b3d6fed8e4ee712ab780f370ef149b12.part --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:11:42.440988 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-092b94e8-8497-429c-9c05-fa43dcb87fac tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] 'nvme version' failed. Not Retrying. {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 11 23:11:42.441534 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.nvmeof [None req-092b94e8-8497-429c-9c05-fa43dcb87fac tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] nvme not present on system {{(pid=98431) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 11 23:11:42.454345 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.lightos [None req-092b94e8-8497-429c-9c05-fa43dcb87fac tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] LIGHTOS: [Errno 111] Connection refused {{(pid=98431) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 11 23:11:42.456235 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.lightos [None req-092b94e8-8497-429c-9c05-fa43dcb87fac tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] Current host hostNQN and IP(s) are ['10.4.3.209', 'fe80::f816:3eff:fea3:3707', '192.168.40.6', 'fe80::f816:3eff:fe06:bdab', '192.168.50.6', 'fe80::f816:3eff:fe7a:46f2', '192.168.10.6', 'fe80::f816:3eff:fe13:793b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::38fa:21ff:fe6c:3746', 'fe80::fc16:3eff:fe6c:eb30', 'fe80::20a8:54ff:fe51:da0a', 'fe80::fc16:3eff:feb5:6ffd', 'fe80::4cb3:64ff:fe13:8a75', 'fe80::fc16:3eff:fe8e:8922', 'fe80::4c61:61ff:fe7d:90dc', 'fe80::fc16:3eff:fe77:488d', 'fe80::9469:f2ff:feae:5824', 'fe80::fc16:3eff:febd:951', 'fe80::84b1:8fff:fe59:2d4f', 'fe80::fc16:3eff:fedc:9cb5', 'fe80::f489:94ff:fe75:ec8a', 'fe80::fc16:3eff:fe8a:95c7', 'fe80::fc16:3eff:fec7:336a', 'fe80::fc16:3eff:fee8:a7df', 'fe80::fc16:3eff:fe9f:58c8', 'fe80::a002:b5ff:fe03:ad7e', 'fe80::fc16:3eff:fec3:b6b', 'fe80::fc16:3eff:feb9:2e2c', 'fe80::fc16:3eff:fea0:a282', 'fe80::fc16:3eff:fe50:f6b', 'fe80::7cd4:d5ff:feac:3f7f', 'fe80::fc16:3eff:fec4:56b3', 'fe80::78a9:34ff:febb:750c', 'fe80::fc16:3eff:fe61:b7fd'] Jun 11 23:11:42.456404 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.lightos [None req-092b94e8-8497-429c-9c05-fa43dcb87fac tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98431) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 11 23:11:42.456519 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.lightos [None req-092b94e8-8497-429c-9c05-fa43dcb87fac tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] LIGHTOS: no hostnqn found. {{(pid=98431) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 11 23:11:42.456909 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-092b94e8-8497-429c-9c05-fa43dcb87fac tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] <== get_connector_properties: return (90ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.209', 'host': 'np0000002687', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:798b370f1cc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad465dfe-0ed1-4637-98c3-ddaebebd61a4', 'nvme_native_multipath': False} {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 11 23:11:42.457151 np0000002687 nova-compute[98431]: DEBUG nova.virt.block_device [None req-092b94e8-8497-429c-9c05-fa43dcb87fac tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] [instance: 73abd331-0bbf-432e-be1c-308801a5429f] Updating existing volume attachment record: e22bc046-560b-4bcc-9120-fe2c4d0688cc {{(pid=98431) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 11 23:11:42.507168 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/58eb9156b3d6fed8e4ee712ab780f370ef149b12.part --force-share --output=json" returned: 0 in 0.098s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:11:42.507593 np0000002687 nova-compute[98431]: DEBUG nova.virt.images [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] 75fbc90b-e98a-4775-9d94-2ed39687945b was qcow2, converting to raw {{(pid=98431) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}} Jun 11 23:11:42.508280 np0000002687 nova-compute[98431]: DEBUG nova.privsep.utils [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98431) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}} Jun 11 23:11:42.508554 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/58eb9156b3d6fed8e4ee712ab780f370ef149b12.part /opt/stack/data/nova/instances/_base/58eb9156b3d6fed8e4ee712ab780f370ef149b12.converted {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:11:42.593600 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/58eb9156b3d6fed8e4ee712ab780f370ef149b12.part /opt/stack/data/nova/instances/_base/58eb9156b3d6fed8e4ee712ab780f370ef149b12.converted" returned: 0 in 0.085s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:11:42.600447 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/58eb9156b3d6fed8e4ee712ab780f370ef149b12.converted --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:11:42.612950 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:42.686096 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/58eb9156b3d6fed8e4ee712ab780f370ef149b12.converted --force-share --output=json" returned: 0 in 0.086s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:11:42.690030 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lock "58eb9156b3d6fed8e4ee712ab780f370ef149b12" "released" by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" :: held 1.208s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:11:42.690030 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:11:42.691391 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:11:42.693557 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Acquiring lock "58eb9156b3d6fed8e4ee712ab780f370ef149b12" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:11:42.694191 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lock "58eb9156b3d6fed8e4ee712ab780f370ef149b12" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:11:42.694671 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:11:42.698060 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:11:42.699076 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/58eb9156b3d6fed8e4ee712ab780f370ef149b12 --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:11:42.788941 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/58eb9156b3d6fed8e4ee712ab780f370ef149b12 --force-share --output=json" returned: 0 in 0.089s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:11:42.789651 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/58eb9156b3d6fed8e4ee712ab780f370ef149b12,backing_fmt=raw /opt/stack/data/nova/instances/c82748e6-1c78-4372-ad4b-48d1c6448efa/disk.rescue {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:11:42.830838 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/58eb9156b3d6fed8e4ee712ab780f370ef149b12,backing_fmt=raw /opt/stack/data/nova/instances/c82748e6-1c78-4372-ad4b-48d1c6448efa/disk.rescue" returned: 0 in 0.041s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:11:42.831561 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lock "58eb9156b3d6fed8e4ee712ab780f370ef149b12" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.137s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:11:42.832138 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lazy-loading 'migration_context' on Instance uuid c82748e6-1c78-4372-ad4b-48d1c6448efa {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:11:43.139183 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4dcde52-06c6-4e6f-a517-9a1a79803692 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98431) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 11 23:11:43.177905 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] No BDM found with device name vda, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:11:43.178140 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] No BDM found with device name hda, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:11:43.178310 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] No VIF found with MAC fa:16:3e:1d:f7:18, not building metadata {{(pid=98431) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13199}} Jun 11 23:11:43.178981 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Using config drive Jun 11 23:11:43.191752 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.volume.iscsi [None req-092b94e8-8497-429c-9c05-fa43dcb87fac tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] [instance: 73abd331-0bbf-432e-be1c-308801a5429f] Calling os-brick to attach iSCSI Volume {{(pid=98431) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 11 23:11:43.192827 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-092b94e8-8497-429c-9c05-fa43dcb87fac tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b6e44a36-048b-41a3-8639-4ee7e1b0122f', 'iqn.2023-03.storpool.com:os--volume-b6e44a36-048b-41a3-8639-4ee7e1b0122f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b6e44a36-048b-41a3-8639-4ee7e1b0122f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b6e44a36-048b-41a3-8639-4ee7e1b0122f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 11 23:11:43.193005 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-092b94e8-8497-429c-9c05-fa43dcb87fac tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 11 23:11:43.336869 np0000002687 nova-compute[98431]: DEBUG nova.objects.base [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=98431) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 11 23:11:43.336869 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Created local disks {{(pid=98431) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}} Jun 11 23:11:43.336869 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Start _get_guest_xml network_info=[{"id": "852fc4ec-82e1-4185-a33c-3c45ff42351e", "address": "fa:16:3e:c6:c6:5b", "network": {"id": "2a770c99-2ec6-4fa2-945b-32830a59e7a7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-137493671-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-137493671-network", "vif_mac": "fa:16:3e:c6:c6:5b"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aaf744af828a4a5eba1e98da63373b2b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap852fc4ec-82", "ovs_interfaceid": "852fc4ec-82e1-4185-a33c-3c45ff42351e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-11T23:08:20Z,direct_url=,disk_format='qcow2',id=f30640f8-7aca-4300-a085-4706a5209a79,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ce012f9fabdb4ee5a73e212437f59d97',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-11T23:08:23Z,virtual_size=,visibility=) rescue={'image_id': '75fbc90b-e98a-4775-9d94-2ed39687945b', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'mount_device': '/dev/vda', 'attachment_id': '825dbf91-4e42-4e4f-af09-fb1a8f94b5f9', 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea', 'iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5498d0af-4b75-4132-b06e-56f2b5b013ea', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, 'status': 'reserved', 'instance': 'c82748e6-1c78-4372-ad4b-48d1c6448efa', 'attached_at': '', 'detached_at': '', 'volume_id': '5498d0af-4b75-4132-b06e-56f2b5b013ea', 'serial': '5498d0af-4b75-4132-b06e-56f2b5b013ea'}, 'disk_bus': 'virtio', 'delete_on_termination': True, 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=98431) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 11 23:11:43.336869 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lazy-loading 'resources' on Instance uuid c82748e6-1c78-4372-ad4b-48d1c6448efa {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:11:43.590888 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-922d3cd0-d5df-4bc5-b3ee-9cdfb633df77 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Acquiring lock "206476b7-d805-4c6c-b7fb-db8b5c2a94a6" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:11:43.591088 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-922d3cd0-d5df-4bc5-b3ee-9cdfb633df77 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "206476b7-d805-4c6c-b7fb-db8b5c2a94a6" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:11:43.591522 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-922d3cd0-d5df-4bc5-b3ee-9cdfb633df77 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 206476b7-d805-4c6c-b7fb-db8b5c2a94a6] Attaching volume 4da6c3da-4a1a-454c-b611-7fa9fc0832d8 to /dev/vdb Jun 11 23:11:43.635352 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-922d3cd0-d5df-4bc5-b3ee-9cdfb633df77 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.209', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000002687', 'execute': None}" {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 11 23:11:43.646391 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.scaleio [None req-922d3cd0-d5df-4bc5-b3ee-9cdfb633df77 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98431) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 11 23:11:43.666163 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-922d3cd0-d5df-4bc5-b3ee-9cdfb633df77 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Running cmd (subprocess): nvme version {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:11:43.688817 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:11:43.691285 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-922d3cd0-d5df-4bc5-b3ee-9cdfb633df77 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] 'nvme version' failed. Not Retrying. {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 11 23:11:43.692387 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.nvmeof [None req-922d3cd0-d5df-4bc5-b3ee-9cdfb633df77 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] nvme not present on system {{(pid=98431) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 11 23:11:43.701699 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.lightos [None req-922d3cd0-d5df-4bc5-b3ee-9cdfb633df77 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98431) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 11 23:11:43.706751 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.lightos [None req-922d3cd0-d5df-4bc5-b3ee-9cdfb633df77 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Current host hostNQN and IP(s) are ['10.4.3.209', 'fe80::f816:3eff:fea3:3707', '192.168.40.6', 'fe80::f816:3eff:fe06:bdab', '192.168.50.6', 'fe80::f816:3eff:fe7a:46f2', '192.168.10.6', 'fe80::f816:3eff:fe13:793b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::38fa:21ff:fe6c:3746', 'fe80::fc16:3eff:fe6c:eb30', 'fe80::20a8:54ff:fe51:da0a', 'fe80::fc16:3eff:feb5:6ffd', 'fe80::4cb3:64ff:fe13:8a75', 'fe80::fc16:3eff:fe8e:8922', 'fe80::4c61:61ff:fe7d:90dc', 'fe80::fc16:3eff:fe77:488d', 'fe80::9469:f2ff:feae:5824', 'fe80::fc16:3eff:febd:951', 'fe80::84b1:8fff:fe59:2d4f', 'fe80::fc16:3eff:fedc:9cb5', 'fe80::f489:94ff:fe75:ec8a', 'fe80::fc16:3eff:fe8a:95c7', 'fe80::fc16:3eff:fec7:336a', 'fe80::fc16:3eff:fee8:a7df', 'fe80::fc16:3eff:fe9f:58c8', 'fe80::a002:b5ff:fe03:ad7e', 'fe80::fc16:3eff:fec3:b6b', 'fe80::fc16:3eff:feb9:2e2c', 'fe80::fc16:3eff:fea0:a282', 'fe80::fc16:3eff:fe50:f6b', 'fe80::7cd4:d5ff:feac:3f7f', 'fe80::fc16:3eff:fec4:56b3', 'fe80::78a9:34ff:febb:750c', 'fe80::fc16:3eff:fe61:b7fd'] Jun 11 23:11:43.706948 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.lightos [None req-922d3cd0-d5df-4bc5-b3ee-9cdfb633df77 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98431) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 11 23:11:43.707075 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.lightos [None req-922d3cd0-d5df-4bc5-b3ee-9cdfb633df77 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] LIGHTOS: no hostnqn found. {{(pid=98431) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 11 23:11:43.707361 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-922d3cd0-d5df-4bc5-b3ee-9cdfb633df77 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] <== get_connector_properties: return (71ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.209', 'host': 'np0000002687', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:798b370f1cc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad465dfe-0ed1-4637-98c3-ddaebebd61a4', 'nvme_native_multipath': False} {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 11 23:11:43.707606 np0000002687 nova-compute[98431]: DEBUG nova.virt.block_device [None req-922d3cd0-d5df-4bc5-b3ee-9cdfb633df77 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 206476b7-d805-4c6c-b7fb-db8b5c2a94a6] Updating existing volume attachment record: 579c2ce2-14c5-4ada-a285-fb46bc8ade3c {{(pid=98431) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 11 23:11:43.839681 np0000002687 nova-compute[98431]: DEBUG nova.objects.base [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=98431) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 11 23:11:43.844040 np0000002687 nova-compute[98431]: WARNING nova.virt.libvirt.driver [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 11 23:11:43.846611 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='f30640f8-7aca-4300-a085-4706a5209a79', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-28433977', uuid='c82748e6-1c78-4372-ad4b-48d1c6448efa'), owner=OwnerMeta(userid='72b6dac5eb744cfba6299636227aa59b', username='tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member', projectid='aaf744af828a4a5eba1e98da63373b2b', projectname='tempest-ServerBootFromVolumeStableRescueTest-539499192'), image=ImageMeta(id='f30640f8-7aca-4300-a085-4706a5209a79', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "852fc4ec-82e1-4185-a33c-3c45ff42351e", "address": "fa:16:3e:c6:c6:5b", "network": {"id": "2a770c99-2ec6-4fa2-945b-32830a59e7a7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-137493671-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-137493671-network", "vif_mac": "fa:16:3e:c6:c6:5b"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aaf744af828a4a5eba1e98da63373b2b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap852fc4ec-82", "ovs_interfaceid": "852fc4ec-82e1-4185-a33c-3c45ff42351e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1781219503.8452685) {{(pid=98431) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 11 23:11:43.847937 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Searching host: 'np0000002687' for CPU controller through CGroups V1... {{(pid=98431) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 11 23:11:43.848983 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] CPU controller missing on host. {{(pid=98431) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 11 23:11:43.851375 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Searching host: 'np0000002687' for CPU controller through CGroups V2... {{(pid=98431) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 11 23:11:43.851818 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] CPU controller found on host. {{(pid=98431) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 11 23:11:43.854045 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98431) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 11 23:11:43.855047 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-11T23:08:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-11T23:08:20Z,direct_url=,disk_format='qcow2',id=f30640f8-7aca-4300-a085-4706a5209a79,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ce012f9fabdb4ee5a73e212437f59d97',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-11T23:08:23Z,virtual_size=,visibility=), allow threads: True {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 11 23:11:43.857645 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Flavor limits 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 11 23:11:43.857645 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Image limits 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 11 23:11:43.857645 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Flavor pref 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 11 23:11:43.857645 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Image pref 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 11 23:11:43.857645 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 11 23:11:43.857645 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 11 23:11:43.857645 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98431) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 11 23:11:43.857645 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Got 1 possible topologies {{(pid=98431) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 11 23:11:43.857645 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 11 23:11:43.857645 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 11 23:11:43.857645 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lazy-loading 'vcpu_model' on Instance uuid c82748e6-1c78-4372-ad4b-48d1c6448efa {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:11:43.875233 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Creating config drive at /opt/stack/data/nova/instances/7609742e-a3a2-4be2-ba02-227efb2101e1/disk.config Jun 11 23:11:43.882051 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/7609742e-a3a2-4be2-ba02-227efb2101e1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp6j63q13k {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:11:43.930788 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/7609742e-a3a2-4be2-ba02-227efb2101e1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp6j63q13k" returned: 0 in 0.048s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:11:44.159463 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4dcde52-06c6-4e6f-a517-9a1a79803692 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Found WWN 3300000004a8e833e for multipath device dm-9 {{(pid=98431) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 11 23:11:44.159959 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-a4dcde52-06c6-4e6f-a517-9a1a79803692 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.036s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 11 23:11:44.160141 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4dcde52-06c6-4e6f-a517-9a1a79803692 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] <== connect_volume: return (3037ms) {'type': 'block', 'scsi_wwn': '3300000004a8e833e', 'path': '/dev/dm-9', 'multipath_id': '3300000004a8e833e'} {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 11 23:11:44.160331 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4dcde52-06c6-4e6f-a517-9a1a79803692 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] [instance: 36688d94-68d3-4ae3-989a-b391d7ee4ad9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000004a8e833e', 'path': '/dev/dm-9', 'multipath_id': '3300000004a8e833e'} {{(pid=98431) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 11 23:11:44.165019 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-092b94e8-8497-429c-9c05-fa43dcb87fac tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.971s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 11 23:11:44.165019 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-092b94e8-8497-429c-9c05-fa43dcb87fac tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b6e44a36-048b-41a3-8639-4ee7e1b0122f', 'iqn.2023-03.storpool.com:os--volume-b6e44a36-048b-41a3-8639-4ee7e1b0122f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b6e44a36-048b-41a3-8639-4ee7e1b0122f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b6e44a36-048b-41a3-8639-4ee7e1b0122f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98431) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 11 23:11:44.168694 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-a4dcde52-06c6-4e6f-a517-9a1a79803692 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Lazy-loading 'flavor' on Instance uuid 36688d94-68d3-4ae3-989a-b391d7ee4ad9 {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:11:44.178612 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-092b94e8-8497-429c-9c05-fa43dcb87fac tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b6e44a36-048b-41a3-8639-4ee7e1b0122f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 11 23:11:44.179104 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-092b94e8-8497-429c-9c05-fa43dcb87fac tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b6e44a36-048b-41a3-8639-4ee7e1b0122f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 11 23:11:44.179654 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-092b94e8-8497-429c-9c05-fa43dcb87fac tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b6e44a36-048b-41a3-8639-4ee7e1b0122f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 11 23:11:44.179737 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.iscsi [None req-092b94e8-8497-429c-9c05-fa43dcb87fac tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 11 23:11:44.180071 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-092b94e8-8497-429c-9c05-fa43dcb87fac tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b6e44a36-048b-41a3-8639-4ee7e1b0122f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 11 23:11:44.180779 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.iscsi [None req-092b94e8-8497-429c-9c05-fa43dcb87fac tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 11 23:11:44.192555 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-092b94e8-8497-429c-9c05-fa43dcb87fac tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 11 23:11:44.192555 np0000002687 nova-compute[98431]: {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:44.196383 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-092b94e8-8497-429c-9c05-fa43dcb87fac tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 11 23:11:44.196383 np0000002687 nova-compute[98431]: {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:44.204637 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-092b94e8-8497-429c-9c05-fa43dcb87fac tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b6e44a36-048b-41a3-8639-4ee7e1b0122f] added Jun 11 23:11:44.204637 np0000002687 nova-compute[98431]: stderr=iscsiadm: Config file line 363 does not have value Jun 11 23:11:44.204637 np0000002687 nova-compute[98431]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 11 23:11:44.204637 np0000002687 nova-compute[98431]: iscsiadm: Config file line 363 does not have value Jun 11 23:11:44.204637 np0000002687 nova-compute[98431]: iscsiadm: Config file line 363 does not have value Jun 11 23:11:44.204637 np0000002687 nova-compute[98431]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 11 23:11:44.204637 np0000002687 nova-compute[98431]: {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:44.204942 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-092b94e8-8497-429c-9c05-fa43dcb87fac tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98431) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 11 23:11:44.205020 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-092b94e8-8497-429c-9c05-fa43dcb87fac tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0252(s), this was the 1st time calling it. {{(pid=98431) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 11 23:11:44.205158 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-092b94e8-8497-429c-9c05-fa43dcb87fac tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98431) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 11 23:11:44.208324 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-092b94e8-8497-429c-9c05-fa43dcb87fac tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b6e44a36-048b-41a3-8639-4ee7e1b0122f] added Jun 11 23:11:44.208324 np0000002687 nova-compute[98431]: stderr=iscsiadm: Config file line 363 does not have value Jun 11 23:11:44.208324 np0000002687 nova-compute[98431]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 11 23:11:44.208324 np0000002687 nova-compute[98431]: iscsiadm: Config file line 363 does not have value Jun 11 23:11:44.208324 np0000002687 nova-compute[98431]: iscsiadm: Config file line 363 does not have value Jun 11 23:11:44.208324 np0000002687 nova-compute[98431]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 11 23:11:44.208324 np0000002687 nova-compute[98431]: {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:44.208509 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-092b94e8-8497-429c-9c05-fa43dcb87fac tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98431) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 11 23:11:44.208725 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-092b94e8-8497-429c-9c05-fa43dcb87fac tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0284(s), this was the 1st time calling it. {{(pid=98431) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 11 23:11:44.208931 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-092b94e8-8497-429c-9c05-fa43dcb87fac tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98431) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 11 23:11:44.263964 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.volume.iscsi [None req-922d3cd0-d5df-4bc5-b3ee-9cdfb633df77 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 206476b7-d805-4c6c-b7fb-db8b5c2a94a6] Calling os-brick to attach iSCSI Volume {{(pid=98431) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 11 23:11:44.264365 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-922d3cd0-d5df-4bc5-b3ee-9cdfb633df77 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8', 'iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4da6c3da-4a1a-454c-b611-7fa9fc0832d8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 11 23:11:44.264513 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-922d3cd0-d5df-4bc5-b3ee-9cdfb633df77 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 11 23:11:44.363045 np0000002687 nova-compute[98431]: DEBUG nova.objects.base [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=98431) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 11 23:11:44.381613 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c82748e6-1c78-4372-ad4b-48d1c6448efa/disk.config --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:11:44.402495 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:44.436852 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:44.474516 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c82748e6-1c78-4372-ad4b-48d1c6448efa/disk.config --force-share --output=json" returned: 0 in 0.092s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:11:44.475127 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Acquiring lock "/opt/stack/data/nova/instances/c82748e6-1c78-4372-ad4b-48d1c6448efa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:11:44.475560 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lock "/opt/stack/data/nova/instances/c82748e6-1c78-4372-ad4b-48d1c6448efa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:11:44.476279 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lock "/opt/stack/data/nova/instances/c82748e6-1c78-4372-ad4b-48d1c6448efa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:11:44.477057 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Calling os-brick to attach iSCSI Volume {{(pid=98431) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 11 23:11:44.477846 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea', 'iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5498d0af-4b75-4132-b06e-56f2b5b013ea', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}}" {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 11 23:11:44.478196 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 11 23:11:44.555039 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:44.663733 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-47d27216-be0c-4afa-8476-3d98b94ba6a3 req-986cb530-938b-47b5-80a6-f730682c8bb4 service nova] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Received event network-vif-plugged-a1e7aeff-5992-43be-bb2c-d504e7019c64 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:11:44.665515 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-47d27216-be0c-4afa-8476-3d98b94ba6a3 req-986cb530-938b-47b5-80a6-f730682c8bb4 service nova] Acquiring lock "7609742e-a3a2-4be2-ba02-227efb2101e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:11:44.665515 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-47d27216-be0c-4afa-8476-3d98b94ba6a3 req-986cb530-938b-47b5-80a6-f730682c8bb4 service nova] Lock "7609742e-a3a2-4be2-ba02-227efb2101e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:11:44.665515 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-47d27216-be0c-4afa-8476-3d98b94ba6a3 req-986cb530-938b-47b5-80a6-f730682c8bb4 service nova] Lock "7609742e-a3a2-4be2-ba02-227efb2101e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:11:44.665515 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-47d27216-be0c-4afa-8476-3d98b94ba6a3 req-986cb530-938b-47b5-80a6-f730682c8bb4 service nova] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Processing event network-vif-plugged-a1e7aeff-5992-43be-bb2c-d504e7019c64 {{(pid=98431) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 11 23:11:44.676512 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.guest [None req-a4dcde52-06c6-4e6f-a517-9a1a79803692 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] attach device xml: Jun 11 23:11:44.676512 np0000002687 nova-compute[98431]: Jun 11 23:11:44.676512 np0000002687 nova-compute[98431]: Jun 11 23:11:44.676512 np0000002687 nova-compute[98431]: Jun 11 23:11:44.676512 np0000002687 nova-compute[98431]: Jun 11 23:11:44.676512 np0000002687 nova-compute[98431]: 6eb3ee75-92d8-430f-86ea-31edf88d1ae8 Jun 11 23:11:44.676512 np0000002687 nova-compute[98431]:
Jun 11 23:11:44.676512 np0000002687 nova-compute[98431]: Jun 11 23:11:44.676512 np0000002687 nova-compute[98431]: {{(pid=98431) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} Jun 11 23:11:44.756982 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:44.764975 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:44.771577 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:44.794998 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:44.804890 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:44.860134 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-0ba99298-c11b-4c61-8430-789be8eedb0e req-1764d2f3-883e-4b93-a156-78eae082baee service nova] [instance: 14699717-b93f-4e67-b841-c67de8fff8d4] Received event network-changed-a266c7d4-9f0e-474d-a4d9-5190dbdd0fc2 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:11:44.860341 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-0ba99298-c11b-4c61-8430-789be8eedb0e req-1764d2f3-883e-4b93-a156-78eae082baee service nova] [instance: 14699717-b93f-4e67-b841-c67de8fff8d4] Refreshing instance network info cache due to event network-changed-a266c7d4-9f0e-474d-a4d9-5190dbdd0fc2. {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 11 23:11:44.862348 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-0ba99298-c11b-4c61-8430-789be8eedb0e req-1764d2f3-883e-4b93-a156-78eae082baee service nova] Acquiring lock "refresh_cache-14699717-b93f-4e67-b841-c67de8fff8d4" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 11 23:11:44.862463 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-0ba99298-c11b-4c61-8430-789be8eedb0e req-1764d2f3-883e-4b93-a156-78eae082baee service nova] Acquired lock "refresh_cache-14699717-b93f-4e67-b841-c67de8fff8d4" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 11 23:11:44.862593 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-0ba99298-c11b-4c61-8430-789be8eedb0e req-1764d2f3-883e-4b93-a156-78eae082baee service nova] [instance: 14699717-b93f-4e67-b841-c67de8fff8d4] Refreshing network info cache for port a266c7d4-9f0e-474d-a4d9-5190dbdd0fc2 {{(pid=98431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 11 23:11:45.205969 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.iscsi [None req-092b94e8-8497-429c-9c05-fa43dcb87fac tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 11 23:11:45.209440 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.iscsi [None req-092b94e8-8497-429c-9c05-fa43dcb87fac tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 11 23:11:45.219381 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-092b94e8-8497-429c-9c05-fa43dcb87fac tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 11 23:11:45.219381 np0000002687 nova-compute[98431]: node.name = iqn.2023-03.storpool.com:os--volume-b6e44a36-048b-41a3-8639-4ee7e1b0122f Jun 11 23:11:45.219381 np0000002687 nova-compute[98431]: node.tpgt = -1 Jun 11 23:11:45.219381 np0000002687 nova-compute[98431]: node.startup = manual Jun 11 23:11:45.219381 np0000002687 nova-compute[98431]: node.leading_login = No Jun 11 23:11:45.219381 np0000002687 nova-compute[98431]: iface.iscsi_ifacename = default Jun 11 23:11:45.219381 np0000002687 nova-compute[98431]: iface.net_ifacename = Jun 11 23:11:45.219381 np0000002687 nova-compute[98431]: iface.ipaddress = Jun 11 23:11:45.219381 np0000002687 nova-compute[98431]: iface.prefix_len = 0 Jun 11 23:11:45.219381 np0000002687 nova-compute[98431]: iface.hwaddress = Jun 11 23:11:45.219381 np0000002687 nova-compute[98431]: iface.transport_name = tcp Jun 11 23:11:45.219381 np0000002687 nova-compute[98431]: iface.initiatorname = Jun 11 23:11:45.219381 np0000002687 nova-compute[98431]: iface.state = Jun 11 23:11:45.219381 np0000002687 nova-compute[98431]: iface.vlan_id = 0 Jun 11 23:11:45.219381 np0000002687 nova-compute[98431]: iface.vlan_priority = 0 Jun 11 23:11:45.219381 np0000002687 nova-compute[98431]: iface.vlan_state = Jun 11 23:11:45.219381 np0000002687 nova-compute[98431]: iface.iface_num = 0 Jun 11 23:11:45.219381 np0000002687 nova-compute[98431]: iface.mtu = 0 Jun 11 23:11:45.219381 np0000002687 nova-compute[98431]: iface.port = 0 Jun 11 23:11:45.219381 np0000002687 nova-compute[98431]: iface.bootproto = Jun 11 23:11:45.219381 np0000002687 nova-compute[98431]: iface.subnet_mask = Jun 11 23:11:45.219381 np0000002687 nova-compute[98431]: iface.gateway = Jun 11 23:11:45.219381 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id_state = Jun 11 23:11:45.219381 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id = Jun 11 23:11:45.219381 np0000002687 nova-compute[98431]: iface.dhcp_dns = Jun 11 23:11:45.219381 np0000002687 nova-compute[98431]: iface.dhcp_learn_iqn = Jun 11 23:11:45.219381 np0000002687 nova-compute[98431]: iface.dhcp_req_vendor_id_state = Jun 11 23:11:45.219381 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id_state = Jun 11 23:11:45.219381 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id = Jun 11 23:11:45.219381 np0000002687 nova-compute[98431]: iface.dhcp_slp_da = Jun 11 23:11:45.219381 np0000002687 nova-compute[98431]: iface.fragmentation = Jun 11 23:11:45.219381 np0000002687 nova-compute[98431]: iface.gratuitous_arp = Jun 11 23:11:45.219381 np0000002687 nova-compute[98431]: iface.incoming_forwarding = Jun 11 23:11:45.219381 np0000002687 nova-compute[98431]: iface.tos_state = Jun 11 23:11:45.219381 np0000002687 nova-compute[98431]: iface.tos = 0 Jun 11 23:11:45.219381 np0000002687 nova-compute[98431]: iface.ttl = 0 Jun 11 23:11:45.219381 np0000002687 nova-compute[98431]: iface.delayed_ack = Jun 11 23:11:45.219381 np0000002687 nova-compute[98431]: iface.tcp_nagle = Jun 11 23:11:45.219381 np0000002687 nova-compute[98431]: iface.tcp_wsf_state = Jun 11 23:11:45.219381 np0000002687 nova-compute[98431]: iface.tcp_wsf = 0 Jun 11 23:11:45.219381 np0000002687 nova-compute[98431]: iface.tcp_timer_scale = 0 Jun 11 23:11:45.219381 np0000002687 nova-compute[98431]: iface.tcp_timestamp = Jun 11 23:11:45.219381 np0000002687 nova-compute[98431]: iface.redirect = Jun 11 23:11:45.219381 np0000002687 nova-compute[98431]: iface.def_task_mgmt_timeout = 0 Jun 11 23:11:45.219381 np0000002687 nova-compute[98431]: iface.header_digest = Jun 11 23:11:45.219381 np0000002687 nova-compute[98431]: iface.data_digest = Jun 11 23:11:45.219381 np0000002687 nova-compute[98431]: iface.immediate_data = Jun 11 23:11:45.219381 np0000002687 nova-compute[98431]: iface.initial_r2t = Jun 11 23:11:45.219381 np0000002687 nova-compute[98431]: iface.data_seq_inorder = Jun 11 23:11:45.219381 np0000002687 nova-compute[98431]: iface.data_pdu_inorder = Jun 11 23:11:45.219381 np0000002687 nova-compute[98431]: iface.erl = 0 Jun 11 23:11:45.219381 np0000002687 nova-compute[98431]: iface.max_receive_data_len = 0 Jun 11 23:11:45.219381 np0000002687 nova-compute[98431]: iface.first_burst_len = 0 Jun 11 23:11:45.219381 np0000002687 nova-compute[98431]: iface.max_outstanding_r2t = 0 Jun 11 23:11:45.219381 np0000002687 nova-compute[98431]: iface.max_burst_len = 0 Jun 11 23:11:45.219381 np0000002687 nova-compute[98431]: iface.chap_auth = Jun 11 23:11:45.219381 np0000002687 nova-compute[98431]: iface.bidi_chap = Jun 11 23:11:45.219381 np0000002687 nova-compute[98431]: iface.strict_login_compliance = Jun 11 23:11:45.219381 np0000002687 nova-compute[98431]: iface.discovery_auth = Jun 11 23:11:45.219381 np0000002687 nova-compute[98431]: iface.discovery_logout = Jun 11 23:11:45.219381 np0000002687 nova-compute[98431]: node.discovery_address = Jun 11 23:11:45.219381 np0000002687 nova-compute[98431]: node.discovery_port = 0 Jun 11 23:11:45.219381 np0000002687 nova-compute[98431]: node.discovery_type = fw Jun 11 23:11:45.219381 np0000002687 nova-compute[98431]: node.session.initial_cmdsn = 0 Jun 11 23:11:45.219381 np0000002687 nova-compute[98431]: node.session.initial_login_retry_max = 8 Jun 11 23:11:45.219381 np0000002687 nova-compute[98431]: node.session.xmit_thread_priority = 0 Jun 11 23:11:45.219381 np0000002687 nova-compute[98431]: node.session.cmds_max = 128 Jun 11 23:11:45.219381 np0000002687 nova-compute[98431]: node.session.queue_depth = 32 Jun 11 23:11:45.219381 np0000002687 nova-compute[98431]: node.session.nr_sessions = 1 Jun 11 23:11:45.219381 np0000002687 nova-compute[98431]: node.session.auth.authmethod = None Jun 11 23:11:45.219381 np0000002687 nova-compute[98431]: node.session.auth.username = Jun 11 23:11:45.219381 np0000002687 nova-compute[98431]: node.session.auth.password = *** Jun 11 23:11:45.219381 np0000002687 nova-compute[98431]: node.session.auth.username_in = Jun 11 23:11:45.219381 np0000002687 nova-compute[98431]: node.session.auth.password_in = Jun 11 23:11:45.219381 np0000002687 nova-compute[98431]: node.session.auth.chap_algs = SHA256 Jun 11 23:11:45.219381 np0000002687 nova-compute[98431]: node.session.timeo.replacement_timeout = 120 Jun 11 23:11:45.219381 np0000002687 nova-compute[98431]: node.session.err_timeo.abort_timeout = 15 Jun 11 23:11:45.219381 np0000002687 nova-compute[98431]: node.session.err_timeo.lu_reset_timeout = 30 Jun 11 23:11:45.219381 np0000002687 nova-compute[98431]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 11 23:11:45.219381 np0000002687 nova-compute[98431]: node.session.err_timeo.host_reset_timeout = 60 Jun 11 23:11:45.219381 np0000002687 nova-compute[98431]: node.session.iscsi.FastAbort = Yes Jun 11 23:11:45.219381 np0000002687 nova-compute[98431]: node.session.iscsi.InitialR2T = No Jun 11 23:11:45.219381 np0000002687 nova-compute[98431]: node.session.iscsi.ImmediateData = Yes Jun 11 23:11:45.219381 np0000002687 nova-compute[98431]: node.session.iscsi.FirstBurstLength = 262144 Jun 11 23:11:45.219381 np0000002687 nova-compute[98431]: node.session.iscsi.MaxBurstLength = 16776192 Jun 11 23:11:45.219381 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Retain = 0 Jun 11 23:11:45.219381 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Wait = 2 Jun 11 23:11:45.219381 np0000002687 nova-compute[98431]: node.session.iscsi.MaxConnections = 1 Jun 11 23:11:45.219381 np0000002687 nova-compute[98431]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 11 23:11:45.219381 np0000002687 nova-compute[98431]: node.session.iscsi.ERL = 0 Jun 11 23:11:45.219381 np0000002687 nova-compute[98431]: node.session.scan = auto Jun 11 23:11:45.219381 np0000002687 nova-compute[98431]: node.session.reopen_max = 0 Jun 11 23:11:45.219381 np0000002687 nova-compute[98431]: node.conn[0].address = 192.168.40.100 Jun 11 23:11:45.219381 np0000002687 nova-compute[98431]: node.conn[0].port = 3260 Jun 11 23:11:45.219381 np0000002687 nova-compute[98431]: node.conn[0].startup = manual Jun 11 23:11:45.219381 np0000002687 nova-compute[98431]: node.conn[0].tcp.window_size = 524288 Jun 11 23:11:45.219381 np0000002687 nova-compute[98431]: node.conn[0].tcp.type_of_service = 0 Jun 11 23:11:45.219381 np0000002687 nova-compute[98431]: node.conn[0].timeo.logout_timeout = 15 Jun 11 23:11:45.219381 np0000002687 nova-compute[98431]: node.conn[0].timeo.login_timeout = 15 Jun 11 23:11:45.219381 np0000002687 nova-compute[98431]: node.conn[0].timeo.auth_timeout = 45 Jun 11 23:11:45.219381 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_interval = 5 Jun 11 23:11:45.219381 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_timeout = 5 Jun 11 23:11:45.219381 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 11 23:11:45.219381 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 11 23:11:45.219381 np0000002687 nova-compute[98431]: node.conn[0].iscsi.HeaderDigest = None Jun 11 23:11:45.219381 np0000002687 nova-compute[98431]: node.conn[0].iscsi.DataDigest = None Jun 11 23:11:45.219381 np0000002687 nova-compute[98431]: node.conn[0].iscsi.IFMarker = No Jun 11 23:11:45.219381 np0000002687 nova-compute[98431]: node.conn[0].iscsi.OFMarker = No Jun 11 23:11:45.219381 np0000002687 nova-compute[98431]: # END RECORD Jun 11 23:11:45.219381 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:45.230108 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-092b94e8-8497-429c-9c05-fa43dcb87fac tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 11 23:11:45.230108 np0000002687 nova-compute[98431]: node.name = iqn.2023-03.storpool.com:os--volume-b6e44a36-048b-41a3-8639-4ee7e1b0122f Jun 11 23:11:45.230108 np0000002687 nova-compute[98431]: node.tpgt = -1 Jun 11 23:11:45.230108 np0000002687 nova-compute[98431]: node.startup = manual Jun 11 23:11:45.230108 np0000002687 nova-compute[98431]: node.leading_login = No Jun 11 23:11:45.230108 np0000002687 nova-compute[98431]: iface.iscsi_ifacename = default Jun 11 23:11:45.230108 np0000002687 nova-compute[98431]: iface.net_ifacename = Jun 11 23:11:45.230108 np0000002687 nova-compute[98431]: iface.ipaddress = Jun 11 23:11:45.230108 np0000002687 nova-compute[98431]: iface.prefix_len = 0 Jun 11 23:11:45.230108 np0000002687 nova-compute[98431]: iface.hwaddress = Jun 11 23:11:45.230108 np0000002687 nova-compute[98431]: iface.transport_name = tcp Jun 11 23:11:45.230108 np0000002687 nova-compute[98431]: iface.initiatorname = Jun 11 23:11:45.230108 np0000002687 nova-compute[98431]: iface.state = Jun 11 23:11:45.230108 np0000002687 nova-compute[98431]: iface.vlan_id = 0 Jun 11 23:11:45.230108 np0000002687 nova-compute[98431]: iface.vlan_priority = 0 Jun 11 23:11:45.230108 np0000002687 nova-compute[98431]: iface.vlan_state = Jun 11 23:11:45.230108 np0000002687 nova-compute[98431]: iface.iface_num = 0 Jun 11 23:11:45.230108 np0000002687 nova-compute[98431]: iface.mtu = 0 Jun 11 23:11:45.230108 np0000002687 nova-compute[98431]: iface.port = 0 Jun 11 23:11:45.230108 np0000002687 nova-compute[98431]: iface.bootproto = Jun 11 23:11:45.230108 np0000002687 nova-compute[98431]: iface.subnet_mask = Jun 11 23:11:45.230108 np0000002687 nova-compute[98431]: iface.gateway = Jun 11 23:11:45.230108 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id_state = Jun 11 23:11:45.230108 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id = Jun 11 23:11:45.230108 np0000002687 nova-compute[98431]: iface.dhcp_dns = Jun 11 23:11:45.230108 np0000002687 nova-compute[98431]: iface.dhcp_learn_iqn = Jun 11 23:11:45.230108 np0000002687 nova-compute[98431]: iface.dhcp_req_vendor_id_state = Jun 11 23:11:45.230108 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id_state = Jun 11 23:11:45.230108 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id = Jun 11 23:11:45.230108 np0000002687 nova-compute[98431]: iface.dhcp_slp_da = Jun 11 23:11:45.230108 np0000002687 nova-compute[98431]: iface.fragmentation = Jun 11 23:11:45.230108 np0000002687 nova-compute[98431]: iface.gratuitous_arp = Jun 11 23:11:45.230108 np0000002687 nova-compute[98431]: iface.incoming_forwarding = Jun 11 23:11:45.230108 np0000002687 nova-compute[98431]: iface.tos_state = Jun 11 23:11:45.230108 np0000002687 nova-compute[98431]: iface.tos = 0 Jun 11 23:11:45.230108 np0000002687 nova-compute[98431]: iface.ttl = 0 Jun 11 23:11:45.230108 np0000002687 nova-compute[98431]: iface.delayed_ack = Jun 11 23:11:45.230108 np0000002687 nova-compute[98431]: iface.tcp_nagle = Jun 11 23:11:45.230108 np0000002687 nova-compute[98431]: iface.tcp_wsf_state = Jun 11 23:11:45.230108 np0000002687 nova-compute[98431]: iface.tcp_wsf = 0 Jun 11 23:11:45.230108 np0000002687 nova-compute[98431]: iface.tcp_timer_scale = 0 Jun 11 23:11:45.230108 np0000002687 nova-compute[98431]: iface.tcp_timestamp = Jun 11 23:11:45.230108 np0000002687 nova-compute[98431]: iface.redirect = Jun 11 23:11:45.230108 np0000002687 nova-compute[98431]: iface.def_task_mgmt_timeout = 0 Jun 11 23:11:45.230108 np0000002687 nova-compute[98431]: iface.header_digest = Jun 11 23:11:45.230108 np0000002687 nova-compute[98431]: iface.data_digest = Jun 11 23:11:45.230108 np0000002687 nova-compute[98431]: iface.immediate_data = Jun 11 23:11:45.230108 np0000002687 nova-compute[98431]: iface.initial_r2t = Jun 11 23:11:45.230108 np0000002687 nova-compute[98431]: iface.data_seq_inorder = Jun 11 23:11:45.230108 np0000002687 nova-compute[98431]: iface.data_pdu_inorder = Jun 11 23:11:45.230108 np0000002687 nova-compute[98431]: iface.erl = 0 Jun 11 23:11:45.230108 np0000002687 nova-compute[98431]: iface.max_receive_data_len = 0 Jun 11 23:11:45.230108 np0000002687 nova-compute[98431]: iface.first_burst_len = 0 Jun 11 23:11:45.230108 np0000002687 nova-compute[98431]: iface.max_outstanding_r2t = 0 Jun 11 23:11:45.230108 np0000002687 nova-compute[98431]: iface.max_burst_len = 0 Jun 11 23:11:45.230108 np0000002687 nova-compute[98431]: iface.chap_auth = Jun 11 23:11:45.230108 np0000002687 nova-compute[98431]: iface.bidi_chap = Jun 11 23:11:45.230108 np0000002687 nova-compute[98431]: iface.strict_login_compliance = Jun 11 23:11:45.230108 np0000002687 nova-compute[98431]: iface.discovery_auth = Jun 11 23:11:45.230108 np0000002687 nova-compute[98431]: iface.discovery_logout = Jun 11 23:11:45.230108 np0000002687 nova-compute[98431]: node.discovery_address = Jun 11 23:11:45.230108 np0000002687 nova-compute[98431]: node.discovery_port = 0 Jun 11 23:11:45.230108 np0000002687 nova-compute[98431]: node.discovery_type = fw Jun 11 23:11:45.230108 np0000002687 nova-compute[98431]: node.session.initial_cmdsn = 0 Jun 11 23:11:45.230108 np0000002687 nova-compute[98431]: node.session.initial_login_retry_max = 8 Jun 11 23:11:45.230108 np0000002687 nova-compute[98431]: node.session.xmit_thread_priority = 0 Jun 11 23:11:45.230108 np0000002687 nova-compute[98431]: node.session.cmds_max = 128 Jun 11 23:11:45.230108 np0000002687 nova-compute[98431]: node.session.queue_depth = 32 Jun 11 23:11:45.230108 np0000002687 nova-compute[98431]: node.session.nr_sessions = 1 Jun 11 23:11:45.230108 np0000002687 nova-compute[98431]: node.session.auth.authmethod = None Jun 11 23:11:45.230108 np0000002687 nova-compute[98431]: node.session.auth.username = Jun 11 23:11:45.230108 np0000002687 nova-compute[98431]: node.session.auth.password = *** Jun 11 23:11:45.230108 np0000002687 nova-compute[98431]: node.session.auth.username_in = Jun 11 23:11:45.230108 np0000002687 nova-compute[98431]: node.session.auth.password_in = Jun 11 23:11:45.230108 np0000002687 nova-compute[98431]: node.session.auth.chap_algs = SHA256 Jun 11 23:11:45.230108 np0000002687 nova-compute[98431]: node.session.timeo.replacement_timeout = 120 Jun 11 23:11:45.230108 np0000002687 nova-compute[98431]: node.session.err_timeo.abort_timeout = 15 Jun 11 23:11:45.230108 np0000002687 nova-compute[98431]: node.session.err_timeo.lu_reset_timeout = 30 Jun 11 23:11:45.230108 np0000002687 nova-compute[98431]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 11 23:11:45.230108 np0000002687 nova-compute[98431]: node.session.err_timeo.host_reset_timeout = 60 Jun 11 23:11:45.230108 np0000002687 nova-compute[98431]: node.session.iscsi.FastAbort = Yes Jun 11 23:11:45.230108 np0000002687 nova-compute[98431]: node.session.iscsi.InitialR2T = No Jun 11 23:11:45.230108 np0000002687 nova-compute[98431]: node.session.iscsi.ImmediateData = Yes Jun 11 23:11:45.230108 np0000002687 nova-compute[98431]: node.session.iscsi.FirstBurstLength = 262144 Jun 11 23:11:45.230108 np0000002687 nova-compute[98431]: node.session.iscsi.MaxBurstLength = 16776192 Jun 11 23:11:45.230108 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Retain = 0 Jun 11 23:11:45.230108 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Wait = 2 Jun 11 23:11:45.230108 np0000002687 nova-compute[98431]: node.session.iscsi.MaxConnections = 1 Jun 11 23:11:45.230108 np0000002687 nova-compute[98431]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 11 23:11:45.230108 np0000002687 nova-compute[98431]: node.session.iscsi.ERL = 0 Jun 11 23:11:45.230108 np0000002687 nova-compute[98431]: node.session.scan = auto Jun 11 23:11:45.230108 np0000002687 nova-compute[98431]: node.session.reopen_max = 0 Jun 11 23:11:45.230108 np0000002687 nova-compute[98431]: node.conn[0].address = 192.168.50.100 Jun 11 23:11:45.230108 np0000002687 nova-compute[98431]: node.conn[0].port = 3260 Jun 11 23:11:45.230108 np0000002687 nova-compute[98431]: node.conn[0].startup = manual Jun 11 23:11:45.230108 np0000002687 nova-compute[98431]: node.conn[0].tcp.window_size = 524288 Jun 11 23:11:45.230108 np0000002687 nova-compute[98431]: node.conn[0].tcp.type_of_service = 0 Jun 11 23:11:45.230108 np0000002687 nova-compute[98431]: node.conn[0].timeo.logout_timeout = 15 Jun 11 23:11:45.230108 np0000002687 nova-compute[98431]: node.conn[0].timeo.login_timeout = 15 Jun 11 23:11:45.230108 np0000002687 nova-compute[98431]: node.conn[0].timeo.auth_timeout = 45 Jun 11 23:11:45.230108 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_interval = 5 Jun 11 23:11:45.230108 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_timeout = 5 Jun 11 23:11:45.230108 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 11 23:11:45.230108 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 11 23:11:45.230108 np0000002687 nova-compute[98431]: node.conn[0].iscsi.HeaderDigest = None Jun 11 23:11:45.230108 np0000002687 nova-compute[98431]: node.conn[0].iscsi.DataDigest = None Jun 11 23:11:45.230108 np0000002687 nova-compute[98431]: node.conn[0].iscsi.IFMarker = No Jun 11 23:11:45.230108 np0000002687 nova-compute[98431]: node.conn[0].iscsi.OFMarker = No Jun 11 23:11:45.230108 np0000002687 nova-compute[98431]: # END RECORD Jun 11 23:11:45.230108 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:45.236560 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-092b94e8-8497-429c-9c05-fa43dcb87fac tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:45.243353 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-092b94e8-8497-429c-9c05-fa43dcb87fac tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:45.256430 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-092b94e8-8497-429c-9c05-fa43dcb87fac tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:45.256430 np0000002687 nova-compute[98431]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:11:45.256430 np0000002687 nova-compute[98431]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:11:45.256430 np0000002687 nova-compute[98431]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:11:45.256430 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:11:45.256430 np0000002687 nova-compute[98431]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6eb3ee75-92d8-430f-86ea-31edf88d1ae8 (non-flash) Jun 11 23:11:45.256430 np0000002687 nova-compute[98431]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6eb3ee75-92d8-430f-86ea-31edf88d1ae8 (non-flash) Jun 11 23:11:45.256430 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:45.256430 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:45.256430 np0000002687 nova-compute[98431]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:45.256430 np0000002687 nova-compute[98431]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:45.256430 np0000002687 nova-compute[98431]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:45.256430 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:11:45.256765 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-092b94e8-8497-429c-9c05-fa43dcb87fac tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:45.256765 np0000002687 nova-compute[98431]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:11:45.256765 np0000002687 nova-compute[98431]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:11:45.256765 np0000002687 nova-compute[98431]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:11:45.256765 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:11:45.256765 np0000002687 nova-compute[98431]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6eb3ee75-92d8-430f-86ea-31edf88d1ae8 (non-flash) Jun 11 23:11:45.256765 np0000002687 nova-compute[98431]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6eb3ee75-92d8-430f-86ea-31edf88d1ae8 (non-flash) Jun 11 23:11:45.256765 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:45.256765 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:45.256765 np0000002687 nova-compute[98431]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:45.256765 np0000002687 nova-compute[98431]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:45.256765 np0000002687 nova-compute[98431]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:45.256765 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:11:45.265495 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-092b94e8-8497-429c-9c05-fa43dcb87fac tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:45.265495 np0000002687 nova-compute[98431]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:11:45.265495 np0000002687 nova-compute[98431]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:11:45.265495 np0000002687 nova-compute[98431]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:11:45.265495 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:11:45.265495 np0000002687 nova-compute[98431]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6eb3ee75-92d8-430f-86ea-31edf88d1ae8 (non-flash) Jun 11 23:11:45.265495 np0000002687 nova-compute[98431]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6eb3ee75-92d8-430f-86ea-31edf88d1ae8 (non-flash) Jun 11 23:11:45.265495 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:45.265495 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:45.265495 np0000002687 nova-compute[98431]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:45.265495 np0000002687 nova-compute[98431]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:45.265495 np0000002687 nova-compute[98431]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:45.265495 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:11:45.265941 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-092b94e8-8497-429c-9c05-fa43dcb87fac tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:45.265941 np0000002687 nova-compute[98431]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:11:45.265941 np0000002687 nova-compute[98431]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:11:45.265941 np0000002687 nova-compute[98431]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:11:45.265941 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:11:45.265941 np0000002687 nova-compute[98431]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6eb3ee75-92d8-430f-86ea-31edf88d1ae8 (non-flash) Jun 11 23:11:45.265941 np0000002687 nova-compute[98431]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6eb3ee75-92d8-430f-86ea-31edf88d1ae8 (non-flash) Jun 11 23:11:45.265941 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:45.265941 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:45.265941 np0000002687 nova-compute[98431]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:45.265941 np0000002687 nova-compute[98431]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:45.265941 np0000002687 nova-compute[98431]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:45.265941 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:11:45.303544 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-adcba578-badf-49c1-9e9f-52ff54d62c70 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:11:45.321649 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-092b94e8-8497-429c-9c05-fa43dcb87fac tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b6e44a36-048b-41a3-8639-4ee7e1b0122f, portal: 192.168.40.100,3260] Jun 11 23:11:45.321649 np0000002687 nova-compute[98431]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b6e44a36-048b-41a3-8639-4ee7e1b0122f, portal: 192.168.40.100,3260] successful. Jun 11 23:11:45.321649 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:45.330323 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-092b94e8-8497-429c-9c05-fa43dcb87fac tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b6e44a36-048b-41a3-8639-4ee7e1b0122f, portal: 192.168.50.100,3260] Jun 11 23:11:45.330323 np0000002687 nova-compute[98431]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b6e44a36-048b-41a3-8639-4ee7e1b0122f, portal: 192.168.50.100,3260] successful. Jun 11 23:11:45.330323 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:45.335751 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-092b94e8-8497-429c-9c05-fa43dcb87fac tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:45.346865 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-092b94e8-8497-429c-9c05-fa43dcb87fac tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:45.360288 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-092b94e8-8497-429c-9c05-fa43dcb87fac tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:45.360288 np0000002687 nova-compute[98431]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:11:45.360288 np0000002687 nova-compute[98431]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:11:45.360288 np0000002687 nova-compute[98431]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:11:45.360288 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:11:45.360288 np0000002687 nova-compute[98431]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6eb3ee75-92d8-430f-86ea-31edf88d1ae8 (non-flash) Jun 11 23:11:45.360288 np0000002687 nova-compute[98431]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6eb3ee75-92d8-430f-86ea-31edf88d1ae8 (non-flash) Jun 11 23:11:45.360288 np0000002687 nova-compute[98431]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6e44a36-048b-41a3-8639-4ee7e1b0122f (non-flash) Jun 11 23:11:45.360288 np0000002687 nova-compute[98431]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6e44a36-048b-41a3-8639-4ee7e1b0122f (non-flash) Jun 11 23:11:45.360288 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:45.360288 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:45.360288 np0000002687 nova-compute[98431]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:45.360288 np0000002687 nova-compute[98431]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:45.360288 np0000002687 nova-compute[98431]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:45.360288 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:11:45.360721 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-092b94e8-8497-429c-9c05-fa43dcb87fac tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:45.360721 np0000002687 nova-compute[98431]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:11:45.360721 np0000002687 nova-compute[98431]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:11:45.360721 np0000002687 nova-compute[98431]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:11:45.360721 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:11:45.360721 np0000002687 nova-compute[98431]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6eb3ee75-92d8-430f-86ea-31edf88d1ae8 (non-flash) Jun 11 23:11:45.360721 np0000002687 nova-compute[98431]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6eb3ee75-92d8-430f-86ea-31edf88d1ae8 (non-flash) Jun 11 23:11:45.360721 np0000002687 nova-compute[98431]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6e44a36-048b-41a3-8639-4ee7e1b0122f (non-flash) Jun 11 23:11:45.360721 np0000002687 nova-compute[98431]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6e44a36-048b-41a3-8639-4ee7e1b0122f (non-flash) Jun 11 23:11:45.360721 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:45.360721 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:45.360721 np0000002687 nova-compute[98431]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:45.360721 np0000002687 nova-compute[98431]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:45.360721 np0000002687 nova-compute[98431]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:45.360721 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:11:45.361147 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-092b94e8-8497-429c-9c05-fa43dcb87fac tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b6e44a36-048b-41a3-8639-4ee7e1b0122f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.181s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 11 23:11:45.361147 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-092b94e8-8497-429c-9c05-fa43dcb87fac tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] Connected to 192.168.40.100:3260 {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 11 23:11:45.362735 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-092b94e8-8497-429c-9c05-fa43dcb87fac tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] HCTL ('19', '-', '-', 0) found on session 17 with lun 0 {{(pid=98431) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 11 23:11:45.362898 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-092b94e8-8497-429c-9c05-fa43dcb87fac tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] Scanning host 19 c: -, t: -, l: 0) {{(pid=98431) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 11 23:11:45.368468 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [req-0ba99298-c11b-4c61-8430-789be8eedb0e req-1764d2f3-883e-4b93-a156-78eae082baee service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:11:45.371373 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-092b94e8-8497-429c-9c05-fa43dcb87fac tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:45.371373 np0000002687 nova-compute[98431]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:11:45.371373 np0000002687 nova-compute[98431]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:11:45.371373 np0000002687 nova-compute[98431]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:11:45.371373 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:11:45.371373 np0000002687 nova-compute[98431]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6eb3ee75-92d8-430f-86ea-31edf88d1ae8 (non-flash) Jun 11 23:11:45.371373 np0000002687 nova-compute[98431]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6eb3ee75-92d8-430f-86ea-31edf88d1ae8 (non-flash) Jun 11 23:11:45.371373 np0000002687 nova-compute[98431]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6e44a36-048b-41a3-8639-4ee7e1b0122f (non-flash) Jun 11 23:11:45.371373 np0000002687 nova-compute[98431]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6e44a36-048b-41a3-8639-4ee7e1b0122f (non-flash) Jun 11 23:11:45.371373 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:45.371373 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:45.371373 np0000002687 nova-compute[98431]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:45.371373 np0000002687 nova-compute[98431]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:45.371373 np0000002687 nova-compute[98431]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:45.371373 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:11:45.371812 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-092b94e8-8497-429c-9c05-fa43dcb87fac tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:45.371812 np0000002687 nova-compute[98431]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:11:45.371812 np0000002687 nova-compute[98431]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:11:45.371812 np0000002687 nova-compute[98431]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:11:45.371812 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:11:45.371812 np0000002687 nova-compute[98431]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6eb3ee75-92d8-430f-86ea-31edf88d1ae8 (non-flash) Jun 11 23:11:45.371812 np0000002687 nova-compute[98431]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6eb3ee75-92d8-430f-86ea-31edf88d1ae8 (non-flash) Jun 11 23:11:45.371812 np0000002687 nova-compute[98431]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6e44a36-048b-41a3-8639-4ee7e1b0122f (non-flash) Jun 11 23:11:45.371812 np0000002687 nova-compute[98431]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6e44a36-048b-41a3-8639-4ee7e1b0122f (non-flash) Jun 11 23:11:45.371812 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:45.371812 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:45.371812 np0000002687 nova-compute[98431]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:45.371812 np0000002687 nova-compute[98431]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:45.371812 np0000002687 nova-compute[98431]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:45.371812 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:11:45.381904 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-092b94e8-8497-429c-9c05-fa43dcb87fac tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b6e44a36-048b-41a3-8639-4ee7e1b0122f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.192s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 11 23:11:45.381904 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-092b94e8-8497-429c-9c05-fa43dcb87fac tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] Connected to 192.168.50.100:3260 {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 11 23:11:45.381904 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-092b94e8-8497-429c-9c05-fa43dcb87fac tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] Searching for a device in session 17 and hctl ['19', '*', '*', 0] yield: sdn {{(pid=98431) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 11 23:11:45.381904 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-092b94e8-8497-429c-9c05-fa43dcb87fac tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] Connected to sdn using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b6e44a36-048b-41a3-8639-4ee7e1b0122f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b6e44a36-048b-41a3-8639-4ee7e1b0122f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 11 23:11:45.382482 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-092b94e8-8497-429c-9c05-fa43dcb87fac tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] HCTL ('20', '-', '-', 0) found on session 18 with lun 0 {{(pid=98431) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 11 23:11:45.382657 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-092b94e8-8497-429c-9c05-fa43dcb87fac tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] Scanning host 20 c: -, t: -, l: 0) {{(pid=98431) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 11 23:11:45.383253 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98431) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 11 23:11:45.384090 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Emitting event Started> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:11:45.384315 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] VM Started (Lifecycle Event) Jun 11 23:11:45.389262 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Guest created on hypervisor {{(pid=98431) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}} Jun 11 23:11:45.392763 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [-] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Instance spawned successfully. Jun 11 23:11:45.393021 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 11 23:11:45.403730 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-092b94e8-8497-429c-9c05-fa43dcb87fac tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] Searching for a device in session 18 and hctl ['20', '*', '*', 0] yield: sdo {{(pid=98431) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 11 23:11:45.404337 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-092b94e8-8497-429c-9c05-fa43dcb87fac tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] Connected to sdo using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b6e44a36-048b-41a3-8639-4ee7e1b0122f', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'b6e44a36-048b-41a3-8639-4ee7e1b0122f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 11 23:11:45.774189 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [req-0ba99298-c11b-4c61-8430-789be8eedb0e req-1764d2f3-883e-4b93-a156-78eae082baee service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:11:45.814188 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-adcba578-badf-49c1-9e9f-52ff54d62c70 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] instance snapshotting Jun 11 23:11:45.891825 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:11:45.893794 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98431) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 11 23:11:45.904867 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Found default for hw_cdrom_bus of ide {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:11:45.904867 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Found default for hw_disk_bus of virtio {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:11:45.905056 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Found default for hw_input_bus of None {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:11:45.905464 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Found default for hw_pointer_model of None {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:11:45.907983 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Found default for hw_video_model of virtio {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:11:45.907983 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Found default for hw_vif_model of virtio {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:11:45.935008 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-0ba99298-c11b-4c61-8430-789be8eedb0e req-1764d2f3-883e-4b93-a156-78eae082baee service nova] [instance: 14699717-b93f-4e67-b841-c67de8fff8d4] Updated VIF entry in instance network info cache for port a266c7d4-9f0e-474d-a4d9-5190dbdd0fc2. {{(pid=98431) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 11 23:11:45.935238 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-0ba99298-c11b-4c61-8430-789be8eedb0e req-1764d2f3-883e-4b93-a156-78eae082baee service nova] [instance: 14699717-b93f-4e67-b841-c67de8fff8d4] Updating instance_info_cache with network_info: [{"id": "a266c7d4-9f0e-474d-a4d9-5190dbdd0fc2", "address": "fa:16:3e:8a:95:c7", "network": {"id": "0dc6da23-6c97-4fd1-9e59-910adaa610a9", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-968328905-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a092509b877483183db8610c8763b93", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa266c7d4-9f", "ovs_interfaceid": "a266c7d4-9f0e-474d-a4d9-5190dbdd0fc2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:11:45.940135 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-adcba578-badf-49c1-9e9f-52ff54d62c70 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Beginning live snapshot process Jun 11 23:11:45.950421 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-4a646a8c-ec60-4c89-8400-a6995b91f1d7 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Acquiring lock "14699717-b93f-4e67-b841-c67de8fff8d4" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:11:45.951285 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-4a646a8c-ec60-4c89-8400-a6995b91f1d7 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Lock "14699717-b93f-4e67-b841-c67de8fff8d4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:11:46.180412 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-092b94e8-8497-429c-9c05-fa43dcb87fac tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98431) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 11 23:11:46.397238 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] During sync_power_state the instance has a pending task (spawning). Skip. Jun 11 23:11:46.397703 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Emitting event Paused> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:11:46.397703 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] VM Paused (Lifecycle Event) Jun 11 23:11:46.402007 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-a4dcde52-06c6-4e6f-a517-9a1a79803692 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] No BDM found with device name sda, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:11:46.402156 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-a4dcde52-06c6-4e6f-a517-9a1a79803692 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] No BDM found with device name sdb, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:11:46.402302 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-a4dcde52-06c6-4e6f-a517-9a1a79803692 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] No BDM found with device name sdc, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:11:46.402402 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-a4dcde52-06c6-4e6f-a517-9a1a79803692 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] No VIF found with MAC fa:16:3e:8e:89:22, not building metadata {{(pid=98431) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13199}} Jun 11 23:11:46.413704 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Took 7.87 seconds to spawn the instance on the hypervisor. Jun 11 23:11:46.414524 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:11:46.440892 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-0ba99298-c11b-4c61-8430-789be8eedb0e req-1764d2f3-883e-4b93-a156-78eae082baee service nova] Releasing lock "refresh_cache-14699717-b93f-4e67-b841-c67de8fff8d4" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 11 23:11:46.458081 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-4a646a8c-ec60-4c89-8400-a6995b91f1d7 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Lazy-loading 'flavor' on Instance uuid 14699717-b93f-4e67-b841-c67de8fff8d4 {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:11:46.628098 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:46.750326 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-a3770224-cdba-47ff-a357-b27e91cfc75c req-b64ec1e1-97af-4cfd-a959-29ed6cd13ed8 service nova] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Received event network-vif-plugged-a1e7aeff-5992-43be-bb2c-d504e7019c64 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:11:46.750580 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-a3770224-cdba-47ff-a357-b27e91cfc75c req-b64ec1e1-97af-4cfd-a959-29ed6cd13ed8 service nova] Acquiring lock "7609742e-a3a2-4be2-ba02-227efb2101e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:11:46.750824 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-a3770224-cdba-47ff-a357-b27e91cfc75c req-b64ec1e1-97af-4cfd-a959-29ed6cd13ed8 service nova] Lock "7609742e-a3a2-4be2-ba02-227efb2101e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:11:46.751002 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-a3770224-cdba-47ff-a357-b27e91cfc75c req-b64ec1e1-97af-4cfd-a959-29ed6cd13ed8 service nova] Lock "7609742e-a3a2-4be2-ba02-227efb2101e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:11:46.751474 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-a3770224-cdba-47ff-a357-b27e91cfc75c req-b64ec1e1-97af-4cfd-a959-29ed6cd13ed8 service nova] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] No waiting events found dispatching network-vif-plugged-a1e7aeff-5992-43be-bb2c-d504e7019c64 {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:11:46.751642 np0000002687 nova-compute[98431]: WARNING nova.compute.manager [req-a3770224-cdba-47ff-a357-b27e91cfc75c req-b64ec1e1-97af-4cfd-a959-29ed6cd13ed8 service nova] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Received unexpected event network-vif-plugged-a1e7aeff-5992-43be-bb2c-d504e7019c64 for instance with vm_state active and task_state None. Jun 11 23:11:46.900000 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:11:46.901401 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Emitting event Resumed> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:11:46.903039 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] VM Resumed (Lifecycle Event) Jun 11 23:11:46.929675 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Took 14.18 seconds to build instance. Jun 11 23:11:46.949034 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-f807f147-e041-4715-8d8d-637ac06918b2 req-8d2d9d45-2438-412e-9581-a9ab9e66d984 service nova] [instance: 27ac8c84-e5db-4bd1-a148-ec5834c5b39c] Received event network-changed-673175fc-0e8b-46fe-9898-7e27d61b8694 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:11:46.949034 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-f807f147-e041-4715-8d8d-637ac06918b2 req-8d2d9d45-2438-412e-9581-a9ab9e66d984 service nova] [instance: 27ac8c84-e5db-4bd1-a148-ec5834c5b39c] Refreshing instance network info cache due to event network-changed-673175fc-0e8b-46fe-9898-7e27d61b8694. {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 11 23:11:46.949034 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-f807f147-e041-4715-8d8d-637ac06918b2 req-8d2d9d45-2438-412e-9581-a9ab9e66d984 service nova] Acquiring lock "refresh_cache-27ac8c84-e5db-4bd1-a148-ec5834c5b39c" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 11 23:11:46.949034 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-f807f147-e041-4715-8d8d-637ac06918b2 req-8d2d9d45-2438-412e-9581-a9ab9e66d984 service nova] Acquired lock "refresh_cache-27ac8c84-e5db-4bd1-a148-ec5834c5b39c" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 11 23:11:46.949034 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-f807f147-e041-4715-8d8d-637ac06918b2 req-8d2d9d45-2438-412e-9581-a9ab9e66d984 service nova] [instance: 27ac8c84-e5db-4bd1-a148-ec5834c5b39c] Refreshing network info cache for port 673175fc-0e8b-46fe-9898-7e27d61b8694 {{(pid=98431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 11 23:11:47.196610 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-092b94e8-8497-429c-9c05-fa43dcb87fac tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] Found WWN 33000000094e59f01 for multipath device dm-10 {{(pid=98431) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 11 23:11:47.196789 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-092b94e8-8497-429c-9c05-fa43dcb87fac tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.032s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 11 23:11:47.197018 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-092b94e8-8497-429c-9c05-fa43dcb87fac tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] <== connect_volume: return (4004ms) {'type': 'block', 'scsi_wwn': '33000000094e59f01', 'path': '/dev/dm-10', 'multipath_id': '33000000094e59f01'} {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 11 23:11:47.197167 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.volume.iscsi [None req-092b94e8-8497-429c-9c05-fa43dcb87fac tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] [instance: 73abd331-0bbf-432e-be1c-308801a5429f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000094e59f01', 'path': '/dev/dm-10', 'multipath_id': '33000000094e59f01'} {{(pid=98431) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 11 23:11:47.197960 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-922d3cd0-d5df-4bc5-b3ee-9cdfb633df77 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.933s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 11 23:11:47.198336 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-922d3cd0-d5df-4bc5-b3ee-9cdfb633df77 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8', 'iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4da6c3da-4a1a-454c-b611-7fa9fc0832d8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98431) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 11 23:11:47.199735 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-092b94e8-8497-429c-9c05-fa43dcb87fac tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] Lazy-loading 'flavor' on Instance uuid 73abd331-0bbf-432e-be1c-308801a5429f {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:11:47.210838 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-922d3cd0-d5df-4bc5-b3ee-9cdfb633df77 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 11 23:11:47.211509 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-922d3cd0-d5df-4bc5-b3ee-9cdfb633df77 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 11 23:11:47.212052 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-922d3cd0-d5df-4bc5-b3ee-9cdfb633df77 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 11 23:11:47.214248 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.iscsi [None req-922d3cd0-d5df-4bc5-b3ee-9cdfb633df77 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 11 23:11:47.214695 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-922d3cd0-d5df-4bc5-b3ee-9cdfb633df77 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 11 23:11:47.214913 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.iscsi [None req-922d3cd0-d5df-4bc5-b3ee-9cdfb633df77 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 11 23:11:47.226556 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-922d3cd0-d5df-4bc5-b3ee-9cdfb633df77 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 11 23:11:47.226556 np0000002687 nova-compute[98431]: {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:47.232722 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-922d3cd0-d5df-4bc5-b3ee-9cdfb633df77 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 11 23:11:47.232722 np0000002687 nova-compute[98431]: {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:47.241682 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-922d3cd0-d5df-4bc5-b3ee-9cdfb633df77 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8] added Jun 11 23:11:47.241682 np0000002687 nova-compute[98431]: stderr=iscsiadm: Config file line 363 does not have value Jun 11 23:11:47.241682 np0000002687 nova-compute[98431]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 11 23:11:47.241682 np0000002687 nova-compute[98431]: iscsiadm: Config file line 363 does not have value Jun 11 23:11:47.241682 np0000002687 nova-compute[98431]: iscsiadm: Config file line 363 does not have value Jun 11 23:11:47.241682 np0000002687 nova-compute[98431]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 11 23:11:47.241682 np0000002687 nova-compute[98431]: {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:47.241923 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-922d3cd0-d5df-4bc5-b3ee-9cdfb633df77 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98431) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 11 23:11:47.242163 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-922d3cd0-d5df-4bc5-b3ee-9cdfb633df77 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0272(s), this was the 1st time calling it. {{(pid=98431) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 11 23:11:47.242348 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-922d3cd0-d5df-4bc5-b3ee-9cdfb633df77 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98431) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 11 23:11:47.243354 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-922d3cd0-d5df-4bc5-b3ee-9cdfb633df77 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8] added Jun 11 23:11:47.243354 np0000002687 nova-compute[98431]: stderr=iscsiadm: Config file line 363 does not have value Jun 11 23:11:47.243354 np0000002687 nova-compute[98431]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 11 23:11:47.243354 np0000002687 nova-compute[98431]: iscsiadm: Config file line 363 does not have value Jun 11 23:11:47.243354 np0000002687 nova-compute[98431]: iscsiadm: Config file line 363 does not have value Jun 11 23:11:47.243354 np0000002687 nova-compute[98431]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 11 23:11:47.243354 np0000002687 nova-compute[98431]: {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:47.243587 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-922d3cd0-d5df-4bc5-b3ee-9cdfb633df77 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98431) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 11 23:11:47.243720 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-922d3cd0-d5df-4bc5-b3ee-9cdfb633df77 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0294(s), this was the 1st time calling it. {{(pid=98431) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 11 23:11:47.243770 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-922d3cd0-d5df-4bc5-b3ee-9cdfb633df77 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98431) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 11 23:11:47.404344 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:11:47.406750 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98431) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 11 23:11:47.431648 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Lock "7609742e-a3a2-4be2-ba02-227efb2101e1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 15.694s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:11:47.453645 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [req-f807f147-e041-4715-8d8d-637ac06918b2 req-8d2d9d45-2438-412e-9581-a9ab9e66d984 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:11:47.462588 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-adcba578-badf-49c1-9e9f-52ff54d62c70 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb63f66c-b69e-42b0-805c-be6fe9b3aee3/disk --force-share --output=json -f qcow2 {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:11:47.481442 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-4a646a8c-ec60-4c89-8400-a6995b91f1d7 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Lock "14699717-b93f-4e67-b841-c67de8fff8d4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.529s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:11:47.554366 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-adcba578-badf-49c1-9e9f-52ff54d62c70 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb63f66c-b69e-42b0-805c-be6fe9b3aee3/disk --force-share --output=json -f qcow2" returned: 0 in 0.092s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:11:47.555773 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-adcba578-badf-49c1-9e9f-52ff54d62c70 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb63f66c-b69e-42b0-805c-be6fe9b3aee3/disk --force-share --output=json -f qcow2 {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:11:47.614892 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:47.656363 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-adcba578-badf-49c1-9e9f-52ff54d62c70 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb63f66c-b69e-42b0-805c-be6fe9b3aee3/disk --force-share --output=json -f qcow2" returned: 0 in 0.101s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:11:47.658480 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-adcba578-badf-49c1-9e9f-52ff54d62c70 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:11:47.666458 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-adcba578-badf-49c1-9e9f-52ff54d62c70 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:11:47.667226 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-adcba578-badf-49c1-9e9f-52ff54d62c70 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:11:47.703301 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-092b94e8-8497-429c-9c05-fa43dcb87fac tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] [instance: 73abd331-0bbf-432e-be1c-308801a5429f] Attempting to attach volume b6e44a36-048b-41a3-8639-4ee7e1b0122f with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98431) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}} Jun 11 23:11:47.705972 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.guest [None req-092b94e8-8497-429c-9c05-fa43dcb87fac tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] attach device xml: Jun 11 23:11:47.705972 np0000002687 nova-compute[98431]: Jun 11 23:11:47.705972 np0000002687 nova-compute[98431]: Jun 11 23:11:47.705972 np0000002687 nova-compute[98431]: Jun 11 23:11:47.705972 np0000002687 nova-compute[98431]: Jun 11 23:11:47.705972 np0000002687 nova-compute[98431]: b6e44a36-048b-41a3-8639-4ee7e1b0122f Jun 11 23:11:47.705972 np0000002687 nova-compute[98431]: Jun 11 23:11:47.705972 np0000002687 nova-compute[98431]: {{(pid=98431) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} Jun 11 23:11:47.753021 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-adcba578-badf-49c1-9e9f-52ff54d62c70 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json" returned: 0 in 0.086s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:11:47.753426 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-adcba578-badf-49c1-9e9f-52ff54d62c70 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpmnswwnj8/03923e50b954468183e700fd8ab5d958.delta 1073741824 {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:11:47.801881 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-adcba578-badf-49c1-9e9f-52ff54d62c70 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpmnswwnj8/03923e50b954468183e700fd8ab5d958.delta 1073741824" returned: 0 in 0.048s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:11:47.803819 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-adcba578-badf-49c1-9e9f-52ff54d62c70 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Quiescing instance not available: QEMU guest agent is not enabled. Jun 11 23:11:47.952685 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [req-f807f147-e041-4715-8d8d-637ac06918b2 req-8d2d9d45-2438-412e-9581-a9ab9e66d984 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:11:48.010113 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-a4dcde52-06c6-4e6f-a517-9a1a79803692 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Lock "36688d94-68d3-4ae3-989a-b391d7ee4ad9" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 7.652s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:11:48.116192 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.guest [None req-adcba578-badf-49c1-9e9f-52ff54d62c70 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] COPY block job progress, current cursor: 0 final cursor: 76677120 {{(pid=98431) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}} Jun 11 23:11:48.137301 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-f807f147-e041-4715-8d8d-637ac06918b2 req-8d2d9d45-2438-412e-9581-a9ab9e66d984 service nova] [instance: 27ac8c84-e5db-4bd1-a148-ec5834c5b39c] Updated VIF entry in instance network info cache for port 673175fc-0e8b-46fe-9898-7e27d61b8694. {{(pid=98431) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 11 23:11:48.137868 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-f807f147-e041-4715-8d8d-637ac06918b2 req-8d2d9d45-2438-412e-9581-a9ab9e66d984 service nova] [instance: 27ac8c84-e5db-4bd1-a148-ec5834c5b39c] Updating instance_info_cache with network_info: [{"id": "673175fc-0e8b-46fe-9898-7e27d61b8694", "address": "fa:16:3e:dc:9c:b5", "network": {"id": "0dc6da23-6c97-4fd1-9e59-910adaa610a9", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-968328905-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a092509b877483183db8610c8763b93", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap673175fc-0e", "ovs_interfaceid": "673175fc-0e8b-46fe-9898-7e27d61b8694", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:11:48.242828 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.iscsi [None req-922d3cd0-d5df-4bc5-b3ee-9cdfb633df77 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 11 23:11:48.244058 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.iscsi [None req-922d3cd0-d5df-4bc5-b3ee-9cdfb633df77 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 11 23:11:48.255136 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-922d3cd0-d5df-4bc5-b3ee-9cdfb633df77 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 11 23:11:48.255136 np0000002687 nova-compute[98431]: node.name = iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8 Jun 11 23:11:48.255136 np0000002687 nova-compute[98431]: node.tpgt = -1 Jun 11 23:11:48.255136 np0000002687 nova-compute[98431]: node.startup = manual Jun 11 23:11:48.255136 np0000002687 nova-compute[98431]: node.leading_login = No Jun 11 23:11:48.255136 np0000002687 nova-compute[98431]: iface.iscsi_ifacename = default Jun 11 23:11:48.255136 np0000002687 nova-compute[98431]: iface.net_ifacename = Jun 11 23:11:48.255136 np0000002687 nova-compute[98431]: iface.ipaddress = Jun 11 23:11:48.255136 np0000002687 nova-compute[98431]: iface.prefix_len = 0 Jun 11 23:11:48.255136 np0000002687 nova-compute[98431]: iface.hwaddress = Jun 11 23:11:48.255136 np0000002687 nova-compute[98431]: iface.transport_name = tcp Jun 11 23:11:48.255136 np0000002687 nova-compute[98431]: iface.initiatorname = Jun 11 23:11:48.255136 np0000002687 nova-compute[98431]: iface.state = Jun 11 23:11:48.255136 np0000002687 nova-compute[98431]: iface.vlan_id = 0 Jun 11 23:11:48.255136 np0000002687 nova-compute[98431]: iface.vlan_priority = 0 Jun 11 23:11:48.255136 np0000002687 nova-compute[98431]: iface.vlan_state = Jun 11 23:11:48.255136 np0000002687 nova-compute[98431]: iface.iface_num = 0 Jun 11 23:11:48.255136 np0000002687 nova-compute[98431]: iface.mtu = 0 Jun 11 23:11:48.255136 np0000002687 nova-compute[98431]: iface.port = 0 Jun 11 23:11:48.255136 np0000002687 nova-compute[98431]: iface.bootproto = Jun 11 23:11:48.255136 np0000002687 nova-compute[98431]: iface.subnet_mask = Jun 11 23:11:48.255136 np0000002687 nova-compute[98431]: iface.gateway = Jun 11 23:11:48.255136 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id_state = Jun 11 23:11:48.255136 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id = Jun 11 23:11:48.255136 np0000002687 nova-compute[98431]: iface.dhcp_dns = Jun 11 23:11:48.255136 np0000002687 nova-compute[98431]: iface.dhcp_learn_iqn = Jun 11 23:11:48.255136 np0000002687 nova-compute[98431]: iface.dhcp_req_vendor_id_state = Jun 11 23:11:48.255136 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id_state = Jun 11 23:11:48.255136 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id = Jun 11 23:11:48.255136 np0000002687 nova-compute[98431]: iface.dhcp_slp_da = Jun 11 23:11:48.255136 np0000002687 nova-compute[98431]: iface.fragmentation = Jun 11 23:11:48.255136 np0000002687 nova-compute[98431]: iface.gratuitous_arp = Jun 11 23:11:48.255136 np0000002687 nova-compute[98431]: iface.incoming_forwarding = Jun 11 23:11:48.255136 np0000002687 nova-compute[98431]: iface.tos_state = Jun 11 23:11:48.255136 np0000002687 nova-compute[98431]: iface.tos = 0 Jun 11 23:11:48.255136 np0000002687 nova-compute[98431]: iface.ttl = 0 Jun 11 23:11:48.255136 np0000002687 nova-compute[98431]: iface.delayed_ack = Jun 11 23:11:48.255136 np0000002687 nova-compute[98431]: iface.tcp_nagle = Jun 11 23:11:48.255136 np0000002687 nova-compute[98431]: iface.tcp_wsf_state = Jun 11 23:11:48.255136 np0000002687 nova-compute[98431]: iface.tcp_wsf = 0 Jun 11 23:11:48.255136 np0000002687 nova-compute[98431]: iface.tcp_timer_scale = 0 Jun 11 23:11:48.255136 np0000002687 nova-compute[98431]: iface.tcp_timestamp = Jun 11 23:11:48.255136 np0000002687 nova-compute[98431]: iface.redirect = Jun 11 23:11:48.255136 np0000002687 nova-compute[98431]: iface.def_task_mgmt_timeout = 0 Jun 11 23:11:48.255136 np0000002687 nova-compute[98431]: iface.header_digest = Jun 11 23:11:48.255136 np0000002687 nova-compute[98431]: iface.data_digest = Jun 11 23:11:48.255136 np0000002687 nova-compute[98431]: iface.immediate_data = Jun 11 23:11:48.255136 np0000002687 nova-compute[98431]: iface.initial_r2t = Jun 11 23:11:48.255136 np0000002687 nova-compute[98431]: iface.data_seq_inorder = Jun 11 23:11:48.255136 np0000002687 nova-compute[98431]: iface.data_pdu_inorder = Jun 11 23:11:48.255136 np0000002687 nova-compute[98431]: iface.erl = 0 Jun 11 23:11:48.255136 np0000002687 nova-compute[98431]: iface.max_receive_data_len = 0 Jun 11 23:11:48.255136 np0000002687 nova-compute[98431]: iface.first_burst_len = 0 Jun 11 23:11:48.255136 np0000002687 nova-compute[98431]: iface.max_outstanding_r2t = 0 Jun 11 23:11:48.255136 np0000002687 nova-compute[98431]: iface.max_burst_len = 0 Jun 11 23:11:48.255136 np0000002687 nova-compute[98431]: iface.chap_auth = Jun 11 23:11:48.255136 np0000002687 nova-compute[98431]: iface.bidi_chap = Jun 11 23:11:48.255136 np0000002687 nova-compute[98431]: iface.strict_login_compliance = Jun 11 23:11:48.255136 np0000002687 nova-compute[98431]: iface.discovery_auth = Jun 11 23:11:48.255136 np0000002687 nova-compute[98431]: iface.discovery_logout = Jun 11 23:11:48.255136 np0000002687 nova-compute[98431]: node.discovery_address = Jun 11 23:11:48.255136 np0000002687 nova-compute[98431]: node.discovery_port = 0 Jun 11 23:11:48.255136 np0000002687 nova-compute[98431]: node.discovery_type = fw Jun 11 23:11:48.255136 np0000002687 nova-compute[98431]: node.session.initial_cmdsn = 0 Jun 11 23:11:48.255136 np0000002687 nova-compute[98431]: node.session.initial_login_retry_max = 8 Jun 11 23:11:48.255136 np0000002687 nova-compute[98431]: node.session.xmit_thread_priority = 0 Jun 11 23:11:48.255136 np0000002687 nova-compute[98431]: node.session.cmds_max = 128 Jun 11 23:11:48.255136 np0000002687 nova-compute[98431]: node.session.queue_depth = 32 Jun 11 23:11:48.255136 np0000002687 nova-compute[98431]: node.session.nr_sessions = 1 Jun 11 23:11:48.255136 np0000002687 nova-compute[98431]: node.session.auth.authmethod = None Jun 11 23:11:48.255136 np0000002687 nova-compute[98431]: node.session.auth.username = Jun 11 23:11:48.255136 np0000002687 nova-compute[98431]: node.session.auth.password = *** Jun 11 23:11:48.255136 np0000002687 nova-compute[98431]: node.session.auth.username_in = Jun 11 23:11:48.255136 np0000002687 nova-compute[98431]: node.session.auth.password_in = Jun 11 23:11:48.255136 np0000002687 nova-compute[98431]: node.session.auth.chap_algs = SHA256 Jun 11 23:11:48.255136 np0000002687 nova-compute[98431]: node.session.timeo.replacement_timeout = 120 Jun 11 23:11:48.255136 np0000002687 nova-compute[98431]: node.session.err_timeo.abort_timeout = 15 Jun 11 23:11:48.255136 np0000002687 nova-compute[98431]: node.session.err_timeo.lu_reset_timeout = 30 Jun 11 23:11:48.255136 np0000002687 nova-compute[98431]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 11 23:11:48.255136 np0000002687 nova-compute[98431]: node.session.err_timeo.host_reset_timeout = 60 Jun 11 23:11:48.255136 np0000002687 nova-compute[98431]: node.session.iscsi.FastAbort = Yes Jun 11 23:11:48.255136 np0000002687 nova-compute[98431]: node.session.iscsi.InitialR2T = No Jun 11 23:11:48.255136 np0000002687 nova-compute[98431]: node.session.iscsi.ImmediateData = Yes Jun 11 23:11:48.255136 np0000002687 nova-compute[98431]: node.session.iscsi.FirstBurstLength = 262144 Jun 11 23:11:48.255136 np0000002687 nova-compute[98431]: node.session.iscsi.MaxBurstLength = 16776192 Jun 11 23:11:48.255136 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Retain = 0 Jun 11 23:11:48.255136 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Wait = 2 Jun 11 23:11:48.255136 np0000002687 nova-compute[98431]: node.session.iscsi.MaxConnections = 1 Jun 11 23:11:48.255136 np0000002687 nova-compute[98431]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 11 23:11:48.255136 np0000002687 nova-compute[98431]: node.session.iscsi.ERL = 0 Jun 11 23:11:48.255136 np0000002687 nova-compute[98431]: node.session.scan = auto Jun 11 23:11:48.255136 np0000002687 nova-compute[98431]: node.session.reopen_max = 0 Jun 11 23:11:48.255136 np0000002687 nova-compute[98431]: node.conn[0].address = 192.168.50.100 Jun 11 23:11:48.255136 np0000002687 nova-compute[98431]: node.conn[0].port = 3260 Jun 11 23:11:48.255136 np0000002687 nova-compute[98431]: node.conn[0].startup = manual Jun 11 23:11:48.255136 np0000002687 nova-compute[98431]: node.conn[0].tcp.window_size = 524288 Jun 11 23:11:48.255136 np0000002687 nova-compute[98431]: node.conn[0].tcp.type_of_service = 0 Jun 11 23:11:48.255136 np0000002687 nova-compute[98431]: node.conn[0].timeo.logout_timeout = 15 Jun 11 23:11:48.255136 np0000002687 nova-compute[98431]: node.conn[0].timeo.login_timeout = 15 Jun 11 23:11:48.255136 np0000002687 nova-compute[98431]: node.conn[0].timeo.auth_timeout = 45 Jun 11 23:11:48.255136 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_interval = 5 Jun 11 23:11:48.255136 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_timeout = 5 Jun 11 23:11:48.255136 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 11 23:11:48.255136 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 11 23:11:48.255136 np0000002687 nova-compute[98431]: node.conn[0].iscsi.HeaderDigest = None Jun 11 23:11:48.255136 np0000002687 nova-compute[98431]: node.conn[0].iscsi.DataDigest = None Jun 11 23:11:48.255136 np0000002687 nova-compute[98431]: node.conn[0].iscsi.IFMarker = No Jun 11 23:11:48.255136 np0000002687 nova-compute[98431]: node.conn[0].iscsi.OFMarker = No Jun 11 23:11:48.255136 np0000002687 nova-compute[98431]: # END RECORD Jun 11 23:11:48.255136 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:48.261266 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-922d3cd0-d5df-4bc5-b3ee-9cdfb633df77 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 11 23:11:48.261266 np0000002687 nova-compute[98431]: node.name = iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8 Jun 11 23:11:48.261266 np0000002687 nova-compute[98431]: node.tpgt = -1 Jun 11 23:11:48.261266 np0000002687 nova-compute[98431]: node.startup = manual Jun 11 23:11:48.261266 np0000002687 nova-compute[98431]: node.leading_login = No Jun 11 23:11:48.261266 np0000002687 nova-compute[98431]: iface.iscsi_ifacename = default Jun 11 23:11:48.261266 np0000002687 nova-compute[98431]: iface.net_ifacename = Jun 11 23:11:48.261266 np0000002687 nova-compute[98431]: iface.ipaddress = Jun 11 23:11:48.261266 np0000002687 nova-compute[98431]: iface.prefix_len = 0 Jun 11 23:11:48.261266 np0000002687 nova-compute[98431]: iface.hwaddress = Jun 11 23:11:48.261266 np0000002687 nova-compute[98431]: iface.transport_name = tcp Jun 11 23:11:48.261266 np0000002687 nova-compute[98431]: iface.initiatorname = Jun 11 23:11:48.261266 np0000002687 nova-compute[98431]: iface.state = Jun 11 23:11:48.261266 np0000002687 nova-compute[98431]: iface.vlan_id = 0 Jun 11 23:11:48.261266 np0000002687 nova-compute[98431]: iface.vlan_priority = 0 Jun 11 23:11:48.261266 np0000002687 nova-compute[98431]: iface.vlan_state = Jun 11 23:11:48.261266 np0000002687 nova-compute[98431]: iface.iface_num = 0 Jun 11 23:11:48.261266 np0000002687 nova-compute[98431]: iface.mtu = 0 Jun 11 23:11:48.261266 np0000002687 nova-compute[98431]: iface.port = 0 Jun 11 23:11:48.261266 np0000002687 nova-compute[98431]: iface.bootproto = Jun 11 23:11:48.261266 np0000002687 nova-compute[98431]: iface.subnet_mask = Jun 11 23:11:48.261266 np0000002687 nova-compute[98431]: iface.gateway = Jun 11 23:11:48.261266 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id_state = Jun 11 23:11:48.261266 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id = Jun 11 23:11:48.261266 np0000002687 nova-compute[98431]: iface.dhcp_dns = Jun 11 23:11:48.261266 np0000002687 nova-compute[98431]: iface.dhcp_learn_iqn = Jun 11 23:11:48.261266 np0000002687 nova-compute[98431]: iface.dhcp_req_vendor_id_state = Jun 11 23:11:48.261266 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id_state = Jun 11 23:11:48.261266 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id = Jun 11 23:11:48.261266 np0000002687 nova-compute[98431]: iface.dhcp_slp_da = Jun 11 23:11:48.261266 np0000002687 nova-compute[98431]: iface.fragmentation = Jun 11 23:11:48.261266 np0000002687 nova-compute[98431]: iface.gratuitous_arp = Jun 11 23:11:48.261266 np0000002687 nova-compute[98431]: iface.incoming_forwarding = Jun 11 23:11:48.261266 np0000002687 nova-compute[98431]: iface.tos_state = Jun 11 23:11:48.261266 np0000002687 nova-compute[98431]: iface.tos = 0 Jun 11 23:11:48.261266 np0000002687 nova-compute[98431]: iface.ttl = 0 Jun 11 23:11:48.261266 np0000002687 nova-compute[98431]: iface.delayed_ack = Jun 11 23:11:48.261266 np0000002687 nova-compute[98431]: iface.tcp_nagle = Jun 11 23:11:48.261266 np0000002687 nova-compute[98431]: iface.tcp_wsf_state = Jun 11 23:11:48.261266 np0000002687 nova-compute[98431]: iface.tcp_wsf = 0 Jun 11 23:11:48.261266 np0000002687 nova-compute[98431]: iface.tcp_timer_scale = 0 Jun 11 23:11:48.261266 np0000002687 nova-compute[98431]: iface.tcp_timestamp = Jun 11 23:11:48.261266 np0000002687 nova-compute[98431]: iface.redirect = Jun 11 23:11:48.261266 np0000002687 nova-compute[98431]: iface.def_task_mgmt_timeout = 0 Jun 11 23:11:48.261266 np0000002687 nova-compute[98431]: iface.header_digest = Jun 11 23:11:48.261266 np0000002687 nova-compute[98431]: iface.data_digest = Jun 11 23:11:48.261266 np0000002687 nova-compute[98431]: iface.immediate_data = Jun 11 23:11:48.261266 np0000002687 nova-compute[98431]: iface.initial_r2t = Jun 11 23:11:48.261266 np0000002687 nova-compute[98431]: iface.data_seq_inorder = Jun 11 23:11:48.261266 np0000002687 nova-compute[98431]: iface.data_pdu_inorder = Jun 11 23:11:48.261266 np0000002687 nova-compute[98431]: iface.erl = 0 Jun 11 23:11:48.261266 np0000002687 nova-compute[98431]: iface.max_receive_data_len = 0 Jun 11 23:11:48.261266 np0000002687 nova-compute[98431]: iface.first_burst_len = 0 Jun 11 23:11:48.261266 np0000002687 nova-compute[98431]: iface.max_outstanding_r2t = 0 Jun 11 23:11:48.261266 np0000002687 nova-compute[98431]: iface.max_burst_len = 0 Jun 11 23:11:48.261266 np0000002687 nova-compute[98431]: iface.chap_auth = Jun 11 23:11:48.261266 np0000002687 nova-compute[98431]: iface.bidi_chap = Jun 11 23:11:48.261266 np0000002687 nova-compute[98431]: iface.strict_login_compliance = Jun 11 23:11:48.261266 np0000002687 nova-compute[98431]: iface.discovery_auth = Jun 11 23:11:48.261266 np0000002687 nova-compute[98431]: iface.discovery_logout = Jun 11 23:11:48.261266 np0000002687 nova-compute[98431]: node.discovery_address = Jun 11 23:11:48.261266 np0000002687 nova-compute[98431]: node.discovery_port = 0 Jun 11 23:11:48.261266 np0000002687 nova-compute[98431]: node.discovery_type = fw Jun 11 23:11:48.261266 np0000002687 nova-compute[98431]: node.session.initial_cmdsn = 0 Jun 11 23:11:48.261266 np0000002687 nova-compute[98431]: node.session.initial_login_retry_max = 8 Jun 11 23:11:48.261266 np0000002687 nova-compute[98431]: node.session.xmit_thread_priority = 0 Jun 11 23:11:48.261266 np0000002687 nova-compute[98431]: node.session.cmds_max = 128 Jun 11 23:11:48.261266 np0000002687 nova-compute[98431]: node.session.queue_depth = 32 Jun 11 23:11:48.261266 np0000002687 nova-compute[98431]: node.session.nr_sessions = 1 Jun 11 23:11:48.261266 np0000002687 nova-compute[98431]: node.session.auth.authmethod = None Jun 11 23:11:48.261266 np0000002687 nova-compute[98431]: node.session.auth.username = Jun 11 23:11:48.261266 np0000002687 nova-compute[98431]: node.session.auth.password = *** Jun 11 23:11:48.261266 np0000002687 nova-compute[98431]: node.session.auth.username_in = Jun 11 23:11:48.261266 np0000002687 nova-compute[98431]: node.session.auth.password_in = Jun 11 23:11:48.261266 np0000002687 nova-compute[98431]: node.session.auth.chap_algs = SHA256 Jun 11 23:11:48.261266 np0000002687 nova-compute[98431]: node.session.timeo.replacement_timeout = 120 Jun 11 23:11:48.261266 np0000002687 nova-compute[98431]: node.session.err_timeo.abort_timeout = 15 Jun 11 23:11:48.261266 np0000002687 nova-compute[98431]: node.session.err_timeo.lu_reset_timeout = 30 Jun 11 23:11:48.261266 np0000002687 nova-compute[98431]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 11 23:11:48.261266 np0000002687 nova-compute[98431]: node.session.err_timeo.host_reset_timeout = 60 Jun 11 23:11:48.261266 np0000002687 nova-compute[98431]: node.session.iscsi.FastAbort = Yes Jun 11 23:11:48.261266 np0000002687 nova-compute[98431]: node.session.iscsi.InitialR2T = No Jun 11 23:11:48.261266 np0000002687 nova-compute[98431]: node.session.iscsi.ImmediateData = Yes Jun 11 23:11:48.261266 np0000002687 nova-compute[98431]: node.session.iscsi.FirstBurstLength = 262144 Jun 11 23:11:48.261266 np0000002687 nova-compute[98431]: node.session.iscsi.MaxBurstLength = 16776192 Jun 11 23:11:48.261266 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Retain = 0 Jun 11 23:11:48.261266 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Wait = 2 Jun 11 23:11:48.261266 np0000002687 nova-compute[98431]: node.session.iscsi.MaxConnections = 1 Jun 11 23:11:48.261266 np0000002687 nova-compute[98431]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 11 23:11:48.261266 np0000002687 nova-compute[98431]: node.session.iscsi.ERL = 0 Jun 11 23:11:48.261266 np0000002687 nova-compute[98431]: node.session.scan = auto Jun 11 23:11:48.261266 np0000002687 nova-compute[98431]: node.session.reopen_max = 0 Jun 11 23:11:48.261266 np0000002687 nova-compute[98431]: node.conn[0].address = 192.168.40.100 Jun 11 23:11:48.261266 np0000002687 nova-compute[98431]: node.conn[0].port = 3260 Jun 11 23:11:48.261266 np0000002687 nova-compute[98431]: node.conn[0].startup = manual Jun 11 23:11:48.261266 np0000002687 nova-compute[98431]: node.conn[0].tcp.window_size = 524288 Jun 11 23:11:48.261266 np0000002687 nova-compute[98431]: node.conn[0].tcp.type_of_service = 0 Jun 11 23:11:48.261266 np0000002687 nova-compute[98431]: node.conn[0].timeo.logout_timeout = 15 Jun 11 23:11:48.261266 np0000002687 nova-compute[98431]: node.conn[0].timeo.login_timeout = 15 Jun 11 23:11:48.261266 np0000002687 nova-compute[98431]: node.conn[0].timeo.auth_timeout = 45 Jun 11 23:11:48.261266 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_interval = 5 Jun 11 23:11:48.261266 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_timeout = 5 Jun 11 23:11:48.261266 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 11 23:11:48.261266 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 11 23:11:48.261266 np0000002687 nova-compute[98431]: node.conn[0].iscsi.HeaderDigest = None Jun 11 23:11:48.261266 np0000002687 nova-compute[98431]: node.conn[0].iscsi.DataDigest = None Jun 11 23:11:48.261266 np0000002687 nova-compute[98431]: node.conn[0].iscsi.IFMarker = No Jun 11 23:11:48.261266 np0000002687 nova-compute[98431]: node.conn[0].iscsi.OFMarker = No Jun 11 23:11:48.261266 np0000002687 nova-compute[98431]: # END RECORD Jun 11 23:11:48.261266 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:48.268846 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-922d3cd0-d5df-4bc5-b3ee-9cdfb633df77 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:48.275313 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-922d3cd0-d5df-4bc5-b3ee-9cdfb633df77 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:48.291374 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-922d3cd0-d5df-4bc5-b3ee-9cdfb633df77 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:48.291374 np0000002687 nova-compute[98431]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:11:48.291374 np0000002687 nova-compute[98431]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:11:48.291374 np0000002687 nova-compute[98431]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:11:48.291374 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:11:48.291374 np0000002687 nova-compute[98431]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6eb3ee75-92d8-430f-86ea-31edf88d1ae8 (non-flash) Jun 11 23:11:48.291374 np0000002687 nova-compute[98431]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6eb3ee75-92d8-430f-86ea-31edf88d1ae8 (non-flash) Jun 11 23:11:48.291374 np0000002687 nova-compute[98431]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6e44a36-048b-41a3-8639-4ee7e1b0122f (non-flash) Jun 11 23:11:48.291374 np0000002687 nova-compute[98431]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6e44a36-048b-41a3-8639-4ee7e1b0122f (non-flash) Jun 11 23:11:48.291374 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:48.291374 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:48.291374 np0000002687 nova-compute[98431]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:48.291374 np0000002687 nova-compute[98431]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:48.291374 np0000002687 nova-compute[98431]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:48.291374 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:11:48.291374 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-922d3cd0-d5df-4bc5-b3ee-9cdfb633df77 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:48.291374 np0000002687 nova-compute[98431]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:11:48.291374 np0000002687 nova-compute[98431]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:11:48.291374 np0000002687 nova-compute[98431]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:11:48.291374 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:11:48.291374 np0000002687 nova-compute[98431]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6eb3ee75-92d8-430f-86ea-31edf88d1ae8 (non-flash) Jun 11 23:11:48.291374 np0000002687 nova-compute[98431]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6eb3ee75-92d8-430f-86ea-31edf88d1ae8 (non-flash) Jun 11 23:11:48.291374 np0000002687 nova-compute[98431]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6e44a36-048b-41a3-8639-4ee7e1b0122f (non-flash) Jun 11 23:11:48.291374 np0000002687 nova-compute[98431]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6e44a36-048b-41a3-8639-4ee7e1b0122f (non-flash) Jun 11 23:11:48.291374 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:48.291374 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:48.291374 np0000002687 nova-compute[98431]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:48.291374 np0000002687 nova-compute[98431]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:48.291374 np0000002687 nova-compute[98431]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:48.291374 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:11:48.302041 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-922d3cd0-d5df-4bc5-b3ee-9cdfb633df77 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:48.302041 np0000002687 nova-compute[98431]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:11:48.302041 np0000002687 nova-compute[98431]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:11:48.302041 np0000002687 nova-compute[98431]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:11:48.302041 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:11:48.302041 np0000002687 nova-compute[98431]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6eb3ee75-92d8-430f-86ea-31edf88d1ae8 (non-flash) Jun 11 23:11:48.302041 np0000002687 nova-compute[98431]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6eb3ee75-92d8-430f-86ea-31edf88d1ae8 (non-flash) Jun 11 23:11:48.302041 np0000002687 nova-compute[98431]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6e44a36-048b-41a3-8639-4ee7e1b0122f (non-flash) Jun 11 23:11:48.302041 np0000002687 nova-compute[98431]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6e44a36-048b-41a3-8639-4ee7e1b0122f (non-flash) Jun 11 23:11:48.302041 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:48.302041 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:48.302041 np0000002687 nova-compute[98431]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:48.302041 np0000002687 nova-compute[98431]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:48.302041 np0000002687 nova-compute[98431]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:48.302041 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:11:48.302041 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-922d3cd0-d5df-4bc5-b3ee-9cdfb633df77 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:48.302041 np0000002687 nova-compute[98431]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:11:48.302041 np0000002687 nova-compute[98431]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:11:48.302041 np0000002687 nova-compute[98431]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:11:48.302041 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:11:48.302041 np0000002687 nova-compute[98431]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6eb3ee75-92d8-430f-86ea-31edf88d1ae8 (non-flash) Jun 11 23:11:48.302041 np0000002687 nova-compute[98431]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6eb3ee75-92d8-430f-86ea-31edf88d1ae8 (non-flash) Jun 11 23:11:48.302041 np0000002687 nova-compute[98431]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6e44a36-048b-41a3-8639-4ee7e1b0122f (non-flash) Jun 11 23:11:48.302041 np0000002687 nova-compute[98431]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6e44a36-048b-41a3-8639-4ee7e1b0122f (non-flash) Jun 11 23:11:48.302041 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:48.302041 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:48.302041 np0000002687 nova-compute[98431]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:48.302041 np0000002687 nova-compute[98431]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:48.302041 np0000002687 nova-compute[98431]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:48.302041 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:11:48.348731 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-922d3cd0-d5df-4bc5-b3ee-9cdfb633df77 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8, portal: 192.168.50.100,3260] Jun 11 23:11:48.348731 np0000002687 nova-compute[98431]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8, portal: 192.168.50.100,3260] successful. Jun 11 23:11:48.348731 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:48.361791 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-922d3cd0-d5df-4bc5-b3ee-9cdfb633df77 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:48.375606 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-922d3cd0-d5df-4bc5-b3ee-9cdfb633df77 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8, portal: 192.168.40.100,3260] Jun 11 23:11:48.375606 np0000002687 nova-compute[98431]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8, portal: 192.168.40.100,3260] successful. Jun 11 23:11:48.375606 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:48.382850 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-922d3cd0-d5df-4bc5-b3ee-9cdfb633df77 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:48.382850 np0000002687 nova-compute[98431]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:11:48.382850 np0000002687 nova-compute[98431]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:11:48.382850 np0000002687 nova-compute[98431]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:11:48.382850 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:11:48.382850 np0000002687 nova-compute[98431]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6eb3ee75-92d8-430f-86ea-31edf88d1ae8 (non-flash) Jun 11 23:11:48.382850 np0000002687 nova-compute[98431]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6eb3ee75-92d8-430f-86ea-31edf88d1ae8 (non-flash) Jun 11 23:11:48.382850 np0000002687 nova-compute[98431]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6e44a36-048b-41a3-8639-4ee7e1b0122f (non-flash) Jun 11 23:11:48.382850 np0000002687 nova-compute[98431]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6e44a36-048b-41a3-8639-4ee7e1b0122f (non-flash) Jun 11 23:11:48.382850 np0000002687 nova-compute[98431]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8 (non-flash) Jun 11 23:11:48.382850 np0000002687 nova-compute[98431]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8 (non-flash) Jun 11 23:11:48.382850 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:48.382850 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:48.382850 np0000002687 nova-compute[98431]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:48.382850 np0000002687 nova-compute[98431]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:48.382850 np0000002687 nova-compute[98431]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:48.382850 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:11:48.383487 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-922d3cd0-d5df-4bc5-b3ee-9cdfb633df77 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:48.383487 np0000002687 nova-compute[98431]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:11:48.383487 np0000002687 nova-compute[98431]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:11:48.383487 np0000002687 nova-compute[98431]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:11:48.383487 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:11:48.383487 np0000002687 nova-compute[98431]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6eb3ee75-92d8-430f-86ea-31edf88d1ae8 (non-flash) Jun 11 23:11:48.383487 np0000002687 nova-compute[98431]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6eb3ee75-92d8-430f-86ea-31edf88d1ae8 (non-flash) Jun 11 23:11:48.383487 np0000002687 nova-compute[98431]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6e44a36-048b-41a3-8639-4ee7e1b0122f (non-flash) Jun 11 23:11:48.383487 np0000002687 nova-compute[98431]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6e44a36-048b-41a3-8639-4ee7e1b0122f (non-flash) Jun 11 23:11:48.383487 np0000002687 nova-compute[98431]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8 (non-flash) Jun 11 23:11:48.383487 np0000002687 nova-compute[98431]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8 (non-flash) Jun 11 23:11:48.383487 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:48.383487 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:48.383487 np0000002687 nova-compute[98431]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:48.383487 np0000002687 nova-compute[98431]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:48.383487 np0000002687 nova-compute[98431]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:48.383487 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:11:48.383955 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-922d3cd0-d5df-4bc5-b3ee-9cdfb633df77 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.169s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 11 23:11:48.384149 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-922d3cd0-d5df-4bc5-b3ee-9cdfb633df77 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Connected to 192.168.50.100:3260 {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 11 23:11:48.386480 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-922d3cd0-d5df-4bc5-b3ee-9cdfb633df77 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] HCTL ('21', '-', '-', 0) found on session 19 with lun 0 {{(pid=98431) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 11 23:11:48.386923 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-922d3cd0-d5df-4bc5-b3ee-9cdfb633df77 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Scanning host 21 c: -, t: -, l: 0) {{(pid=98431) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 11 23:11:48.395537 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-922d3cd0-d5df-4bc5-b3ee-9cdfb633df77 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:48.406078 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-922d3cd0-d5df-4bc5-b3ee-9cdfb633df77 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Searching for a device in session 19 and hctl ['21', '*', '*', 0] yield: sdp {{(pid=98431) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 11 23:11:48.406078 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-922d3cd0-d5df-4bc5-b3ee-9cdfb633df77 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Connected to sdp using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '4da6c3da-4a1a-454c-b611-7fa9fc0832d8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 11 23:11:48.419988 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-922d3cd0-d5df-4bc5-b3ee-9cdfb633df77 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:48.419988 np0000002687 nova-compute[98431]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:11:48.419988 np0000002687 nova-compute[98431]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:11:48.419988 np0000002687 nova-compute[98431]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:11:48.419988 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:11:48.419988 np0000002687 nova-compute[98431]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6eb3ee75-92d8-430f-86ea-31edf88d1ae8 (non-flash) Jun 11 23:11:48.419988 np0000002687 nova-compute[98431]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6eb3ee75-92d8-430f-86ea-31edf88d1ae8 (non-flash) Jun 11 23:11:48.419988 np0000002687 nova-compute[98431]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6e44a36-048b-41a3-8639-4ee7e1b0122f (non-flash) Jun 11 23:11:48.419988 np0000002687 nova-compute[98431]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6e44a36-048b-41a3-8639-4ee7e1b0122f (non-flash) Jun 11 23:11:48.419988 np0000002687 nova-compute[98431]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8 (non-flash) Jun 11 23:11:48.419988 np0000002687 nova-compute[98431]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8 (non-flash) Jun 11 23:11:48.419988 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:48.419988 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:48.419988 np0000002687 nova-compute[98431]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:48.419988 np0000002687 nova-compute[98431]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:48.419988 np0000002687 nova-compute[98431]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:48.419988 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:11:48.420434 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-922d3cd0-d5df-4bc5-b3ee-9cdfb633df77 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:48.420434 np0000002687 nova-compute[98431]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:11:48.420434 np0000002687 nova-compute[98431]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:11:48.420434 np0000002687 nova-compute[98431]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:11:48.420434 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:11:48.420434 np0000002687 nova-compute[98431]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6eb3ee75-92d8-430f-86ea-31edf88d1ae8 (non-flash) Jun 11 23:11:48.420434 np0000002687 nova-compute[98431]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6eb3ee75-92d8-430f-86ea-31edf88d1ae8 (non-flash) Jun 11 23:11:48.420434 np0000002687 nova-compute[98431]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6e44a36-048b-41a3-8639-4ee7e1b0122f (non-flash) Jun 11 23:11:48.420434 np0000002687 nova-compute[98431]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6e44a36-048b-41a3-8639-4ee7e1b0122f (non-flash) Jun 11 23:11:48.420434 np0000002687 nova-compute[98431]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8 (non-flash) Jun 11 23:11:48.420434 np0000002687 nova-compute[98431]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8 (non-flash) Jun 11 23:11:48.420434 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:48.420434 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:48.420434 np0000002687 nova-compute[98431]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:48.420434 np0000002687 nova-compute[98431]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:48.420434 np0000002687 nova-compute[98431]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:48.420434 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:11:48.420434 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-922d3cd0-d5df-4bc5-b3ee-9cdfb633df77 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.208s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 11 23:11:48.420877 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-922d3cd0-d5df-4bc5-b3ee-9cdfb633df77 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Connected to 192.168.40.100:3260 {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 11 23:11:48.421913 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-922d3cd0-d5df-4bc5-b3ee-9cdfb633df77 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] HCTL ('22', '-', '-', 0) found on session 20 with lun 0 {{(pid=98431) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 11 23:11:48.422013 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-922d3cd0-d5df-4bc5-b3ee-9cdfb633df77 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Scanning host 22 c: -, t: -, l: 0) {{(pid=98431) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 11 23:11:48.439533 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-922d3cd0-d5df-4bc5-b3ee-9cdfb633df77 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Searching for a device in session 20 and hctl ['22', '*', '*', 0] yield: sdq {{(pid=98431) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 11 23:11:48.439533 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-922d3cd0-d5df-4bc5-b3ee-9cdfb633df77 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Connected to sdq using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4da6c3da-4a1a-454c-b611-7fa9fc0832d8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 11 23:11:48.577516 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-4a646a8c-ec60-4c89-8400-a6995b91f1d7 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Acquiring lock "14699717-b93f-4e67-b841-c67de8fff8d4" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:11:48.578049 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-4a646a8c-ec60-4c89-8400-a6995b91f1d7 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Lock "14699717-b93f-4e67-b841-c67de8fff8d4" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:11:48.579478 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-e489f06b-214f-48fb-9af3-5bd916033e19 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Acquiring lock "36688d94-68d3-4ae3-989a-b391d7ee4ad9" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:11:48.579887 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-e489f06b-214f-48fb-9af3-5bd916033e19 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Lock "36688d94-68d3-4ae3-989a-b391d7ee4ad9" acquired by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: waited 0.002s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:11:48.583071 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-4a646a8c-ec60-4c89-8400-a6995b91f1d7 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] [instance: 14699717-b93f-4e67-b841-c67de8fff8d4] Attaching volume 65724ff3-60af-4d3f-b1bf-3aa2695037ce to /dev/vdb Jun 11 23:11:48.624481 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.guest [None req-adcba578-badf-49c1-9e9f-52ff54d62c70 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] COPY block job progress, current cursor: 76808192 final cursor: 76808192 {{(pid=98431) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}} Jun 11 23:11:48.626265 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-adcba578-badf-49c1-9e9f-52ff54d62c70 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Skipping quiescing instance: QEMU guest agent is not enabled. Jun 11 23:11:48.640839 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-f807f147-e041-4715-8d8d-637ac06918b2 req-8d2d9d45-2438-412e-9581-a9ab9e66d984 service nova] Releasing lock "refresh_cache-27ac8c84-e5db-4bd1-a148-ec5834c5b39c" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 11 23:11:48.645167 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-4a646a8c-ec60-4c89-8400-a6995b91f1d7 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.209', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000002687', 'execute': None}" {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 11 23:11:48.657595 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.scaleio [None req-4a646a8c-ec60-4c89-8400-a6995b91f1d7 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98431) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 11 23:11:48.679076 np0000002687 nova-compute[98431]: DEBUG nova.privsep.utils [None req-adcba578-badf-49c1-9e9f-52ff54d62c70 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98431) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}} Jun 11 23:11:48.679310 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-adcba578-badf-49c1-9e9f-52ff54d62c70 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpmnswwnj8/03923e50b954468183e700fd8ab5d958.delta /opt/stack/data/nova/instances/snapshots/tmpmnswwnj8/03923e50b954468183e700fd8ab5d958 {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:11:48.679712 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-4a646a8c-ec60-4c89-8400-a6995b91f1d7 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Running cmd (subprocess): nvme version {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:11:48.713587 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-4a646a8c-ec60-4c89-8400-a6995b91f1d7 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] 'nvme version' failed. Not Retrying. {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 11 23:11:48.714333 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4a646a8c-ec60-4c89-8400-a6995b91f1d7 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] nvme not present on system {{(pid=98431) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 11 23:11:48.725829 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.lightos [None req-4a646a8c-ec60-4c89-8400-a6995b91f1d7 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98431) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 11 23:11:48.728731 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.lightos [None req-4a646a8c-ec60-4c89-8400-a6995b91f1d7 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Current host hostNQN and IP(s) are ['10.4.3.209', 'fe80::f816:3eff:fea3:3707', '192.168.40.6', 'fe80::f816:3eff:fe06:bdab', '192.168.50.6', 'fe80::f816:3eff:fe7a:46f2', '192.168.10.6', 'fe80::f816:3eff:fe13:793b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::38fa:21ff:fe6c:3746', 'fe80::fc16:3eff:fe6c:eb30', 'fe80::20a8:54ff:fe51:da0a', 'fe80::fc16:3eff:feb5:6ffd', 'fe80::4cb3:64ff:fe13:8a75', 'fe80::fc16:3eff:fe8e:8922', 'fe80::4c61:61ff:fe7d:90dc', 'fe80::fc16:3eff:fe77:488d', 'fe80::9469:f2ff:feae:5824', 'fe80::fc16:3eff:febd:951', 'fe80::84b1:8fff:fe59:2d4f', 'fe80::fc16:3eff:fedc:9cb5', 'fe80::f489:94ff:fe75:ec8a', 'fe80::fc16:3eff:fe8a:95c7', 'fe80::fc16:3eff:fec7:336a', 'fe80::fc16:3eff:fee8:a7df', 'fe80::fc16:3eff:fe9f:58c8', 'fe80::a002:b5ff:fe03:ad7e', 'fe80::fc16:3eff:fec3:b6b', 'fe80::fc16:3eff:feb9:2e2c', 'fe80::fc16:3eff:fea0:a282', 'fe80::fc16:3eff:fe50:f6b', 'fe80::7cd4:d5ff:feac:3f7f', 'fe80::fc16:3eff:fec4:56b3', 'fe80::78a9:34ff:febb:750c', 'fe80::fc16:3eff:fe61:b7fd', 'fe80::fc16:3eff:fe1d:f718', 'fe80::14a2:b8ff:feec:f607'] Jun 11 23:11:48.728976 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.lightos [None req-4a646a8c-ec60-4c89-8400-a6995b91f1d7 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98431) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 11 23:11:48.729129 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.lightos [None req-4a646a8c-ec60-4c89-8400-a6995b91f1d7 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] LIGHTOS: no hostnqn found. {{(pid=98431) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 11 23:11:48.729463 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-4a646a8c-ec60-4c89-8400-a6995b91f1d7 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] <== get_connector_properties: return (83ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.209', 'host': 'np0000002687', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:798b370f1cc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad465dfe-0ed1-4637-98c3-ddaebebd61a4', 'nvme_native_multipath': False} {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 11 23:11:48.729821 np0000002687 nova-compute[98431]: DEBUG nova.virt.block_device [None req-4a646a8c-ec60-4c89-8400-a6995b91f1d7 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] [instance: 14699717-b93f-4e67-b841-c67de8fff8d4] Updating existing volume attachment record: 68c43a0f-9422-453d-8f23-e73ec9116685 {{(pid=98431) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 11 23:11:48.820791 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-cbe1342b-056f-4875-8f4a-11c987c243d8 req-305bb24f-25ac-4086-93bd-8173f29d1421 service nova] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Received event network-changed-a1e7aeff-5992-43be-bb2c-d504e7019c64 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:11:48.820997 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-cbe1342b-056f-4875-8f4a-11c987c243d8 req-305bb24f-25ac-4086-93bd-8173f29d1421 service nova] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Refreshing instance network info cache due to event network-changed-a1e7aeff-5992-43be-bb2c-d504e7019c64. {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 11 23:11:48.821257 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-cbe1342b-056f-4875-8f4a-11c987c243d8 req-305bb24f-25ac-4086-93bd-8173f29d1421 service nova] Acquiring lock "refresh_cache-7609742e-a3a2-4be2-ba02-227efb2101e1" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 11 23:11:48.821587 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-cbe1342b-056f-4875-8f4a-11c987c243d8 req-305bb24f-25ac-4086-93bd-8173f29d1421 service nova] Acquired lock "refresh_cache-7609742e-a3a2-4be2-ba02-227efb2101e1" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 11 23:11:48.821587 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-cbe1342b-056f-4875-8f4a-11c987c243d8 req-305bb24f-25ac-4086-93bd-8173f29d1421 service nova] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Refreshing network info cache for port a1e7aeff-5992-43be-bb2c-d504e7019c64 {{(pid=98431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 11 23:11:48.898073 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-adcba578-badf-49c1-9e9f-52ff54d62c70 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpmnswwnj8/03923e50b954468183e700fd8ab5d958.delta /opt/stack/data/nova/instances/snapshots/tmpmnswwnj8/03923e50b954468183e700fd8ab5d958" returned: 0 in 0.219s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:11:48.904048 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-adcba578-badf-49c1-9e9f-52ff54d62c70 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Snapshot extracted, beginning image upload Jun 11 23:11:49.088001 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-e489f06b-214f-48fb-9af3-5bd916033e19 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] [instance: 36688d94-68d3-4ae3-989a-b391d7ee4ad9] Detaching volume 6eb3ee75-92d8-430f-86ea-31edf88d1ae8 Jun 11 23:11:49.141693 np0000002687 nova-compute[98431]: INFO nova.virt.block_device [None req-e489f06b-214f-48fb-9af3-5bd916033e19 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] [instance: 36688d94-68d3-4ae3-989a-b391d7ee4ad9] Attempting to driver detach volume 6eb3ee75-92d8-430f-86ea-31edf88d1ae8 from mountpoint /dev/sdc Jun 11 23:11:49.148027 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-e489f06b-214f-48fb-9af3-5bd916033e19 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Found disk sdc by alias ua-6eb3ee75-92d8-430f-86ea-31edf88d1ae8 {{(pid=98431) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}} Jun 11 23:11:49.150483 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-e489f06b-214f-48fb-9af3-5bd916033e19 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Found disk sdc by alias ua-6eb3ee75-92d8-430f-86ea-31edf88d1ae8 {{(pid=98431) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}} Jun 11 23:11:49.150483 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-e489f06b-214f-48fb-9af3-5bd916033e19 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Attempting to detach device sdc from instance 36688d94-68d3-4ae3-989a-b391d7ee4ad9 from the persistent domain config. {{(pid=98431) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}} Jun 11 23:11:49.150483 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.guest [None req-e489f06b-214f-48fb-9af3-5bd916033e19 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] detach device xml: Jun 11 23:11:49.150483 np0000002687 nova-compute[98431]: Jun 11 23:11:49.150483 np0000002687 nova-compute[98431]: Jun 11 23:11:49.150483 np0000002687 nova-compute[98431]: Jun 11 23:11:49.150483 np0000002687 nova-compute[98431]: Jun 11 23:11:49.150483 np0000002687 nova-compute[98431]: 6eb3ee75-92d8-430f-86ea-31edf88d1ae8 Jun 11 23:11:49.150483 np0000002687 nova-compute[98431]:
Jun 11 23:11:49.150483 np0000002687 nova-compute[98431]: Jun 11 23:11:49.150483 np0000002687 nova-compute[98431]: {{(pid=98431) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jun 11 23:11:49.157986 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-e489f06b-214f-48fb-9af3-5bd916033e19 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Successfully detached device sdc from instance 36688d94-68d3-4ae3-989a-b391d7ee4ad9 from the persistent domain config. Jun 11 23:11:49.157986 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-e489f06b-214f-48fb-9af3-5bd916033e19 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] (1/8): Attempting to detach device sdc with device alias ua-6eb3ee75-92d8-430f-86ea-31edf88d1ae8 from instance 36688d94-68d3-4ae3-989a-b391d7ee4ad9 from the live domain config. {{(pid=98431) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}} Jun 11 23:11:49.157986 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.guest [None req-e489f06b-214f-48fb-9af3-5bd916033e19 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] detach device xml: Jun 11 23:11:49.157986 np0000002687 nova-compute[98431]: Jun 11 23:11:49.157986 np0000002687 nova-compute[98431]: Jun 11 23:11:49.157986 np0000002687 nova-compute[98431]: Jun 11 23:11:49.157986 np0000002687 nova-compute[98431]: Jun 11 23:11:49.157986 np0000002687 nova-compute[98431]: 6eb3ee75-92d8-430f-86ea-31edf88d1ae8 Jun 11 23:11:49.157986 np0000002687 nova-compute[98431]:
Jun 11 23:11:49.157986 np0000002687 nova-compute[98431]: Jun 11 23:11:49.157986 np0000002687 nova-compute[98431]: {{(pid=98431) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jun 11 23:11:49.213481 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-922d3cd0-d5df-4bc5-b3ee-9cdfb633df77 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98431) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 11 23:11:49.292393 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a646a8c-ec60-4c89-8400-a6995b91f1d7 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] [instance: 14699717-b93f-4e67-b841-c67de8fff8d4] Calling os-brick to attach iSCSI Volume {{(pid=98431) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 11 23:11:49.292891 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a646a8c-ec60-4c89-8400-a6995b91f1d7 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce', 'iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '65724ff3-60af-4d3f-b1bf-3aa2695037ce', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 11 23:11:49.293058 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-4a646a8c-ec60-4c89-8400-a6995b91f1d7 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 11 23:11:49.324889 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [req-cbe1342b-056f-4875-8f4a-11c987c243d8 req-305bb24f-25ac-4086-93bd-8173f29d1421 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:11:49.349992 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Received event ua-6eb3ee75-92d8-430f-86ea-31edf88d1ae8> from libvirt while the driver is waiting for it; dispatched. {{(pid=98431) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}} Jun 11 23:11:49.351386 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-e489f06b-214f-48fb-9af3-5bd916033e19 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Start waiting for the detach event from libvirt for device sdc with device alias ua-6eb3ee75-92d8-430f-86ea-31edf88d1ae8 for instance 36688d94-68d3-4ae3-989a-b391d7ee4ad9 {{(pid=98431) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}} Jun 11 23:11:49.357294 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-e489f06b-214f-48fb-9af3-5bd916033e19 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Successfully detached device sdc from instance 36688d94-68d3-4ae3-989a-b391d7ee4ad9 from the live domain config. Jun 11 23:11:49.359389 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e489f06b-214f-48fb-9af3-5bd916033e19 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] [instance: 36688d94-68d3-4ae3-989a-b391d7ee4ad9] calling os-brick to detach iSCSI Volume {{(pid=98431) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jun 11 23:11:49.359389 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-e489f06b-214f-48fb-9af3-5bd916033e19 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6eb3ee75-92d8-430f-86ea-31edf88d1ae8', 'iqn.2023-03.storpool.com:os--volume-6eb3ee75-92d8-430f-86ea-31edf88d1ae8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6eb3ee75-92d8-430f-86ea-31edf88d1ae8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6eb3ee75-92d8-430f-86ea-31edf88d1ae8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, None), 'kwargs': {'force': False}}" {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 11 23:11:49.359389 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-e489f06b-214f-48fb-9af3-5bd916033e19 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 11 23:11:49.389156 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-092b94e8-8497-429c-9c05-fa43dcb87fac tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] No BDM found with device name vda, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:11:49.389344 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-092b94e8-8497-429c-9c05-fa43dcb87fac tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:11:49.389588 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-092b94e8-8497-429c-9c05-fa43dcb87fac tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] No BDM found with device name hda, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:11:49.389778 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-092b94e8-8497-429c-9c05-fa43dcb87fac tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] No VIF found with MAC fa:16:3e:bd:09:51, not building metadata {{(pid=98431) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13199}} Jun 11 23:11:49.749652 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [req-cbe1342b-056f-4875-8f4a-11c987c243d8 req-305bb24f-25ac-4086-93bd-8173f29d1421 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:11:49.919193 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-cbe1342b-056f-4875-8f4a-11c987c243d8 req-305bb24f-25ac-4086-93bd-8173f29d1421 service nova] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Updated VIF entry in instance network info cache for port a1e7aeff-5992-43be-bb2c-d504e7019c64. {{(pid=98431) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 11 23:11:49.919466 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-cbe1342b-056f-4875-8f4a-11c987c243d8 req-305bb24f-25ac-4086-93bd-8173f29d1421 service nova] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Updating instance_info_cache with network_info: [{"id": "a1e7aeff-5992-43be-bb2c-d504e7019c64", "address": "fa:16:3e:1d:f7:18", "network": {"id": "710d3c5f-1a08-4a35-b3e1-e59f427989c2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2068802531-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62f47df2e0374879b837bc7431326e62", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1e7aeff-59", "ovs_interfaceid": "a1e7aeff-5992-43be-bb2c-d504e7019c64", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:11:50.235669 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-922d3cd0-d5df-4bc5-b3ee-9cdfb633df77 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Found WWN 33000000073fa3d0d for multipath device dm-11 {{(pid=98431) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 11 23:11:50.235669 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-922d3cd0-d5df-4bc5-b3ee-9cdfb633df77 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.038s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 11 23:11:50.235669 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-922d3cd0-d5df-4bc5-b3ee-9cdfb633df77 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] <== connect_volume: return (5971ms) {'type': 'block', 'scsi_wwn': '33000000073fa3d0d', 'path': '/dev/dm-11', 'multipath_id': '33000000073fa3d0d'} {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 11 23:11:50.235958 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.volume.iscsi [None req-922d3cd0-d5df-4bc5-b3ee-9cdfb633df77 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 206476b7-d805-4c6c-b7fb-db8b5c2a94a6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000073fa3d0d', 'path': '/dev/dm-11', 'multipath_id': '33000000073fa3d0d'} {{(pid=98431) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 11 23:11:50.236352 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 5.758s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 11 23:11:50.236730 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea', 'iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5498d0af-4b75-4132-b06e-56f2b5b013ea', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'} {{(pid=98431) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 11 23:11:50.238067 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-922d3cd0-d5df-4bc5-b3ee-9cdfb633df77 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lazy-loading 'flavor' on Instance uuid 206476b7-d805-4c6c-b7fb-db8b5c2a94a6 {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:11:50.255051 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 11 23:11:50.255972 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 11 23:11:50.256587 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 11 23:11:50.256832 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.iscsi [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 11 23:11:50.257346 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 11 23:11:50.257592 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.iscsi [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 11 23:11:50.270835 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 11 23:11:50.270835 np0000002687 nova-compute[98431]: node.name = iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea Jun 11 23:11:50.270835 np0000002687 nova-compute[98431]: node.tpgt = -1 Jun 11 23:11:50.270835 np0000002687 nova-compute[98431]: node.startup = automatic Jun 11 23:11:50.270835 np0000002687 nova-compute[98431]: node.leading_login = No Jun 11 23:11:50.270835 np0000002687 nova-compute[98431]: iface.iscsi_ifacename = default Jun 11 23:11:50.270835 np0000002687 nova-compute[98431]: iface.net_ifacename = Jun 11 23:11:50.270835 np0000002687 nova-compute[98431]: iface.ipaddress = Jun 11 23:11:50.270835 np0000002687 nova-compute[98431]: iface.prefix_len = 0 Jun 11 23:11:50.270835 np0000002687 nova-compute[98431]: iface.hwaddress = Jun 11 23:11:50.270835 np0000002687 nova-compute[98431]: iface.transport_name = tcp Jun 11 23:11:50.270835 np0000002687 nova-compute[98431]: iface.initiatorname = Jun 11 23:11:50.270835 np0000002687 nova-compute[98431]: iface.state = Jun 11 23:11:50.270835 np0000002687 nova-compute[98431]: iface.vlan_id = 0 Jun 11 23:11:50.270835 np0000002687 nova-compute[98431]: iface.vlan_priority = 0 Jun 11 23:11:50.270835 np0000002687 nova-compute[98431]: iface.vlan_state = Jun 11 23:11:50.270835 np0000002687 nova-compute[98431]: iface.iface_num = 0 Jun 11 23:11:50.270835 np0000002687 nova-compute[98431]: iface.mtu = 0 Jun 11 23:11:50.270835 np0000002687 nova-compute[98431]: iface.port = 0 Jun 11 23:11:50.270835 np0000002687 nova-compute[98431]: iface.bootproto = Jun 11 23:11:50.270835 np0000002687 nova-compute[98431]: iface.subnet_mask = Jun 11 23:11:50.270835 np0000002687 nova-compute[98431]: iface.gateway = Jun 11 23:11:50.270835 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id_state = Jun 11 23:11:50.270835 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id = Jun 11 23:11:50.270835 np0000002687 nova-compute[98431]: iface.dhcp_dns = Jun 11 23:11:50.270835 np0000002687 nova-compute[98431]: iface.dhcp_learn_iqn = Jun 11 23:11:50.270835 np0000002687 nova-compute[98431]: iface.dhcp_req_vendor_id_state = Jun 11 23:11:50.270835 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id_state = Jun 11 23:11:50.270835 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id = Jun 11 23:11:50.270835 np0000002687 nova-compute[98431]: iface.dhcp_slp_da = Jun 11 23:11:50.270835 np0000002687 nova-compute[98431]: iface.fragmentation = Jun 11 23:11:50.270835 np0000002687 nova-compute[98431]: iface.gratuitous_arp = Jun 11 23:11:50.270835 np0000002687 nova-compute[98431]: iface.incoming_forwarding = Jun 11 23:11:50.270835 np0000002687 nova-compute[98431]: iface.tos_state = Jun 11 23:11:50.270835 np0000002687 nova-compute[98431]: iface.tos = 0 Jun 11 23:11:50.270835 np0000002687 nova-compute[98431]: iface.ttl = 0 Jun 11 23:11:50.270835 np0000002687 nova-compute[98431]: iface.delayed_ack = Jun 11 23:11:50.270835 np0000002687 nova-compute[98431]: iface.tcp_nagle = Jun 11 23:11:50.270835 np0000002687 nova-compute[98431]: iface.tcp_wsf_state = Jun 11 23:11:50.270835 np0000002687 nova-compute[98431]: iface.tcp_wsf = 0 Jun 11 23:11:50.270835 np0000002687 nova-compute[98431]: iface.tcp_timer_scale = 0 Jun 11 23:11:50.270835 np0000002687 nova-compute[98431]: iface.tcp_timestamp = Jun 11 23:11:50.270835 np0000002687 nova-compute[98431]: iface.redirect = Jun 11 23:11:50.270835 np0000002687 nova-compute[98431]: iface.def_task_mgmt_timeout = 0 Jun 11 23:11:50.270835 np0000002687 nova-compute[98431]: iface.header_digest = Jun 11 23:11:50.270835 np0000002687 nova-compute[98431]: iface.data_digest = Jun 11 23:11:50.270835 np0000002687 nova-compute[98431]: iface.immediate_data = Jun 11 23:11:50.270835 np0000002687 nova-compute[98431]: iface.initial_r2t = Jun 11 23:11:50.270835 np0000002687 nova-compute[98431]: iface.data_seq_inorder = Jun 11 23:11:50.270835 np0000002687 nova-compute[98431]: iface.data_pdu_inorder = Jun 11 23:11:50.270835 np0000002687 nova-compute[98431]: iface.erl = 0 Jun 11 23:11:50.270835 np0000002687 nova-compute[98431]: iface.max_receive_data_len = 0 Jun 11 23:11:50.270835 np0000002687 nova-compute[98431]: iface.first_burst_len = 0 Jun 11 23:11:50.270835 np0000002687 nova-compute[98431]: iface.max_outstanding_r2t = 0 Jun 11 23:11:50.270835 np0000002687 nova-compute[98431]: iface.max_burst_len = 0 Jun 11 23:11:50.270835 np0000002687 nova-compute[98431]: iface.chap_auth = Jun 11 23:11:50.270835 np0000002687 nova-compute[98431]: iface.bidi_chap = Jun 11 23:11:50.270835 np0000002687 nova-compute[98431]: iface.strict_login_compliance = Jun 11 23:11:50.270835 np0000002687 nova-compute[98431]: iface.discovery_auth = Jun 11 23:11:50.270835 np0000002687 nova-compute[98431]: iface.discovery_logout = Jun 11 23:11:50.270835 np0000002687 nova-compute[98431]: node.discovery_address = Jun 11 23:11:50.270835 np0000002687 nova-compute[98431]: node.discovery_port = 0 Jun 11 23:11:50.270835 np0000002687 nova-compute[98431]: node.discovery_type = fw Jun 11 23:11:50.270835 np0000002687 nova-compute[98431]: node.session.initial_cmdsn = 0 Jun 11 23:11:50.270835 np0000002687 nova-compute[98431]: node.session.initial_login_retry_max = 8 Jun 11 23:11:50.270835 np0000002687 nova-compute[98431]: node.session.xmit_thread_priority = 0 Jun 11 23:11:50.270835 np0000002687 nova-compute[98431]: node.session.cmds_max = 128 Jun 11 23:11:50.270835 np0000002687 nova-compute[98431]: node.session.queue_depth = 32 Jun 11 23:11:50.270835 np0000002687 nova-compute[98431]: node.session.nr_sessions = 1 Jun 11 23:11:50.270835 np0000002687 nova-compute[98431]: node.session.auth.authmethod = None Jun 11 23:11:50.270835 np0000002687 nova-compute[98431]: node.session.auth.username = Jun 11 23:11:50.270835 np0000002687 nova-compute[98431]: node.session.auth.password = *** Jun 11 23:11:50.270835 np0000002687 nova-compute[98431]: node.session.auth.username_in = Jun 11 23:11:50.270835 np0000002687 nova-compute[98431]: node.session.auth.password_in = Jun 11 23:11:50.270835 np0000002687 nova-compute[98431]: node.session.auth.chap_algs = SHA256 Jun 11 23:11:50.270835 np0000002687 nova-compute[98431]: node.session.timeo.replacement_timeout = 120 Jun 11 23:11:50.270835 np0000002687 nova-compute[98431]: node.session.err_timeo.abort_timeout = 15 Jun 11 23:11:50.270835 np0000002687 nova-compute[98431]: node.session.err_timeo.lu_reset_timeout = 30 Jun 11 23:11:50.270835 np0000002687 nova-compute[98431]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 11 23:11:50.270835 np0000002687 nova-compute[98431]: node.session.err_timeo.host_reset_timeout = 60 Jun 11 23:11:50.270835 np0000002687 nova-compute[98431]: node.session.iscsi.FastAbort = Yes Jun 11 23:11:50.270835 np0000002687 nova-compute[98431]: node.session.iscsi.InitialR2T = No Jun 11 23:11:50.270835 np0000002687 nova-compute[98431]: node.session.iscsi.ImmediateData = Yes Jun 11 23:11:50.270835 np0000002687 nova-compute[98431]: node.session.iscsi.FirstBurstLength = 262144 Jun 11 23:11:50.270835 np0000002687 nova-compute[98431]: node.session.iscsi.MaxBurstLength = 16776192 Jun 11 23:11:50.270835 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Retain = 0 Jun 11 23:11:50.270835 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Wait = 2 Jun 11 23:11:50.270835 np0000002687 nova-compute[98431]: node.session.iscsi.MaxConnections = 1 Jun 11 23:11:50.270835 np0000002687 nova-compute[98431]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 11 23:11:50.270835 np0000002687 nova-compute[98431]: node.session.iscsi.ERL = 0 Jun 11 23:11:50.270835 np0000002687 nova-compute[98431]: node.session.scan = manual Jun 11 23:11:50.270835 np0000002687 nova-compute[98431]: node.session.reopen_max = 0 Jun 11 23:11:50.270835 np0000002687 nova-compute[98431]: node.conn[0].address = 192.168.40.100 Jun 11 23:11:50.270835 np0000002687 nova-compute[98431]: node.conn[0].port = 3260 Jun 11 23:11:50.270835 np0000002687 nova-compute[98431]: node.conn[0].startup = manual Jun 11 23:11:50.270835 np0000002687 nova-compute[98431]: node.conn[0].tcp.window_size = 524288 Jun 11 23:11:50.270835 np0000002687 nova-compute[98431]: node.conn[0].tcp.type_of_service = 0 Jun 11 23:11:50.270835 np0000002687 nova-compute[98431]: node.conn[0].timeo.logout_timeout = 15 Jun 11 23:11:50.270835 np0000002687 nova-compute[98431]: node.conn[0].timeo.login_timeout = 15 Jun 11 23:11:50.270835 np0000002687 nova-compute[98431]: node.conn[0].timeo.auth_timeout = 45 Jun 11 23:11:50.270835 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_interval = 5 Jun 11 23:11:50.270835 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_timeout = 5 Jun 11 23:11:50.270835 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 11 23:11:50.270835 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 11 23:11:50.270835 np0000002687 nova-compute[98431]: node.conn[0].iscsi.HeaderDigest = None Jun 11 23:11:50.270835 np0000002687 nova-compute[98431]: node.conn[0].iscsi.DataDigest = None Jun 11 23:11:50.270835 np0000002687 nova-compute[98431]: node.conn[0].iscsi.IFMarker = No Jun 11 23:11:50.270835 np0000002687 nova-compute[98431]: node.conn[0].iscsi.OFMarker = No Jun 11 23:11:50.270835 np0000002687 nova-compute[98431]: # END RECORD Jun 11 23:11:50.270835 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:50.276338 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 11 23:11:50.276338 np0000002687 nova-compute[98431]: node.name = iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea Jun 11 23:11:50.276338 np0000002687 nova-compute[98431]: node.tpgt = -1 Jun 11 23:11:50.276338 np0000002687 nova-compute[98431]: node.startup = automatic Jun 11 23:11:50.276338 np0000002687 nova-compute[98431]: node.leading_login = No Jun 11 23:11:50.276338 np0000002687 nova-compute[98431]: iface.iscsi_ifacename = default Jun 11 23:11:50.276338 np0000002687 nova-compute[98431]: iface.net_ifacename = Jun 11 23:11:50.276338 np0000002687 nova-compute[98431]: iface.ipaddress = Jun 11 23:11:50.276338 np0000002687 nova-compute[98431]: iface.prefix_len = 0 Jun 11 23:11:50.276338 np0000002687 nova-compute[98431]: iface.hwaddress = Jun 11 23:11:50.276338 np0000002687 nova-compute[98431]: iface.transport_name = tcp Jun 11 23:11:50.276338 np0000002687 nova-compute[98431]: iface.initiatorname = Jun 11 23:11:50.276338 np0000002687 nova-compute[98431]: iface.state = Jun 11 23:11:50.276338 np0000002687 nova-compute[98431]: iface.vlan_id = 0 Jun 11 23:11:50.276338 np0000002687 nova-compute[98431]: iface.vlan_priority = 0 Jun 11 23:11:50.276338 np0000002687 nova-compute[98431]: iface.vlan_state = Jun 11 23:11:50.276338 np0000002687 nova-compute[98431]: iface.iface_num = 0 Jun 11 23:11:50.276338 np0000002687 nova-compute[98431]: iface.mtu = 0 Jun 11 23:11:50.276338 np0000002687 nova-compute[98431]: iface.port = 0 Jun 11 23:11:50.276338 np0000002687 nova-compute[98431]: iface.bootproto = Jun 11 23:11:50.276338 np0000002687 nova-compute[98431]: iface.subnet_mask = Jun 11 23:11:50.276338 np0000002687 nova-compute[98431]: iface.gateway = Jun 11 23:11:50.276338 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id_state = Jun 11 23:11:50.276338 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id = Jun 11 23:11:50.276338 np0000002687 nova-compute[98431]: iface.dhcp_dns = Jun 11 23:11:50.276338 np0000002687 nova-compute[98431]: iface.dhcp_learn_iqn = Jun 11 23:11:50.276338 np0000002687 nova-compute[98431]: iface.dhcp_req_vendor_id_state = Jun 11 23:11:50.276338 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id_state = Jun 11 23:11:50.276338 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id = Jun 11 23:11:50.276338 np0000002687 nova-compute[98431]: iface.dhcp_slp_da = Jun 11 23:11:50.276338 np0000002687 nova-compute[98431]: iface.fragmentation = Jun 11 23:11:50.276338 np0000002687 nova-compute[98431]: iface.gratuitous_arp = Jun 11 23:11:50.276338 np0000002687 nova-compute[98431]: iface.incoming_forwarding = Jun 11 23:11:50.276338 np0000002687 nova-compute[98431]: iface.tos_state = Jun 11 23:11:50.276338 np0000002687 nova-compute[98431]: iface.tos = 0 Jun 11 23:11:50.276338 np0000002687 nova-compute[98431]: iface.ttl = 0 Jun 11 23:11:50.276338 np0000002687 nova-compute[98431]: iface.delayed_ack = Jun 11 23:11:50.276338 np0000002687 nova-compute[98431]: iface.tcp_nagle = Jun 11 23:11:50.276338 np0000002687 nova-compute[98431]: iface.tcp_wsf_state = Jun 11 23:11:50.276338 np0000002687 nova-compute[98431]: iface.tcp_wsf = 0 Jun 11 23:11:50.276338 np0000002687 nova-compute[98431]: iface.tcp_timer_scale = 0 Jun 11 23:11:50.276338 np0000002687 nova-compute[98431]: iface.tcp_timestamp = Jun 11 23:11:50.276338 np0000002687 nova-compute[98431]: iface.redirect = Jun 11 23:11:50.276338 np0000002687 nova-compute[98431]: iface.def_task_mgmt_timeout = 0 Jun 11 23:11:50.276338 np0000002687 nova-compute[98431]: iface.header_digest = Jun 11 23:11:50.276338 np0000002687 nova-compute[98431]: iface.data_digest = Jun 11 23:11:50.276338 np0000002687 nova-compute[98431]: iface.immediate_data = Jun 11 23:11:50.276338 np0000002687 nova-compute[98431]: iface.initial_r2t = Jun 11 23:11:50.276338 np0000002687 nova-compute[98431]: iface.data_seq_inorder = Jun 11 23:11:50.276338 np0000002687 nova-compute[98431]: iface.data_pdu_inorder = Jun 11 23:11:50.276338 np0000002687 nova-compute[98431]: iface.erl = 0 Jun 11 23:11:50.276338 np0000002687 nova-compute[98431]: iface.max_receive_data_len = 0 Jun 11 23:11:50.276338 np0000002687 nova-compute[98431]: iface.first_burst_len = 0 Jun 11 23:11:50.276338 np0000002687 nova-compute[98431]: iface.max_outstanding_r2t = 0 Jun 11 23:11:50.276338 np0000002687 nova-compute[98431]: iface.max_burst_len = 0 Jun 11 23:11:50.276338 np0000002687 nova-compute[98431]: iface.chap_auth = Jun 11 23:11:50.276338 np0000002687 nova-compute[98431]: iface.bidi_chap = Jun 11 23:11:50.276338 np0000002687 nova-compute[98431]: iface.strict_login_compliance = Jun 11 23:11:50.276338 np0000002687 nova-compute[98431]: iface.discovery_auth = Jun 11 23:11:50.276338 np0000002687 nova-compute[98431]: iface.discovery_logout = Jun 11 23:11:50.276338 np0000002687 nova-compute[98431]: node.discovery_address = Jun 11 23:11:50.276338 np0000002687 nova-compute[98431]: node.discovery_port = 0 Jun 11 23:11:50.276338 np0000002687 nova-compute[98431]: node.discovery_type = fw Jun 11 23:11:50.276338 np0000002687 nova-compute[98431]: node.session.initial_cmdsn = 0 Jun 11 23:11:50.276338 np0000002687 nova-compute[98431]: node.session.initial_login_retry_max = 8 Jun 11 23:11:50.276338 np0000002687 nova-compute[98431]: node.session.xmit_thread_priority = 0 Jun 11 23:11:50.276338 np0000002687 nova-compute[98431]: node.session.cmds_max = 128 Jun 11 23:11:50.276338 np0000002687 nova-compute[98431]: node.session.queue_depth = 32 Jun 11 23:11:50.276338 np0000002687 nova-compute[98431]: node.session.nr_sessions = 1 Jun 11 23:11:50.276338 np0000002687 nova-compute[98431]: node.session.auth.authmethod = None Jun 11 23:11:50.276338 np0000002687 nova-compute[98431]: node.session.auth.username = Jun 11 23:11:50.276338 np0000002687 nova-compute[98431]: node.session.auth.password = *** Jun 11 23:11:50.276338 np0000002687 nova-compute[98431]: node.session.auth.username_in = Jun 11 23:11:50.276338 np0000002687 nova-compute[98431]: node.session.auth.password_in = Jun 11 23:11:50.276338 np0000002687 nova-compute[98431]: node.session.auth.chap_algs = SHA256 Jun 11 23:11:50.276338 np0000002687 nova-compute[98431]: node.session.timeo.replacement_timeout = 120 Jun 11 23:11:50.276338 np0000002687 nova-compute[98431]: node.session.err_timeo.abort_timeout = 15 Jun 11 23:11:50.276338 np0000002687 nova-compute[98431]: node.session.err_timeo.lu_reset_timeout = 30 Jun 11 23:11:50.276338 np0000002687 nova-compute[98431]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 11 23:11:50.276338 np0000002687 nova-compute[98431]: node.session.err_timeo.host_reset_timeout = 60 Jun 11 23:11:50.276338 np0000002687 nova-compute[98431]: node.session.iscsi.FastAbort = Yes Jun 11 23:11:50.276338 np0000002687 nova-compute[98431]: node.session.iscsi.InitialR2T = No Jun 11 23:11:50.276338 np0000002687 nova-compute[98431]: node.session.iscsi.ImmediateData = Yes Jun 11 23:11:50.276338 np0000002687 nova-compute[98431]: node.session.iscsi.FirstBurstLength = 262144 Jun 11 23:11:50.276338 np0000002687 nova-compute[98431]: node.session.iscsi.MaxBurstLength = 16776192 Jun 11 23:11:50.276338 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Retain = 0 Jun 11 23:11:50.276338 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Wait = 2 Jun 11 23:11:50.276338 np0000002687 nova-compute[98431]: node.session.iscsi.MaxConnections = 1 Jun 11 23:11:50.276338 np0000002687 nova-compute[98431]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 11 23:11:50.276338 np0000002687 nova-compute[98431]: node.session.iscsi.ERL = 0 Jun 11 23:11:50.276338 np0000002687 nova-compute[98431]: node.session.scan = manual Jun 11 23:11:50.276338 np0000002687 nova-compute[98431]: node.session.reopen_max = 0 Jun 11 23:11:50.276338 np0000002687 nova-compute[98431]: node.conn[0].address = 192.168.50.100 Jun 11 23:11:50.276338 np0000002687 nova-compute[98431]: node.conn[0].port = 3260 Jun 11 23:11:50.276338 np0000002687 nova-compute[98431]: node.conn[0].startup = manual Jun 11 23:11:50.276338 np0000002687 nova-compute[98431]: node.conn[0].tcp.window_size = 524288 Jun 11 23:11:50.276338 np0000002687 nova-compute[98431]: node.conn[0].tcp.type_of_service = 0 Jun 11 23:11:50.276338 np0000002687 nova-compute[98431]: node.conn[0].timeo.logout_timeout = 15 Jun 11 23:11:50.276338 np0000002687 nova-compute[98431]: node.conn[0].timeo.login_timeout = 15 Jun 11 23:11:50.276338 np0000002687 nova-compute[98431]: node.conn[0].timeo.auth_timeout = 45 Jun 11 23:11:50.276338 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_interval = 5 Jun 11 23:11:50.276338 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_timeout = 5 Jun 11 23:11:50.276338 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 11 23:11:50.276338 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 11 23:11:50.276338 np0000002687 nova-compute[98431]: node.conn[0].iscsi.HeaderDigest = None Jun 11 23:11:50.276338 np0000002687 nova-compute[98431]: node.conn[0].iscsi.DataDigest = None Jun 11 23:11:50.276338 np0000002687 nova-compute[98431]: node.conn[0].iscsi.IFMarker = No Jun 11 23:11:50.276338 np0000002687 nova-compute[98431]: node.conn[0].iscsi.OFMarker = No Jun 11 23:11:50.276338 np0000002687 nova-compute[98431]: # END RECORD Jun 11 23:11:50.276338 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:50.285453 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:50.294321 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:50.320837 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:50.320837 np0000002687 nova-compute[98431]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:11:50.320837 np0000002687 nova-compute[98431]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:11:50.320837 np0000002687 nova-compute[98431]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:11:50.320837 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:11:50.320837 np0000002687 nova-compute[98431]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6eb3ee75-92d8-430f-86ea-31edf88d1ae8 (non-flash) Jun 11 23:11:50.320837 np0000002687 nova-compute[98431]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6eb3ee75-92d8-430f-86ea-31edf88d1ae8 (non-flash) Jun 11 23:11:50.320837 np0000002687 nova-compute[98431]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6e44a36-048b-41a3-8639-4ee7e1b0122f (non-flash) Jun 11 23:11:50.320837 np0000002687 nova-compute[98431]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6e44a36-048b-41a3-8639-4ee7e1b0122f (non-flash) Jun 11 23:11:50.320837 np0000002687 nova-compute[98431]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8 (non-flash) Jun 11 23:11:50.320837 np0000002687 nova-compute[98431]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8 (non-flash) Jun 11 23:11:50.320837 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:50.320837 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:50.320837 np0000002687 nova-compute[98431]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:50.320837 np0000002687 nova-compute[98431]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:50.320837 np0000002687 nova-compute[98431]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:50.320837 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:11:50.321529 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:50.321529 np0000002687 nova-compute[98431]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:11:50.321529 np0000002687 nova-compute[98431]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:11:50.321529 np0000002687 nova-compute[98431]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:11:50.321529 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:11:50.321529 np0000002687 nova-compute[98431]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6eb3ee75-92d8-430f-86ea-31edf88d1ae8 (non-flash) Jun 11 23:11:50.321529 np0000002687 nova-compute[98431]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6eb3ee75-92d8-430f-86ea-31edf88d1ae8 (non-flash) Jun 11 23:11:50.321529 np0000002687 nova-compute[98431]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6e44a36-048b-41a3-8639-4ee7e1b0122f (non-flash) Jun 11 23:11:50.321529 np0000002687 nova-compute[98431]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6e44a36-048b-41a3-8639-4ee7e1b0122f (non-flash) Jun 11 23:11:50.321529 np0000002687 nova-compute[98431]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8 (non-flash) Jun 11 23:11:50.321529 np0000002687 nova-compute[98431]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8 (non-flash) Jun 11 23:11:50.321529 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:50.321529 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:50.321529 np0000002687 nova-compute[98431]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:50.321529 np0000002687 nova-compute[98431]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:50.321529 np0000002687 nova-compute[98431]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:50.321529 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:11:50.322417 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:50.322417 np0000002687 nova-compute[98431]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:11:50.322417 np0000002687 nova-compute[98431]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:11:50.322417 np0000002687 nova-compute[98431]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:11:50.322417 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:11:50.322417 np0000002687 nova-compute[98431]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6eb3ee75-92d8-430f-86ea-31edf88d1ae8 (non-flash) Jun 11 23:11:50.322417 np0000002687 nova-compute[98431]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6eb3ee75-92d8-430f-86ea-31edf88d1ae8 (non-flash) Jun 11 23:11:50.322417 np0000002687 nova-compute[98431]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6e44a36-048b-41a3-8639-4ee7e1b0122f (non-flash) Jun 11 23:11:50.322417 np0000002687 nova-compute[98431]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6e44a36-048b-41a3-8639-4ee7e1b0122f (non-flash) Jun 11 23:11:50.322417 np0000002687 nova-compute[98431]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8 (non-flash) Jun 11 23:11:50.322417 np0000002687 nova-compute[98431]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8 (non-flash) Jun 11 23:11:50.322417 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:50.322417 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:50.322417 np0000002687 nova-compute[98431]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:50.322417 np0000002687 nova-compute[98431]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:50.322417 np0000002687 nova-compute[98431]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:50.322417 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:11:50.322992 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.066s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 11 23:11:50.323074 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:50.323074 np0000002687 nova-compute[98431]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:11:50.323074 np0000002687 nova-compute[98431]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:11:50.323074 np0000002687 nova-compute[98431]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:11:50.323074 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:11:50.323074 np0000002687 nova-compute[98431]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6eb3ee75-92d8-430f-86ea-31edf88d1ae8 (non-flash) Jun 11 23:11:50.323074 np0000002687 nova-compute[98431]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6eb3ee75-92d8-430f-86ea-31edf88d1ae8 (non-flash) Jun 11 23:11:50.323074 np0000002687 nova-compute[98431]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6e44a36-048b-41a3-8639-4ee7e1b0122f (non-flash) Jun 11 23:11:50.323074 np0000002687 nova-compute[98431]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6e44a36-048b-41a3-8639-4ee7e1b0122f (non-flash) Jun 11 23:11:50.323074 np0000002687 nova-compute[98431]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8 (non-flash) Jun 11 23:11:50.323074 np0000002687 nova-compute[98431]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8 (non-flash) Jun 11 23:11:50.323074 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:50.323074 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:50.323074 np0000002687 nova-compute[98431]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:50.323074 np0000002687 nova-compute[98431]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:50.323074 np0000002687 nova-compute[98431]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:50.323074 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:11:50.323903 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Connected to 192.168.50.100:3260 {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 11 23:11:50.323903 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.067s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 11 23:11:50.323903 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Connected to 192.168.40.100:3260 {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 11 23:11:50.325502 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] HCTL ('15', '0', '0', 0) found on session 13 with lun 0 {{(pid=98431) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 11 23:11:50.325694 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Scanning host 15 c: 0, t: 0, l: 0) {{(pid=98431) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 11 23:11:50.326245 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] HCTL ('16', '0', '0', 0) found on session 14 with lun 0 {{(pid=98431) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 11 23:11:50.326392 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Scanning host 16 c: 0, t: 0, l: 0) {{(pid=98431) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 11 23:11:50.335621 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Searching for a device in session 14 and hctl ('16', '0', '0', 0) yield: sdk {{(pid=98431) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 11 23:11:50.335875 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5498d0af-4b75-4132-b06e-56f2b5b013ea', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'} {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 11 23:11:50.341643 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Searching for a device in session 13 and hctl ('15', '0', '0', 0) yield: sdj {{(pid=98431) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 11 23:11:50.341911 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '5498d0af-4b75-4132-b06e-56f2b5b013ea', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'} {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 11 23:11:50.421828 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-cbe1342b-056f-4875-8f4a-11c987c243d8 req-305bb24f-25ac-4086-93bd-8173f29d1421 service nova] Releasing lock "refresh_cache-7609742e-a3a2-4be2-ba02-227efb2101e1" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 11 23:11:50.742700 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-922d3cd0-d5df-4bc5-b3ee-9cdfb633df77 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 206476b7-d805-4c6c-b7fb-db8b5c2a94a6] Attempting to attach volume 4da6c3da-4a1a-454c-b611-7fa9fc0832d8 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98431) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}} Jun 11 23:11:50.744717 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.guest [None req-922d3cd0-d5df-4bc5-b3ee-9cdfb633df77 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] attach device xml: Jun 11 23:11:50.744717 np0000002687 nova-compute[98431]: Jun 11 23:11:50.744717 np0000002687 nova-compute[98431]: Jun 11 23:11:50.744717 np0000002687 nova-compute[98431]: Jun 11 23:11:50.744717 np0000002687 nova-compute[98431]: Jun 11 23:11:50.744717 np0000002687 nova-compute[98431]: 4da6c3da-4a1a-454c-b611-7fa9fc0832d8 Jun 11 23:11:50.744717 np0000002687 nova-compute[98431]: Jun 11 23:11:50.744717 np0000002687 nova-compute[98431]: Jun 11 23:11:50.744717 np0000002687 nova-compute[98431]: {{(pid=98431) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} Jun 11 23:11:50.960880 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-092b94e8-8497-429c-9c05-fa43dcb87fac tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] Lock "73abd331-0bbf-432e-be1c-308801a5429f" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 8.790s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:11:51.258386 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98431) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 11 23:11:51.630968 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:52.056639 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-c4ca9691-f7c2-4d62-91cf-b5717ad1b63c tempest-VolumesAssistedSnapshotsTest-33690166 tempest-VolumesAssistedSnapshotsTest-33690166-project] [instance: 73abd331-0bbf-432e-be1c-308801a5429f] volume_snapshot_create: create_info: {'snapshot_id': 'e934faaf-2438-4552-b70c-0bcaaee4351d', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=98431) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3759}} Jun 11 23:11:52.058634 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-c4ca9691-f7c2-4d62-91cf-b5717ad1b63c tempest-VolumesAssistedSnapshotsTest-33690166 tempest-VolumesAssistedSnapshotsTest-33690166-project] [instance: 73abd331-0bbf-432e-be1c-308801a5429f] snap xml: Jun 11 23:11:52.058634 np0000002687 nova-compute[98431]: Jun 11 23:11:52.058634 np0000002687 nova-compute[98431]: Jun 11 23:11:52.058634 np0000002687 nova-compute[98431]: Jun 11 23:11:52.058634 np0000002687 nova-compute[98431]: Jun 11 23:11:52.058634 np0000002687 nova-compute[98431]: Jun 11 23:11:52.058634 np0000002687 nova-compute[98431]: Jun 11 23:11:52.058634 np0000002687 nova-compute[98431]: Jun 11 23:11:52.058634 np0000002687 nova-compute[98431]: Jun 11 23:11:52.058634 np0000002687 nova-compute[98431]: {{(pid=98431) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3700}} Jun 11 23:11:52.058975 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-c4ca9691-f7c2-4d62-91cf-b5717ad1b63c tempest-VolumesAssistedSnapshotsTest-33690166 tempest-VolumesAssistedSnapshotsTest-33690166-project] Lazy-loading 'system_metadata' on Instance uuid 73abd331-0bbf-432e-be1c-308801a5429f {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:11:52.146859 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-8d30858f-87ac-4dfd-ba0e-224de6481473 tempest-VolumesAssistedSnapshotsTest-33690166 tempest-VolumesAssistedSnapshotsTest-33690166-project] [instance: 73abd331-0bbf-432e-be1c-308801a5429f] volume_snapshot_delete: delete_info: {'volume_id': 'b6e44a36-048b-41a3-8639-4ee7e1b0122f'} {{(pid=98431) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3867}} Jun 11 23:11:52.152602 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver [None req-8d30858f-87ac-4dfd-ba0e-224de6481473 tempest-VolumesAssistedSnapshotsTest-33690166 tempest-VolumesAssistedSnapshotsTest-33690166-project] [instance: 73abd331-0bbf-432e-be1c-308801a5429f] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type' Jun 11 23:11:52.152602 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver [instance: 73abd331-0bbf-432e-be1c-308801a5429f] Traceback (most recent call last): Jun 11 23:11:52.152602 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver [instance: 73abd331-0bbf-432e-be1c-308801a5429f] File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 4040, in volume_snapshot_delete Jun 11 23:11:52.152602 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver [instance: 73abd331-0bbf-432e-be1c-308801a5429f] self._volume_snapshot_delete(context, instance, volume_id, Jun 11 23:11:52.152602 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver [instance: 73abd331-0bbf-432e-be1c-308801a5429f] File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3870, in _volume_snapshot_delete Jun 11 23:11:52.152602 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver [instance: 73abd331-0bbf-432e-be1c-308801a5429f] if delete_info['type'] != 'qcow2': Jun 11 23:11:52.152602 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver [instance: 73abd331-0bbf-432e-be1c-308801a5429f] ~~~~~~~~~~~^^^^^^^^ Jun 11 23:11:52.152602 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver [instance: 73abd331-0bbf-432e-be1c-308801a5429f] KeyError: 'type' Jun 11 23:11:52.152602 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver [instance: 73abd331-0bbf-432e-be1c-308801a5429f] Jun 11 23:11:52.227431 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver [None req-8d30858f-87ac-4dfd-ba0e-224de6481473 tempest-VolumesAssistedSnapshotsTest-33690166 tempest-VolumesAssistedSnapshotsTest-33690166-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found. Jun 11 23:11:52.227431 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver Traceback (most recent call last): Jun 11 23:11:52.227431 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 4040, in volume_snapshot_delete Jun 11 23:11:52.227431 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver self._volume_snapshot_delete(context, instance, volume_id, Jun 11 23:11:52.227431 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3870, in _volume_snapshot_delete Jun 11 23:11:52.227431 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver if delete_info['type'] != 'qcow2': Jun 11 23:11:52.227431 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver ~~~~~~~~~~~^^^^^^^^ Jun 11 23:11:52.227431 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver KeyError: 'type' Jun 11 23:11:52.227431 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver Jun 11 23:11:52.227431 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred: Jun 11 23:11:52.227431 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver Jun 11 23:11:52.227431 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver Traceback (most recent call last): Jun 11 23:11:52.227431 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 445, in wrapper Jun 11 23:11:52.227431 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 11 23:11:52.227431 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 11 23:11:52.227431 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 740, in update_snapshot_status Jun 11 23:11:52.227431 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver vs.update_snapshot_status( Jun 11 23:11:52.227431 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status Jun 11 23:11:52.227431 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver return self._action('os-update_snapshot_status', Jun 11 23:11:52.227431 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 11 23:11:52.227431 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action Jun 11 23:11:52.227431 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver resp, body = self.api.client.post(url, body=body) Jun 11 23:11:52.227431 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 11 23:11:52.227431 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 223, in post Jun 11 23:11:52.227431 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver return self._cs_request(url, 'POST', **kwargs) Jun 11 23:11:52.227431 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 11 23:11:52.227431 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 211, in _cs_request Jun 11 23:11:52.227431 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver return self.request(url, method, **kwargs) Jun 11 23:11:52.227431 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 11 23:11:52.227431 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 197, in request Jun 11 23:11:52.227431 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver raise exceptions.from_response(resp, body) Jun 11 23:11:52.227431 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-48664485-389c-4a18-9770-00df941b8fe2) Jun 11 23:11:52.227431 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver Jun 11 23:11:52.227431 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred: Jun 11 23:11:52.227431 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver Jun 11 23:11:52.227431 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver Traceback (most recent call last): Jun 11 23:11:52.227431 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3599, in _volume_snapshot_update_status Jun 11 23:11:52.227431 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver self._volume_api.update_snapshot_status(context, Jun 11 23:11:52.227431 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 376, in wrapper Jun 11 23:11:52.227431 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver res = method(self, ctx, *args, **kwargs) Jun 11 23:11:52.227431 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 11 23:11:52.227431 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 447, in wrapper Jun 11 23:11:52.227431 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 11 23:11:52.227431 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 467, in _reraise Jun 11 23:11:52.227431 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 11 23:11:52.227431 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 445, in wrapper Jun 11 23:11:52.227431 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 11 23:11:52.227431 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 11 23:11:52.227431 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 740, in update_snapshot_status Jun 11 23:11:52.227431 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver vs.update_snapshot_status( Jun 11 23:11:52.227431 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status Jun 11 23:11:52.227431 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver return self._action('os-update_snapshot_status', Jun 11 23:11:52.227431 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 11 23:11:52.227431 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action Jun 11 23:11:52.227431 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver resp, body = self.api.client.post(url, body=body) Jun 11 23:11:52.227431 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 11 23:11:52.227431 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 223, in post Jun 11 23:11:52.227431 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver return self._cs_request(url, 'POST', **kwargs) Jun 11 23:11:52.227431 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 11 23:11:52.227431 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 211, in _cs_request Jun 11 23:11:52.227431 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver return self.request(url, method, **kwargs) Jun 11 23:11:52.227431 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 11 23:11:52.227431 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 197, in request Jun 11 23:11:52.227431 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver raise exceptions.from_response(resp, body) Jun 11 23:11:52.227431 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found. Jun 11 23:11:52.227431 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver Jun 11 23:11:52.245966 np0000002687 nova-compute[98431]: ERROR oslo_messaging.rpc.server [None req-8d30858f-87ac-4dfd-ba0e-224de6481473 tempest-VolumesAssistedSnapshotsTest-33690166 tempest-VolumesAssistedSnapshotsTest-33690166-project] Exception during message handling: KeyError: 'type' Jun 11 23:11:52.245966 np0000002687 nova-compute[98431]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Jun 11 23:11:52.245966 np0000002687 nova-compute[98431]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming Jun 11 23:11:52.245966 np0000002687 nova-compute[98431]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Jun 11 23:11:52.245966 np0000002687 nova-compute[98431]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 11 23:11:52.245966 np0000002687 nova-compute[98431]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Jun 11 23:11:52.245966 np0000002687 nova-compute[98431]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Jun 11 23:11:52.245966 np0000002687 nova-compute[98431]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 11 23:11:52.245966 np0000002687 nova-compute[98431]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Jun 11 23:11:52.245966 np0000002687 nova-compute[98431]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Jun 11 23:11:52.245966 np0000002687 nova-compute[98431]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^ Jun 11 23:11:52.245966 np0000002687 nova-compute[98431]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 269, in inner Jun 11 23:11:52.245966 np0000002687 nova-compute[98431]: ERROR oslo_messaging.rpc.server return func(*args, **kwargs) Jun 11 23:11:52.245966 np0000002687 nova-compute[98431]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^ Jun 11 23:11:52.245966 np0000002687 nova-compute[98431]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped Jun 11 23:11:52.245966 np0000002687 nova-compute[98431]: ERROR oslo_messaging.rpc.server with excutils.save_and_reraise_exception(): Jun 11 23:11:52.245966 np0000002687 nova-compute[98431]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 266, in __exit__ Jun 11 23:11:52.245966 np0000002687 nova-compute[98431]: ERROR oslo_messaging.rpc.server self.force_reraise() Jun 11 23:11:52.245966 np0000002687 nova-compute[98431]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 232, in force_reraise Jun 11 23:11:52.245966 np0000002687 nova-compute[98431]: ERROR oslo_messaging.rpc.server raise self.value Jun 11 23:11:52.245966 np0000002687 nova-compute[98431]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 11 23:11:52.245966 np0000002687 nova-compute[98431]: ERROR oslo_messaging.rpc.server return f(self, context, *args, **kw) Jun 11 23:11:52.245966 np0000002687 nova-compute[98431]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 11 23:11:52.245966 np0000002687 nova-compute[98431]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/compute/manager.py", line 4829, in volume_snapshot_delete Jun 11 23:11:52.245966 np0000002687 nova-compute[98431]: ERROR oslo_messaging.rpc.server self.driver.volume_snapshot_delete(context, instance, volume_id, Jun 11 23:11:52.245966 np0000002687 nova-compute[98431]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 4043, in volume_snapshot_delete Jun 11 23:11:52.245966 np0000002687 nova-compute[98431]: ERROR oslo_messaging.rpc.server with excutils.save_and_reraise_exception(): Jun 11 23:11:52.245966 np0000002687 nova-compute[98431]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 266, in __exit__ Jun 11 23:11:52.245966 np0000002687 nova-compute[98431]: ERROR oslo_messaging.rpc.server self.force_reraise() Jun 11 23:11:52.245966 np0000002687 nova-compute[98431]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 232, in force_reraise Jun 11 23:11:52.245966 np0000002687 nova-compute[98431]: ERROR oslo_messaging.rpc.server raise self.value Jun 11 23:11:52.245966 np0000002687 nova-compute[98431]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 4040, in volume_snapshot_delete Jun 11 23:11:52.245966 np0000002687 nova-compute[98431]: ERROR oslo_messaging.rpc.server self._volume_snapshot_delete(context, instance, volume_id, Jun 11 23:11:52.245966 np0000002687 nova-compute[98431]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3870, in _volume_snapshot_delete Jun 11 23:11:52.245966 np0000002687 nova-compute[98431]: ERROR oslo_messaging.rpc.server if delete_info['type'] != 'qcow2': Jun 11 23:11:52.245966 np0000002687 nova-compute[98431]: ERROR oslo_messaging.rpc.server ~~~~~~~~~~~^^^^^^^^ Jun 11 23:11:52.245966 np0000002687 nova-compute[98431]: ERROR oslo_messaging.rpc.server KeyError: 'type' Jun 11 23:11:52.245966 np0000002687 nova-compute[98431]: ERROR oslo_messaging.rpc.server Jun 11 23:11:52.277930 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Found WWN 330000000b5e39cd6 for multipath device dm-8 {{(pid=98431) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 11 23:11:52.277930 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.042s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 11 23:11:52.278150 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] <== connect_volume: return (7800ms) {'type': 'block', 'scsi_wwn': '330000000b5e39cd6', 'path': '/dev/dm-8', 'multipath_id': '330000000b5e39cd6'} {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 11 23:11:52.278503 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000b5e39cd6', 'path': '/dev/dm-8', 'multipath_id': '330000000b5e39cd6'} {{(pid=98431) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 11 23:11:52.278817 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-4a646a8c-ec60-4c89-8400-a6995b91f1d7 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.986s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 11 23:11:52.279123 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-4a646a8c-ec60-4c89-8400-a6995b91f1d7 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce', 'iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '65724ff3-60af-4d3f-b1bf-3aa2695037ce', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98431) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 11 23:11:52.299170 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-4a646a8c-ec60-4c89-8400-a6995b91f1d7 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 11 23:11:52.300840 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-4a646a8c-ec60-4c89-8400-a6995b91f1d7 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 11 23:11:52.302000 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-4a646a8c-ec60-4c89-8400-a6995b91f1d7 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 11 23:11:52.302325 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.iscsi [None req-4a646a8c-ec60-4c89-8400-a6995b91f1d7 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 11 23:11:52.303916 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-4a646a8c-ec60-4c89-8400-a6995b91f1d7 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 11 23:11:52.303916 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.iscsi [None req-4a646a8c-ec60-4c89-8400-a6995b91f1d7 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 11 23:11:52.323471 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a646a8c-ec60-4c89-8400-a6995b91f1d7 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 11 23:11:52.323471 np0000002687 nova-compute[98431]: {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:52.334826 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a646a8c-ec60-4c89-8400-a6995b91f1d7 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 11 23:11:52.334826 np0000002687 nova-compute[98431]: {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:52.339901 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a646a8c-ec60-4c89-8400-a6995b91f1d7 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce] added Jun 11 23:11:52.339901 np0000002687 nova-compute[98431]: stderr=iscsiadm: Config file line 363 does not have value Jun 11 23:11:52.339901 np0000002687 nova-compute[98431]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 11 23:11:52.339901 np0000002687 nova-compute[98431]: iscsiadm: Config file line 363 does not have value Jun 11 23:11:52.339901 np0000002687 nova-compute[98431]: iscsiadm: Config file line 363 does not have value Jun 11 23:11:52.339901 np0000002687 nova-compute[98431]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 11 23:11:52.339901 np0000002687 nova-compute[98431]: {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:52.340436 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a646a8c-ec60-4c89-8400-a6995b91f1d7 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98431) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 11 23:11:52.340730 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-4a646a8c-ec60-4c89-8400-a6995b91f1d7 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0385(s), this was the 1st time calling it. {{(pid=98431) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 11 23:11:52.340929 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-4a646a8c-ec60-4c89-8400-a6995b91f1d7 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98431) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 11 23:11:52.347009 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a646a8c-ec60-4c89-8400-a6995b91f1d7 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce] added Jun 11 23:11:52.347009 np0000002687 nova-compute[98431]: stderr=iscsiadm: Config file line 363 does not have value Jun 11 23:11:52.347009 np0000002687 nova-compute[98431]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 11 23:11:52.347009 np0000002687 nova-compute[98431]: iscsiadm: Config file line 363 does not have value Jun 11 23:11:52.347009 np0000002687 nova-compute[98431]: iscsiadm: Config file line 363 does not have value Jun 11 23:11:52.347009 np0000002687 nova-compute[98431]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 11 23:11:52.347009 np0000002687 nova-compute[98431]: {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:52.347009 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a646a8c-ec60-4c89-8400-a6995b91f1d7 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98431) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 11 23:11:52.347009 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-4a646a8c-ec60-4c89-8400-a6995b91f1d7 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0425(s), this was the 1st time calling it. {{(pid=98431) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 11 23:11:52.347009 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-4a646a8c-ec60-4c89-8400-a6995b91f1d7 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98431) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 11 23:11:52.403994 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-922d3cd0-d5df-4bc5-b3ee-9cdfb633df77 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] No BDM found with device name vda, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:11:52.404217 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-922d3cd0-d5df-4bc5-b3ee-9cdfb633df77 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:11:52.404332 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-922d3cd0-d5df-4bc5-b3ee-9cdfb633df77 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] No BDM found with device name hda, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:11:52.405981 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-922d3cd0-d5df-4bc5-b3ee-9cdfb633df77 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] No VIF found with MAC fa:16:3e:c7:33:6a, not building metadata {{(pid=98431) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13199}} Jun 11 23:11:52.561956 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-c4ca9691-f7c2-4d62-91cf-b5717ad1b63c tempest-VolumesAssistedSnapshotsTest-33690166 tempest-VolumesAssistedSnapshotsTest-33690166-project] [instance: 73abd331-0bbf-432e-be1c-308801a5429f] Skipping quiescing instance: QEMU guest agent is not enabled. Jun 11 23:11:52.569908 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver [None req-c4ca9691-f7c2-4d62-91cf-b5717ad1b63c tempest-VolumesAssistedSnapshotsTest-33690166 tempest-VolumesAssistedSnapshotsTest-33690166-project] [instance: 73abd331-0bbf-432e-be1c-308801a5429f] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory Jun 11 23:11:52.569908 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver [instance: 73abd331-0bbf-432e-be1c-308801a5429f] Traceback (most recent call last): Jun 11 23:11:52.569908 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver [instance: 73abd331-0bbf-432e-be1c-308801a5429f] File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3727, in _volume_snapshot_create Jun 11 23:11:52.569908 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver [instance: 73abd331-0bbf-432e-be1c-308801a5429f] guest.snapshot(snapshot, no_metadata=True, disk_only=True, Jun 11 23:11:52.569908 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver [instance: 73abd331-0bbf-432e-be1c-308801a5429f] File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 583, in snapshot Jun 11 23:11:52.569908 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver [instance: 73abd331-0bbf-432e-be1c-308801a5429f] self._domain.snapshotCreateXML(device_xml, flags=flags) Jun 11 23:11:52.569908 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver [instance: 73abd331-0bbf-432e-be1c-308801a5429f] File "/usr/lib/python3/dist-packages/libvirt.py", line 3125, in snapshotCreateXML Jun 11 23:11:52.569908 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver [instance: 73abd331-0bbf-432e-be1c-308801a5429f] raise libvirtError('virDomainSnapshotCreateXML() failed') Jun 11 23:11:52.569908 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver [instance: 73abd331-0bbf-432e-be1c-308801a5429f] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory Jun 11 23:11:52.569908 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver [instance: 73abd331-0bbf-432e-be1c-308801a5429f] Jun 11 23:11:52.571078 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver [None req-c4ca9691-f7c2-4d62-91cf-b5717ad1b63c tempest-VolumesAssistedSnapshotsTest-33690166 tempest-VolumesAssistedSnapshotsTest-33690166-project] [instance: 73abd331-0bbf-432e-be1c-308801a5429f] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory Jun 11 23:11:52.571078 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver [instance: 73abd331-0bbf-432e-be1c-308801a5429f] Traceback (most recent call last): Jun 11 23:11:52.571078 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver [instance: 73abd331-0bbf-432e-be1c-308801a5429f] File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3777, in volume_snapshot_create Jun 11 23:11:52.571078 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver [instance: 73abd331-0bbf-432e-be1c-308801a5429f] self._volume_snapshot_create(context, instance, guest, Jun 11 23:11:52.571078 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver [instance: 73abd331-0bbf-432e-be1c-308801a5429f] File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3727, in _volume_snapshot_create Jun 11 23:11:52.571078 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver [instance: 73abd331-0bbf-432e-be1c-308801a5429f] guest.snapshot(snapshot, no_metadata=True, disk_only=True, Jun 11 23:11:52.571078 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver [instance: 73abd331-0bbf-432e-be1c-308801a5429f] File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 583, in snapshot Jun 11 23:11:52.571078 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver [instance: 73abd331-0bbf-432e-be1c-308801a5429f] self._domain.snapshotCreateXML(device_xml, flags=flags) Jun 11 23:11:52.571078 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver [instance: 73abd331-0bbf-432e-be1c-308801a5429f] File "/usr/lib/python3/dist-packages/libvirt.py", line 3125, in snapshotCreateXML Jun 11 23:11:52.571078 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver [instance: 73abd331-0bbf-432e-be1c-308801a5429f] raise libvirtError('virDomainSnapshotCreateXML() failed') Jun 11 23:11:52.571078 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver [instance: 73abd331-0bbf-432e-be1c-308801a5429f] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory Jun 11 23:11:52.571078 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver [instance: 73abd331-0bbf-432e-be1c-308801a5429f] Jun 11 23:11:52.626651 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:52.632681 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver [None req-c4ca9691-f7c2-4d62-91cf-b5717ad1b63c tempest-VolumesAssistedSnapshotsTest-33690166 tempest-VolumesAssistedSnapshotsTest-33690166-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot e934faaf-2438-4552-b70c-0bcaaee4351d could not be found. Jun 11 23:11:52.632681 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver Traceback (most recent call last): Jun 11 23:11:52.632681 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3777, in volume_snapshot_create Jun 11 23:11:52.632681 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver self._volume_snapshot_create(context, instance, guest, Jun 11 23:11:52.632681 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3727, in _volume_snapshot_create Jun 11 23:11:52.632681 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver guest.snapshot(snapshot, no_metadata=True, disk_only=True, Jun 11 23:11:52.632681 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 583, in snapshot Jun 11 23:11:52.632681 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver self._domain.snapshotCreateXML(device_xml, flags=flags) Jun 11 23:11:52.632681 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver File "/usr/lib/python3/dist-packages/libvirt.py", line 3125, in snapshotCreateXML Jun 11 23:11:52.632681 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver raise libvirtError('virDomainSnapshotCreateXML() failed') Jun 11 23:11:52.632681 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory Jun 11 23:11:52.632681 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver Jun 11 23:11:52.632681 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred: Jun 11 23:11:52.632681 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver Jun 11 23:11:52.632681 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver Traceback (most recent call last): Jun 11 23:11:52.632681 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 445, in wrapper Jun 11 23:11:52.632681 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 11 23:11:52.632681 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 11 23:11:52.632681 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 740, in update_snapshot_status Jun 11 23:11:52.632681 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver vs.update_snapshot_status( Jun 11 23:11:52.632681 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status Jun 11 23:11:52.632681 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver return self._action('os-update_snapshot_status', Jun 11 23:11:52.632681 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 11 23:11:52.632681 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action Jun 11 23:11:52.632681 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver resp, body = self.api.client.post(url, body=body) Jun 11 23:11:52.632681 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 11 23:11:52.632681 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 223, in post Jun 11 23:11:52.632681 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver return self._cs_request(url, 'POST', **kwargs) Jun 11 23:11:52.632681 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 11 23:11:52.632681 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 211, in _cs_request Jun 11 23:11:52.632681 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver return self.request(url, method, **kwargs) Jun 11 23:11:52.632681 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 11 23:11:52.632681 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 197, in request Jun 11 23:11:52.632681 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver raise exceptions.from_response(resp, body) Jun 11 23:11:52.632681 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot e934faaf-2438-4552-b70c-0bcaaee4351d could not be found. (HTTP 404) (Request-ID: req-254d1db9-1734-4e1a-a217-d01816abb636) Jun 11 23:11:52.632681 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver Jun 11 23:11:52.632681 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred: Jun 11 23:11:52.632681 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver Jun 11 23:11:52.632681 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver Traceback (most recent call last): Jun 11 23:11:52.632681 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3599, in _volume_snapshot_update_status Jun 11 23:11:52.632681 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver self._volume_api.update_snapshot_status(context, Jun 11 23:11:52.632681 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 376, in wrapper Jun 11 23:11:52.632681 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver res = method(self, ctx, *args, **kwargs) Jun 11 23:11:52.632681 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 11 23:11:52.632681 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 447, in wrapper Jun 11 23:11:52.632681 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 11 23:11:52.632681 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 467, in _reraise Jun 11 23:11:52.632681 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 11 23:11:52.632681 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 445, in wrapper Jun 11 23:11:52.632681 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 11 23:11:52.632681 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 11 23:11:52.632681 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 740, in update_snapshot_status Jun 11 23:11:52.632681 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver vs.update_snapshot_status( Jun 11 23:11:52.632681 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status Jun 11 23:11:52.632681 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver return self._action('os-update_snapshot_status', Jun 11 23:11:52.632681 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 11 23:11:52.632681 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action Jun 11 23:11:52.632681 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver resp, body = self.api.client.post(url, body=body) Jun 11 23:11:52.632681 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 11 23:11:52.632681 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 223, in post Jun 11 23:11:52.632681 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver return self._cs_request(url, 'POST', **kwargs) Jun 11 23:11:52.632681 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 11 23:11:52.632681 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 211, in _cs_request Jun 11 23:11:52.632681 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver return self.request(url, method, **kwargs) Jun 11 23:11:52.632681 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 11 23:11:52.632681 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 197, in request Jun 11 23:11:52.632681 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver raise exceptions.from_response(resp, body) Jun 11 23:11:52.632681 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot e934faaf-2438-4552-b70c-0bcaaee4351d could not be found. Jun 11 23:11:52.632681 np0000002687 nova-compute[98431]: ERROR nova.virt.libvirt.driver Jun 11 23:11:52.642620 np0000002687 nova-compute[98431]: ERROR oslo_messaging.rpc.server [None req-c4ca9691-f7c2-4d62-91cf-b5717ad1b63c tempest-VolumesAssistedSnapshotsTest-33690166 tempest-VolumesAssistedSnapshotsTest-33690166-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory Jun 11 23:11:52.642620 np0000002687 nova-compute[98431]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Jun 11 23:11:52.642620 np0000002687 nova-compute[98431]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming Jun 11 23:11:52.642620 np0000002687 nova-compute[98431]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Jun 11 23:11:52.642620 np0000002687 nova-compute[98431]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 11 23:11:52.642620 np0000002687 nova-compute[98431]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Jun 11 23:11:52.642620 np0000002687 nova-compute[98431]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Jun 11 23:11:52.642620 np0000002687 nova-compute[98431]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 11 23:11:52.642620 np0000002687 nova-compute[98431]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Jun 11 23:11:52.642620 np0000002687 nova-compute[98431]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Jun 11 23:11:52.642620 np0000002687 nova-compute[98431]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^ Jun 11 23:11:52.642620 np0000002687 nova-compute[98431]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 269, in inner Jun 11 23:11:52.642620 np0000002687 nova-compute[98431]: ERROR oslo_messaging.rpc.server return func(*args, **kwargs) Jun 11 23:11:52.642620 np0000002687 nova-compute[98431]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^ Jun 11 23:11:52.642620 np0000002687 nova-compute[98431]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped Jun 11 23:11:52.642620 np0000002687 nova-compute[98431]: ERROR oslo_messaging.rpc.server with excutils.save_and_reraise_exception(): Jun 11 23:11:52.642620 np0000002687 nova-compute[98431]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 266, in __exit__ Jun 11 23:11:52.642620 np0000002687 nova-compute[98431]: ERROR oslo_messaging.rpc.server self.force_reraise() Jun 11 23:11:52.642620 np0000002687 nova-compute[98431]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 232, in force_reraise Jun 11 23:11:52.642620 np0000002687 nova-compute[98431]: ERROR oslo_messaging.rpc.server raise self.value Jun 11 23:11:52.642620 np0000002687 nova-compute[98431]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 11 23:11:52.642620 np0000002687 nova-compute[98431]: ERROR oslo_messaging.rpc.server return f(self, context, *args, **kw) Jun 11 23:11:52.642620 np0000002687 nova-compute[98431]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 11 23:11:52.642620 np0000002687 nova-compute[98431]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/compute/manager.py", line 4817, in volume_snapshot_create Jun 11 23:11:52.642620 np0000002687 nova-compute[98431]: ERROR oslo_messaging.rpc.server self.driver.volume_snapshot_create(context, instance, volume_id, Jun 11 23:11:52.642620 np0000002687 nova-compute[98431]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3780, in volume_snapshot_create Jun 11 23:11:52.642620 np0000002687 nova-compute[98431]: ERROR oslo_messaging.rpc.server with excutils.save_and_reraise_exception(): Jun 11 23:11:52.642620 np0000002687 nova-compute[98431]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 266, in __exit__ Jun 11 23:11:52.642620 np0000002687 nova-compute[98431]: ERROR oslo_messaging.rpc.server self.force_reraise() Jun 11 23:11:52.642620 np0000002687 nova-compute[98431]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 232, in force_reraise Jun 11 23:11:52.642620 np0000002687 nova-compute[98431]: ERROR oslo_messaging.rpc.server raise self.value Jun 11 23:11:52.642620 np0000002687 nova-compute[98431]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3777, in volume_snapshot_create Jun 11 23:11:52.642620 np0000002687 nova-compute[98431]: ERROR oslo_messaging.rpc.server self._volume_snapshot_create(context, instance, guest, Jun 11 23:11:52.642620 np0000002687 nova-compute[98431]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3727, in _volume_snapshot_create Jun 11 23:11:52.642620 np0000002687 nova-compute[98431]: ERROR oslo_messaging.rpc.server guest.snapshot(snapshot, no_metadata=True, disk_only=True, Jun 11 23:11:52.642620 np0000002687 nova-compute[98431]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 583, in snapshot Jun 11 23:11:52.642620 np0000002687 nova-compute[98431]: ERROR oslo_messaging.rpc.server self._domain.snapshotCreateXML(device_xml, flags=flags) Jun 11 23:11:52.642620 np0000002687 nova-compute[98431]: ERROR oslo_messaging.rpc.server File "/usr/lib/python3/dist-packages/libvirt.py", line 3125, in snapshotCreateXML Jun 11 23:11:52.642620 np0000002687 nova-compute[98431]: ERROR oslo_messaging.rpc.server raise libvirtError('virDomainSnapshotCreateXML() failed') Jun 11 23:11:52.642620 np0000002687 nova-compute[98431]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory Jun 11 23:11:52.642620 np0000002687 nova-compute[98431]: ERROR oslo_messaging.rpc.server Jun 11 23:11:52.789193 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-11T23:11:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-28433977',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='tempest-serverbootfromvolumestablerescuetest-server-28433977',id=11,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-06-11T23:11:34Z,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='aaf744af828a4a5eba1e98da63373b2b',ramdisk_id='',reservation_id='r-mqq12a2i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-539499192',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member'},tags=,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-06-11T23:11:34Z,user_data=None,user_id='72b6dac5eb744cfba6299636227aa59b',uuid=c82748e6-1c78-4372-ad4b-48d1c6448efa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "852fc4ec-82e1-4185-a33c-3c45ff42351e", "address": "fa:16:3e:c6:c6:5b", "network": {"id": "2a770c99-2ec6-4fa2-945b-32830a59e7a7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-137493671-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-137493671-network", "vif_mac": "fa:16:3e:c6:c6:5b"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aaf744af828a4a5eba1e98da63373b2b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap852fc4ec-82", "ovs_interfaceid": "852fc4ec-82e1-4185-a33c-3c45ff42351e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98431) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 11 23:11:52.790056 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Converting VIF {"id": "852fc4ec-82e1-4185-a33c-3c45ff42351e", "address": "fa:16:3e:c6:c6:5b", "network": {"id": "2a770c99-2ec6-4fa2-945b-32830a59e7a7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-137493671-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-137493671-network", "vif_mac": "fa:16:3e:c6:c6:5b"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aaf744af828a4a5eba1e98da63373b2b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap852fc4ec-82", "ovs_interfaceid": "852fc4ec-82e1-4185-a33c-3c45ff42351e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:11:52.794828 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c6:c6:5b,bridge_name='br-int',has_traffic_filtering=True,id=852fc4ec-82e1-4185-a33c-3c45ff42351e,network=Network(2a770c99-2ec6-4fa2-945b-32830a59e7a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap852fc4ec-82') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:11:52.794828 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lazy-loading 'pci_devices' on Instance uuid c82748e6-1c78-4372-ad4b-48d1c6448efa {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:11:52.799790 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-adcba578-badf-49c1-9e9f-52ff54d62c70 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Snapshot image upload complete Jun 11 23:11:52.800813 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-adcba578-badf-49c1-9e9f-52ff54d62c70 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Took 6.98 seconds to snapshot the instance on the hypervisor. Jun 11 23:11:52.961293 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-1feaaaa0-ddd5-45de-9313-47b9291420fb tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] Acquiring lock "73abd331-0bbf-432e-be1c-308801a5429f" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:11:52.961521 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-1feaaaa0-ddd5-45de-9313-47b9291420fb tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] Lock "73abd331-0bbf-432e-be1c-308801a5429f" acquired by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:11:53.297295 np0000002687 nova-compute[98431]: DEBUG nova.objects.base [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=98431) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 11 23:11:53.298421 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] End _get_guest_xml xml= Jun 11 23:11:53.298421 np0000002687 nova-compute[98431]: c82748e6-1c78-4372-ad4b-48d1c6448efa Jun 11 23:11:53.298421 np0000002687 nova-compute[98431]: instance-0000000b Jun 11 23:11:53.298421 np0000002687 nova-compute[98431]: 196608 Jun 11 23:11:53.298421 np0000002687 nova-compute[98431]: 1 Jun 11 23:11:53.298421 np0000002687 nova-compute[98431]: Jun 11 23:11:53.298421 np0000002687 nova-compute[98431]: Jun 11 23:11:53.298421 np0000002687 nova-compute[98431]: Jun 11 23:11:53.298421 np0000002687 nova-compute[98431]: tempest-ServerBootFromVolumeStableRescueTest-server-28433977 Jun 11 23:11:53.298421 np0000002687 nova-compute[98431]: 2026-06-11 23:11:43 Jun 11 23:11:53.298421 np0000002687 nova-compute[98431]: Jun 11 23:11:53.298421 np0000002687 nova-compute[98431]: 192 Jun 11 23:11:53.298421 np0000002687 nova-compute[98431]: 1 Jun 11 23:11:53.298421 np0000002687 nova-compute[98431]: 0 Jun 11 23:11:53.298421 np0000002687 nova-compute[98431]: 0 Jun 11 23:11:53.298421 np0000002687 nova-compute[98431]: 1 Jun 11 23:11:53.298421 np0000002687 nova-compute[98431]: Jun 11 23:11:53.298421 np0000002687 nova-compute[98431]: True Jun 11 23:11:53.298421 np0000002687 nova-compute[98431]: Jun 11 23:11:53.298421 np0000002687 nova-compute[98431]: Jun 11 23:11:53.298421 np0000002687 nova-compute[98431]: Jun 11 23:11:53.298421 np0000002687 nova-compute[98431]: bare Jun 11 23:11:53.298421 np0000002687 nova-compute[98431]: qcow2 Jun 11 23:11:53.298421 np0000002687 nova-compute[98431]: 1 Jun 11 23:11:53.298421 np0000002687 nova-compute[98431]: 0 Jun 11 23:11:53.298421 np0000002687 nova-compute[98431]: Jun 11 23:11:53.298421 np0000002687 nova-compute[98431]: ide Jun 11 23:11:53.298421 np0000002687 nova-compute[98431]: virtio Jun 11 23:11:53.298421 np0000002687 nova-compute[98431]: pc Jun 11 23:11:53.298421 np0000002687 nova-compute[98431]: virtio Jun 11 23:11:53.298421 np0000002687 nova-compute[98431]: virtio Jun 11 23:11:53.298421 np0000002687 nova-compute[98431]: virtio Jun 11 23:11:53.298421 np0000002687 nova-compute[98431]: Jun 11 23:11:53.298421 np0000002687 nova-compute[98431]: Jun 11 23:11:53.298421 np0000002687 nova-compute[98431]: Jun 11 23:11:53.298421 np0000002687 nova-compute[98431]: tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member Jun 11 23:11:53.298421 np0000002687 nova-compute[98431]: tempest-ServerBootFromVolumeStableRescueTest-539499192 Jun 11 23:11:53.298421 np0000002687 nova-compute[98431]: Jun 11 23:11:53.298421 np0000002687 nova-compute[98431]: Jun 11 23:11:53.298421 np0000002687 nova-compute[98431]: Jun 11 23:11:53.298421 np0000002687 nova-compute[98431]: Jun 11 23:11:53.298421 np0000002687 nova-compute[98431]: Jun 11 23:11:53.298421 np0000002687 nova-compute[98431]: Jun 11 23:11:53.298421 np0000002687 nova-compute[98431]: Jun 11 23:11:53.298421 np0000002687 nova-compute[98431]: Jun 11 23:11:53.298421 np0000002687 nova-compute[98431]: Jun 11 23:11:53.298421 np0000002687 nova-compute[98431]: Jun 11 23:11:53.298421 np0000002687 nova-compute[98431]: Jun 11 23:11:53.298421 np0000002687 nova-compute[98431]: OpenStack Foundation Jun 11 23:11:53.298421 np0000002687 nova-compute[98431]: OpenStack Nova Jun 11 23:11:53.298421 np0000002687 nova-compute[98431]: 33.1.0 Jun 11 23:11:53.298421 np0000002687 nova-compute[98431]: c82748e6-1c78-4372-ad4b-48d1c6448efa Jun 11 23:11:53.298421 np0000002687 nova-compute[98431]: c82748e6-1c78-4372-ad4b-48d1c6448efa Jun 11 23:11:53.298421 np0000002687 nova-compute[98431]: Virtual Machine Jun 11 23:11:53.298421 np0000002687 nova-compute[98431]: Jun 11 23:11:53.298421 np0000002687 nova-compute[98431]: Jun 11 23:11:53.298421 np0000002687 nova-compute[98431]: Jun 11 23:11:53.298421 np0000002687 nova-compute[98431]: hvm Jun 11 23:11:53.298421 np0000002687 nova-compute[98431]: Jun 11 23:11:53.298421 np0000002687 nova-compute[98431]: Jun 11 23:11:53.298421 np0000002687 nova-compute[98431]: Jun 11 23:11:53.298421 np0000002687 nova-compute[98431]: Jun 11 23:11:53.298421 np0000002687 nova-compute[98431]: Jun 11 23:11:53.298421 np0000002687 nova-compute[98431]: 128 Jun 11 23:11:53.298421 np0000002687 nova-compute[98431]: Jun 11 23:11:53.298421 np0000002687 nova-compute[98431]: Jun 11 23:11:53.298421 np0000002687 nova-compute[98431]: Jun 11 23:11:53.298421 np0000002687 nova-compute[98431]: 1 Jun 11 23:11:53.298421 np0000002687 nova-compute[98431]: Jun 11 23:11:53.298421 np0000002687 nova-compute[98431]: Jun 11 23:11:53.298421 np0000002687 nova-compute[98431]: Nehalem Jun 11 23:11:53.298421 np0000002687 nova-compute[98431]: Jun 11 23:11:53.298421 np0000002687 nova-compute[98431]: Jun 11 23:11:53.298421 np0000002687 nova-compute[98431]: Jun 11 23:11:53.298421 np0000002687 nova-compute[98431]: Jun 11 23:11:53.298421 np0000002687 nova-compute[98431]: Jun 11 23:11:53.298421 np0000002687 nova-compute[98431]: Jun 11 23:11:53.298421 np0000002687 nova-compute[98431]: Jun 11 23:11:53.298421 np0000002687 nova-compute[98431]: Jun 11 23:11:53.298421 np0000002687 nova-compute[98431]: Jun 11 23:11:53.298421 np0000002687 nova-compute[98431]: Jun 11 23:11:53.298421 np0000002687 nova-compute[98431]: Jun 11 23:11:53.298421 np0000002687 nova-compute[98431]: Jun 11 23:11:53.298421 np0000002687 nova-compute[98431]: Jun 11 23:11:53.298421 np0000002687 nova-compute[98431]: 5498d0af-4b75-4132-b06e-56f2b5b013ea Jun 11 23:11:53.298421 np0000002687 nova-compute[98431]: Jun 11 23:11:53.298421 np0000002687 nova-compute[98431]: Jun 11 23:11:53.298421 np0000002687 nova-compute[98431]: Jun 11 23:11:53.298421 np0000002687 nova-compute[98431]: Jun 11 23:11:53.298421 np0000002687 nova-compute[98431]: Jun 11 23:11:53.298421 np0000002687 nova-compute[98431]: Jun 11 23:11:53.298421 np0000002687 nova-compute[98431]: Jun 11 23:11:53.298421 np0000002687 nova-compute[98431]: Jun 11 23:11:53.298421 np0000002687 nova-compute[98431]: Jun 11 23:11:53.298421 np0000002687 nova-compute[98431]: Jun 11 23:11:53.298421 np0000002687 nova-compute[98431]: Jun 11 23:11:53.298421 np0000002687 nova-compute[98431]: Jun 11 23:11:53.298421 np0000002687 nova-compute[98431]: Jun 11 23:11:53.298421 np0000002687 nova-compute[98431]: Jun 11 23:11:53.298421 np0000002687 nova-compute[98431]: Jun 11 23:11:53.298421 np0000002687 nova-compute[98431]: Jun 11 23:11:53.298421 np0000002687 nova-compute[98431]: Jun 11 23:11:53.298421 np0000002687 nova-compute[98431]: Jun 11 23:11:53.298421 np0000002687 nova-compute[98431]: Jun 11 23:11:53.298421 np0000002687 nova-compute[98431]: Jun 11 23:11:53.298421 np0000002687 nova-compute[98431]: /dev/urandom Jun 11 23:11:53.298421 np0000002687 nova-compute[98431]: Jun 11 23:11:53.298421 np0000002687 nova-compute[98431]: Jun 11 23:11:53.298421 np0000002687 nova-compute[98431]: Jun 11 23:11:53.298421 np0000002687 nova-compute[98431]: Jun 11 23:11:53.298421 np0000002687 nova-compute[98431]: Jun 11 23:11:53.298421 np0000002687 nova-compute[98431]: Jun 11 23:11:53.298421 np0000002687 nova-compute[98431]: Jun 11 23:11:53.298421 np0000002687 nova-compute[98431]: {{(pid=98431) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 11 23:11:53.302075 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [-] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Instance destroyed successfully. Jun 11 23:11:53.341364 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.iscsi [None req-4a646a8c-ec60-4c89-8400-a6995b91f1d7 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 11 23:11:53.346965 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.iscsi [None req-4a646a8c-ec60-4c89-8400-a6995b91f1d7 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 11 23:11:53.355835 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a646a8c-ec60-4c89-8400-a6995b91f1d7 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 11 23:11:53.355835 np0000002687 nova-compute[98431]: node.name = iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce Jun 11 23:11:53.355835 np0000002687 nova-compute[98431]: node.tpgt = -1 Jun 11 23:11:53.355835 np0000002687 nova-compute[98431]: node.startup = manual Jun 11 23:11:53.355835 np0000002687 nova-compute[98431]: node.leading_login = No Jun 11 23:11:53.355835 np0000002687 nova-compute[98431]: iface.iscsi_ifacename = default Jun 11 23:11:53.355835 np0000002687 nova-compute[98431]: iface.net_ifacename = Jun 11 23:11:53.355835 np0000002687 nova-compute[98431]: iface.ipaddress = Jun 11 23:11:53.355835 np0000002687 nova-compute[98431]: iface.prefix_len = 0 Jun 11 23:11:53.355835 np0000002687 nova-compute[98431]: iface.hwaddress = Jun 11 23:11:53.355835 np0000002687 nova-compute[98431]: iface.transport_name = tcp Jun 11 23:11:53.355835 np0000002687 nova-compute[98431]: iface.initiatorname = Jun 11 23:11:53.355835 np0000002687 nova-compute[98431]: iface.state = Jun 11 23:11:53.355835 np0000002687 nova-compute[98431]: iface.vlan_id = 0 Jun 11 23:11:53.355835 np0000002687 nova-compute[98431]: iface.vlan_priority = 0 Jun 11 23:11:53.355835 np0000002687 nova-compute[98431]: iface.vlan_state = Jun 11 23:11:53.355835 np0000002687 nova-compute[98431]: iface.iface_num = 0 Jun 11 23:11:53.355835 np0000002687 nova-compute[98431]: iface.mtu = 0 Jun 11 23:11:53.355835 np0000002687 nova-compute[98431]: iface.port = 0 Jun 11 23:11:53.355835 np0000002687 nova-compute[98431]: iface.bootproto = Jun 11 23:11:53.355835 np0000002687 nova-compute[98431]: iface.subnet_mask = Jun 11 23:11:53.355835 np0000002687 nova-compute[98431]: iface.gateway = Jun 11 23:11:53.355835 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id_state = Jun 11 23:11:53.355835 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id = Jun 11 23:11:53.355835 np0000002687 nova-compute[98431]: iface.dhcp_dns = Jun 11 23:11:53.355835 np0000002687 nova-compute[98431]: iface.dhcp_learn_iqn = Jun 11 23:11:53.355835 np0000002687 nova-compute[98431]: iface.dhcp_req_vendor_id_state = Jun 11 23:11:53.355835 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id_state = Jun 11 23:11:53.355835 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id = Jun 11 23:11:53.355835 np0000002687 nova-compute[98431]: iface.dhcp_slp_da = Jun 11 23:11:53.355835 np0000002687 nova-compute[98431]: iface.fragmentation = Jun 11 23:11:53.355835 np0000002687 nova-compute[98431]: iface.gratuitous_arp = Jun 11 23:11:53.355835 np0000002687 nova-compute[98431]: iface.incoming_forwarding = Jun 11 23:11:53.355835 np0000002687 nova-compute[98431]: iface.tos_state = Jun 11 23:11:53.355835 np0000002687 nova-compute[98431]: iface.tos = 0 Jun 11 23:11:53.355835 np0000002687 nova-compute[98431]: iface.ttl = 0 Jun 11 23:11:53.355835 np0000002687 nova-compute[98431]: iface.delayed_ack = Jun 11 23:11:53.355835 np0000002687 nova-compute[98431]: iface.tcp_nagle = Jun 11 23:11:53.355835 np0000002687 nova-compute[98431]: iface.tcp_wsf_state = Jun 11 23:11:53.355835 np0000002687 nova-compute[98431]: iface.tcp_wsf = 0 Jun 11 23:11:53.355835 np0000002687 nova-compute[98431]: iface.tcp_timer_scale = 0 Jun 11 23:11:53.355835 np0000002687 nova-compute[98431]: iface.tcp_timestamp = Jun 11 23:11:53.355835 np0000002687 nova-compute[98431]: iface.redirect = Jun 11 23:11:53.355835 np0000002687 nova-compute[98431]: iface.def_task_mgmt_timeout = 0 Jun 11 23:11:53.355835 np0000002687 nova-compute[98431]: iface.header_digest = Jun 11 23:11:53.355835 np0000002687 nova-compute[98431]: iface.data_digest = Jun 11 23:11:53.355835 np0000002687 nova-compute[98431]: iface.immediate_data = Jun 11 23:11:53.355835 np0000002687 nova-compute[98431]: iface.initial_r2t = Jun 11 23:11:53.355835 np0000002687 nova-compute[98431]: iface.data_seq_inorder = Jun 11 23:11:53.355835 np0000002687 nova-compute[98431]: iface.data_pdu_inorder = Jun 11 23:11:53.355835 np0000002687 nova-compute[98431]: iface.erl = 0 Jun 11 23:11:53.355835 np0000002687 nova-compute[98431]: iface.max_receive_data_len = 0 Jun 11 23:11:53.355835 np0000002687 nova-compute[98431]: iface.first_burst_len = 0 Jun 11 23:11:53.355835 np0000002687 nova-compute[98431]: iface.max_outstanding_r2t = 0 Jun 11 23:11:53.355835 np0000002687 nova-compute[98431]: iface.max_burst_len = 0 Jun 11 23:11:53.355835 np0000002687 nova-compute[98431]: iface.chap_auth = Jun 11 23:11:53.355835 np0000002687 nova-compute[98431]: iface.bidi_chap = Jun 11 23:11:53.355835 np0000002687 nova-compute[98431]: iface.strict_login_compliance = Jun 11 23:11:53.355835 np0000002687 nova-compute[98431]: iface.discovery_auth = Jun 11 23:11:53.355835 np0000002687 nova-compute[98431]: iface.discovery_logout = Jun 11 23:11:53.355835 np0000002687 nova-compute[98431]: node.discovery_address = Jun 11 23:11:53.355835 np0000002687 nova-compute[98431]: node.discovery_port = 0 Jun 11 23:11:53.355835 np0000002687 nova-compute[98431]: node.discovery_type = fw Jun 11 23:11:53.355835 np0000002687 nova-compute[98431]: node.session.initial_cmdsn = 0 Jun 11 23:11:53.355835 np0000002687 nova-compute[98431]: node.session.initial_login_retry_max = 8 Jun 11 23:11:53.355835 np0000002687 nova-compute[98431]: node.session.xmit_thread_priority = 0 Jun 11 23:11:53.355835 np0000002687 nova-compute[98431]: node.session.cmds_max = 128 Jun 11 23:11:53.355835 np0000002687 nova-compute[98431]: node.session.queue_depth = 32 Jun 11 23:11:53.355835 np0000002687 nova-compute[98431]: node.session.nr_sessions = 1 Jun 11 23:11:53.355835 np0000002687 nova-compute[98431]: node.session.auth.authmethod = None Jun 11 23:11:53.355835 np0000002687 nova-compute[98431]: node.session.auth.username = Jun 11 23:11:53.355835 np0000002687 nova-compute[98431]: node.session.auth.password = *** Jun 11 23:11:53.355835 np0000002687 nova-compute[98431]: node.session.auth.username_in = Jun 11 23:11:53.355835 np0000002687 nova-compute[98431]: node.session.auth.password_in = Jun 11 23:11:53.355835 np0000002687 nova-compute[98431]: node.session.auth.chap_algs = SHA256 Jun 11 23:11:53.355835 np0000002687 nova-compute[98431]: node.session.timeo.replacement_timeout = 120 Jun 11 23:11:53.355835 np0000002687 nova-compute[98431]: node.session.err_timeo.abort_timeout = 15 Jun 11 23:11:53.355835 np0000002687 nova-compute[98431]: node.session.err_timeo.lu_reset_timeout = 30 Jun 11 23:11:53.355835 np0000002687 nova-compute[98431]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 11 23:11:53.355835 np0000002687 nova-compute[98431]: node.session.err_timeo.host_reset_timeout = 60 Jun 11 23:11:53.355835 np0000002687 nova-compute[98431]: node.session.iscsi.FastAbort = Yes Jun 11 23:11:53.355835 np0000002687 nova-compute[98431]: node.session.iscsi.InitialR2T = No Jun 11 23:11:53.355835 np0000002687 nova-compute[98431]: node.session.iscsi.ImmediateData = Yes Jun 11 23:11:53.355835 np0000002687 nova-compute[98431]: node.session.iscsi.FirstBurstLength = 262144 Jun 11 23:11:53.355835 np0000002687 nova-compute[98431]: node.session.iscsi.MaxBurstLength = 16776192 Jun 11 23:11:53.355835 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Retain = 0 Jun 11 23:11:53.355835 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Wait = 2 Jun 11 23:11:53.355835 np0000002687 nova-compute[98431]: node.session.iscsi.MaxConnections = 1 Jun 11 23:11:53.355835 np0000002687 nova-compute[98431]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 11 23:11:53.355835 np0000002687 nova-compute[98431]: node.session.iscsi.ERL = 0 Jun 11 23:11:53.355835 np0000002687 nova-compute[98431]: node.session.scan = auto Jun 11 23:11:53.355835 np0000002687 nova-compute[98431]: node.session.reopen_max = 0 Jun 11 23:11:53.355835 np0000002687 nova-compute[98431]: node.conn[0].address = 192.168.40.100 Jun 11 23:11:53.355835 np0000002687 nova-compute[98431]: node.conn[0].port = 3260 Jun 11 23:11:53.355835 np0000002687 nova-compute[98431]: node.conn[0].startup = manual Jun 11 23:11:53.355835 np0000002687 nova-compute[98431]: node.conn[0].tcp.window_size = 524288 Jun 11 23:11:53.355835 np0000002687 nova-compute[98431]: node.conn[0].tcp.type_of_service = 0 Jun 11 23:11:53.355835 np0000002687 nova-compute[98431]: node.conn[0].timeo.logout_timeout = 15 Jun 11 23:11:53.355835 np0000002687 nova-compute[98431]: node.conn[0].timeo.login_timeout = 15 Jun 11 23:11:53.355835 np0000002687 nova-compute[98431]: node.conn[0].timeo.auth_timeout = 45 Jun 11 23:11:53.355835 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_interval = 5 Jun 11 23:11:53.355835 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_timeout = 5 Jun 11 23:11:53.355835 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 11 23:11:53.355835 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 11 23:11:53.355835 np0000002687 nova-compute[98431]: node.conn[0].iscsi.HeaderDigest = None Jun 11 23:11:53.355835 np0000002687 nova-compute[98431]: node.conn[0].iscsi.DataDigest = None Jun 11 23:11:53.355835 np0000002687 nova-compute[98431]: node.conn[0].iscsi.IFMarker = No Jun 11 23:11:53.355835 np0000002687 nova-compute[98431]: node.conn[0].iscsi.OFMarker = No Jun 11 23:11:53.355835 np0000002687 nova-compute[98431]: # END RECORD Jun 11 23:11:53.355835 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:53.366453 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a646a8c-ec60-4c89-8400-a6995b91f1d7 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 11 23:11:53.366453 np0000002687 nova-compute[98431]: node.name = iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce Jun 11 23:11:53.366453 np0000002687 nova-compute[98431]: node.tpgt = -1 Jun 11 23:11:53.366453 np0000002687 nova-compute[98431]: node.startup = manual Jun 11 23:11:53.366453 np0000002687 nova-compute[98431]: node.leading_login = No Jun 11 23:11:53.366453 np0000002687 nova-compute[98431]: iface.iscsi_ifacename = default Jun 11 23:11:53.366453 np0000002687 nova-compute[98431]: iface.net_ifacename = Jun 11 23:11:53.366453 np0000002687 nova-compute[98431]: iface.ipaddress = Jun 11 23:11:53.366453 np0000002687 nova-compute[98431]: iface.prefix_len = 0 Jun 11 23:11:53.366453 np0000002687 nova-compute[98431]: iface.hwaddress = Jun 11 23:11:53.366453 np0000002687 nova-compute[98431]: iface.transport_name = tcp Jun 11 23:11:53.366453 np0000002687 nova-compute[98431]: iface.initiatorname = Jun 11 23:11:53.366453 np0000002687 nova-compute[98431]: iface.state = Jun 11 23:11:53.366453 np0000002687 nova-compute[98431]: iface.vlan_id = 0 Jun 11 23:11:53.366453 np0000002687 nova-compute[98431]: iface.vlan_priority = 0 Jun 11 23:11:53.366453 np0000002687 nova-compute[98431]: iface.vlan_state = Jun 11 23:11:53.366453 np0000002687 nova-compute[98431]: iface.iface_num = 0 Jun 11 23:11:53.366453 np0000002687 nova-compute[98431]: iface.mtu = 0 Jun 11 23:11:53.366453 np0000002687 nova-compute[98431]: iface.port = 0 Jun 11 23:11:53.366453 np0000002687 nova-compute[98431]: iface.bootproto = Jun 11 23:11:53.366453 np0000002687 nova-compute[98431]: iface.subnet_mask = Jun 11 23:11:53.366453 np0000002687 nova-compute[98431]: iface.gateway = Jun 11 23:11:53.366453 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id_state = Jun 11 23:11:53.366453 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id = Jun 11 23:11:53.366453 np0000002687 nova-compute[98431]: iface.dhcp_dns = Jun 11 23:11:53.366453 np0000002687 nova-compute[98431]: iface.dhcp_learn_iqn = Jun 11 23:11:53.366453 np0000002687 nova-compute[98431]: iface.dhcp_req_vendor_id_state = Jun 11 23:11:53.366453 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id_state = Jun 11 23:11:53.366453 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id = Jun 11 23:11:53.366453 np0000002687 nova-compute[98431]: iface.dhcp_slp_da = Jun 11 23:11:53.366453 np0000002687 nova-compute[98431]: iface.fragmentation = Jun 11 23:11:53.366453 np0000002687 nova-compute[98431]: iface.gratuitous_arp = Jun 11 23:11:53.366453 np0000002687 nova-compute[98431]: iface.incoming_forwarding = Jun 11 23:11:53.366453 np0000002687 nova-compute[98431]: iface.tos_state = Jun 11 23:11:53.366453 np0000002687 nova-compute[98431]: iface.tos = 0 Jun 11 23:11:53.366453 np0000002687 nova-compute[98431]: iface.ttl = 0 Jun 11 23:11:53.366453 np0000002687 nova-compute[98431]: iface.delayed_ack = Jun 11 23:11:53.366453 np0000002687 nova-compute[98431]: iface.tcp_nagle = Jun 11 23:11:53.366453 np0000002687 nova-compute[98431]: iface.tcp_wsf_state = Jun 11 23:11:53.366453 np0000002687 nova-compute[98431]: iface.tcp_wsf = 0 Jun 11 23:11:53.366453 np0000002687 nova-compute[98431]: iface.tcp_timer_scale = 0 Jun 11 23:11:53.366453 np0000002687 nova-compute[98431]: iface.tcp_timestamp = Jun 11 23:11:53.366453 np0000002687 nova-compute[98431]: iface.redirect = Jun 11 23:11:53.366453 np0000002687 nova-compute[98431]: iface.def_task_mgmt_timeout = 0 Jun 11 23:11:53.366453 np0000002687 nova-compute[98431]: iface.header_digest = Jun 11 23:11:53.366453 np0000002687 nova-compute[98431]: iface.data_digest = Jun 11 23:11:53.366453 np0000002687 nova-compute[98431]: iface.immediate_data = Jun 11 23:11:53.366453 np0000002687 nova-compute[98431]: iface.initial_r2t = Jun 11 23:11:53.366453 np0000002687 nova-compute[98431]: iface.data_seq_inorder = Jun 11 23:11:53.366453 np0000002687 nova-compute[98431]: iface.data_pdu_inorder = Jun 11 23:11:53.366453 np0000002687 nova-compute[98431]: iface.erl = 0 Jun 11 23:11:53.366453 np0000002687 nova-compute[98431]: iface.max_receive_data_len = 0 Jun 11 23:11:53.366453 np0000002687 nova-compute[98431]: iface.first_burst_len = 0 Jun 11 23:11:53.366453 np0000002687 nova-compute[98431]: iface.max_outstanding_r2t = 0 Jun 11 23:11:53.366453 np0000002687 nova-compute[98431]: iface.max_burst_len = 0 Jun 11 23:11:53.366453 np0000002687 nova-compute[98431]: iface.chap_auth = Jun 11 23:11:53.366453 np0000002687 nova-compute[98431]: iface.bidi_chap = Jun 11 23:11:53.366453 np0000002687 nova-compute[98431]: iface.strict_login_compliance = Jun 11 23:11:53.366453 np0000002687 nova-compute[98431]: iface.discovery_auth = Jun 11 23:11:53.366453 np0000002687 nova-compute[98431]: iface.discovery_logout = Jun 11 23:11:53.366453 np0000002687 nova-compute[98431]: node.discovery_address = Jun 11 23:11:53.366453 np0000002687 nova-compute[98431]: node.discovery_port = 0 Jun 11 23:11:53.366453 np0000002687 nova-compute[98431]: node.discovery_type = fw Jun 11 23:11:53.366453 np0000002687 nova-compute[98431]: node.session.initial_cmdsn = 0 Jun 11 23:11:53.366453 np0000002687 nova-compute[98431]: node.session.initial_login_retry_max = 8 Jun 11 23:11:53.366453 np0000002687 nova-compute[98431]: node.session.xmit_thread_priority = 0 Jun 11 23:11:53.366453 np0000002687 nova-compute[98431]: node.session.cmds_max = 128 Jun 11 23:11:53.366453 np0000002687 nova-compute[98431]: node.session.queue_depth = 32 Jun 11 23:11:53.366453 np0000002687 nova-compute[98431]: node.session.nr_sessions = 1 Jun 11 23:11:53.366453 np0000002687 nova-compute[98431]: node.session.auth.authmethod = None Jun 11 23:11:53.366453 np0000002687 nova-compute[98431]: node.session.auth.username = Jun 11 23:11:53.366453 np0000002687 nova-compute[98431]: node.session.auth.password = *** Jun 11 23:11:53.366453 np0000002687 nova-compute[98431]: node.session.auth.username_in = Jun 11 23:11:53.366453 np0000002687 nova-compute[98431]: node.session.auth.password_in = Jun 11 23:11:53.366453 np0000002687 nova-compute[98431]: node.session.auth.chap_algs = SHA256 Jun 11 23:11:53.366453 np0000002687 nova-compute[98431]: node.session.timeo.replacement_timeout = 120 Jun 11 23:11:53.366453 np0000002687 nova-compute[98431]: node.session.err_timeo.abort_timeout = 15 Jun 11 23:11:53.366453 np0000002687 nova-compute[98431]: node.session.err_timeo.lu_reset_timeout = 30 Jun 11 23:11:53.366453 np0000002687 nova-compute[98431]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 11 23:11:53.366453 np0000002687 nova-compute[98431]: node.session.err_timeo.host_reset_timeout = 60 Jun 11 23:11:53.366453 np0000002687 nova-compute[98431]: node.session.iscsi.FastAbort = Yes Jun 11 23:11:53.366453 np0000002687 nova-compute[98431]: node.session.iscsi.InitialR2T = No Jun 11 23:11:53.366453 np0000002687 nova-compute[98431]: node.session.iscsi.ImmediateData = Yes Jun 11 23:11:53.366453 np0000002687 nova-compute[98431]: node.session.iscsi.FirstBurstLength = 262144 Jun 11 23:11:53.366453 np0000002687 nova-compute[98431]: node.session.iscsi.MaxBurstLength = 16776192 Jun 11 23:11:53.366453 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Retain = 0 Jun 11 23:11:53.366453 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Wait = 2 Jun 11 23:11:53.366453 np0000002687 nova-compute[98431]: node.session.iscsi.MaxConnections = 1 Jun 11 23:11:53.366453 np0000002687 nova-compute[98431]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 11 23:11:53.366453 np0000002687 nova-compute[98431]: node.session.iscsi.ERL = 0 Jun 11 23:11:53.366453 np0000002687 nova-compute[98431]: node.session.scan = auto Jun 11 23:11:53.366453 np0000002687 nova-compute[98431]: node.session.reopen_max = 0 Jun 11 23:11:53.366453 np0000002687 nova-compute[98431]: node.conn[0].address = 192.168.50.100 Jun 11 23:11:53.366453 np0000002687 nova-compute[98431]: node.conn[0].port = 3260 Jun 11 23:11:53.366453 np0000002687 nova-compute[98431]: node.conn[0].startup = manual Jun 11 23:11:53.366453 np0000002687 nova-compute[98431]: node.conn[0].tcp.window_size = 524288 Jun 11 23:11:53.366453 np0000002687 nova-compute[98431]: node.conn[0].tcp.type_of_service = 0 Jun 11 23:11:53.366453 np0000002687 nova-compute[98431]: node.conn[0].timeo.logout_timeout = 15 Jun 11 23:11:53.366453 np0000002687 nova-compute[98431]: node.conn[0].timeo.login_timeout = 15 Jun 11 23:11:53.366453 np0000002687 nova-compute[98431]: node.conn[0].timeo.auth_timeout = 45 Jun 11 23:11:53.366453 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_interval = 5 Jun 11 23:11:53.366453 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_timeout = 5 Jun 11 23:11:53.366453 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 11 23:11:53.366453 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 11 23:11:53.366453 np0000002687 nova-compute[98431]: node.conn[0].iscsi.HeaderDigest = None Jun 11 23:11:53.366453 np0000002687 nova-compute[98431]: node.conn[0].iscsi.DataDigest = None Jun 11 23:11:53.366453 np0000002687 nova-compute[98431]: node.conn[0].iscsi.IFMarker = No Jun 11 23:11:53.366453 np0000002687 nova-compute[98431]: node.conn[0].iscsi.OFMarker = No Jun 11 23:11:53.366453 np0000002687 nova-compute[98431]: # END RECORD Jun 11 23:11:53.366453 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:53.369089 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a646a8c-ec60-4c89-8400-a6995b91f1d7 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:53.384383 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a646a8c-ec60-4c89-8400-a6995b91f1d7 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:53.407071 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a646a8c-ec60-4c89-8400-a6995b91f1d7 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:53.407071 np0000002687 nova-compute[98431]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:11:53.407071 np0000002687 nova-compute[98431]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:11:53.407071 np0000002687 nova-compute[98431]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:11:53.407071 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:11:53.407071 np0000002687 nova-compute[98431]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6eb3ee75-92d8-430f-86ea-31edf88d1ae8 (non-flash) Jun 11 23:11:53.407071 np0000002687 nova-compute[98431]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6eb3ee75-92d8-430f-86ea-31edf88d1ae8 (non-flash) Jun 11 23:11:53.407071 np0000002687 nova-compute[98431]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6e44a36-048b-41a3-8639-4ee7e1b0122f (non-flash) Jun 11 23:11:53.407071 np0000002687 nova-compute[98431]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6e44a36-048b-41a3-8639-4ee7e1b0122f (non-flash) Jun 11 23:11:53.407071 np0000002687 nova-compute[98431]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8 (non-flash) Jun 11 23:11:53.407071 np0000002687 nova-compute[98431]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8 (non-flash) Jun 11 23:11:53.407071 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:53.407071 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:53.407071 np0000002687 nova-compute[98431]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:53.407071 np0000002687 nova-compute[98431]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:53.407071 np0000002687 nova-compute[98431]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:53.407071 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:11:53.407467 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a646a8c-ec60-4c89-8400-a6995b91f1d7 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:53.407467 np0000002687 nova-compute[98431]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:11:53.407467 np0000002687 nova-compute[98431]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:11:53.407467 np0000002687 nova-compute[98431]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:11:53.407467 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:11:53.407467 np0000002687 nova-compute[98431]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6eb3ee75-92d8-430f-86ea-31edf88d1ae8 (non-flash) Jun 11 23:11:53.407467 np0000002687 nova-compute[98431]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6eb3ee75-92d8-430f-86ea-31edf88d1ae8 (non-flash) Jun 11 23:11:53.407467 np0000002687 nova-compute[98431]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6e44a36-048b-41a3-8639-4ee7e1b0122f (non-flash) Jun 11 23:11:53.407467 np0000002687 nova-compute[98431]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6e44a36-048b-41a3-8639-4ee7e1b0122f (non-flash) Jun 11 23:11:53.407467 np0000002687 nova-compute[98431]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8 (non-flash) Jun 11 23:11:53.407467 np0000002687 nova-compute[98431]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8 (non-flash) Jun 11 23:11:53.407467 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:53.407467 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:53.407467 np0000002687 nova-compute[98431]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:53.407467 np0000002687 nova-compute[98431]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:53.407467 np0000002687 nova-compute[98431]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:53.407467 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:11:53.408544 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a646a8c-ec60-4c89-8400-a6995b91f1d7 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:53.408544 np0000002687 nova-compute[98431]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:11:53.408544 np0000002687 nova-compute[98431]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:11:53.408544 np0000002687 nova-compute[98431]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:11:53.408544 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:11:53.408544 np0000002687 nova-compute[98431]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6eb3ee75-92d8-430f-86ea-31edf88d1ae8 (non-flash) Jun 11 23:11:53.408544 np0000002687 nova-compute[98431]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6eb3ee75-92d8-430f-86ea-31edf88d1ae8 (non-flash) Jun 11 23:11:53.408544 np0000002687 nova-compute[98431]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6e44a36-048b-41a3-8639-4ee7e1b0122f (non-flash) Jun 11 23:11:53.408544 np0000002687 nova-compute[98431]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6e44a36-048b-41a3-8639-4ee7e1b0122f (non-flash) Jun 11 23:11:53.408544 np0000002687 nova-compute[98431]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8 (non-flash) Jun 11 23:11:53.408544 np0000002687 nova-compute[98431]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8 (non-flash) Jun 11 23:11:53.408544 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:53.408544 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:53.408544 np0000002687 nova-compute[98431]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:53.408544 np0000002687 nova-compute[98431]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:53.408544 np0000002687 nova-compute[98431]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:53.408544 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:11:53.408928 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a646a8c-ec60-4c89-8400-a6995b91f1d7 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:53.408928 np0000002687 nova-compute[98431]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:11:53.408928 np0000002687 nova-compute[98431]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:11:53.408928 np0000002687 nova-compute[98431]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:11:53.408928 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:11:53.408928 np0000002687 nova-compute[98431]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6eb3ee75-92d8-430f-86ea-31edf88d1ae8 (non-flash) Jun 11 23:11:53.408928 np0000002687 nova-compute[98431]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6eb3ee75-92d8-430f-86ea-31edf88d1ae8 (non-flash) Jun 11 23:11:53.408928 np0000002687 nova-compute[98431]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6e44a36-048b-41a3-8639-4ee7e1b0122f (non-flash) Jun 11 23:11:53.408928 np0000002687 nova-compute[98431]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6e44a36-048b-41a3-8639-4ee7e1b0122f (non-flash) Jun 11 23:11:53.408928 np0000002687 nova-compute[98431]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8 (non-flash) Jun 11 23:11:53.408928 np0000002687 nova-compute[98431]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8 (non-flash) Jun 11 23:11:53.408928 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:53.408928 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:53.408928 np0000002687 nova-compute[98431]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:53.408928 np0000002687 nova-compute[98431]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:53.408928 np0000002687 nova-compute[98431]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:53.408928 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:11:53.469593 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-1feaaaa0-ddd5-45de-9313-47b9291420fb tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] [instance: 73abd331-0bbf-432e-be1c-308801a5429f] Detaching volume b6e44a36-048b-41a3-8639-4ee7e1b0122f Jun 11 23:11:53.486016 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a646a8c-ec60-4c89-8400-a6995b91f1d7 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce, portal: 192.168.50.100,3260] Jun 11 23:11:53.486016 np0000002687 nova-compute[98431]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce, portal: 192.168.50.100,3260] successful. Jun 11 23:11:53.486016 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:53.486851 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a646a8c-ec60-4c89-8400-a6995b91f1d7 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce, portal: 192.168.40.100,3260] Jun 11 23:11:53.486851 np0000002687 nova-compute[98431]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce, portal: 192.168.40.100,3260] successful. Jun 11 23:11:53.486851 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:53.503213 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a646a8c-ec60-4c89-8400-a6995b91f1d7 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:53.507668 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a646a8c-ec60-4c89-8400-a6995b91f1d7 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:53.529079 np0000002687 nova-compute[98431]: INFO nova.virt.block_device [None req-1feaaaa0-ddd5-45de-9313-47b9291420fb tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] [instance: 73abd331-0bbf-432e-be1c-308801a5429f] Attempting to driver detach volume b6e44a36-048b-41a3-8639-4ee7e1b0122f from mountpoint /dev/vdb Jun 11 23:11:53.530226 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a646a8c-ec60-4c89-8400-a6995b91f1d7 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:53.530226 np0000002687 nova-compute[98431]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:11:53.530226 np0000002687 nova-compute[98431]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:11:53.530226 np0000002687 nova-compute[98431]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:11:53.530226 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:11:53.530226 np0000002687 nova-compute[98431]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6eb3ee75-92d8-430f-86ea-31edf88d1ae8 (non-flash) Jun 11 23:11:53.530226 np0000002687 nova-compute[98431]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6eb3ee75-92d8-430f-86ea-31edf88d1ae8 (non-flash) Jun 11 23:11:53.530226 np0000002687 nova-compute[98431]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6e44a36-048b-41a3-8639-4ee7e1b0122f (non-flash) Jun 11 23:11:53.530226 np0000002687 nova-compute[98431]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6e44a36-048b-41a3-8639-4ee7e1b0122f (non-flash) Jun 11 23:11:53.530226 np0000002687 nova-compute[98431]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8 (non-flash) Jun 11 23:11:53.530226 np0000002687 nova-compute[98431]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8 (non-flash) Jun 11 23:11:53.530226 np0000002687 nova-compute[98431]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce (non-flash) Jun 11 23:11:53.530226 np0000002687 nova-compute[98431]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce (non-flash) Jun 11 23:11:53.530226 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:53.530226 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:53.530226 np0000002687 nova-compute[98431]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:53.530226 np0000002687 nova-compute[98431]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:53.530226 np0000002687 nova-compute[98431]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:53.530226 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:11:53.531199 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a646a8c-ec60-4c89-8400-a6995b91f1d7 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:53.531199 np0000002687 nova-compute[98431]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:11:53.531199 np0000002687 nova-compute[98431]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:11:53.531199 np0000002687 nova-compute[98431]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:11:53.531199 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:11:53.531199 np0000002687 nova-compute[98431]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6eb3ee75-92d8-430f-86ea-31edf88d1ae8 (non-flash) Jun 11 23:11:53.531199 np0000002687 nova-compute[98431]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6eb3ee75-92d8-430f-86ea-31edf88d1ae8 (non-flash) Jun 11 23:11:53.531199 np0000002687 nova-compute[98431]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6e44a36-048b-41a3-8639-4ee7e1b0122f (non-flash) Jun 11 23:11:53.531199 np0000002687 nova-compute[98431]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6e44a36-048b-41a3-8639-4ee7e1b0122f (non-flash) Jun 11 23:11:53.531199 np0000002687 nova-compute[98431]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8 (non-flash) Jun 11 23:11:53.531199 np0000002687 nova-compute[98431]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8 (non-flash) Jun 11 23:11:53.531199 np0000002687 nova-compute[98431]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce (non-flash) Jun 11 23:11:53.531199 np0000002687 nova-compute[98431]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce (non-flash) Jun 11 23:11:53.531199 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:53.531199 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:53.531199 np0000002687 nova-compute[98431]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:53.531199 np0000002687 nova-compute[98431]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:53.531199 np0000002687 nova-compute[98431]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:53.531199 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:11:53.532076 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-4a646a8c-ec60-4c89-8400-a6995b91f1d7 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.228s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 11 23:11:53.532076 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a646a8c-ec60-4c89-8400-a6995b91f1d7 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Connected to 192.168.50.100:3260 {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 11 23:11:53.534820 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a646a8c-ec60-4c89-8400-a6995b91f1d7 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:53.534820 np0000002687 nova-compute[98431]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:11:53.534820 np0000002687 nova-compute[98431]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:11:53.534820 np0000002687 nova-compute[98431]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:11:53.534820 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:11:53.534820 np0000002687 nova-compute[98431]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6eb3ee75-92d8-430f-86ea-31edf88d1ae8 (non-flash) Jun 11 23:11:53.534820 np0000002687 nova-compute[98431]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6eb3ee75-92d8-430f-86ea-31edf88d1ae8 (non-flash) Jun 11 23:11:53.534820 np0000002687 nova-compute[98431]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6e44a36-048b-41a3-8639-4ee7e1b0122f (non-flash) Jun 11 23:11:53.534820 np0000002687 nova-compute[98431]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6e44a36-048b-41a3-8639-4ee7e1b0122f (non-flash) Jun 11 23:11:53.534820 np0000002687 nova-compute[98431]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8 (non-flash) Jun 11 23:11:53.534820 np0000002687 nova-compute[98431]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8 (non-flash) Jun 11 23:11:53.534820 np0000002687 nova-compute[98431]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce (non-flash) Jun 11 23:11:53.534820 np0000002687 nova-compute[98431]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce (non-flash) Jun 11 23:11:53.534820 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:53.534820 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:53.534820 np0000002687 nova-compute[98431]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:53.534820 np0000002687 nova-compute[98431]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:53.534820 np0000002687 nova-compute[98431]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:53.534820 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:11:53.535336 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a646a8c-ec60-4c89-8400-a6995b91f1d7 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:53.535336 np0000002687 nova-compute[98431]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:11:53.535336 np0000002687 nova-compute[98431]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:11:53.535336 np0000002687 nova-compute[98431]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:11:53.535336 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:11:53.535336 np0000002687 nova-compute[98431]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6eb3ee75-92d8-430f-86ea-31edf88d1ae8 (non-flash) Jun 11 23:11:53.535336 np0000002687 nova-compute[98431]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6eb3ee75-92d8-430f-86ea-31edf88d1ae8 (non-flash) Jun 11 23:11:53.535336 np0000002687 nova-compute[98431]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6e44a36-048b-41a3-8639-4ee7e1b0122f (non-flash) Jun 11 23:11:53.535336 np0000002687 nova-compute[98431]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6e44a36-048b-41a3-8639-4ee7e1b0122f (non-flash) Jun 11 23:11:53.535336 np0000002687 nova-compute[98431]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8 (non-flash) Jun 11 23:11:53.535336 np0000002687 nova-compute[98431]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8 (non-flash) Jun 11 23:11:53.535336 np0000002687 nova-compute[98431]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce (non-flash) Jun 11 23:11:53.535336 np0000002687 nova-compute[98431]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce (non-flash) Jun 11 23:11:53.535336 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:53.535336 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:53.535336 np0000002687 nova-compute[98431]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:53.535336 np0000002687 nova-compute[98431]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:53.535336 np0000002687 nova-compute[98431]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:53.535336 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:11:53.535336 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-4a646a8c-ec60-4c89-8400-a6995b91f1d7 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.233s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 11 23:11:53.535336 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a646a8c-ec60-4c89-8400-a6995b91f1d7 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Connected to 192.168.40.100:3260 {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 11 23:11:53.536236 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-1feaaaa0-ddd5-45de-9313-47b9291420fb tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] Found disk vdb by alias ua-b6e44a36-048b-41a3-8639-4ee7e1b0122f {{(pid=98431) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}} Jun 11 23:11:53.539326 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-1feaaaa0-ddd5-45de-9313-47b9291420fb tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] Found disk vdb by alias ua-b6e44a36-048b-41a3-8639-4ee7e1b0122f {{(pid=98431) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}} Jun 11 23:11:53.539608 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-1feaaaa0-ddd5-45de-9313-47b9291420fb tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] Attempting to detach device vdb from instance 73abd331-0bbf-432e-be1c-308801a5429f from the persistent domain config. {{(pid=98431) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}} Jun 11 23:11:53.539855 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.guest [None req-1feaaaa0-ddd5-45de-9313-47b9291420fb tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] detach device xml: Jun 11 23:11:53.539855 np0000002687 nova-compute[98431]: Jun 11 23:11:53.539855 np0000002687 nova-compute[98431]: Jun 11 23:11:53.539855 np0000002687 nova-compute[98431]: Jun 11 23:11:53.539855 np0000002687 nova-compute[98431]: Jun 11 23:11:53.539855 np0000002687 nova-compute[98431]: b6e44a36-048b-41a3-8639-4ee7e1b0122f Jun 11 23:11:53.539855 np0000002687 nova-compute[98431]:
Jun 11 23:11:53.539855 np0000002687 nova-compute[98431]: Jun 11 23:11:53.539855 np0000002687 nova-compute[98431]: {{(pid=98431) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jun 11 23:11:53.542958 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-4a646a8c-ec60-4c89-8400-a6995b91f1d7 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] HCTL ('23', '-', '-', 0) found on session 21 with lun 0 {{(pid=98431) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 11 23:11:53.542958 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-4a646a8c-ec60-4c89-8400-a6995b91f1d7 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Scanning host 23 c: -, t: -, l: 0) {{(pid=98431) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 11 23:11:53.543631 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-4a646a8c-ec60-4c89-8400-a6995b91f1d7 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] HCTL ('24', '-', '-', 0) found on session 22 with lun 0 {{(pid=98431) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 11 23:11:53.543840 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-4a646a8c-ec60-4c89-8400-a6995b91f1d7 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Scanning host 24 c: -, t: -, l: 0) {{(pid=98431) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 11 23:11:53.553157 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-1feaaaa0-ddd5-45de-9313-47b9291420fb tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] Successfully detached device vdb from instance 73abd331-0bbf-432e-be1c-308801a5429f from the persistent domain config. Jun 11 23:11:53.553363 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-1feaaaa0-ddd5-45de-9313-47b9291420fb tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] (1/8): Attempting to detach device vdb with device alias ua-b6e44a36-048b-41a3-8639-4ee7e1b0122f from instance 73abd331-0bbf-432e-be1c-308801a5429f from the live domain config. {{(pid=98431) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}} Jun 11 23:11:53.553713 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.guest [None req-1feaaaa0-ddd5-45de-9313-47b9291420fb tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] detach device xml: Jun 11 23:11:53.553713 np0000002687 nova-compute[98431]: Jun 11 23:11:53.553713 np0000002687 nova-compute[98431]: Jun 11 23:11:53.553713 np0000002687 nova-compute[98431]: Jun 11 23:11:53.553713 np0000002687 nova-compute[98431]: Jun 11 23:11:53.553713 np0000002687 nova-compute[98431]: b6e44a36-048b-41a3-8639-4ee7e1b0122f Jun 11 23:11:53.553713 np0000002687 nova-compute[98431]:
Jun 11 23:11:53.553713 np0000002687 nova-compute[98431]: Jun 11 23:11:53.553713 np0000002687 nova-compute[98431]: {{(pid=98431) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jun 11 23:11:53.566601 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-4a646a8c-ec60-4c89-8400-a6995b91f1d7 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Searching for a device in session 21 and hctl ['23', '*', '*', 0] yield: sdr {{(pid=98431) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 11 23:11:53.566601 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a646a8c-ec60-4c89-8400-a6995b91f1d7 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Connected to sdr using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '65724ff3-60af-4d3f-b1bf-3aa2695037ce', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 11 23:11:53.576126 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-4a646a8c-ec60-4c89-8400-a6995b91f1d7 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Searching for a device in session 22 and hctl ['24', '*', '*', 0] yield: sds {{(pid=98431) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 11 23:11:53.576126 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a646a8c-ec60-4c89-8400-a6995b91f1d7 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Connected to sds using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '65724ff3-60af-4d3f-b1bf-3aa2695037ce', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 11 23:11:53.995792 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-922d3cd0-d5df-4bc5-b3ee-9cdfb633df77 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "206476b7-d805-4c6c-b7fb-db8b5c2a94a6" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 10.404s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:11:54.107653 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-4089a89c-b865-4eb8-b095-538b3028492e tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Acquiring lock "8ffa4bbe-7ead-4029-aba5-28f031f6e784" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:11:54.107828 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-4089a89c-b865-4eb8-b095-538b3028492e tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "8ffa4bbe-7ead-4029-aba5-28f031f6e784" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:11:54.182811 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Received event ua-b6e44a36-048b-41a3-8639-4ee7e1b0122f> from libvirt while the driver is waiting for it; dispatched. {{(pid=98431) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}} Jun 11 23:11:54.184837 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-1feaaaa0-ddd5-45de-9313-47b9291420fb tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias ua-b6e44a36-048b-41a3-8639-4ee7e1b0122f for instance 73abd331-0bbf-432e-be1c-308801a5429f {{(pid=98431) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}} Jun 11 23:11:54.188281 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-1feaaaa0-ddd5-45de-9313-47b9291420fb tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] Successfully detached device vdb from instance 73abd331-0bbf-432e-be1c-308801a5429f from the live domain config. Jun 11 23:11:54.193156 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1feaaaa0-ddd5-45de-9313-47b9291420fb tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] [instance: 73abd331-0bbf-432e-be1c-308801a5429f] calling os-brick to detach iSCSI Volume {{(pid=98431) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jun 11 23:11:54.193924 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-1feaaaa0-ddd5-45de-9313-47b9291420fb tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b6e44a36-048b-41a3-8639-4ee7e1b0122f', 'iqn.2023-03.storpool.com:os--volume-b6e44a36-048b-41a3-8639-4ee7e1b0122f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b6e44a36-048b-41a3-8639-4ee7e1b0122f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b6e44a36-048b-41a3-8639-4ee7e1b0122f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, None), 'kwargs': {'force': False}}" {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 11 23:11:54.194088 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-1feaaaa0-ddd5-45de-9313-47b9291420fb tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 11 23:11:54.306095 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a646a8c-ec60-4c89-8400-a6995b91f1d7 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98431) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 11 23:11:54.611291 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-4089a89c-b865-4eb8-b095-538b3028492e tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lazy-loading 'flavor' on Instance uuid 8ffa4bbe-7ead-4029-aba5-28f031f6e784 {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:11:54.821750 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] No BDM found with device name hda, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:11:54.821954 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] No BDM found with device name vda, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:11:54.822120 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:11:54.822264 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] No VIF found with MAC fa:16:3e:c6:c6:5b, not building metadata {{(pid=98431) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13199}} Jun 11 23:11:54.824040 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Using config drive Jun 11 23:11:54.953413 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-fb3bafa7-57b2-4711-b982-8c208f85ff32 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Acquiring lock "cb63f66c-b69e-42b0-805c-be6fe9b3aee3" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:11:54.954579 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-fb3bafa7-57b2-4711-b982-8c208f85ff32 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Lock "cb63f66c-b69e-42b0-805c-be6fe9b3aee3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:11:55.322482 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a646a8c-ec60-4c89-8400-a6995b91f1d7 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Found WWN 330000000f7449ef5 for multipath device dm-12 {{(pid=98431) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 11 23:11:55.323094 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-4a646a8c-ec60-4c89-8400-a6995b91f1d7 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.044s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 11 23:11:55.323094 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a646a8c-ec60-4c89-8400-a6995b91f1d7 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] <== connect_volume: return (6030ms) {'type': 'block', 'scsi_wwn': '330000000f7449ef5', 'path': '/dev/dm-12', 'multipath_id': '330000000f7449ef5'} {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 11 23:11:55.323277 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a646a8c-ec60-4c89-8400-a6995b91f1d7 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] [instance: 14699717-b93f-4e67-b841-c67de8fff8d4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000f7449ef5', 'path': '/dev/dm-12', 'multipath_id': '330000000f7449ef5'} {{(pid=98431) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 11 23:11:55.323957 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-e489f06b-214f-48fb-9af3-5bd916033e19 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 5.965s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 11 23:11:55.324496 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-e489f06b-214f-48fb-9af3-5bd916033e19 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6eb3ee75-92d8-430f-86ea-31edf88d1ae8', 'iqn.2023-03.storpool.com:os--volume-6eb3ee75-92d8-430f-86ea-31edf88d1ae8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6eb3ee75-92d8-430f-86ea-31edf88d1ae8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6eb3ee75-92d8-430f-86ea-31edf88d1ae8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 11 23:11:55.325701 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-e489f06b-214f-48fb-9af3-5bd916033e19 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6eb3ee75-92d8-430f-86ea-31edf88d1ae8', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6eb3ee75-92d8-430f-86ea-31edf88d1ae8', 0)] {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 11 23:11:55.326817 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-4a646a8c-ec60-4c89-8400-a6995b91f1d7 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Lazy-loading 'flavor' on Instance uuid 14699717-b93f-4e67-b841-c67de8fff8d4 {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:11:55.329693 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lazy-loading 'ec2_ids' on Instance uuid c82748e6-1c78-4372-ad4b-48d1c6448efa {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:11:55.335536 np0000002687 nova-compute[98431]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.00044311199985713756 future=) submitted to {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:11:55.337220 np0000002687 nova-compute[98431]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:11:55.337220 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [-] Emitting event Stopped> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:11:55.337220 np0000002687 nova-compute[98431]: INFO nova.compute.manager [-] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] VM Stopped (Lifecycle Event) Jun 11 23:11:55.369347 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-e489f06b-214f-48fb-9af3-5bd916033e19 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:55.369347 np0000002687 nova-compute[98431]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:11:55.369347 np0000002687 nova-compute[98431]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:11:55.369347 np0000002687 nova-compute[98431]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:11:55.369347 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:11:55.369347 np0000002687 nova-compute[98431]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6eb3ee75-92d8-430f-86ea-31edf88d1ae8 (non-flash) Jun 11 23:11:55.369347 np0000002687 nova-compute[98431]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6eb3ee75-92d8-430f-86ea-31edf88d1ae8 (non-flash) Jun 11 23:11:55.369347 np0000002687 nova-compute[98431]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6e44a36-048b-41a3-8639-4ee7e1b0122f (non-flash) Jun 11 23:11:55.369347 np0000002687 nova-compute[98431]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6e44a36-048b-41a3-8639-4ee7e1b0122f (non-flash) Jun 11 23:11:55.369347 np0000002687 nova-compute[98431]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8 (non-flash) Jun 11 23:11:55.369347 np0000002687 nova-compute[98431]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8 (non-flash) Jun 11 23:11:55.369347 np0000002687 nova-compute[98431]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce (non-flash) Jun 11 23:11:55.369347 np0000002687 nova-compute[98431]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce (non-flash) Jun 11 23:11:55.369347 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:55.369347 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:55.369347 np0000002687 nova-compute[98431]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:55.369347 np0000002687 nova-compute[98431]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:55.369347 np0000002687 nova-compute[98431]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:55.369347 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:11:55.370075 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-e489f06b-214f-48fb-9af3-5bd916033e19 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:55.370075 np0000002687 nova-compute[98431]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:11:55.370075 np0000002687 nova-compute[98431]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:11:55.370075 np0000002687 nova-compute[98431]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:11:55.370075 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:11:55.370075 np0000002687 nova-compute[98431]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6eb3ee75-92d8-430f-86ea-31edf88d1ae8 (non-flash) Jun 11 23:11:55.370075 np0000002687 nova-compute[98431]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6eb3ee75-92d8-430f-86ea-31edf88d1ae8 (non-flash) Jun 11 23:11:55.370075 np0000002687 nova-compute[98431]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6e44a36-048b-41a3-8639-4ee7e1b0122f (non-flash) Jun 11 23:11:55.370075 np0000002687 nova-compute[98431]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6e44a36-048b-41a3-8639-4ee7e1b0122f (non-flash) Jun 11 23:11:55.370075 np0000002687 nova-compute[98431]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8 (non-flash) Jun 11 23:11:55.370075 np0000002687 nova-compute[98431]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8 (non-flash) Jun 11 23:11:55.370075 np0000002687 nova-compute[98431]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce (non-flash) Jun 11 23:11:55.370075 np0000002687 nova-compute[98431]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce (non-flash) Jun 11 23:11:55.370075 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:55.370075 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:55.370075 np0000002687 nova-compute[98431]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:55.370075 np0000002687 nova-compute[98431]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:55.370075 np0000002687 nova-compute[98431]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:55.370075 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:11:55.370075 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-e489f06b-214f-48fb-9af3-5bd916033e19 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c', '10'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff', '11'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff', '12'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea', '13'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea', '14'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6eb3ee75-92d8-430f-86ea-31edf88d1ae8', '15'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6eb3ee75-92d8-430f-86ea-31edf88d1ae8', '16'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6e44a36-048b-41a3-8639-4ee7e1b0122f', '17'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6e44a36-048b-41a3-8639-4ee7e1b0122f', '18'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8', '19'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8', '20'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce', '21'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce', '22'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9', '3'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9', '4'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9', '7'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9', '8'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c', '9')] {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 11 23:11:55.370075 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-e489f06b-214f-48fb-9af3-5bd916033e19 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-6eb3ee75-92d8-430f-86ea-31edf88d1ae8, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6eb3ee75-92d8-430f-86ea-31edf88d1ae8', '15')] {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 11 23:11:55.371330 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-e489f06b-214f-48fb-9af3-5bd916033e19 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-6eb3ee75-92d8-430f-86ea-31edf88d1ae8, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6eb3ee75-92d8-430f-86ea-31edf88d1ae8', '16')] {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 11 23:11:55.372917 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-e489f06b-214f-48fb-9af3-5bd916033e19 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Resulting device map defaultdict(. at 0x7e1ea0397f60>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6eb3ee75-92d8-430f-86ea-31edf88d1ae8'): ({'sdl'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6eb3ee75-92d8-430f-86ea-31edf88d1ae8'): ({'sdm'}, set())}) {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 11 23:11:55.373137 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-e489f06b-214f-48fb-9af3-5bd916033e19 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Removing multipathed devices sdm, sdl {{(pid=98431) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 11 23:11:55.373371 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-e489f06b-214f-48fb-9af3-5bd916033e19 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Flush multipath device 3300000004a8e833e {{(pid=98431) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jun 11 23:11:55.403376 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-e489f06b-214f-48fb-9af3-5bd916033e19 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=98431) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 11 23:11:55.449478 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-e489f06b-214f-48fb-9af3-5bd916033e19 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=98431) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 11 23:11:55.458154 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-fb3bafa7-57b2-4711-b982-8c208f85ff32 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Lazy-loading 'flavor' on Instance uuid cb63f66c-b69e-42b0-805c-be6fe9b3aee3 {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:11:55.495883 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-e489f06b-214f-48fb-9af3-5bd916033e19 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Checking to see if SCSI volumes sdm, sdl have been removed. {{(pid=98431) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 11 23:11:55.496104 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-e489f06b-214f-48fb-9af3-5bd916033e19 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] SCSI volumes sdm, sdl have been removed. {{(pid=98431) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 11 23:11:55.497644 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-e489f06b-214f-48fb-9af3-5bd916033e19 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Checking to see if device paths {'sdm', 'sdl'} are still under multipathd monitoring {{(pid=98431) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 11 23:11:55.510911 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-e489f06b-214f-48fb-9af3-5bd916033e19 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Device paths {'sdm', 'sdl'} have been removed from multipathd monitoring. {{(pid=98431) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 11 23:11:55.511108 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-e489f06b-214f-48fb-9af3-5bd916033e19 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6eb3ee75-92d8-430f-86ea-31edf88d1ae8'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6eb3ee75-92d8-430f-86ea-31edf88d1ae8')] {{(pid=98431) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 11 23:11:55.524928 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-e489f06b-214f-48fb-9af3-5bd916033e19 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:55.572153 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-e489f06b-214f-48fb-9af3-5bd916033e19 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2023-03.storpool.com:os--volume-6eb3ee75-92d8-430f-86ea-31edf88d1ae8, portal: 192.168.40.100,3260] Jun 11 23:11:55.572153 np0000002687 nova-compute[98431]: Logout of [sid: 15, target: iqn.2023-03.storpool.com:os--volume-6eb3ee75-92d8-430f-86ea-31edf88d1ae8, portal: 192.168.40.100,3260] successful. Jun 11 23:11:55.572153 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:55.601357 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-e489f06b-214f-48fb-9af3-5bd916033e19 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:55.613959 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-e489f06b-214f-48fb-9af3-5bd916033e19 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:55.616325 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-4089a89c-b865-4eb8-b095-538b3028492e tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "8ffa4bbe-7ead-4029-aba5-28f031f6e784" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.508s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:11:55.662734 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-e489f06b-214f-48fb-9af3-5bd916033e19 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2023-03.storpool.com:os--volume-6eb3ee75-92d8-430f-86ea-31edf88d1ae8, portal: 192.168.50.100,3260] Jun 11 23:11:55.662734 np0000002687 nova-compute[98431]: Logout of [sid: 16, target: iqn.2023-03.storpool.com:os--volume-6eb3ee75-92d8-430f-86ea-31edf88d1ae8, portal: 192.168.50.100,3260] successful. Jun 11 23:11:55.662734 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:55.687827 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-e489f06b-214f-48fb-9af3-5bd916033e19 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:55.688092 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-e489f06b-214f-48fb-9af3-5bd916033e19 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.364s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 11 23:11:55.688216 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-e489f06b-214f-48fb-9af3-5bd916033e19 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] <== disconnect_volume: return (6329ms) None {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 11 23:11:55.688399 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e489f06b-214f-48fb-9af3-5bd916033e19 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] [instance: 36688d94-68d3-4ae3-989a-b391d7ee4ad9] Disconnected iSCSI Volume {{(pid=98431) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jun 11 23:11:55.691251 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-1feaaaa0-ddd5-45de-9313-47b9291420fb tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.497s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 11 23:11:55.691790 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-1feaaaa0-ddd5-45de-9313-47b9291420fb tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b6e44a36-048b-41a3-8639-4ee7e1b0122f', 'iqn.2023-03.storpool.com:os--volume-b6e44a36-048b-41a3-8639-4ee7e1b0122f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b6e44a36-048b-41a3-8639-4ee7e1b0122f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b6e44a36-048b-41a3-8639-4ee7e1b0122f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 11 23:11:55.691954 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-1feaaaa0-ddd5-45de-9313-47b9291420fb tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6e44a36-048b-41a3-8639-4ee7e1b0122f', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6e44a36-048b-41a3-8639-4ee7e1b0122f', 0)] {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 11 23:11:55.728830 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-1feaaaa0-ddd5-45de-9313-47b9291420fb tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:55.728830 np0000002687 nova-compute[98431]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:11:55.728830 np0000002687 nova-compute[98431]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:11:55.728830 np0000002687 nova-compute[98431]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:11:55.728830 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:11:55.728830 np0000002687 nova-compute[98431]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6e44a36-048b-41a3-8639-4ee7e1b0122f (non-flash) Jun 11 23:11:55.728830 np0000002687 nova-compute[98431]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6e44a36-048b-41a3-8639-4ee7e1b0122f (non-flash) Jun 11 23:11:55.728830 np0000002687 nova-compute[98431]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8 (non-flash) Jun 11 23:11:55.728830 np0000002687 nova-compute[98431]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8 (non-flash) Jun 11 23:11:55.728830 np0000002687 nova-compute[98431]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce (non-flash) Jun 11 23:11:55.728830 np0000002687 nova-compute[98431]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce (non-flash) Jun 11 23:11:55.728830 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:55.728830 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:55.728830 np0000002687 nova-compute[98431]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:55.728830 np0000002687 nova-compute[98431]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:55.728830 np0000002687 nova-compute[98431]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:55.728830 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:11:55.729246 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-1feaaaa0-ddd5-45de-9313-47b9291420fb tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:55.729246 np0000002687 nova-compute[98431]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:11:55.729246 np0000002687 nova-compute[98431]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:11:55.729246 np0000002687 nova-compute[98431]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:11:55.729246 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:11:55.729246 np0000002687 nova-compute[98431]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6e44a36-048b-41a3-8639-4ee7e1b0122f (non-flash) Jun 11 23:11:55.729246 np0000002687 nova-compute[98431]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6e44a36-048b-41a3-8639-4ee7e1b0122f (non-flash) Jun 11 23:11:55.729246 np0000002687 nova-compute[98431]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8 (non-flash) Jun 11 23:11:55.729246 np0000002687 nova-compute[98431]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8 (non-flash) Jun 11 23:11:55.729246 np0000002687 nova-compute[98431]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce (non-flash) Jun 11 23:11:55.729246 np0000002687 nova-compute[98431]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce (non-flash) Jun 11 23:11:55.729246 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:55.729246 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:55.729246 np0000002687 nova-compute[98431]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:55.729246 np0000002687 nova-compute[98431]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:55.729246 np0000002687 nova-compute[98431]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:55.729246 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:11:55.729246 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-1feaaaa0-ddd5-45de-9313-47b9291420fb tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c', '10'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff', '11'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff', '12'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea', '13'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea', '14'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6e44a36-048b-41a3-8639-4ee7e1b0122f', '17'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6e44a36-048b-41a3-8639-4ee7e1b0122f', '18'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8', '19'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8', '20'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce', '21'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce', '22'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9', '3'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9', '4'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9', '7'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9', '8'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c', '9')] {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 11 23:11:55.729246 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-1feaaaa0-ddd5-45de-9313-47b9291420fb tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-b6e44a36-048b-41a3-8639-4ee7e1b0122f, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6e44a36-048b-41a3-8639-4ee7e1b0122f', '17')] {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 11 23:11:55.730648 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-1feaaaa0-ddd5-45de-9313-47b9291420fb tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-b6e44a36-048b-41a3-8639-4ee7e1b0122f, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6e44a36-048b-41a3-8639-4ee7e1b0122f', '18')] {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 11 23:11:55.732312 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-1feaaaa0-ddd5-45de-9313-47b9291420fb tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] Resulting device map defaultdict(. at 0x7e1ea0290900>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6e44a36-048b-41a3-8639-4ee7e1b0122f'): ({'sdn'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6e44a36-048b-41a3-8639-4ee7e1b0122f'): ({'sdo'}, set())}) {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 11 23:11:55.732613 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-1feaaaa0-ddd5-45de-9313-47b9291420fb tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] Removing multipathed devices sdo, sdn {{(pid=98431) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 11 23:11:55.733323 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-1feaaaa0-ddd5-45de-9313-47b9291420fb tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] Flush multipath device 33000000094e59f01 {{(pid=98431) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jun 11 23:11:55.763700 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-1feaaaa0-ddd5-45de-9313-47b9291420fb tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] Remove SCSI device /dev/sdo with /sys/block/sdo/device/delete {{(pid=98431) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 11 23:11:55.805082 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-1feaaaa0-ddd5-45de-9313-47b9291420fb tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] Remove SCSI device /dev/sdn with /sys/block/sdn/device/delete {{(pid=98431) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 11 23:11:55.836340 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-4a646a8c-ec60-4c89-8400-a6995b91f1d7 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] [instance: 14699717-b93f-4e67-b841-c67de8fff8d4] Attempting to attach volume 65724ff3-60af-4d3f-b1bf-3aa2695037ce with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98431) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}} Jun 11 23:11:55.837017 np0000002687 nova-compute[98431]: DEBUG nova.objects.base [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=98431) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 11 23:11:55.837731 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lazy-loading 'keypairs' on Instance uuid c82748e6-1c78-4372-ad4b-48d1c6448efa {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:11:55.839694 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-751a490a-41ff-4222-88de-e87fd4942467 None None] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:11:55.840913 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.guest [None req-4a646a8c-ec60-4c89-8400-a6995b91f1d7 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] attach device xml: Jun 11 23:11:55.840913 np0000002687 nova-compute[98431]: Jun 11 23:11:55.840913 np0000002687 nova-compute[98431]: Jun 11 23:11:55.840913 np0000002687 nova-compute[98431]: Jun 11 23:11:55.840913 np0000002687 nova-compute[98431]: Jun 11 23:11:55.840913 np0000002687 nova-compute[98431]: 65724ff3-60af-4d3f-b1bf-3aa2695037ce Jun 11 23:11:55.840913 np0000002687 nova-compute[98431]: Jun 11 23:11:55.840913 np0000002687 nova-compute[98431]: Jun 11 23:11:55.840913 np0000002687 nova-compute[98431]: {{(pid=98431) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} Jun 11 23:11:55.847742 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-751a490a-41ff-4222-88de-e87fd4942467 None None] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 4 {{(pid=98431) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 11 23:11:55.861319 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-1feaaaa0-ddd5-45de-9313-47b9291420fb tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] Checking to see if SCSI volumes sdo, sdn have been removed. {{(pid=98431) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 11 23:11:55.861542 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-1feaaaa0-ddd5-45de-9313-47b9291420fb tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] SCSI volumes sdo, sdn have been removed. {{(pid=98431) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 11 23:11:55.863315 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-1feaaaa0-ddd5-45de-9313-47b9291420fb tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] Checking to see if device paths {'sdo', 'sdn'} are still under multipathd monitoring {{(pid=98431) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 11 23:11:55.876724 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-1feaaaa0-ddd5-45de-9313-47b9291420fb tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] Device paths {'sdo', 'sdn'} have been removed from multipathd monitoring. {{(pid=98431) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 11 23:11:55.876906 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-1feaaaa0-ddd5-45de-9313-47b9291420fb tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6e44a36-048b-41a3-8639-4ee7e1b0122f'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6e44a36-048b-41a3-8639-4ee7e1b0122f')] {{(pid=98431) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 11 23:11:55.890487 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-1feaaaa0-ddd5-45de-9313-47b9291420fb tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:55.935502 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-1feaaaa0-ddd5-45de-9313-47b9291420fb tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2023-03.storpool.com:os--volume-b6e44a36-048b-41a3-8639-4ee7e1b0122f, portal: 192.168.40.100,3260] Jun 11 23:11:55.935502 np0000002687 nova-compute[98431]: Logout of [sid: 17, target: iqn.2023-03.storpool.com:os--volume-b6e44a36-048b-41a3-8639-4ee7e1b0122f, portal: 192.168.40.100,3260] successful. Jun 11 23:11:55.935502 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:55.958615 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-1feaaaa0-ddd5-45de-9313-47b9291420fb tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:55.972630 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-1feaaaa0-ddd5-45de-9313-47b9291420fb tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:56.014824 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-1feaaaa0-ddd5-45de-9313-47b9291420fb tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2023-03.storpool.com:os--volume-b6e44a36-048b-41a3-8639-4ee7e1b0122f, portal: 192.168.50.100,3260] Jun 11 23:11:56.014824 np0000002687 nova-compute[98431]: Logout of [sid: 18, target: iqn.2023-03.storpool.com:os--volume-b6e44a36-048b-41a3-8639-4ee7e1b0122f, portal: 192.168.50.100,3260] successful. Jun 11 23:11:56.014824 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:56.036539 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-1feaaaa0-ddd5-45de-9313-47b9291420fb tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:56.036865 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-1feaaaa0-ddd5-45de-9313-47b9291420fb tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.346s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 11 23:11:56.037030 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-1feaaaa0-ddd5-45de-9313-47b9291420fb tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] <== disconnect_volume: return (1843ms) None {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 11 23:11:56.037202 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1feaaaa0-ddd5-45de-9313-47b9291420fb tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] [instance: 73abd331-0bbf-432e-be1c-308801a5429f] Disconnected iSCSI Volume {{(pid=98431) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jun 11 23:11:56.265253 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-e489f06b-214f-48fb-9af3-5bd916033e19 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Lazy-loading 'flavor' on Instance uuid 36688d94-68d3-4ae3-989a-b391d7ee4ad9 {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:11:56.340966 np0000002687 nova-compute[98431]: DEBUG nova.objects.base [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98431) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 11 23:11:56.343908 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:11:56.350584 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-751a490a-41ff-4222-88de-e87fd4942467 None None] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] During sync_power_state the instance has a pending task (rescuing). Skip. Jun 11 23:11:56.466107 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Creating config drive at /opt/stack/data/nova/instances/c82748e6-1c78-4372-ad4b-48d1c6448efa/disk.config.rescue Jun 11 23:11:56.467785 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-fb3bafa7-57b2-4711-b982-8c208f85ff32 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Lock "cb63f66c-b69e-42b0-805c-be6fe9b3aee3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.513s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:11:56.471672 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/c82748e6-1c78-4372-ad4b-48d1c6448efa/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp5ewccq0j {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:11:56.518120 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/c82748e6-1c78-4372-ad4b-48d1c6448efa/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp5ewccq0j" returned: 0 in 0.046s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:11:56.616289 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-1feaaaa0-ddd5-45de-9313-47b9291420fb tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] Lazy-loading 'flavor' on Instance uuid 73abd331-0bbf-432e-be1c-308801a5429f {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:11:56.635148 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:56.698188 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-4089a89c-b865-4eb8-b095-538b3028492e tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Acquiring lock "8ffa4bbe-7ead-4029-aba5-28f031f6e784" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:11:56.698490 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-4089a89c-b865-4eb8-b095-538b3028492e tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "8ffa4bbe-7ead-4029-aba5-28f031f6e784" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:11:56.698846 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-4089a89c-b865-4eb8-b095-538b3028492e tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 8ffa4bbe-7ead-4029-aba5-28f031f6e784] Attaching volume 4da6c3da-4a1a-454c-b611-7fa9fc0832d8 to /dev/vdb Jun 11 23:11:56.750028 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-4089a89c-b865-4eb8-b095-538b3028492e tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.209', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000002687', 'execute': None}" {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 11 23:11:56.761717 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.scaleio [None req-4089a89c-b865-4eb8-b095-538b3028492e tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98431) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 11 23:11:56.785575 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-4089a89c-b865-4eb8-b095-538b3028492e tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Running cmd (subprocess): nvme version {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:11:56.814332 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-4089a89c-b865-4eb8-b095-538b3028492e tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] 'nvme version' failed. Not Retrying. {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 11 23:11:56.814724 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4089a89c-b865-4eb8-b095-538b3028492e tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] nvme not present on system {{(pid=98431) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 11 23:11:56.823670 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.lightos [None req-4089a89c-b865-4eb8-b095-538b3028492e tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98431) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 11 23:11:56.826844 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.lightos [None req-4089a89c-b865-4eb8-b095-538b3028492e tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Current host hostNQN and IP(s) are ['10.4.3.209', 'fe80::f816:3eff:fea3:3707', '192.168.40.6', 'fe80::f816:3eff:fe06:bdab', '192.168.50.6', 'fe80::f816:3eff:fe7a:46f2', '192.168.10.6', 'fe80::f816:3eff:fe13:793b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::38fa:21ff:fe6c:3746', 'fe80::fc16:3eff:fe6c:eb30', 'fe80::20a8:54ff:fe51:da0a', 'fe80::fc16:3eff:feb5:6ffd', 'fe80::4cb3:64ff:fe13:8a75', 'fe80::fc16:3eff:fe8e:8922', 'fe80::4c61:61ff:fe7d:90dc', 'fe80::fc16:3eff:fe77:488d', 'fe80::9469:f2ff:feae:5824', 'fe80::fc16:3eff:febd:951', 'fe80::84b1:8fff:fe59:2d4f', 'fe80::fc16:3eff:fedc:9cb5', 'fe80::f489:94ff:fe75:ec8a', 'fe80::fc16:3eff:fe8a:95c7', 'fe80::fc16:3eff:fec7:336a', 'fe80::fc16:3eff:fee8:a7df', 'fe80::fc16:3eff:fe9f:58c8', 'fe80::a002:b5ff:fe03:ad7e', 'fe80::fc16:3eff:fec3:b6b', 'fe80::fc16:3eff:feb9:2e2c', 'fe80::fc16:3eff:fea0:a282', 'fe80::fc16:3eff:fe50:f6b', 'fe80::7cd4:d5ff:feac:3f7f', 'fe80::fc16:3eff:fec4:56b3', 'fe80::78a9:34ff:febb:750c', 'fe80::fc16:3eff:fe61:b7fd', 'fe80::fc16:3eff:fe1d:f718', 'fe80::14a2:b8ff:feec:f607'] Jun 11 23:11:56.827036 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.lightos [None req-4089a89c-b865-4eb8-b095-538b3028492e tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98431) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 11 23:11:56.827175 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.lightos [None req-4089a89c-b865-4eb8-b095-538b3028492e tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] LIGHTOS: no hostnqn found. {{(pid=98431) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 11 23:11:56.827442 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-4089a89c-b865-4eb8-b095-538b3028492e tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] <== get_connector_properties: return (76ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.209', 'host': 'np0000002687', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:798b370f1cc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad465dfe-0ed1-4637-98c3-ddaebebd61a4', 'nvme_native_multipath': False} {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 11 23:11:56.827724 np0000002687 nova-compute[98431]: DEBUG nova.virt.block_device [None req-4089a89c-b865-4eb8-b095-538b3028492e tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 8ffa4bbe-7ead-4029-aba5-28f031f6e784] Updating existing volume attachment record: 7bb6837a-b377-42f7-88ea-f9506e4f7317 {{(pid=98431) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 11 23:11:56.990072 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:57.015324 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:57.020899 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:57.117066 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:57.209936 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:57.229512 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-cce3fa0e-c351-4110-a27b-c854a014cc3b req-aa028947-1574-4ede-be0b-e12f02268e38 service nova] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Received event network-vif-plugged-852fc4ec-82e1-4185-a33c-3c45ff42351e {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:11:57.229753 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-cce3fa0e-c351-4110-a27b-c854a014cc3b req-aa028947-1574-4ede-be0b-e12f02268e38 service nova] Acquiring lock "c82748e6-1c78-4372-ad4b-48d1c6448efa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:11:57.230147 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-cce3fa0e-c351-4110-a27b-c854a014cc3b req-aa028947-1574-4ede-be0b-e12f02268e38 service nova] Lock "c82748e6-1c78-4372-ad4b-48d1c6448efa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:11:57.230147 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-cce3fa0e-c351-4110-a27b-c854a014cc3b req-aa028947-1574-4ede-be0b-e12f02268e38 service nova] Lock "c82748e6-1c78-4372-ad4b-48d1c6448efa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:11:57.230221 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-cce3fa0e-c351-4110-a27b-c854a014cc3b req-aa028947-1574-4ede-be0b-e12f02268e38 service nova] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] No waiting events found dispatching network-vif-plugged-852fc4ec-82e1-4185-a33c-3c45ff42351e {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:11:57.230759 np0000002687 nova-compute[98431]: WARNING nova.compute.manager [req-cce3fa0e-c351-4110-a27b-c854a014cc3b req-aa028947-1574-4ede-be0b-e12f02268e38 service nova] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Received unexpected event network-vif-plugged-852fc4ec-82e1-4185-a33c-3c45ff42351e for instance with vm_state active and task_state rescuing. Jun 11 23:11:57.275298 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-e489f06b-214f-48fb-9af3-5bd916033e19 tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Lock "36688d94-68d3-4ae3-989a-b391d7ee4ad9" "released" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: held 8.695s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:11:57.384554 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4089a89c-b865-4eb8-b095-538b3028492e tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 8ffa4bbe-7ead-4029-aba5-28f031f6e784] Calling os-brick to attach iSCSI Volume {{(pid=98431) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 11 23:11:57.384949 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-4089a89c-b865-4eb8-b095-538b3028492e tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8', 'iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4da6c3da-4a1a-454c-b611-7fa9fc0832d8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 11 23:11:57.385130 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-4089a89c-b865-4eb8-b095-538b3028492e tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 11 23:11:57.385497 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-4089a89c-b865-4eb8-b095-538b3028492e tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 11 23:11:57.385749 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-4089a89c-b865-4eb8-b095-538b3028492e tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8', 'iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4da6c3da-4a1a-454c-b611-7fa9fc0832d8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98431) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 11 23:11:57.398940 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-4089a89c-b865-4eb8-b095-538b3028492e tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 11 23:11:57.399666 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-4089a89c-b865-4eb8-b095-538b3028492e tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 11 23:11:57.400116 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-4089a89c-b865-4eb8-b095-538b3028492e tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 11 23:11:57.400323 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.iscsi [None req-4089a89c-b865-4eb8-b095-538b3028492e tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 11 23:11:57.400648 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-4089a89c-b865-4eb8-b095-538b3028492e tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 11 23:11:57.402733 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.iscsi [None req-4089a89c-b865-4eb8-b095-538b3028492e tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 11 23:11:57.413148 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-4089a89c-b865-4eb8-b095-538b3028492e tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 11 23:11:57.413148 np0000002687 nova-compute[98431]: node.name = iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8 Jun 11 23:11:57.413148 np0000002687 nova-compute[98431]: node.tpgt = -1 Jun 11 23:11:57.413148 np0000002687 nova-compute[98431]: node.startup = automatic Jun 11 23:11:57.413148 np0000002687 nova-compute[98431]: node.leading_login = No Jun 11 23:11:57.413148 np0000002687 nova-compute[98431]: iface.iscsi_ifacename = default Jun 11 23:11:57.413148 np0000002687 nova-compute[98431]: iface.net_ifacename = Jun 11 23:11:57.413148 np0000002687 nova-compute[98431]: iface.ipaddress = Jun 11 23:11:57.413148 np0000002687 nova-compute[98431]: iface.prefix_len = 0 Jun 11 23:11:57.413148 np0000002687 nova-compute[98431]: iface.hwaddress = Jun 11 23:11:57.413148 np0000002687 nova-compute[98431]: iface.transport_name = tcp Jun 11 23:11:57.413148 np0000002687 nova-compute[98431]: iface.initiatorname = Jun 11 23:11:57.413148 np0000002687 nova-compute[98431]: iface.state = Jun 11 23:11:57.413148 np0000002687 nova-compute[98431]: iface.vlan_id = 0 Jun 11 23:11:57.413148 np0000002687 nova-compute[98431]: iface.vlan_priority = 0 Jun 11 23:11:57.413148 np0000002687 nova-compute[98431]: iface.vlan_state = Jun 11 23:11:57.413148 np0000002687 nova-compute[98431]: iface.iface_num = 0 Jun 11 23:11:57.413148 np0000002687 nova-compute[98431]: iface.mtu = 0 Jun 11 23:11:57.413148 np0000002687 nova-compute[98431]: iface.port = 0 Jun 11 23:11:57.413148 np0000002687 nova-compute[98431]: iface.bootproto = Jun 11 23:11:57.413148 np0000002687 nova-compute[98431]: iface.subnet_mask = Jun 11 23:11:57.413148 np0000002687 nova-compute[98431]: iface.gateway = Jun 11 23:11:57.413148 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id_state = Jun 11 23:11:57.413148 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id = Jun 11 23:11:57.413148 np0000002687 nova-compute[98431]: iface.dhcp_dns = Jun 11 23:11:57.413148 np0000002687 nova-compute[98431]: iface.dhcp_learn_iqn = Jun 11 23:11:57.413148 np0000002687 nova-compute[98431]: iface.dhcp_req_vendor_id_state = Jun 11 23:11:57.413148 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id_state = Jun 11 23:11:57.413148 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id = Jun 11 23:11:57.413148 np0000002687 nova-compute[98431]: iface.dhcp_slp_da = Jun 11 23:11:57.413148 np0000002687 nova-compute[98431]: iface.fragmentation = Jun 11 23:11:57.413148 np0000002687 nova-compute[98431]: iface.gratuitous_arp = Jun 11 23:11:57.413148 np0000002687 nova-compute[98431]: iface.incoming_forwarding = Jun 11 23:11:57.413148 np0000002687 nova-compute[98431]: iface.tos_state = Jun 11 23:11:57.413148 np0000002687 nova-compute[98431]: iface.tos = 0 Jun 11 23:11:57.413148 np0000002687 nova-compute[98431]: iface.ttl = 0 Jun 11 23:11:57.413148 np0000002687 nova-compute[98431]: iface.delayed_ack = Jun 11 23:11:57.413148 np0000002687 nova-compute[98431]: iface.tcp_nagle = Jun 11 23:11:57.413148 np0000002687 nova-compute[98431]: iface.tcp_wsf_state = Jun 11 23:11:57.413148 np0000002687 nova-compute[98431]: iface.tcp_wsf = 0 Jun 11 23:11:57.413148 np0000002687 nova-compute[98431]: iface.tcp_timer_scale = 0 Jun 11 23:11:57.413148 np0000002687 nova-compute[98431]: iface.tcp_timestamp = Jun 11 23:11:57.413148 np0000002687 nova-compute[98431]: iface.redirect = Jun 11 23:11:57.413148 np0000002687 nova-compute[98431]: iface.def_task_mgmt_timeout = 0 Jun 11 23:11:57.413148 np0000002687 nova-compute[98431]: iface.header_digest = Jun 11 23:11:57.413148 np0000002687 nova-compute[98431]: iface.data_digest = Jun 11 23:11:57.413148 np0000002687 nova-compute[98431]: iface.immediate_data = Jun 11 23:11:57.413148 np0000002687 nova-compute[98431]: iface.initial_r2t = Jun 11 23:11:57.413148 np0000002687 nova-compute[98431]: iface.data_seq_inorder = Jun 11 23:11:57.413148 np0000002687 nova-compute[98431]: iface.data_pdu_inorder = Jun 11 23:11:57.413148 np0000002687 nova-compute[98431]: iface.erl = 0 Jun 11 23:11:57.413148 np0000002687 nova-compute[98431]: iface.max_receive_data_len = 0 Jun 11 23:11:57.413148 np0000002687 nova-compute[98431]: iface.first_burst_len = 0 Jun 11 23:11:57.413148 np0000002687 nova-compute[98431]: iface.max_outstanding_r2t = 0 Jun 11 23:11:57.413148 np0000002687 nova-compute[98431]: iface.max_burst_len = 0 Jun 11 23:11:57.413148 np0000002687 nova-compute[98431]: iface.chap_auth = Jun 11 23:11:57.413148 np0000002687 nova-compute[98431]: iface.bidi_chap = Jun 11 23:11:57.413148 np0000002687 nova-compute[98431]: iface.strict_login_compliance = Jun 11 23:11:57.413148 np0000002687 nova-compute[98431]: iface.discovery_auth = Jun 11 23:11:57.413148 np0000002687 nova-compute[98431]: iface.discovery_logout = Jun 11 23:11:57.413148 np0000002687 nova-compute[98431]: node.discovery_address = Jun 11 23:11:57.413148 np0000002687 nova-compute[98431]: node.discovery_port = 0 Jun 11 23:11:57.413148 np0000002687 nova-compute[98431]: node.discovery_type = fw Jun 11 23:11:57.413148 np0000002687 nova-compute[98431]: node.session.initial_cmdsn = 0 Jun 11 23:11:57.413148 np0000002687 nova-compute[98431]: node.session.initial_login_retry_max = 8 Jun 11 23:11:57.413148 np0000002687 nova-compute[98431]: node.session.xmit_thread_priority = 0 Jun 11 23:11:57.413148 np0000002687 nova-compute[98431]: node.session.cmds_max = 128 Jun 11 23:11:57.413148 np0000002687 nova-compute[98431]: node.session.queue_depth = 32 Jun 11 23:11:57.413148 np0000002687 nova-compute[98431]: node.session.nr_sessions = 1 Jun 11 23:11:57.413148 np0000002687 nova-compute[98431]: node.session.auth.authmethod = None Jun 11 23:11:57.413148 np0000002687 nova-compute[98431]: node.session.auth.username = Jun 11 23:11:57.413148 np0000002687 nova-compute[98431]: node.session.auth.password = *** Jun 11 23:11:57.413148 np0000002687 nova-compute[98431]: node.session.auth.username_in = Jun 11 23:11:57.413148 np0000002687 nova-compute[98431]: node.session.auth.password_in = Jun 11 23:11:57.413148 np0000002687 nova-compute[98431]: node.session.auth.chap_algs = SHA256 Jun 11 23:11:57.413148 np0000002687 nova-compute[98431]: node.session.timeo.replacement_timeout = 120 Jun 11 23:11:57.413148 np0000002687 nova-compute[98431]: node.session.err_timeo.abort_timeout = 15 Jun 11 23:11:57.413148 np0000002687 nova-compute[98431]: node.session.err_timeo.lu_reset_timeout = 30 Jun 11 23:11:57.413148 np0000002687 nova-compute[98431]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 11 23:11:57.413148 np0000002687 nova-compute[98431]: node.session.err_timeo.host_reset_timeout = 60 Jun 11 23:11:57.413148 np0000002687 nova-compute[98431]: node.session.iscsi.FastAbort = Yes Jun 11 23:11:57.413148 np0000002687 nova-compute[98431]: node.session.iscsi.InitialR2T = No Jun 11 23:11:57.413148 np0000002687 nova-compute[98431]: node.session.iscsi.ImmediateData = Yes Jun 11 23:11:57.413148 np0000002687 nova-compute[98431]: node.session.iscsi.FirstBurstLength = 262144 Jun 11 23:11:57.413148 np0000002687 nova-compute[98431]: node.session.iscsi.MaxBurstLength = 16776192 Jun 11 23:11:57.413148 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Retain = 0 Jun 11 23:11:57.413148 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Wait = 2 Jun 11 23:11:57.413148 np0000002687 nova-compute[98431]: node.session.iscsi.MaxConnections = 1 Jun 11 23:11:57.413148 np0000002687 nova-compute[98431]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 11 23:11:57.413148 np0000002687 nova-compute[98431]: node.session.iscsi.ERL = 0 Jun 11 23:11:57.413148 np0000002687 nova-compute[98431]: node.session.scan = manual Jun 11 23:11:57.413148 np0000002687 nova-compute[98431]: node.session.reopen_max = 0 Jun 11 23:11:57.413148 np0000002687 nova-compute[98431]: node.conn[0].address = 192.168.50.100 Jun 11 23:11:57.413148 np0000002687 nova-compute[98431]: node.conn[0].port = 3260 Jun 11 23:11:57.413148 np0000002687 nova-compute[98431]: node.conn[0].startup = manual Jun 11 23:11:57.413148 np0000002687 nova-compute[98431]: node.conn[0].tcp.window_size = 524288 Jun 11 23:11:57.413148 np0000002687 nova-compute[98431]: node.conn[0].tcp.type_of_service = 0 Jun 11 23:11:57.413148 np0000002687 nova-compute[98431]: node.conn[0].timeo.logout_timeout = 15 Jun 11 23:11:57.413148 np0000002687 nova-compute[98431]: node.conn[0].timeo.login_timeout = 15 Jun 11 23:11:57.413148 np0000002687 nova-compute[98431]: node.conn[0].timeo.auth_timeout = 45 Jun 11 23:11:57.413148 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_interval = 5 Jun 11 23:11:57.413148 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_timeout = 5 Jun 11 23:11:57.413148 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 11 23:11:57.413148 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 11 23:11:57.413148 np0000002687 nova-compute[98431]: node.conn[0].iscsi.HeaderDigest = None Jun 11 23:11:57.413148 np0000002687 nova-compute[98431]: node.conn[0].iscsi.DataDigest = None Jun 11 23:11:57.413148 np0000002687 nova-compute[98431]: node.conn[0].iscsi.IFMarker = No Jun 11 23:11:57.413148 np0000002687 nova-compute[98431]: node.conn[0].iscsi.OFMarker = No Jun 11 23:11:57.413148 np0000002687 nova-compute[98431]: # END RECORD Jun 11 23:11:57.413148 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:57.416037 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-4089a89c-b865-4eb8-b095-538b3028492e tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 11 23:11:57.416037 np0000002687 nova-compute[98431]: node.name = iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8 Jun 11 23:11:57.416037 np0000002687 nova-compute[98431]: node.tpgt = -1 Jun 11 23:11:57.416037 np0000002687 nova-compute[98431]: node.startup = automatic Jun 11 23:11:57.416037 np0000002687 nova-compute[98431]: node.leading_login = No Jun 11 23:11:57.416037 np0000002687 nova-compute[98431]: iface.iscsi_ifacename = default Jun 11 23:11:57.416037 np0000002687 nova-compute[98431]: iface.net_ifacename = Jun 11 23:11:57.416037 np0000002687 nova-compute[98431]: iface.ipaddress = Jun 11 23:11:57.416037 np0000002687 nova-compute[98431]: iface.prefix_len = 0 Jun 11 23:11:57.416037 np0000002687 nova-compute[98431]: iface.hwaddress = Jun 11 23:11:57.416037 np0000002687 nova-compute[98431]: iface.transport_name = tcp Jun 11 23:11:57.416037 np0000002687 nova-compute[98431]: iface.initiatorname = Jun 11 23:11:57.416037 np0000002687 nova-compute[98431]: iface.state = Jun 11 23:11:57.416037 np0000002687 nova-compute[98431]: iface.vlan_id = 0 Jun 11 23:11:57.416037 np0000002687 nova-compute[98431]: iface.vlan_priority = 0 Jun 11 23:11:57.416037 np0000002687 nova-compute[98431]: iface.vlan_state = Jun 11 23:11:57.416037 np0000002687 nova-compute[98431]: iface.iface_num = 0 Jun 11 23:11:57.416037 np0000002687 nova-compute[98431]: iface.mtu = 0 Jun 11 23:11:57.416037 np0000002687 nova-compute[98431]: iface.port = 0 Jun 11 23:11:57.416037 np0000002687 nova-compute[98431]: iface.bootproto = Jun 11 23:11:57.416037 np0000002687 nova-compute[98431]: iface.subnet_mask = Jun 11 23:11:57.416037 np0000002687 nova-compute[98431]: iface.gateway = Jun 11 23:11:57.416037 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id_state = Jun 11 23:11:57.416037 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id = Jun 11 23:11:57.416037 np0000002687 nova-compute[98431]: iface.dhcp_dns = Jun 11 23:11:57.416037 np0000002687 nova-compute[98431]: iface.dhcp_learn_iqn = Jun 11 23:11:57.416037 np0000002687 nova-compute[98431]: iface.dhcp_req_vendor_id_state = Jun 11 23:11:57.416037 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id_state = Jun 11 23:11:57.416037 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id = Jun 11 23:11:57.416037 np0000002687 nova-compute[98431]: iface.dhcp_slp_da = Jun 11 23:11:57.416037 np0000002687 nova-compute[98431]: iface.fragmentation = Jun 11 23:11:57.416037 np0000002687 nova-compute[98431]: iface.gratuitous_arp = Jun 11 23:11:57.416037 np0000002687 nova-compute[98431]: iface.incoming_forwarding = Jun 11 23:11:57.416037 np0000002687 nova-compute[98431]: iface.tos_state = Jun 11 23:11:57.416037 np0000002687 nova-compute[98431]: iface.tos = 0 Jun 11 23:11:57.416037 np0000002687 nova-compute[98431]: iface.ttl = 0 Jun 11 23:11:57.416037 np0000002687 nova-compute[98431]: iface.delayed_ack = Jun 11 23:11:57.416037 np0000002687 nova-compute[98431]: iface.tcp_nagle = Jun 11 23:11:57.416037 np0000002687 nova-compute[98431]: iface.tcp_wsf_state = Jun 11 23:11:57.416037 np0000002687 nova-compute[98431]: iface.tcp_wsf = 0 Jun 11 23:11:57.416037 np0000002687 nova-compute[98431]: iface.tcp_timer_scale = 0 Jun 11 23:11:57.416037 np0000002687 nova-compute[98431]: iface.tcp_timestamp = Jun 11 23:11:57.416037 np0000002687 nova-compute[98431]: iface.redirect = Jun 11 23:11:57.416037 np0000002687 nova-compute[98431]: iface.def_task_mgmt_timeout = 0 Jun 11 23:11:57.416037 np0000002687 nova-compute[98431]: iface.header_digest = Jun 11 23:11:57.416037 np0000002687 nova-compute[98431]: iface.data_digest = Jun 11 23:11:57.416037 np0000002687 nova-compute[98431]: iface.immediate_data = Jun 11 23:11:57.416037 np0000002687 nova-compute[98431]: iface.initial_r2t = Jun 11 23:11:57.416037 np0000002687 nova-compute[98431]: iface.data_seq_inorder = Jun 11 23:11:57.416037 np0000002687 nova-compute[98431]: iface.data_pdu_inorder = Jun 11 23:11:57.416037 np0000002687 nova-compute[98431]: iface.erl = 0 Jun 11 23:11:57.416037 np0000002687 nova-compute[98431]: iface.max_receive_data_len = 0 Jun 11 23:11:57.416037 np0000002687 nova-compute[98431]: iface.first_burst_len = 0 Jun 11 23:11:57.416037 np0000002687 nova-compute[98431]: iface.max_outstanding_r2t = 0 Jun 11 23:11:57.416037 np0000002687 nova-compute[98431]: iface.max_burst_len = 0 Jun 11 23:11:57.416037 np0000002687 nova-compute[98431]: iface.chap_auth = Jun 11 23:11:57.416037 np0000002687 nova-compute[98431]: iface.bidi_chap = Jun 11 23:11:57.416037 np0000002687 nova-compute[98431]: iface.strict_login_compliance = Jun 11 23:11:57.416037 np0000002687 nova-compute[98431]: iface.discovery_auth = Jun 11 23:11:57.416037 np0000002687 nova-compute[98431]: iface.discovery_logout = Jun 11 23:11:57.416037 np0000002687 nova-compute[98431]: node.discovery_address = Jun 11 23:11:57.416037 np0000002687 nova-compute[98431]: node.discovery_port = 0 Jun 11 23:11:57.416037 np0000002687 nova-compute[98431]: node.discovery_type = fw Jun 11 23:11:57.416037 np0000002687 nova-compute[98431]: node.session.initial_cmdsn = 0 Jun 11 23:11:57.416037 np0000002687 nova-compute[98431]: node.session.initial_login_retry_max = 8 Jun 11 23:11:57.416037 np0000002687 nova-compute[98431]: node.session.xmit_thread_priority = 0 Jun 11 23:11:57.416037 np0000002687 nova-compute[98431]: node.session.cmds_max = 128 Jun 11 23:11:57.416037 np0000002687 nova-compute[98431]: node.session.queue_depth = 32 Jun 11 23:11:57.416037 np0000002687 nova-compute[98431]: node.session.nr_sessions = 1 Jun 11 23:11:57.416037 np0000002687 nova-compute[98431]: node.session.auth.authmethod = None Jun 11 23:11:57.416037 np0000002687 nova-compute[98431]: node.session.auth.username = Jun 11 23:11:57.416037 np0000002687 nova-compute[98431]: node.session.auth.password = *** Jun 11 23:11:57.416037 np0000002687 nova-compute[98431]: node.session.auth.username_in = Jun 11 23:11:57.416037 np0000002687 nova-compute[98431]: node.session.auth.password_in = Jun 11 23:11:57.416037 np0000002687 nova-compute[98431]: node.session.auth.chap_algs = SHA256 Jun 11 23:11:57.416037 np0000002687 nova-compute[98431]: node.session.timeo.replacement_timeout = 120 Jun 11 23:11:57.416037 np0000002687 nova-compute[98431]: node.session.err_timeo.abort_timeout = 15 Jun 11 23:11:57.416037 np0000002687 nova-compute[98431]: node.session.err_timeo.lu_reset_timeout = 30 Jun 11 23:11:57.416037 np0000002687 nova-compute[98431]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 11 23:11:57.416037 np0000002687 nova-compute[98431]: node.session.err_timeo.host_reset_timeout = 60 Jun 11 23:11:57.416037 np0000002687 nova-compute[98431]: node.session.iscsi.FastAbort = Yes Jun 11 23:11:57.416037 np0000002687 nova-compute[98431]: node.session.iscsi.InitialR2T = No Jun 11 23:11:57.416037 np0000002687 nova-compute[98431]: node.session.iscsi.ImmediateData = Yes Jun 11 23:11:57.416037 np0000002687 nova-compute[98431]: node.session.iscsi.FirstBurstLength = 262144 Jun 11 23:11:57.416037 np0000002687 nova-compute[98431]: node.session.iscsi.MaxBurstLength = 16776192 Jun 11 23:11:57.416037 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Retain = 0 Jun 11 23:11:57.416037 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Wait = 2 Jun 11 23:11:57.416037 np0000002687 nova-compute[98431]: node.session.iscsi.MaxConnections = 1 Jun 11 23:11:57.416037 np0000002687 nova-compute[98431]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 11 23:11:57.416037 np0000002687 nova-compute[98431]: node.session.iscsi.ERL = 0 Jun 11 23:11:57.416037 np0000002687 nova-compute[98431]: node.session.scan = manual Jun 11 23:11:57.416037 np0000002687 nova-compute[98431]: node.session.reopen_max = 0 Jun 11 23:11:57.416037 np0000002687 nova-compute[98431]: node.conn[0].address = 192.168.40.100 Jun 11 23:11:57.416037 np0000002687 nova-compute[98431]: node.conn[0].port = 3260 Jun 11 23:11:57.416037 np0000002687 nova-compute[98431]: node.conn[0].startup = manual Jun 11 23:11:57.416037 np0000002687 nova-compute[98431]: node.conn[0].tcp.window_size = 524288 Jun 11 23:11:57.416037 np0000002687 nova-compute[98431]: node.conn[0].tcp.type_of_service = 0 Jun 11 23:11:57.416037 np0000002687 nova-compute[98431]: node.conn[0].timeo.logout_timeout = 15 Jun 11 23:11:57.416037 np0000002687 nova-compute[98431]: node.conn[0].timeo.login_timeout = 15 Jun 11 23:11:57.416037 np0000002687 nova-compute[98431]: node.conn[0].timeo.auth_timeout = 45 Jun 11 23:11:57.416037 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_interval = 5 Jun 11 23:11:57.416037 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_timeout = 5 Jun 11 23:11:57.416037 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 11 23:11:57.416037 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 11 23:11:57.416037 np0000002687 nova-compute[98431]: node.conn[0].iscsi.HeaderDigest = None Jun 11 23:11:57.416037 np0000002687 nova-compute[98431]: node.conn[0].iscsi.DataDigest = None Jun 11 23:11:57.416037 np0000002687 nova-compute[98431]: node.conn[0].iscsi.IFMarker = No Jun 11 23:11:57.416037 np0000002687 nova-compute[98431]: node.conn[0].iscsi.OFMarker = No Jun 11 23:11:57.416037 np0000002687 nova-compute[98431]: # END RECORD Jun 11 23:11:57.416037 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:57.428493 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-4089a89c-b865-4eb8-b095-538b3028492e tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:57.433097 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-4089a89c-b865-4eb8-b095-538b3028492e tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:57.455301 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-4089a89c-b865-4eb8-b095-538b3028492e tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:57.455301 np0000002687 nova-compute[98431]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:11:57.455301 np0000002687 nova-compute[98431]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:11:57.455301 np0000002687 nova-compute[98431]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:11:57.455301 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:11:57.455301 np0000002687 nova-compute[98431]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8 (non-flash) Jun 11 23:11:57.455301 np0000002687 nova-compute[98431]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8 (non-flash) Jun 11 23:11:57.455301 np0000002687 nova-compute[98431]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce (non-flash) Jun 11 23:11:57.455301 np0000002687 nova-compute[98431]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce (non-flash) Jun 11 23:11:57.455301 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:57.455301 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:57.455301 np0000002687 nova-compute[98431]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:57.455301 np0000002687 nova-compute[98431]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:57.455301 np0000002687 nova-compute[98431]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:57.455301 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:11:57.455688 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-4089a89c-b865-4eb8-b095-538b3028492e tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:57.455688 np0000002687 nova-compute[98431]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:11:57.455688 np0000002687 nova-compute[98431]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:11:57.455688 np0000002687 nova-compute[98431]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:11:57.455688 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:11:57.455688 np0000002687 nova-compute[98431]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8 (non-flash) Jun 11 23:11:57.455688 np0000002687 nova-compute[98431]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8 (non-flash) Jun 11 23:11:57.455688 np0000002687 nova-compute[98431]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce (non-flash) Jun 11 23:11:57.455688 np0000002687 nova-compute[98431]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce (non-flash) Jun 11 23:11:57.455688 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:57.455688 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:57.455688 np0000002687 nova-compute[98431]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:57.455688 np0000002687 nova-compute[98431]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:57.455688 np0000002687 nova-compute[98431]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:57.455688 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:11:57.456885 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-4089a89c-b865-4eb8-b095-538b3028492e tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:57.456885 np0000002687 nova-compute[98431]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:11:57.456885 np0000002687 nova-compute[98431]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:11:57.456885 np0000002687 nova-compute[98431]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:11:57.456885 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:11:57.456885 np0000002687 nova-compute[98431]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8 (non-flash) Jun 11 23:11:57.456885 np0000002687 nova-compute[98431]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8 (non-flash) Jun 11 23:11:57.456885 np0000002687 nova-compute[98431]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce (non-flash) Jun 11 23:11:57.456885 np0000002687 nova-compute[98431]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce (non-flash) Jun 11 23:11:57.456885 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:57.456885 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:57.456885 np0000002687 nova-compute[98431]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:57.456885 np0000002687 nova-compute[98431]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:57.456885 np0000002687 nova-compute[98431]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:57.456885 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:11:57.457288 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-4089a89c-b865-4eb8-b095-538b3028492e tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:57.457288 np0000002687 nova-compute[98431]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:11:57.457288 np0000002687 nova-compute[98431]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:11:57.457288 np0000002687 nova-compute[98431]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:11:57.457288 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:11:57.457288 np0000002687 nova-compute[98431]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8 (non-flash) Jun 11 23:11:57.457288 np0000002687 nova-compute[98431]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8 (non-flash) Jun 11 23:11:57.457288 np0000002687 nova-compute[98431]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce (non-flash) Jun 11 23:11:57.457288 np0000002687 nova-compute[98431]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce (non-flash) Jun 11 23:11:57.457288 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:57.457288 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:11:57.457288 np0000002687 nova-compute[98431]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:57.457288 np0000002687 nova-compute[98431]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:11:57.457288 np0000002687 nova-compute[98431]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:11:57.457288 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:11:57.457581 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-4089a89c-b865-4eb8-b095-538b3028492e tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.057s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 11 23:11:57.457775 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-4089a89c-b865-4eb8-b095-538b3028492e tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Connected to 192.168.40.100:3260 {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 11 23:11:57.458083 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-4089a89c-b865-4eb8-b095-538b3028492e tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.058s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 11 23:11:57.458273 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-4089a89c-b865-4eb8-b095-538b3028492e tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Connected to 192.168.50.100:3260 {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 11 23:11:57.459500 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-4089a89c-b865-4eb8-b095-538b3028492e tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] HCTL ('22', '0', '0', 0) found on session 20 with lun 0 {{(pid=98431) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 11 23:11:57.459655 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-4089a89c-b865-4eb8-b095-538b3028492e tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Scanning host 22 c: 0, t: 0, l: 0) {{(pid=98431) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 11 23:11:57.463213 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-4089a89c-b865-4eb8-b095-538b3028492e tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] HCTL ('21', '0', '0', 0) found on session 19 with lun 0 {{(pid=98431) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 11 23:11:57.463213 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-4089a89c-b865-4eb8-b095-538b3028492e tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Scanning host 21 c: 0, t: 0, l: 0) {{(pid=98431) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 11 23:11:57.471666 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-4089a89c-b865-4eb8-b095-538b3028492e tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Searching for a device in session 20 and hctl ('22', '0', '0', 0) yield: sdq {{(pid=98431) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 11 23:11:57.471935 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-4089a89c-b865-4eb8-b095-538b3028492e tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Connected to sdq using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4da6c3da-4a1a-454c-b611-7fa9fc0832d8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 11 23:11:57.475221 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-4089a89c-b865-4eb8-b095-538b3028492e tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Searching for a device in session 19 and hctl ('21', '0', '0', 0) yield: sdp {{(pid=98431) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 11 23:11:57.475477 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-4089a89c-b865-4eb8-b095-538b3028492e tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Connected to sdp using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '4da6c3da-4a1a-454c-b611-7fa9fc0832d8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 11 23:11:57.507335 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-4a646a8c-ec60-4c89-8400-a6995b91f1d7 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] No BDM found with device name vda, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:11:57.507335 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-4a646a8c-ec60-4c89-8400-a6995b91f1d7 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:11:57.507335 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-4a646a8c-ec60-4c89-8400-a6995b91f1d7 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] No BDM found with device name hda, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:11:57.507335 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-4a646a8c-ec60-4c89-8400-a6995b91f1d7 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] No VIF found with MAC fa:16:3e:8a:95:c7, not building metadata {{(pid=98431) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13199}} Jun 11 23:11:57.599126 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-fb3bafa7-57b2-4711-b982-8c208f85ff32 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Acquiring lock "cb63f66c-b69e-42b0-805c-be6fe9b3aee3" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:11:57.599249 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-fb3bafa7-57b2-4711-b982-8c208f85ff32 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Lock "cb63f66c-b69e-42b0-805c-be6fe9b3aee3" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:11:57.599445 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-fb3bafa7-57b2-4711-b982-8c208f85ff32 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Attaching volume 859ffbad-3fc1-400a-a7f7-ac423851f060 to /dev/vdb Jun 11 23:11:57.626821 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-1feaaaa0-ddd5-45de-9313-47b9291420fb tempest-VolumesAssistedSnapshotsTest-1523231931 tempest-VolumesAssistedSnapshotsTest-1523231931-project-admin] Lock "73abd331-0bbf-432e-be1c-308801a5429f" "released" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: held 4.665s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:11:57.641243 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:57.654387 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-fb3bafa7-57b2-4711-b982-8c208f85ff32 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.209', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000002687', 'execute': None}" {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 11 23:11:57.667821 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.scaleio [None req-fb3bafa7-57b2-4711-b982-8c208f85ff32 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98431) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 11 23:11:57.697848 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-fb3bafa7-57b2-4711-b982-8c208f85ff32 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Running cmd (subprocess): nvme version {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:11:57.726893 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-fb3bafa7-57b2-4711-b982-8c208f85ff32 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] 'nvme version' failed. Not Retrying. {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 11 23:11:57.727306 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fb3bafa7-57b2-4711-b982-8c208f85ff32 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] nvme not present on system {{(pid=98431) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 11 23:11:57.737090 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.lightos [None req-fb3bafa7-57b2-4711-b982-8c208f85ff32 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98431) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 11 23:11:57.739318 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.lightos [None req-fb3bafa7-57b2-4711-b982-8c208f85ff32 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Current host hostNQN and IP(s) are ['10.4.3.209', 'fe80::f816:3eff:fea3:3707', '192.168.40.6', 'fe80::f816:3eff:fe06:bdab', '192.168.50.6', 'fe80::f816:3eff:fe7a:46f2', '192.168.10.6', 'fe80::f816:3eff:fe13:793b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::38fa:21ff:fe6c:3746', 'fe80::fc16:3eff:fe6c:eb30', 'fe80::20a8:54ff:fe51:da0a', 'fe80::fc16:3eff:feb5:6ffd', 'fe80::4cb3:64ff:fe13:8a75', 'fe80::fc16:3eff:fe8e:8922', 'fe80::4c61:61ff:fe7d:90dc', 'fe80::fc16:3eff:fe77:488d', 'fe80::9469:f2ff:feae:5824', 'fe80::fc16:3eff:febd:951', 'fe80::84b1:8fff:fe59:2d4f', 'fe80::fc16:3eff:fedc:9cb5', 'fe80::f489:94ff:fe75:ec8a', 'fe80::fc16:3eff:fe8a:95c7', 'fe80::fc16:3eff:fec7:336a', 'fe80::fc16:3eff:fee8:a7df', 'fe80::fc16:3eff:fe9f:58c8', 'fe80::a002:b5ff:fe03:ad7e', 'fe80::fc16:3eff:fec3:b6b', 'fe80::fc16:3eff:feb9:2e2c', 'fe80::fc16:3eff:fea0:a282', 'fe80::fc16:3eff:fe50:f6b', 'fe80::7cd4:d5ff:feac:3f7f', 'fe80::fc16:3eff:fec4:56b3', 'fe80::78a9:34ff:febb:750c', 'fe80::fc16:3eff:fe61:b7fd', 'fe80::fc16:3eff:fe1d:f718', 'fe80::14a2:b8ff:feec:f607', 'fe80::fc16:3eff:fec6:c65b'] Jun 11 23:11:57.739924 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.lightos [None req-fb3bafa7-57b2-4711-b982-8c208f85ff32 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98431) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 11 23:11:57.739924 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.lightos [None req-fb3bafa7-57b2-4711-b982-8c208f85ff32 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] LIGHTOS: no hostnqn found. {{(pid=98431) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 11 23:11:57.739924 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-fb3bafa7-57b2-4711-b982-8c208f85ff32 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] <== get_connector_properties: return (85ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.209', 'host': 'np0000002687', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:798b370f1cc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad465dfe-0ed1-4637-98c3-ddaebebd61a4', 'nvme_native_multipath': False} {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 11 23:11:57.740292 np0000002687 nova-compute[98431]: DEBUG nova.virt.block_device [None req-fb3bafa7-57b2-4711-b982-8c208f85ff32 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Updating existing volume attachment record: 390b7f89-7212-4eae-9c33-8d8623facecc {{(pid=98431) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 11 23:11:57.942671 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Emitting event Resumed> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:11:57.942671 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] VM Resumed (Lifecycle Event) Jun 11 23:11:57.947382 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-1b783b0d-e82c-4881-a15f-b704b1d31385 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:11:58.317926 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb3bafa7-57b2-4711-b982-8c208f85ff32 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Calling os-brick to attach iSCSI Volume {{(pid=98431) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 11 23:11:58.318339 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb3bafa7-57b2-4711-b982-8c208f85ff32 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060', 'iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '859ffbad-3fc1-400a-a7f7-ac423851f060', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 11 23:11:58.318567 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-fb3bafa7-57b2-4711-b982-8c208f85ff32 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 11 23:11:58.400908 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-4089a89c-b865-4eb8-b095-538b3028492e tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98431) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 11 23:11:58.448916 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:11:58.450742 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98431) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 11 23:11:58.696811 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-add1989e-df80-4804-9bd2-cf702ab3d6de tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Acquiring lock "36688d94-68d3-4ae3-989a-b391d7ee4ad9" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:11:58.696928 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-add1989e-df80-4804-9bd2-cf702ab3d6de tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Lock "36688d94-68d3-4ae3-989a-b391d7ee4ad9" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:11:58.697144 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-add1989e-df80-4804-9bd2-cf702ab3d6de tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Acquiring lock "36688d94-68d3-4ae3-989a-b391d7ee4ad9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:11:58.697284 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-add1989e-df80-4804-9bd2-cf702ab3d6de tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Lock "36688d94-68d3-4ae3-989a-b391d7ee4ad9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:11:58.697390 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-add1989e-df80-4804-9bd2-cf702ab3d6de tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Lock "36688d94-68d3-4ae3-989a-b391d7ee4ad9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:11:58.699563 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-add1989e-df80-4804-9bd2-cf702ab3d6de tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] [instance: 36688d94-68d3-4ae3-989a-b391d7ee4ad9] Terminating instance Jun 11 23:11:58.953837 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Emitting event Started> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:11:58.953981 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] VM Started (Lifecycle Event) Jun 11 23:11:59.068678 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-4a646a8c-ec60-4c89-8400-a6995b91f1d7 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Lock "14699717-b93f-4e67-b841-c67de8fff8d4" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 10.490s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:11:59.098247 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-50d95170-3b66-43b5-8adb-e70adbf32d94 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Acquiring lock "27ac8c84-e5db-4bd1-a148-ec5834c5b39c" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:11:59.098334 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-50d95170-3b66-43b5-8adb-e70adbf32d94 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Lock "27ac8c84-e5db-4bd1-a148-ec5834c5b39c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:11:59.203105 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-add1989e-df80-4804-9bd2-cf702ab3d6de tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] [instance: 36688d94-68d3-4ae3-989a-b391d7ee4ad9] Start destroying the instance on the hypervisor. {{(pid=98431) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}} Jun 11 23:11:59.226856 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:59.230472 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:59.258163 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:59.258163 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:59.288848 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:59.291273 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:11:59.354896 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-3b6b658a-c246-4dde-b7dc-6e48b7ee8736 req-a91f702d-1cdc-451b-b8a1-4798493fb83d service nova] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Received event network-vif-plugged-852fc4ec-82e1-4185-a33c-3c45ff42351e {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:11:59.355502 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-3b6b658a-c246-4dde-b7dc-6e48b7ee8736 req-a91f702d-1cdc-451b-b8a1-4798493fb83d service nova] Acquiring lock "c82748e6-1c78-4372-ad4b-48d1c6448efa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:11:59.355732 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-3b6b658a-c246-4dde-b7dc-6e48b7ee8736 req-a91f702d-1cdc-451b-b8a1-4798493fb83d service nova] Lock "c82748e6-1c78-4372-ad4b-48d1c6448efa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:11:59.355927 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-3b6b658a-c246-4dde-b7dc-6e48b7ee8736 req-a91f702d-1cdc-451b-b8a1-4798493fb83d service nova] Lock "c82748e6-1c78-4372-ad4b-48d1c6448efa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:11:59.356166 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-3b6b658a-c246-4dde-b7dc-6e48b7ee8736 req-a91f702d-1cdc-451b-b8a1-4798493fb83d service nova] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] No waiting events found dispatching network-vif-plugged-852fc4ec-82e1-4185-a33c-3c45ff42351e {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:11:59.356341 np0000002687 nova-compute[98431]: WARNING nova.compute.manager [req-3b6b658a-c246-4dde-b7dc-6e48b7ee8736 req-a91f702d-1cdc-451b-b8a1-4798493fb83d service nova] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Received unexpected event network-vif-plugged-852fc4ec-82e1-4185-a33c-3c45ff42351e for instance with vm_state rescued and task_state None. Jun 11 23:11:59.422455 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-4089a89c-b865-4eb8-b095-538b3028492e tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Found WWN 33000000073fa3d0d for multipath device dm-11 {{(pid=98431) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 11 23:11:59.422871 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-4089a89c-b865-4eb8-b095-538b3028492e tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.037s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 11 23:11:59.423081 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-4089a89c-b865-4eb8-b095-538b3028492e tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] <== connect_volume: return (2038ms) {'type': 'block', 'scsi_wwn': '33000000073fa3d0d', 'path': '/dev/dm-11', 'multipath_id': '33000000073fa3d0d'} {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 11 23:11:59.423253 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4089a89c-b865-4eb8-b095-538b3028492e tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 8ffa4bbe-7ead-4029-aba5-28f031f6e784] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000073fa3d0d', 'path': '/dev/dm-11', 'multipath_id': '33000000073fa3d0d'} {{(pid=98431) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 11 23:11:59.426605 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-fb3bafa7-57b2-4711-b982-8c208f85ff32 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.108s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 11 23:11:59.427088 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-fb3bafa7-57b2-4711-b982-8c208f85ff32 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060', 'iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '859ffbad-3fc1-400a-a7f7-ac423851f060', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98431) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 11 23:11:59.434904 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-4089a89c-b865-4eb8-b095-538b3028492e tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lazy-loading 'flavor' on Instance uuid 8ffa4bbe-7ead-4029-aba5-28f031f6e784 {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:11:59.439708 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-fb3bafa7-57b2-4711-b982-8c208f85ff32 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 11 23:11:59.440583 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-fb3bafa7-57b2-4711-b982-8c208f85ff32 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 11 23:11:59.441054 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-fb3bafa7-57b2-4711-b982-8c208f85ff32 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 11 23:11:59.441286 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.iscsi [None req-fb3bafa7-57b2-4711-b982-8c208f85ff32 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 11 23:11:59.441592 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-fb3bafa7-57b2-4711-b982-8c208f85ff32 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 11 23:11:59.441766 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.iscsi [None req-fb3bafa7-57b2-4711-b982-8c208f85ff32 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 11 23:11:59.457857 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:11:59.459216 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb3bafa7-57b2-4711-b982-8c208f85ff32 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 11 23:11:59.459216 np0000002687 nova-compute[98431]: {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:59.461612 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb3bafa7-57b2-4711-b982-8c208f85ff32 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 11 23:11:59.461612 np0000002687 nova-compute[98431]: {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:59.464454 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-54b04128-9f35-434f-8dd2-86915d4373b3 req-bee99097-5663-4cbf-89a0-ecd44e23a23b service nova] [instance: 36688d94-68d3-4ae3-989a-b391d7ee4ad9] Received event network-vif-unplugged-6075e13d-d32a-4d8f-8741-a4686059985e {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:11:59.465794 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-54b04128-9f35-434f-8dd2-86915d4373b3 req-bee99097-5663-4cbf-89a0-ecd44e23a23b service nova] Acquiring lock "36688d94-68d3-4ae3-989a-b391d7ee4ad9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:11:59.466494 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-54b04128-9f35-434f-8dd2-86915d4373b3 req-bee99097-5663-4cbf-89a0-ecd44e23a23b service nova] Lock "36688d94-68d3-4ae3-989a-b391d7ee4ad9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:11:59.466494 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-54b04128-9f35-434f-8dd2-86915d4373b3 req-bee99097-5663-4cbf-89a0-ecd44e23a23b service nova] Lock "36688d94-68d3-4ae3-989a-b391d7ee4ad9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:11:59.466494 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-54b04128-9f35-434f-8dd2-86915d4373b3 req-bee99097-5663-4cbf-89a0-ecd44e23a23b service nova] [instance: 36688d94-68d3-4ae3-989a-b391d7ee4ad9] No waiting events found dispatching network-vif-unplugged-6075e13d-d32a-4d8f-8741-a4686059985e {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:11:59.466494 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-54b04128-9f35-434f-8dd2-86915d4373b3 req-bee99097-5663-4cbf-89a0-ecd44e23a23b service nova] [instance: 36688d94-68d3-4ae3-989a-b391d7ee4ad9] Received event network-vif-unplugged-6075e13d-d32a-4d8f-8741-a4686059985e for instance with task_state deleting. {{(pid=98431) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 11 23:11:59.467061 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98431) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 11 23:11:59.476916 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb3bafa7-57b2-4711-b982-8c208f85ff32 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060] added Jun 11 23:11:59.476916 np0000002687 nova-compute[98431]: stderr=iscsiadm: Config file line 363 does not have value Jun 11 23:11:59.476916 np0000002687 nova-compute[98431]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 11 23:11:59.476916 np0000002687 nova-compute[98431]: iscsiadm: Config file line 363 does not have value Jun 11 23:11:59.476916 np0000002687 nova-compute[98431]: iscsiadm: Config file line 363 does not have value Jun 11 23:11:59.476916 np0000002687 nova-compute[98431]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 11 23:11:59.476916 np0000002687 nova-compute[98431]: {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:59.476916 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb3bafa7-57b2-4711-b982-8c208f85ff32 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98431) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 11 23:11:59.477215 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-fb3bafa7-57b2-4711-b982-8c208f85ff32 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0353(s), this was the 1st time calling it. {{(pid=98431) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 11 23:11:59.477296 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-fb3bafa7-57b2-4711-b982-8c208f85ff32 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98431) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 11 23:11:59.479728 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb3bafa7-57b2-4711-b982-8c208f85ff32 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060] added Jun 11 23:11:59.479728 np0000002687 nova-compute[98431]: stderr=iscsiadm: Config file line 363 does not have value Jun 11 23:11:59.479728 np0000002687 nova-compute[98431]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 11 23:11:59.479728 np0000002687 nova-compute[98431]: iscsiadm: Config file line 363 does not have value Jun 11 23:11:59.479728 np0000002687 nova-compute[98431]: iscsiadm: Config file line 363 does not have value Jun 11 23:11:59.479728 np0000002687 nova-compute[98431]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 11 23:11:59.479728 np0000002687 nova-compute[98431]: {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:11:59.480070 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb3bafa7-57b2-4711-b982-8c208f85ff32 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98431) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 11 23:11:59.480124 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-fb3bafa7-57b2-4711-b982-8c208f85ff32 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0388(s), this was the 1st time calling it. {{(pid=98431) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 11 23:11:59.480284 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-fb3bafa7-57b2-4711-b982-8c208f85ff32 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98431) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 11 23:11:59.562137 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [-] [instance: 36688d94-68d3-4ae3-989a-b391d7ee4ad9] Instance destroyed successfully. Jun 11 23:11:59.562137 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-add1989e-df80-4804-9bd2-cf702ab3d6de tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Lazy-loading 'resources' on Instance uuid 36688d94-68d3-4ae3-989a-b391d7ee4ad9 {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:11:59.603183 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-50d95170-3b66-43b5-8adb-e70adbf32d94 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Lazy-loading 'flavor' on Instance uuid 27ac8c84-e5db-4bd1-a148-ec5834c5b39c {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:11:59.615377 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-91030f7c-06ab-46ce-9a29-9010afbca4e9 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] Acquiring lock "73abd331-0bbf-432e-be1c-308801a5429f" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:11:59.617517 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-91030f7c-06ab-46ce-9a29-9010afbca4e9 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] Lock "73abd331-0bbf-432e-be1c-308801a5429f" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:11:59.617910 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-91030f7c-06ab-46ce-9a29-9010afbca4e9 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] Acquiring lock "73abd331-0bbf-432e-be1c-308801a5429f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:11:59.618438 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-91030f7c-06ab-46ce-9a29-9010afbca4e9 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] Lock "73abd331-0bbf-432e-be1c-308801a5429f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:11:59.618438 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-91030f7c-06ab-46ce-9a29-9010afbca4e9 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] Lock "73abd331-0bbf-432e-be1c-308801a5429f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:11:59.620386 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-91030f7c-06ab-46ce-9a29-9010afbca4e9 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] [instance: 73abd331-0bbf-432e-be1c-308801a5429f] Terminating instance Jun 11 23:11:59.946021 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-4089a89c-b865-4eb8-b095-538b3028492e tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 8ffa4bbe-7ead-4029-aba5-28f031f6e784] Attempting to attach volume 4da6c3da-4a1a-454c-b611-7fa9fc0832d8 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98431) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}} Jun 11 23:11:59.946989 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.guest [None req-4089a89c-b865-4eb8-b095-538b3028492e tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] attach device xml: Jun 11 23:11:59.946989 np0000002687 nova-compute[98431]: Jun 11 23:11:59.946989 np0000002687 nova-compute[98431]: Jun 11 23:11:59.946989 np0000002687 nova-compute[98431]: Jun 11 23:11:59.946989 np0000002687 nova-compute[98431]: Jun 11 23:11:59.946989 np0000002687 nova-compute[98431]: 4da6c3da-4a1a-454c-b611-7fa9fc0832d8 Jun 11 23:11:59.946989 np0000002687 nova-compute[98431]: Jun 11 23:11:59.946989 np0000002687 nova-compute[98431]: Jun 11 23:11:59.946989 np0000002687 nova-compute[98431]: {{(pid=98431) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} Jun 11 23:11:59.972872 np0000002687 nova-compute[98431]: DEBUG nova.utils [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Queued Task(fn=>, remaining_delay=14.999728810000079 future=) {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:11:59.973305 np0000002687 nova-compute[98431]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=14.999266327999976 future=) {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:11:59.973415 np0000002687 nova-compute[98431]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=14.99910729499993 future=) {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:12:00.064413 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-add1989e-df80-4804-9bd2-cf702ab3d6de tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-11T23:10:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1868622634',display_name='tempest-AttachSCSIVolumeTestJSON-server-1868622634',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='tempest-attachscsivolumetestjson-server-1868622634',id=5,image_ref='65e91f66-f375-4f5e-9b57-399258d96eca',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF1thjFvorvXqsEH/7y5pYr+XHh+/ziAmsipnoBI0/9KJESyszMx6EprZ77ONfMl5p2ViNQRpHNo2K7BPs6Tmw9iYp3BPUj79pp4DPz6glAqMmKCXoLegWno83hW4fAPmg==',key_name='tempest-keypair-243904066',keypairs=,launch_index=0,launched_at=2026-06-11T23:10:57Z,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='ae41a1c4221b4e7483281a8b80f16ee6',ramdisk_id='',reservation_id='r-52nfjfhu',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='65e91f66-f375-4f5e-9b57-399258d96eca',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-613359672',owner_user_name='tempest-AttachSCSIVolumeTestJSON-613359672-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-11T23:10:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='776c0e8b8bb74ffea6010d632b9ba0d0',uuid=36688d94-68d3-4ae3-989a-b391d7ee4ad9,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6075e13d-d32a-4d8f-8741-a4686059985e", "address": "fa:16:3e:8e:89:22", "network": {"id": "e87d6560-c7a9-4b70-83f1-b0863de32387", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1405293341-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ae41a1c4221b4e7483281a8b80f16ee6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6075e13d-d3", "ovs_interfaceid": "6075e13d-d32a-4d8f-8741-a4686059985e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 11 23:12:00.064621 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-add1989e-df80-4804-9bd2-cf702ab3d6de tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Converting VIF {"id": "6075e13d-d32a-4d8f-8741-a4686059985e", "address": "fa:16:3e:8e:89:22", "network": {"id": "e87d6560-c7a9-4b70-83f1-b0863de32387", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1405293341-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ae41a1c4221b4e7483281a8b80f16ee6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6075e13d-d3", "ovs_interfaceid": "6075e13d-d32a-4d8f-8741-a4686059985e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:12:00.065242 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-add1989e-df80-4804-9bd2-cf702ab3d6de tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8e:89:22,bridge_name='br-int',has_traffic_filtering=True,id=6075e13d-d32a-4d8f-8741-a4686059985e,network=Network(e87d6560-c7a9-4b70-83f1-b0863de32387),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6075e13d-d3') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:12:00.065499 np0000002687 nova-compute[98431]: DEBUG os_vif [None req-add1989e-df80-4804-9bd2-cf702ab3d6de tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:89:22,bridge_name='br-int',has_traffic_filtering=True,id=6075e13d-d32a-4d8f-8741-a4686059985e,network=Network(e87d6560-c7a9-4b70-83f1-b0863de32387),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6075e13d-d3') {{(pid=98431) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 11 23:12:00.066810 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:00.067025 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6075e13d-d3, bridge=br-int, if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:12:00.068416 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:00.069464 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:12:00.070463 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:00.070612 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=463d949e-f594-488e-bfbc-ceb854b9a5b5) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:12:00.071205 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:00.071669 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:12:00.072284 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:00.074301 np0000002687 nova-compute[98431]: INFO os_vif [None req-add1989e-df80-4804-9bd2-cf702ab3d6de tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:89:22,bridge_name='br-int',has_traffic_filtering=True,id=6075e13d-d32a-4d8f-8741-a4686059985e,network=Network(e87d6560-c7a9-4b70-83f1-b0863de32387),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6075e13d-d3') Jun 11 23:12:00.074609 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-add1989e-df80-4804-9bd2-cf702ab3d6de tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] [instance: 36688d94-68d3-4ae3-989a-b391d7ee4ad9] Deleting instance files /opt/stack/data/nova/instances/36688d94-68d3-4ae3-989a-b391d7ee4ad9_del Jun 11 23:12:00.075498 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-add1989e-df80-4804-9bd2-cf702ab3d6de tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] [instance: 36688d94-68d3-4ae3-989a-b391d7ee4ad9] Deletion of /opt/stack/data/nova/instances/36688d94-68d3-4ae3-989a-b391d7ee4ad9_del complete Jun 11 23:12:00.124523 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-91030f7c-06ab-46ce-9a29-9010afbca4e9 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] [instance: 73abd331-0bbf-432e-be1c-308801a5429f] Start destroying the instance on the hypervisor. {{(pid=98431) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}} Jun 11 23:12:00.152068 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:00.155827 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:00.157540 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-064e4429-4a53-482d-9918-5822f12f669e tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Unrescuing Jun 11 23:12:00.161881 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-064e4429-4a53-482d-9918-5822f12f669e tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Acquiring lock "refresh_cache-c82748e6-1c78-4372-ad4b-48d1c6448efa" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 11 23:12:00.161881 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-064e4429-4a53-482d-9918-5822f12f669e tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Acquired lock "refresh_cache-c82748e6-1c78-4372-ad4b-48d1c6448efa" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 11 23:12:00.161881 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-064e4429-4a53-482d-9918-5822f12f669e tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Building network info cache for instance {{(pid=98431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 11 23:12:00.181227 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:00.187763 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:00.217974 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:00.219184 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:00.350683 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-ba06508a-d1e6-433b-9d80-79a536573b62 req-ce3f7146-3970-4917-9832-1e3d3dd5d314 service nova] [instance: 73abd331-0bbf-432e-be1c-308801a5429f] Received event network-vif-unplugged-d1203b92-b9d5-4d1c-bc39-326783c31294 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:12:00.351187 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-ba06508a-d1e6-433b-9d80-79a536573b62 req-ce3f7146-3970-4917-9832-1e3d3dd5d314 service nova] Acquiring lock "73abd331-0bbf-432e-be1c-308801a5429f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:12:00.352180 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-ba06508a-d1e6-433b-9d80-79a536573b62 req-ce3f7146-3970-4917-9832-1e3d3dd5d314 service nova] Lock "73abd331-0bbf-432e-be1c-308801a5429f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:12:00.352383 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-ba06508a-d1e6-433b-9d80-79a536573b62 req-ce3f7146-3970-4917-9832-1e3d3dd5d314 service nova] Lock "73abd331-0bbf-432e-be1c-308801a5429f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:12:00.352480 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-ba06508a-d1e6-433b-9d80-79a536573b62 req-ce3f7146-3970-4917-9832-1e3d3dd5d314 service nova] [instance: 73abd331-0bbf-432e-be1c-308801a5429f] No waiting events found dispatching network-vif-unplugged-d1203b92-b9d5-4d1c-bc39-326783c31294 {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:12:00.352883 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-ba06508a-d1e6-433b-9d80-79a536573b62 req-ce3f7146-3970-4917-9832-1e3d3dd5d314 service nova] [instance: 73abd331-0bbf-432e-be1c-308801a5429f] Received event network-vif-unplugged-d1203b92-b9d5-4d1c-bc39-326783c31294 for instance with task_state deleting. {{(pid=98431) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 11 23:12:00.480119 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.iscsi [None req-fb3bafa7-57b2-4711-b982-8c208f85ff32 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 11 23:12:00.481149 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.iscsi [None req-fb3bafa7-57b2-4711-b982-8c208f85ff32 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 11 23:12:00.488120 np0000002687 nova-compute[98431]: DEBUG nova.utils [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Queued Task(fn=>, remaining_delay=14.999617815000192 future=) {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:12:00.490388 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [-] [instance: 73abd331-0bbf-432e-be1c-308801a5429f] Instance destroyed successfully. Jun 11 23:12:00.490887 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-91030f7c-06ab-46ce-9a29-9010afbca4e9 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] Lazy-loading 'resources' on Instance uuid 73abd331-0bbf-432e-be1c-308801a5429f {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:12:00.494763 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb3bafa7-57b2-4711-b982-8c208f85ff32 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 11 23:12:00.494763 np0000002687 nova-compute[98431]: node.name = iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060 Jun 11 23:12:00.494763 np0000002687 nova-compute[98431]: node.tpgt = -1 Jun 11 23:12:00.494763 np0000002687 nova-compute[98431]: node.startup = manual Jun 11 23:12:00.494763 np0000002687 nova-compute[98431]: node.leading_login = No Jun 11 23:12:00.494763 np0000002687 nova-compute[98431]: iface.iscsi_ifacename = default Jun 11 23:12:00.494763 np0000002687 nova-compute[98431]: iface.net_ifacename = Jun 11 23:12:00.494763 np0000002687 nova-compute[98431]: iface.ipaddress = Jun 11 23:12:00.494763 np0000002687 nova-compute[98431]: iface.prefix_len = 0 Jun 11 23:12:00.494763 np0000002687 nova-compute[98431]: iface.hwaddress = Jun 11 23:12:00.494763 np0000002687 nova-compute[98431]: iface.transport_name = tcp Jun 11 23:12:00.494763 np0000002687 nova-compute[98431]: iface.initiatorname = Jun 11 23:12:00.494763 np0000002687 nova-compute[98431]: iface.state = Jun 11 23:12:00.494763 np0000002687 nova-compute[98431]: iface.vlan_id = 0 Jun 11 23:12:00.494763 np0000002687 nova-compute[98431]: iface.vlan_priority = 0 Jun 11 23:12:00.494763 np0000002687 nova-compute[98431]: iface.vlan_state = Jun 11 23:12:00.494763 np0000002687 nova-compute[98431]: iface.iface_num = 0 Jun 11 23:12:00.494763 np0000002687 nova-compute[98431]: iface.mtu = 0 Jun 11 23:12:00.494763 np0000002687 nova-compute[98431]: iface.port = 0 Jun 11 23:12:00.494763 np0000002687 nova-compute[98431]: iface.bootproto = Jun 11 23:12:00.494763 np0000002687 nova-compute[98431]: iface.subnet_mask = Jun 11 23:12:00.494763 np0000002687 nova-compute[98431]: iface.gateway = Jun 11 23:12:00.494763 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id_state = Jun 11 23:12:00.494763 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id = Jun 11 23:12:00.494763 np0000002687 nova-compute[98431]: iface.dhcp_dns = Jun 11 23:12:00.494763 np0000002687 nova-compute[98431]: iface.dhcp_learn_iqn = Jun 11 23:12:00.494763 np0000002687 nova-compute[98431]: iface.dhcp_req_vendor_id_state = Jun 11 23:12:00.494763 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id_state = Jun 11 23:12:00.494763 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id = Jun 11 23:12:00.494763 np0000002687 nova-compute[98431]: iface.dhcp_slp_da = Jun 11 23:12:00.494763 np0000002687 nova-compute[98431]: iface.fragmentation = Jun 11 23:12:00.494763 np0000002687 nova-compute[98431]: iface.gratuitous_arp = Jun 11 23:12:00.494763 np0000002687 nova-compute[98431]: iface.incoming_forwarding = Jun 11 23:12:00.494763 np0000002687 nova-compute[98431]: iface.tos_state = Jun 11 23:12:00.494763 np0000002687 nova-compute[98431]: iface.tos = 0 Jun 11 23:12:00.494763 np0000002687 nova-compute[98431]: iface.ttl = 0 Jun 11 23:12:00.494763 np0000002687 nova-compute[98431]: iface.delayed_ack = Jun 11 23:12:00.494763 np0000002687 nova-compute[98431]: iface.tcp_nagle = Jun 11 23:12:00.494763 np0000002687 nova-compute[98431]: iface.tcp_wsf_state = Jun 11 23:12:00.494763 np0000002687 nova-compute[98431]: iface.tcp_wsf = 0 Jun 11 23:12:00.494763 np0000002687 nova-compute[98431]: iface.tcp_timer_scale = 0 Jun 11 23:12:00.494763 np0000002687 nova-compute[98431]: iface.tcp_timestamp = Jun 11 23:12:00.494763 np0000002687 nova-compute[98431]: iface.redirect = Jun 11 23:12:00.494763 np0000002687 nova-compute[98431]: iface.def_task_mgmt_timeout = 0 Jun 11 23:12:00.494763 np0000002687 nova-compute[98431]: iface.header_digest = Jun 11 23:12:00.494763 np0000002687 nova-compute[98431]: iface.data_digest = Jun 11 23:12:00.494763 np0000002687 nova-compute[98431]: iface.immediate_data = Jun 11 23:12:00.494763 np0000002687 nova-compute[98431]: iface.initial_r2t = Jun 11 23:12:00.494763 np0000002687 nova-compute[98431]: iface.data_seq_inorder = Jun 11 23:12:00.494763 np0000002687 nova-compute[98431]: iface.data_pdu_inorder = Jun 11 23:12:00.494763 np0000002687 nova-compute[98431]: iface.erl = 0 Jun 11 23:12:00.494763 np0000002687 nova-compute[98431]: iface.max_receive_data_len = 0 Jun 11 23:12:00.494763 np0000002687 nova-compute[98431]: iface.first_burst_len = 0 Jun 11 23:12:00.494763 np0000002687 nova-compute[98431]: iface.max_outstanding_r2t = 0 Jun 11 23:12:00.494763 np0000002687 nova-compute[98431]: iface.max_burst_len = 0 Jun 11 23:12:00.494763 np0000002687 nova-compute[98431]: iface.chap_auth = Jun 11 23:12:00.494763 np0000002687 nova-compute[98431]: iface.bidi_chap = Jun 11 23:12:00.494763 np0000002687 nova-compute[98431]: iface.strict_login_compliance = Jun 11 23:12:00.494763 np0000002687 nova-compute[98431]: iface.discovery_auth = Jun 11 23:12:00.494763 np0000002687 nova-compute[98431]: iface.discovery_logout = Jun 11 23:12:00.494763 np0000002687 nova-compute[98431]: node.discovery_address = Jun 11 23:12:00.494763 np0000002687 nova-compute[98431]: node.discovery_port = 0 Jun 11 23:12:00.494763 np0000002687 nova-compute[98431]: node.discovery_type = fw Jun 11 23:12:00.494763 np0000002687 nova-compute[98431]: node.session.initial_cmdsn = 0 Jun 11 23:12:00.494763 np0000002687 nova-compute[98431]: node.session.initial_login_retry_max = 8 Jun 11 23:12:00.494763 np0000002687 nova-compute[98431]: node.session.xmit_thread_priority = 0 Jun 11 23:12:00.494763 np0000002687 nova-compute[98431]: node.session.cmds_max = 128 Jun 11 23:12:00.494763 np0000002687 nova-compute[98431]: node.session.queue_depth = 32 Jun 11 23:12:00.494763 np0000002687 nova-compute[98431]: node.session.nr_sessions = 1 Jun 11 23:12:00.494763 np0000002687 nova-compute[98431]: node.session.auth.authmethod = None Jun 11 23:12:00.494763 np0000002687 nova-compute[98431]: node.session.auth.username = Jun 11 23:12:00.494763 np0000002687 nova-compute[98431]: node.session.auth.password = *** Jun 11 23:12:00.494763 np0000002687 nova-compute[98431]: node.session.auth.username_in = Jun 11 23:12:00.494763 np0000002687 nova-compute[98431]: node.session.auth.password_in = Jun 11 23:12:00.494763 np0000002687 nova-compute[98431]: node.session.auth.chap_algs = SHA256 Jun 11 23:12:00.494763 np0000002687 nova-compute[98431]: node.session.timeo.replacement_timeout = 120 Jun 11 23:12:00.494763 np0000002687 nova-compute[98431]: node.session.err_timeo.abort_timeout = 15 Jun 11 23:12:00.494763 np0000002687 nova-compute[98431]: node.session.err_timeo.lu_reset_timeout = 30 Jun 11 23:12:00.494763 np0000002687 nova-compute[98431]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 11 23:12:00.494763 np0000002687 nova-compute[98431]: node.session.err_timeo.host_reset_timeout = 60 Jun 11 23:12:00.494763 np0000002687 nova-compute[98431]: node.session.iscsi.FastAbort = Yes Jun 11 23:12:00.494763 np0000002687 nova-compute[98431]: node.session.iscsi.InitialR2T = No Jun 11 23:12:00.494763 np0000002687 nova-compute[98431]: node.session.iscsi.ImmediateData = Yes Jun 11 23:12:00.494763 np0000002687 nova-compute[98431]: node.session.iscsi.FirstBurstLength = 262144 Jun 11 23:12:00.494763 np0000002687 nova-compute[98431]: node.session.iscsi.MaxBurstLength = 16776192 Jun 11 23:12:00.494763 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Retain = 0 Jun 11 23:12:00.494763 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Wait = 2 Jun 11 23:12:00.494763 np0000002687 nova-compute[98431]: node.session.iscsi.MaxConnections = 1 Jun 11 23:12:00.494763 np0000002687 nova-compute[98431]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 11 23:12:00.494763 np0000002687 nova-compute[98431]: node.session.iscsi.ERL = 0 Jun 11 23:12:00.494763 np0000002687 nova-compute[98431]: node.session.scan = auto Jun 11 23:12:00.494763 np0000002687 nova-compute[98431]: node.session.reopen_max = 0 Jun 11 23:12:00.494763 np0000002687 nova-compute[98431]: node.conn[0].address = 192.168.40.100 Jun 11 23:12:00.494763 np0000002687 nova-compute[98431]: node.conn[0].port = 3260 Jun 11 23:12:00.494763 np0000002687 nova-compute[98431]: node.conn[0].startup = manual Jun 11 23:12:00.494763 np0000002687 nova-compute[98431]: node.conn[0].tcp.window_size = 524288 Jun 11 23:12:00.494763 np0000002687 nova-compute[98431]: node.conn[0].tcp.type_of_service = 0 Jun 11 23:12:00.494763 np0000002687 nova-compute[98431]: node.conn[0].timeo.logout_timeout = 15 Jun 11 23:12:00.494763 np0000002687 nova-compute[98431]: node.conn[0].timeo.login_timeout = 15 Jun 11 23:12:00.494763 np0000002687 nova-compute[98431]: node.conn[0].timeo.auth_timeout = 45 Jun 11 23:12:00.494763 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_interval = 5 Jun 11 23:12:00.494763 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_timeout = 5 Jun 11 23:12:00.494763 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 11 23:12:00.494763 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 11 23:12:00.494763 np0000002687 nova-compute[98431]: node.conn[0].iscsi.HeaderDigest = None Jun 11 23:12:00.494763 np0000002687 nova-compute[98431]: node.conn[0].iscsi.DataDigest = None Jun 11 23:12:00.494763 np0000002687 nova-compute[98431]: node.conn[0].iscsi.IFMarker = No Jun 11 23:12:00.494763 np0000002687 nova-compute[98431]: node.conn[0].iscsi.OFMarker = No Jun 11 23:12:00.494763 np0000002687 nova-compute[98431]: # END RECORD Jun 11 23:12:00.494763 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:12:00.500662 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb3bafa7-57b2-4711-b982-8c208f85ff32 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 11 23:12:00.500662 np0000002687 nova-compute[98431]: node.name = iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060 Jun 11 23:12:00.500662 np0000002687 nova-compute[98431]: node.tpgt = -1 Jun 11 23:12:00.500662 np0000002687 nova-compute[98431]: node.startup = manual Jun 11 23:12:00.500662 np0000002687 nova-compute[98431]: node.leading_login = No Jun 11 23:12:00.500662 np0000002687 nova-compute[98431]: iface.iscsi_ifacename = default Jun 11 23:12:00.500662 np0000002687 nova-compute[98431]: iface.net_ifacename = Jun 11 23:12:00.500662 np0000002687 nova-compute[98431]: iface.ipaddress = Jun 11 23:12:00.500662 np0000002687 nova-compute[98431]: iface.prefix_len = 0 Jun 11 23:12:00.500662 np0000002687 nova-compute[98431]: iface.hwaddress = Jun 11 23:12:00.500662 np0000002687 nova-compute[98431]: iface.transport_name = tcp Jun 11 23:12:00.500662 np0000002687 nova-compute[98431]: iface.initiatorname = Jun 11 23:12:00.500662 np0000002687 nova-compute[98431]: iface.state = Jun 11 23:12:00.500662 np0000002687 nova-compute[98431]: iface.vlan_id = 0 Jun 11 23:12:00.500662 np0000002687 nova-compute[98431]: iface.vlan_priority = 0 Jun 11 23:12:00.500662 np0000002687 nova-compute[98431]: iface.vlan_state = Jun 11 23:12:00.500662 np0000002687 nova-compute[98431]: iface.iface_num = 0 Jun 11 23:12:00.500662 np0000002687 nova-compute[98431]: iface.mtu = 0 Jun 11 23:12:00.500662 np0000002687 nova-compute[98431]: iface.port = 0 Jun 11 23:12:00.500662 np0000002687 nova-compute[98431]: iface.bootproto = Jun 11 23:12:00.500662 np0000002687 nova-compute[98431]: iface.subnet_mask = Jun 11 23:12:00.500662 np0000002687 nova-compute[98431]: iface.gateway = Jun 11 23:12:00.500662 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id_state = Jun 11 23:12:00.500662 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id = Jun 11 23:12:00.500662 np0000002687 nova-compute[98431]: iface.dhcp_dns = Jun 11 23:12:00.500662 np0000002687 nova-compute[98431]: iface.dhcp_learn_iqn = Jun 11 23:12:00.500662 np0000002687 nova-compute[98431]: iface.dhcp_req_vendor_id_state = Jun 11 23:12:00.500662 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id_state = Jun 11 23:12:00.500662 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id = Jun 11 23:12:00.500662 np0000002687 nova-compute[98431]: iface.dhcp_slp_da = Jun 11 23:12:00.500662 np0000002687 nova-compute[98431]: iface.fragmentation = Jun 11 23:12:00.500662 np0000002687 nova-compute[98431]: iface.gratuitous_arp = Jun 11 23:12:00.500662 np0000002687 nova-compute[98431]: iface.incoming_forwarding = Jun 11 23:12:00.500662 np0000002687 nova-compute[98431]: iface.tos_state = Jun 11 23:12:00.500662 np0000002687 nova-compute[98431]: iface.tos = 0 Jun 11 23:12:00.500662 np0000002687 nova-compute[98431]: iface.ttl = 0 Jun 11 23:12:00.500662 np0000002687 nova-compute[98431]: iface.delayed_ack = Jun 11 23:12:00.500662 np0000002687 nova-compute[98431]: iface.tcp_nagle = Jun 11 23:12:00.500662 np0000002687 nova-compute[98431]: iface.tcp_wsf_state = Jun 11 23:12:00.500662 np0000002687 nova-compute[98431]: iface.tcp_wsf = 0 Jun 11 23:12:00.500662 np0000002687 nova-compute[98431]: iface.tcp_timer_scale = 0 Jun 11 23:12:00.500662 np0000002687 nova-compute[98431]: iface.tcp_timestamp = Jun 11 23:12:00.500662 np0000002687 nova-compute[98431]: iface.redirect = Jun 11 23:12:00.500662 np0000002687 nova-compute[98431]: iface.def_task_mgmt_timeout = 0 Jun 11 23:12:00.500662 np0000002687 nova-compute[98431]: iface.header_digest = Jun 11 23:12:00.500662 np0000002687 nova-compute[98431]: iface.data_digest = Jun 11 23:12:00.500662 np0000002687 nova-compute[98431]: iface.immediate_data = Jun 11 23:12:00.500662 np0000002687 nova-compute[98431]: iface.initial_r2t = Jun 11 23:12:00.500662 np0000002687 nova-compute[98431]: iface.data_seq_inorder = Jun 11 23:12:00.500662 np0000002687 nova-compute[98431]: iface.data_pdu_inorder = Jun 11 23:12:00.500662 np0000002687 nova-compute[98431]: iface.erl = 0 Jun 11 23:12:00.500662 np0000002687 nova-compute[98431]: iface.max_receive_data_len = 0 Jun 11 23:12:00.500662 np0000002687 nova-compute[98431]: iface.first_burst_len = 0 Jun 11 23:12:00.500662 np0000002687 nova-compute[98431]: iface.max_outstanding_r2t = 0 Jun 11 23:12:00.500662 np0000002687 nova-compute[98431]: iface.max_burst_len = 0 Jun 11 23:12:00.500662 np0000002687 nova-compute[98431]: iface.chap_auth = Jun 11 23:12:00.500662 np0000002687 nova-compute[98431]: iface.bidi_chap = Jun 11 23:12:00.500662 np0000002687 nova-compute[98431]: iface.strict_login_compliance = Jun 11 23:12:00.500662 np0000002687 nova-compute[98431]: iface.discovery_auth = Jun 11 23:12:00.500662 np0000002687 nova-compute[98431]: iface.discovery_logout = Jun 11 23:12:00.500662 np0000002687 nova-compute[98431]: node.discovery_address = Jun 11 23:12:00.500662 np0000002687 nova-compute[98431]: node.discovery_port = 0 Jun 11 23:12:00.500662 np0000002687 nova-compute[98431]: node.discovery_type = fw Jun 11 23:12:00.500662 np0000002687 nova-compute[98431]: node.session.initial_cmdsn = 0 Jun 11 23:12:00.500662 np0000002687 nova-compute[98431]: node.session.initial_login_retry_max = 8 Jun 11 23:12:00.500662 np0000002687 nova-compute[98431]: node.session.xmit_thread_priority = 0 Jun 11 23:12:00.500662 np0000002687 nova-compute[98431]: node.session.cmds_max = 128 Jun 11 23:12:00.500662 np0000002687 nova-compute[98431]: node.session.queue_depth = 32 Jun 11 23:12:00.500662 np0000002687 nova-compute[98431]: node.session.nr_sessions = 1 Jun 11 23:12:00.500662 np0000002687 nova-compute[98431]: node.session.auth.authmethod = None Jun 11 23:12:00.500662 np0000002687 nova-compute[98431]: node.session.auth.username = Jun 11 23:12:00.500662 np0000002687 nova-compute[98431]: node.session.auth.password = *** Jun 11 23:12:00.500662 np0000002687 nova-compute[98431]: node.session.auth.username_in = Jun 11 23:12:00.500662 np0000002687 nova-compute[98431]: node.session.auth.password_in = Jun 11 23:12:00.500662 np0000002687 nova-compute[98431]: node.session.auth.chap_algs = SHA256 Jun 11 23:12:00.500662 np0000002687 nova-compute[98431]: node.session.timeo.replacement_timeout = 120 Jun 11 23:12:00.500662 np0000002687 nova-compute[98431]: node.session.err_timeo.abort_timeout = 15 Jun 11 23:12:00.500662 np0000002687 nova-compute[98431]: node.session.err_timeo.lu_reset_timeout = 30 Jun 11 23:12:00.500662 np0000002687 nova-compute[98431]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 11 23:12:00.500662 np0000002687 nova-compute[98431]: node.session.err_timeo.host_reset_timeout = 60 Jun 11 23:12:00.500662 np0000002687 nova-compute[98431]: node.session.iscsi.FastAbort = Yes Jun 11 23:12:00.500662 np0000002687 nova-compute[98431]: node.session.iscsi.InitialR2T = No Jun 11 23:12:00.500662 np0000002687 nova-compute[98431]: node.session.iscsi.ImmediateData = Yes Jun 11 23:12:00.500662 np0000002687 nova-compute[98431]: node.session.iscsi.FirstBurstLength = 262144 Jun 11 23:12:00.500662 np0000002687 nova-compute[98431]: node.session.iscsi.MaxBurstLength = 16776192 Jun 11 23:12:00.500662 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Retain = 0 Jun 11 23:12:00.500662 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Wait = 2 Jun 11 23:12:00.500662 np0000002687 nova-compute[98431]: node.session.iscsi.MaxConnections = 1 Jun 11 23:12:00.500662 np0000002687 nova-compute[98431]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 11 23:12:00.500662 np0000002687 nova-compute[98431]: node.session.iscsi.ERL = 0 Jun 11 23:12:00.500662 np0000002687 nova-compute[98431]: node.session.scan = auto Jun 11 23:12:00.500662 np0000002687 nova-compute[98431]: node.session.reopen_max = 0 Jun 11 23:12:00.500662 np0000002687 nova-compute[98431]: node.conn[0].address = 192.168.50.100 Jun 11 23:12:00.500662 np0000002687 nova-compute[98431]: node.conn[0].port = 3260 Jun 11 23:12:00.500662 np0000002687 nova-compute[98431]: node.conn[0].startup = manual Jun 11 23:12:00.500662 np0000002687 nova-compute[98431]: node.conn[0].tcp.window_size = 524288 Jun 11 23:12:00.500662 np0000002687 nova-compute[98431]: node.conn[0].tcp.type_of_service = 0 Jun 11 23:12:00.500662 np0000002687 nova-compute[98431]: node.conn[0].timeo.logout_timeout = 15 Jun 11 23:12:00.500662 np0000002687 nova-compute[98431]: node.conn[0].timeo.login_timeout = 15 Jun 11 23:12:00.500662 np0000002687 nova-compute[98431]: node.conn[0].timeo.auth_timeout = 45 Jun 11 23:12:00.500662 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_interval = 5 Jun 11 23:12:00.500662 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_timeout = 5 Jun 11 23:12:00.500662 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 11 23:12:00.500662 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 11 23:12:00.500662 np0000002687 nova-compute[98431]: node.conn[0].iscsi.HeaderDigest = None Jun 11 23:12:00.500662 np0000002687 nova-compute[98431]: node.conn[0].iscsi.DataDigest = None Jun 11 23:12:00.500662 np0000002687 nova-compute[98431]: node.conn[0].iscsi.IFMarker = No Jun 11 23:12:00.500662 np0000002687 nova-compute[98431]: node.conn[0].iscsi.OFMarker = No Jun 11 23:12:00.500662 np0000002687 nova-compute[98431]: # END RECORD Jun 11 23:12:00.500662 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:12:00.507221 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb3bafa7-57b2-4711-b982-8c208f85ff32 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:12:00.513332 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb3bafa7-57b2-4711-b982-8c208f85ff32 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:12:00.533120 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb3bafa7-57b2-4711-b982-8c208f85ff32 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:12:00.533120 np0000002687 nova-compute[98431]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:12:00.533120 np0000002687 nova-compute[98431]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:12:00.533120 np0000002687 nova-compute[98431]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:12:00.533120 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:12:00.533120 np0000002687 nova-compute[98431]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8 (non-flash) Jun 11 23:12:00.533120 np0000002687 nova-compute[98431]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8 (non-flash) Jun 11 23:12:00.533120 np0000002687 nova-compute[98431]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce (non-flash) Jun 11 23:12:00.533120 np0000002687 nova-compute[98431]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce (non-flash) Jun 11 23:12:00.533120 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:12:00.533120 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:12:00.533120 np0000002687 nova-compute[98431]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:12:00.533120 np0000002687 nova-compute[98431]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:12:00.533120 np0000002687 nova-compute[98431]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:12:00.533120 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:12:00.533810 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb3bafa7-57b2-4711-b982-8c208f85ff32 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:12:00.533810 np0000002687 nova-compute[98431]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:12:00.533810 np0000002687 nova-compute[98431]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:12:00.533810 np0000002687 nova-compute[98431]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:12:00.533810 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:12:00.533810 np0000002687 nova-compute[98431]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8 (non-flash) Jun 11 23:12:00.533810 np0000002687 nova-compute[98431]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8 (non-flash) Jun 11 23:12:00.533810 np0000002687 nova-compute[98431]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce (non-flash) Jun 11 23:12:00.533810 np0000002687 nova-compute[98431]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce (non-flash) Jun 11 23:12:00.533810 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:12:00.533810 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:12:00.533810 np0000002687 nova-compute[98431]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:12:00.533810 np0000002687 nova-compute[98431]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:12:00.533810 np0000002687 nova-compute[98431]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:12:00.533810 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:12:00.540367 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb3bafa7-57b2-4711-b982-8c208f85ff32 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:12:00.540367 np0000002687 nova-compute[98431]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:12:00.540367 np0000002687 nova-compute[98431]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:12:00.540367 np0000002687 nova-compute[98431]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:12:00.540367 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:12:00.540367 np0000002687 nova-compute[98431]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8 (non-flash) Jun 11 23:12:00.540367 np0000002687 nova-compute[98431]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8 (non-flash) Jun 11 23:12:00.540367 np0000002687 nova-compute[98431]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce (non-flash) Jun 11 23:12:00.540367 np0000002687 nova-compute[98431]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce (non-flash) Jun 11 23:12:00.540367 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:12:00.540367 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:12:00.540367 np0000002687 nova-compute[98431]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:12:00.540367 np0000002687 nova-compute[98431]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:12:00.540367 np0000002687 nova-compute[98431]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:12:00.540367 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:12:00.540881 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb3bafa7-57b2-4711-b982-8c208f85ff32 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:12:00.540881 np0000002687 nova-compute[98431]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:12:00.540881 np0000002687 nova-compute[98431]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:12:00.540881 np0000002687 nova-compute[98431]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:12:00.540881 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:12:00.540881 np0000002687 nova-compute[98431]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8 (non-flash) Jun 11 23:12:00.540881 np0000002687 nova-compute[98431]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8 (non-flash) Jun 11 23:12:00.540881 np0000002687 nova-compute[98431]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce (non-flash) Jun 11 23:12:00.540881 np0000002687 nova-compute[98431]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce (non-flash) Jun 11 23:12:00.540881 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:12:00.540881 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:12:00.540881 np0000002687 nova-compute[98431]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:12:00.540881 np0000002687 nova-compute[98431]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:12:00.540881 np0000002687 nova-compute[98431]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:12:00.540881 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:12:00.581417 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-add1989e-df80-4804-9bd2-cf702ab3d6de tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] [instance: 36688d94-68d3-4ae3-989a-b391d7ee4ad9] Took 1.38 seconds to destroy the instance on the hypervisor. Jun 11 23:12:00.583527 np0000002687 nova-compute[98431]: DEBUG oslo.service.backend._common.loopingcall [None req-add1989e-df80-4804-9bd2-cf702ab3d6de tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98431) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jun 11 23:12:00.584242 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [-] [instance: 36688d94-68d3-4ae3-989a-b391d7ee4ad9] Deallocating network for instance {{(pid=98431) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}} Jun 11 23:12:00.584434 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [-] [instance: 36688d94-68d3-4ae3-989a-b391d7ee4ad9] deallocate_for_instance() {{(pid=98431) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jun 11 23:12:00.584656 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:12:00.608666 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb3bafa7-57b2-4711-b982-8c208f85ff32 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060, portal: 192.168.40.100,3260] Jun 11 23:12:00.608666 np0000002687 nova-compute[98431]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060, portal: 192.168.40.100,3260] successful. Jun 11 23:12:00.608666 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:12:00.613671 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-50d95170-3b66-43b5-8adb-e70adbf32d94 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Lock "27ac8c84-e5db-4bd1-a148-ec5834c5b39c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.515s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:12:00.619369 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb3bafa7-57b2-4711-b982-8c208f85ff32 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060, portal: 192.168.50.100,3260] Jun 11 23:12:00.619369 np0000002687 nova-compute[98431]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060, portal: 192.168.50.100,3260] successful. Jun 11 23:12:00.619369 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:12:00.621528 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb3bafa7-57b2-4711-b982-8c208f85ff32 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:12:00.636670 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb3bafa7-57b2-4711-b982-8c208f85ff32 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:12:00.656550 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb3bafa7-57b2-4711-b982-8c208f85ff32 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:12:00.656550 np0000002687 nova-compute[98431]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:12:00.656550 np0000002687 nova-compute[98431]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:12:00.656550 np0000002687 nova-compute[98431]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:12:00.656550 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:12:00.656550 np0000002687 nova-compute[98431]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8 (non-flash) Jun 11 23:12:00.656550 np0000002687 nova-compute[98431]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8 (non-flash) Jun 11 23:12:00.656550 np0000002687 nova-compute[98431]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce (non-flash) Jun 11 23:12:00.656550 np0000002687 nova-compute[98431]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce (non-flash) Jun 11 23:12:00.656550 np0000002687 nova-compute[98431]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060 (non-flash) Jun 11 23:12:00.656550 np0000002687 nova-compute[98431]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060 (non-flash) Jun 11 23:12:00.656550 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:12:00.656550 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:12:00.656550 np0000002687 nova-compute[98431]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:12:00.656550 np0000002687 nova-compute[98431]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:12:00.656550 np0000002687 nova-compute[98431]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:12:00.656550 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:12:00.656550 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb3bafa7-57b2-4711-b982-8c208f85ff32 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:12:00.656550 np0000002687 nova-compute[98431]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:12:00.656550 np0000002687 nova-compute[98431]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:12:00.656550 np0000002687 nova-compute[98431]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:12:00.656550 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:12:00.656550 np0000002687 nova-compute[98431]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8 (non-flash) Jun 11 23:12:00.656550 np0000002687 nova-compute[98431]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8 (non-flash) Jun 11 23:12:00.656550 np0000002687 nova-compute[98431]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce (non-flash) Jun 11 23:12:00.656550 np0000002687 nova-compute[98431]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce (non-flash) Jun 11 23:12:00.656550 np0000002687 nova-compute[98431]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060 (non-flash) Jun 11 23:12:00.656550 np0000002687 nova-compute[98431]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060 (non-flash) Jun 11 23:12:00.656550 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:12:00.656550 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:12:00.656550 np0000002687 nova-compute[98431]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:12:00.656550 np0000002687 nova-compute[98431]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:12:00.656550 np0000002687 nova-compute[98431]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:12:00.656550 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:12:00.656550 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-fb3bafa7-57b2-4711-b982-8c208f85ff32 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.213s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 11 23:12:00.656550 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb3bafa7-57b2-4711-b982-8c208f85ff32 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Connected to 192.168.40.100:3260 {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 11 23:12:00.656550 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-fb3bafa7-57b2-4711-b982-8c208f85ff32 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] HCTL ('17', '-', '-', 0) found on session 23 with lun 0 {{(pid=98431) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 11 23:12:00.656550 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-fb3bafa7-57b2-4711-b982-8c208f85ff32 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Scanning host 17 c: -, t: -, l: 0) {{(pid=98431) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 11 23:12:00.665047 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-064e4429-4a53-482d-9918-5822f12f669e tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:12:00.669557 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb3bafa7-57b2-4711-b982-8c208f85ff32 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:12:00.669557 np0000002687 nova-compute[98431]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:12:00.669557 np0000002687 nova-compute[98431]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:12:00.669557 np0000002687 nova-compute[98431]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:12:00.669557 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:12:00.669557 np0000002687 nova-compute[98431]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8 (non-flash) Jun 11 23:12:00.669557 np0000002687 nova-compute[98431]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8 (non-flash) Jun 11 23:12:00.669557 np0000002687 nova-compute[98431]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce (non-flash) Jun 11 23:12:00.669557 np0000002687 nova-compute[98431]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce (non-flash) Jun 11 23:12:00.669557 np0000002687 nova-compute[98431]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060 (non-flash) Jun 11 23:12:00.669557 np0000002687 nova-compute[98431]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060 (non-flash) Jun 11 23:12:00.669557 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:12:00.669557 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:12:00.669557 np0000002687 nova-compute[98431]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:12:00.669557 np0000002687 nova-compute[98431]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:12:00.669557 np0000002687 nova-compute[98431]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:12:00.669557 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:12:00.669557 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb3bafa7-57b2-4711-b982-8c208f85ff32 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:12:00.669557 np0000002687 nova-compute[98431]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:12:00.669557 np0000002687 nova-compute[98431]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:12:00.669557 np0000002687 nova-compute[98431]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:12:00.669557 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:12:00.669557 np0000002687 nova-compute[98431]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8 (non-flash) Jun 11 23:12:00.669557 np0000002687 nova-compute[98431]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8 (non-flash) Jun 11 23:12:00.669557 np0000002687 nova-compute[98431]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce (non-flash) Jun 11 23:12:00.669557 np0000002687 nova-compute[98431]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce (non-flash) Jun 11 23:12:00.669557 np0000002687 nova-compute[98431]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060 (non-flash) Jun 11 23:12:00.669557 np0000002687 nova-compute[98431]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060 (non-flash) Jun 11 23:12:00.669557 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:12:00.669557 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:12:00.669557 np0000002687 nova-compute[98431]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:12:00.669557 np0000002687 nova-compute[98431]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:12:00.669557 np0000002687 nova-compute[98431]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:12:00.669557 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:12:00.669557 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-fb3bafa7-57b2-4711-b982-8c208f85ff32 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.228s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 11 23:12:00.669557 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb3bafa7-57b2-4711-b982-8c208f85ff32 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Connected to 192.168.50.100:3260 {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 11 23:12:00.674480 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-fb3bafa7-57b2-4711-b982-8c208f85ff32 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Searching for a device in session 23 and hctl ['17', '*', '*', 0] yield: None {{(pid=98431) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 11 23:12:00.679411 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:12:00.684241 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-fb3bafa7-57b2-4711-b982-8c208f85ff32 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] HCTL ('18', '-', '-', 0) found on session 24 with lun 0 {{(pid=98431) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 11 23:12:00.684424 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-fb3bafa7-57b2-4711-b982-8c208f85ff32 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Scanning host 18 c: -, t: -, l: 0) {{(pid=98431) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 11 23:12:00.702987 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-fb3bafa7-57b2-4711-b982-8c208f85ff32 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Searching for a device in session 24 and hctl ['18', '*', '*', 0] yield: sdm {{(pid=98431) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 11 23:12:00.702987 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb3bafa7-57b2-4711-b982-8c208f85ff32 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '859ffbad-3fc1-400a-a7f7-ac423851f060', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 11 23:12:00.994284 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-91030f7c-06ab-46ce-9a29-9010afbca4e9 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-11T23:10:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1353756978',display_name='tempest-VolumesAssistedSnapshotsTest-server-1353756978',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='tempest-volumesassistedsnapshotstest-server-1353756978',id=6,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLtWpmTL57Lc0YUQTSd5NfPApT5DUW8RTfDnqIDjCf8IZRaRZyzj4Oad3caiamoQEi2ojJRXJkaX6kBk4HafhVUNFjCaVH0FoduTDf6KbJiXGKZNdi6CtQ9AFkqYIhvXpg==',key_name='tempest-keypair-647594787',keypairs=,launch_index=0,launched_at=2026-06-11T23:10:58Z,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='bddeb2fac9c34c65996201c81b5c77e4',ramdisk_id='',reservation_id='r-ogjxfq8o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1009218362',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1009218362-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-11T23:10:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fe97a7ae092d47588d6656d03aace2d4',uuid=73abd331-0bbf-432e-be1c-308801a5429f,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d1203b92-b9d5-4d1c-bc39-326783c31294", "address": "fa:16:3e:bd:09:51", "network": {"id": "40608c63-4bf9-4326-a714-e03e56d8c4de", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1884073402-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bddeb2fac9c34c65996201c81b5c77e4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1203b92-b9", "ovs_interfaceid": "d1203b92-b9d5-4d1c-bc39-326783c31294", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 11 23:12:00.994284 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-91030f7c-06ab-46ce-9a29-9010afbca4e9 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] Converting VIF {"id": "d1203b92-b9d5-4d1c-bc39-326783c31294", "address": "fa:16:3e:bd:09:51", "network": {"id": "40608c63-4bf9-4326-a714-e03e56d8c4de", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1884073402-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bddeb2fac9c34c65996201c81b5c77e4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1203b92-b9", "ovs_interfaceid": "d1203b92-b9d5-4d1c-bc39-326783c31294", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:12:00.994646 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-91030f7c-06ab-46ce-9a29-9010afbca4e9 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bd:09:51,bridge_name='br-int',has_traffic_filtering=True,id=d1203b92-b9d5-4d1c-bc39-326783c31294,network=Network(40608c63-4bf9-4326-a714-e03e56d8c4de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1203b92-b9') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:12:00.994737 np0000002687 nova-compute[98431]: DEBUG os_vif [None req-91030f7c-06ab-46ce-9a29-9010afbca4e9 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bd:09:51,bridge_name='br-int',has_traffic_filtering=True,id=d1203b92-b9d5-4d1c-bc39-326783c31294,network=Network(40608c63-4bf9-4326-a714-e03e56d8c4de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1203b92-b9') {{(pid=98431) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 11 23:12:00.995536 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:00.995737 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd1203b92-b9, bridge=br-int, if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:12:00.997210 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:00.998239 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:12:00.998416 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:01.000105 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:01.000312 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9004d72f-35e5-4464-bab4-e0f06be635ab) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:12:01.000875 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:01.001573 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:12:01.003403 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:01.006638 np0000002687 nova-compute[98431]: INFO os_vif [None req-91030f7c-06ab-46ce-9a29-9010afbca4e9 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bd:09:51,bridge_name='br-int',has_traffic_filtering=True,id=d1203b92-b9d5-4d1c-bc39-326783c31294,network=Network(40608c63-4bf9-4326-a714-e03e56d8c4de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1203b92-b9') Jun 11 23:12:01.006787 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-91030f7c-06ab-46ce-9a29-9010afbca4e9 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] [instance: 73abd331-0bbf-432e-be1c-308801a5429f] Deleting instance files /opt/stack/data/nova/instances/73abd331-0bbf-432e-be1c-308801a5429f_del Jun 11 23:12:01.007944 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-91030f7c-06ab-46ce-9a29-9010afbca4e9 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] [instance: 73abd331-0bbf-432e-be1c-308801a5429f] Deletion of /opt/stack/data/nova/instances/73abd331-0bbf-432e-be1c-308801a5429f_del complete Jun 11 23:12:01.133794 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-064e4429-4a53-482d-9918-5822f12f669e tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:12:01.301858 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-064e4429-4a53-482d-9918-5822f12f669e tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Updating instance_info_cache with network_info: [{"id": "852fc4ec-82e1-4185-a33c-3c45ff42351e", "address": "fa:16:3e:c6:c6:5b", "network": {"id": "2a770c99-2ec6-4fa2-945b-32830a59e7a7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-137493671-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aaf744af828a4a5eba1e98da63373b2b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap852fc4ec-82", "ovs_interfaceid": "852fc4ec-82e1-4185-a33c-3c45ff42351e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:12:01.437103 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-9012aba3-81c4-404a-9633-577278d0cf6d req-e7af0074-a8ce-48de-a49b-dc76409dd3e9 service nova] [instance: 36688d94-68d3-4ae3-989a-b391d7ee4ad9] Received event network-vif-deleted-6075e13d-d32a-4d8f-8741-a4686059985e {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:12:01.437181 np0000002687 nova-compute[98431]: INFO nova.compute.manager [req-9012aba3-81c4-404a-9633-577278d0cf6d req-e7af0074-a8ce-48de-a49b-dc76409dd3e9 service nova] [instance: 36688d94-68d3-4ae3-989a-b391d7ee4ad9] Neutron deleted interface 6075e13d-d32a-4d8f-8741-a4686059985e; detaching it from the instance and deleting it from the info cache Jun 11 23:12:01.439605 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-9012aba3-81c4-404a-9633-577278d0cf6d req-e7af0074-a8ce-48de-a49b-dc76409dd3e9 service nova] [instance: 36688d94-68d3-4ae3-989a-b391d7ee4ad9] Detach interface failed, port_id=6075e13d-d32a-4d8f-8741-a4686059985e, reason: Instance 36688d94-68d3-4ae3-989a-b391d7ee4ad9 could not be found. {{(pid=98431) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}} Jun 11 23:12:01.514488 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-91030f7c-06ab-46ce-9a29-9010afbca4e9 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] [instance: 73abd331-0bbf-432e-be1c-308801a5429f] Took 1.39 seconds to destroy the instance on the hypervisor. Jun 11 23:12:01.515559 np0000002687 nova-compute[98431]: DEBUG oslo.service.backend._common.loopingcall [None req-91030f7c-06ab-46ce-9a29-9010afbca4e9 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98431) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jun 11 23:12:01.515983 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [-] [instance: 73abd331-0bbf-432e-be1c-308801a5429f] Deallocating network for instance {{(pid=98431) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}} Jun 11 23:12:01.516160 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [-] [instance: 73abd331-0bbf-432e-be1c-308801a5429f] deallocate_for_instance() {{(pid=98431) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jun 11 23:12:01.516438 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:12:01.536636 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-869a10ae-87e3-456b-b0da-893719da80f7 req-1fe7fb0e-737e-4fd2-a0c9-2e981690f13f service nova] [instance: 36688d94-68d3-4ae3-989a-b391d7ee4ad9] Received event network-vif-unplugged-6075e13d-d32a-4d8f-8741-a4686059985e {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:12:01.536872 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-869a10ae-87e3-456b-b0da-893719da80f7 req-1fe7fb0e-737e-4fd2-a0c9-2e981690f13f service nova] Acquiring lock "36688d94-68d3-4ae3-989a-b391d7ee4ad9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:12:01.537062 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-869a10ae-87e3-456b-b0da-893719da80f7 req-1fe7fb0e-737e-4fd2-a0c9-2e981690f13f service nova] Lock "36688d94-68d3-4ae3-989a-b391d7ee4ad9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:12:01.537483 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-869a10ae-87e3-456b-b0da-893719da80f7 req-1fe7fb0e-737e-4fd2-a0c9-2e981690f13f service nova] Lock "36688d94-68d3-4ae3-989a-b391d7ee4ad9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:12:01.540901 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-869a10ae-87e3-456b-b0da-893719da80f7 req-1fe7fb0e-737e-4fd2-a0c9-2e981690f13f service nova] [instance: 36688d94-68d3-4ae3-989a-b391d7ee4ad9] No waiting events found dispatching network-vif-unplugged-6075e13d-d32a-4d8f-8741-a4686059985e {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:12:01.541146 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-869a10ae-87e3-456b-b0da-893719da80f7 req-1fe7fb0e-737e-4fd2-a0c9-2e981690f13f service nova] [instance: 36688d94-68d3-4ae3-989a-b391d7ee4ad9] Received event network-vif-unplugged-6075e13d-d32a-4d8f-8741-a4686059985e for instance with task_state deleting. {{(pid=98431) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 11 23:12:01.621184 np0000002687 nova-compute[98431]: DEBUG oslo_service.periodic_task [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 11 23:12:01.621354 np0000002687 nova-compute[98431]: DEBUG oslo_service.periodic_task [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 11 23:12:01.621563 np0000002687 nova-compute[98431]: DEBUG oslo_service.periodic_task [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 11 23:12:01.621739 np0000002687 nova-compute[98431]: DEBUG oslo_service.periodic_task [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 11 23:12:01.621960 np0000002687 nova-compute[98431]: DEBUG oslo_service.periodic_task [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 11 23:12:01.622156 np0000002687 nova-compute[98431]: DEBUG oslo_service.periodic_task [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 11 23:12:01.622315 np0000002687 nova-compute[98431]: DEBUG oslo_service.periodic_task [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 11 23:12:01.622494 np0000002687 nova-compute[98431]: DEBUG oslo_service.periodic_task [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 11 23:12:01.622633 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98431) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}} Jun 11 23:12:01.623950 np0000002687 nova-compute[98431]: DEBUG oslo_service.periodic_task [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running periodic task ComputeManager.update_available_resource {{(pid=98431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 11 23:12:01.627765 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-4089a89c-b865-4eb8-b095-538b3028492e tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] No BDM found with device name vda, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:12:01.628006 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-4089a89c-b865-4eb8-b095-538b3028492e tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:12:01.628685 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-4089a89c-b865-4eb8-b095-538b3028492e tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] No BDM found with device name hda, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:12:01.628685 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-4089a89c-b865-4eb8-b095-538b3028492e tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] No VIF found with MAC fa:16:3e:61:b7:fd, not building metadata {{(pid=98431) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13199}} Jun 11 23:12:01.646259 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:12:01.676498 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-fb3bafa7-57b2-4711-b982-8c208f85ff32 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Searching for a device in session 23 and hctl ['17', '*', '*', 0] yield: sdl {{(pid=98431) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 11 23:12:01.676688 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb3bafa7-57b2-4711-b982-8c208f85ff32 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '859ffbad-3fc1-400a-a7f7-ac423851f060', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 11 23:12:01.734824 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-50d95170-3b66-43b5-8adb-e70adbf32d94 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Acquiring lock "27ac8c84-e5db-4bd1-a148-ec5834c5b39c" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:12:01.735175 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-50d95170-3b66-43b5-8adb-e70adbf32d94 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Lock "27ac8c84-e5db-4bd1-a148-ec5834c5b39c" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:12:01.735464 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-50d95170-3b66-43b5-8adb-e70adbf32d94 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] [instance: 27ac8c84-e5db-4bd1-a148-ec5834c5b39c] Attaching volume 65724ff3-60af-4d3f-b1bf-3aa2695037ce to /dev/vdb Jun 11 23:12:01.789263 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-50d95170-3b66-43b5-8adb-e70adbf32d94 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.209', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000002687', 'execute': None}" {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 11 23:12:01.800851 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.scaleio [None req-50d95170-3b66-43b5-8adb-e70adbf32d94 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98431) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 11 23:12:01.805657 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-064e4429-4a53-482d-9918-5822f12f669e tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Releasing lock "refresh_cache-c82748e6-1c78-4372-ad4b-48d1c6448efa" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 11 23:12:01.805657 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-064e4429-4a53-482d-9918-5822f12f669e tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lazy-loading 'flavor' on Instance uuid c82748e6-1c78-4372-ad4b-48d1c6448efa {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:12:01.819826 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-50d95170-3b66-43b5-8adb-e70adbf32d94 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Running cmd (subprocess): nvme version {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:12:01.847571 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-50d95170-3b66-43b5-8adb-e70adbf32d94 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] 'nvme version' failed. Not Retrying. {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 11 23:12:01.848150 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.nvmeof [None req-50d95170-3b66-43b5-8adb-e70adbf32d94 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] nvme not present on system {{(pid=98431) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 11 23:12:01.849368 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [-] [instance: 36688d94-68d3-4ae3-989a-b391d7ee4ad9] Updating instance_info_cache with network_info: [] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:12:01.857398 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.lightos [None req-50d95170-3b66-43b5-8adb-e70adbf32d94 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98431) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 11 23:12:01.860434 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.lightos [None req-50d95170-3b66-43b5-8adb-e70adbf32d94 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Current host hostNQN and IP(s) are ['10.4.3.209', 'fe80::f816:3eff:fea3:3707', '192.168.40.6', 'fe80::f816:3eff:fe06:bdab', '192.168.50.6', 'fe80::f816:3eff:fe7a:46f2', '192.168.10.6', 'fe80::f816:3eff:fe13:793b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::38fa:21ff:fe6c:3746', 'fe80::fc16:3eff:fe6c:eb30', 'fe80::20a8:54ff:fe51:da0a', 'fe80::fc16:3eff:feb5:6ffd', 'fe80::4cb3:64ff:fe13:8a75', 'fe80::fc16:3eff:fe77:488d', 'fe80::9469:f2ff:feae:5824', 'fe80::fc16:3eff:fedc:9cb5', 'fe80::f489:94ff:fe75:ec8a', 'fe80::fc16:3eff:fe8a:95c7', 'fe80::fc16:3eff:fec7:336a', 'fe80::fc16:3eff:fee8:a7df', 'fe80::fc16:3eff:fe9f:58c8', 'fe80::a002:b5ff:fe03:ad7e', 'fe80::fc16:3eff:fec3:b6b', 'fe80::fc16:3eff:feb9:2e2c', 'fe80::fc16:3eff:fea0:a282', 'fe80::fc16:3eff:fe50:f6b', 'fe80::7cd4:d5ff:feac:3f7f', 'fe80::fc16:3eff:fec4:56b3', 'fe80::78a9:34ff:febb:750c', 'fe80::fc16:3eff:fe61:b7fd', 'fe80::fc16:3eff:fe1d:f718', 'fe80::14a2:b8ff:feec:f607', 'fe80::fc16:3eff:fec6:c65b'] Jun 11 23:12:01.860636 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.lightos [None req-50d95170-3b66-43b5-8adb-e70adbf32d94 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98431) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 11 23:12:01.860706 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.lightos [None req-50d95170-3b66-43b5-8adb-e70adbf32d94 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] LIGHTOS: no hostnqn found. {{(pid=98431) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 11 23:12:01.861135 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-50d95170-3b66-43b5-8adb-e70adbf32d94 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] <== get_connector_properties: return (71ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.209', 'host': 'np0000002687', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:798b370f1cc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad465dfe-0ed1-4637-98c3-ddaebebd61a4', 'nvme_native_multipath': False} {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 11 23:12:01.861376 np0000002687 nova-compute[98431]: DEBUG nova.virt.block_device [None req-50d95170-3b66-43b5-8adb-e70adbf32d94 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] [instance: 27ac8c84-e5db-4bd1-a148-ec5834c5b39c] Updating existing volume attachment record: 141c4be7-e354-4a33-bcd0-ebb8200e26e8 {{(pid=98431) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 11 23:12:02.133644 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:12:02.133852 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:12:02.134046 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:12:02.134230 np0000002687 nova-compute[98431]: DEBUG nova.compute.resource_tracker [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Auditing locally available compute resources for np0000002687 (node: np0000002687) {{(pid=98431) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}} Jun 11 23:12:02.332044 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:02.335943 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:02.353542 np0000002687 nova-compute[98431]: INFO nova.compute.manager [-] [instance: 36688d94-68d3-4ae3-989a-b391d7ee4ad9] Took 1.77 seconds to deallocate network for instance. Jun 11 23:12:02.358012 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:02.420336 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-ed43c87b-8785-4940-851d-c8334c4a274e req-adf98ff1-c55f-444e-935d-ad479620fa1a service nova] [instance: 73abd331-0bbf-432e-be1c-308801a5429f] Received event network-vif-unplugged-d1203b92-b9d5-4d1c-bc39-326783c31294 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:12:02.420336 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-ed43c87b-8785-4940-851d-c8334c4a274e req-adf98ff1-c55f-444e-935d-ad479620fa1a service nova] Acquiring lock "73abd331-0bbf-432e-be1c-308801a5429f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:12:02.420527 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-ed43c87b-8785-4940-851d-c8334c4a274e req-adf98ff1-c55f-444e-935d-ad479620fa1a service nova] Lock "73abd331-0bbf-432e-be1c-308801a5429f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:12:02.420653 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-ed43c87b-8785-4940-851d-c8334c4a274e req-adf98ff1-c55f-444e-935d-ad479620fa1a service nova] Lock "73abd331-0bbf-432e-be1c-308801a5429f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:12:02.421229 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-ed43c87b-8785-4940-851d-c8334c4a274e req-adf98ff1-c55f-444e-935d-ad479620fa1a service nova] [instance: 73abd331-0bbf-432e-be1c-308801a5429f] No waiting events found dispatching network-vif-unplugged-d1203b92-b9d5-4d1c-bc39-326783c31294 {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:12:02.421688 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-ed43c87b-8785-4940-851d-c8334c4a274e req-adf98ff1-c55f-444e-935d-ad479620fa1a service nova] [instance: 73abd331-0bbf-432e-be1c-308801a5429f] Received event network-vif-unplugged-d1203b92-b9d5-4d1c-bc39-326783c31294 for instance with task_state deleting. {{(pid=98431) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 11 23:12:02.421688 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-ed43c87b-8785-4940-851d-c8334c4a274e req-adf98ff1-c55f-444e-935d-ad479620fa1a service nova] [instance: 73abd331-0bbf-432e-be1c-308801a5429f] Received event network-vif-deleted-d1203b92-b9d5-4d1c-bc39-326783c31294 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:12:02.421767 np0000002687 nova-compute[98431]: INFO nova.compute.manager [req-ed43c87b-8785-4940-851d-c8334c4a274e req-adf98ff1-c55f-444e-935d-ad479620fa1a service nova] [instance: 73abd331-0bbf-432e-be1c-308801a5429f] Neutron deleted interface d1203b92-b9d5-4d1c-bc39-326783c31294; detaching it from the instance and deleting it from the info cache Jun 11 23:12:02.433188 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-ed43c87b-8785-4940-851d-c8334c4a274e req-adf98ff1-c55f-444e-935d-ad479620fa1a service nova] [instance: 73abd331-0bbf-432e-be1c-308801a5429f] Detach interface failed, port_id=d1203b92-b9d5-4d1c-bc39-326783c31294, reason: Instance 73abd331-0bbf-432e-be1c-308801a5429f could not be found. {{(pid=98431) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}} Jun 11 23:12:02.434674 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50d95170-3b66-43b5-8adb-e70adbf32d94 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] [instance: 27ac8c84-e5db-4bd1-a148-ec5834c5b39c] Calling os-brick to attach iSCSI Volume {{(pid=98431) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 11 23:12:02.434674 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-50d95170-3b66-43b5-8adb-e70adbf32d94 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce', 'iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '65724ff3-60af-4d3f-b1bf-3aa2695037ce', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 11 23:12:02.434674 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-50d95170-3b66-43b5-8adb-e70adbf32d94 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 11 23:12:02.463414 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb3bafa7-57b2-4711-b982-8c208f85ff32 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Found WWN 330000000484693f8 for multipath device dm-9 {{(pid=98431) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 11 23:12:02.463746 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-fb3bafa7-57b2-4711-b982-8c208f85ff32 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.037s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 11 23:12:02.464841 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb3bafa7-57b2-4711-b982-8c208f85ff32 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] <== connect_volume: return (4145ms) {'type': 'block', 'scsi_wwn': '330000000484693f8', 'path': '/dev/dm-9', 'multipath_id': '330000000484693f8'} {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 11 23:12:02.464841 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb3bafa7-57b2-4711-b982-8c208f85ff32 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000484693f8', 'path': '/dev/dm-9', 'multipath_id': '330000000484693f8'} {{(pid=98431) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 11 23:12:02.464841 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-50d95170-3b66-43b5-8adb-e70adbf32d94 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.030s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 11 23:12:02.465064 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-50d95170-3b66-43b5-8adb-e70adbf32d94 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce', 'iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '65724ff3-60af-4d3f-b1bf-3aa2695037ce', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98431) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 11 23:12:02.471136 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-fb3bafa7-57b2-4711-b982-8c208f85ff32 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Lazy-loading 'flavor' on Instance uuid cb63f66c-b69e-42b0-805c-be6fe9b3aee3 {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:12:02.480314 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-50d95170-3b66-43b5-8adb-e70adbf32d94 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 11 23:12:02.480696 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-50d95170-3b66-43b5-8adb-e70adbf32d94 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 11 23:12:02.480975 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.iscsi [None req-50d95170-3b66-43b5-8adb-e70adbf32d94 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 11 23:12:02.481568 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-50d95170-3b66-43b5-8adb-e70adbf32d94 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 11 23:12:02.482176 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-50d95170-3b66-43b5-8adb-e70adbf32d94 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 11 23:12:02.482383 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.iscsi [None req-50d95170-3b66-43b5-8adb-e70adbf32d94 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 11 23:12:02.499690 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-50d95170-3b66-43b5-8adb-e70adbf32d94 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 11 23:12:02.499690 np0000002687 nova-compute[98431]: node.name = iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce Jun 11 23:12:02.499690 np0000002687 nova-compute[98431]: node.tpgt = -1 Jun 11 23:12:02.499690 np0000002687 nova-compute[98431]: node.startup = automatic Jun 11 23:12:02.499690 np0000002687 nova-compute[98431]: node.leading_login = No Jun 11 23:12:02.499690 np0000002687 nova-compute[98431]: iface.iscsi_ifacename = default Jun 11 23:12:02.499690 np0000002687 nova-compute[98431]: iface.net_ifacename = Jun 11 23:12:02.499690 np0000002687 nova-compute[98431]: iface.ipaddress = Jun 11 23:12:02.499690 np0000002687 nova-compute[98431]: iface.prefix_len = 0 Jun 11 23:12:02.499690 np0000002687 nova-compute[98431]: iface.hwaddress = Jun 11 23:12:02.499690 np0000002687 nova-compute[98431]: iface.transport_name = tcp Jun 11 23:12:02.499690 np0000002687 nova-compute[98431]: iface.initiatorname = Jun 11 23:12:02.499690 np0000002687 nova-compute[98431]: iface.state = Jun 11 23:12:02.499690 np0000002687 nova-compute[98431]: iface.vlan_id = 0 Jun 11 23:12:02.499690 np0000002687 nova-compute[98431]: iface.vlan_priority = 0 Jun 11 23:12:02.499690 np0000002687 nova-compute[98431]: iface.vlan_state = Jun 11 23:12:02.499690 np0000002687 nova-compute[98431]: iface.iface_num = 0 Jun 11 23:12:02.499690 np0000002687 nova-compute[98431]: iface.mtu = 0 Jun 11 23:12:02.499690 np0000002687 nova-compute[98431]: iface.port = 0 Jun 11 23:12:02.499690 np0000002687 nova-compute[98431]: iface.bootproto = Jun 11 23:12:02.499690 np0000002687 nova-compute[98431]: iface.subnet_mask = Jun 11 23:12:02.499690 np0000002687 nova-compute[98431]: iface.gateway = Jun 11 23:12:02.499690 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id_state = Jun 11 23:12:02.499690 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id = Jun 11 23:12:02.499690 np0000002687 nova-compute[98431]: iface.dhcp_dns = Jun 11 23:12:02.499690 np0000002687 nova-compute[98431]: iface.dhcp_learn_iqn = Jun 11 23:12:02.499690 np0000002687 nova-compute[98431]: iface.dhcp_req_vendor_id_state = Jun 11 23:12:02.499690 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id_state = Jun 11 23:12:02.499690 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id = Jun 11 23:12:02.499690 np0000002687 nova-compute[98431]: iface.dhcp_slp_da = Jun 11 23:12:02.499690 np0000002687 nova-compute[98431]: iface.fragmentation = Jun 11 23:12:02.499690 np0000002687 nova-compute[98431]: iface.gratuitous_arp = Jun 11 23:12:02.499690 np0000002687 nova-compute[98431]: iface.incoming_forwarding = Jun 11 23:12:02.499690 np0000002687 nova-compute[98431]: iface.tos_state = Jun 11 23:12:02.499690 np0000002687 nova-compute[98431]: iface.tos = 0 Jun 11 23:12:02.499690 np0000002687 nova-compute[98431]: iface.ttl = 0 Jun 11 23:12:02.499690 np0000002687 nova-compute[98431]: iface.delayed_ack = Jun 11 23:12:02.499690 np0000002687 nova-compute[98431]: iface.tcp_nagle = Jun 11 23:12:02.499690 np0000002687 nova-compute[98431]: iface.tcp_wsf_state = Jun 11 23:12:02.499690 np0000002687 nova-compute[98431]: iface.tcp_wsf = 0 Jun 11 23:12:02.499690 np0000002687 nova-compute[98431]: iface.tcp_timer_scale = 0 Jun 11 23:12:02.499690 np0000002687 nova-compute[98431]: iface.tcp_timestamp = Jun 11 23:12:02.499690 np0000002687 nova-compute[98431]: iface.redirect = Jun 11 23:12:02.499690 np0000002687 nova-compute[98431]: iface.def_task_mgmt_timeout = 0 Jun 11 23:12:02.499690 np0000002687 nova-compute[98431]: iface.header_digest = Jun 11 23:12:02.499690 np0000002687 nova-compute[98431]: iface.data_digest = Jun 11 23:12:02.499690 np0000002687 nova-compute[98431]: iface.immediate_data = Jun 11 23:12:02.499690 np0000002687 nova-compute[98431]: iface.initial_r2t = Jun 11 23:12:02.499690 np0000002687 nova-compute[98431]: iface.data_seq_inorder = Jun 11 23:12:02.499690 np0000002687 nova-compute[98431]: iface.data_pdu_inorder = Jun 11 23:12:02.499690 np0000002687 nova-compute[98431]: iface.erl = 0 Jun 11 23:12:02.499690 np0000002687 nova-compute[98431]: iface.max_receive_data_len = 0 Jun 11 23:12:02.499690 np0000002687 nova-compute[98431]: iface.first_burst_len = 0 Jun 11 23:12:02.499690 np0000002687 nova-compute[98431]: iface.max_outstanding_r2t = 0 Jun 11 23:12:02.499690 np0000002687 nova-compute[98431]: iface.max_burst_len = 0 Jun 11 23:12:02.499690 np0000002687 nova-compute[98431]: iface.chap_auth = Jun 11 23:12:02.499690 np0000002687 nova-compute[98431]: iface.bidi_chap = Jun 11 23:12:02.499690 np0000002687 nova-compute[98431]: iface.strict_login_compliance = Jun 11 23:12:02.499690 np0000002687 nova-compute[98431]: iface.discovery_auth = Jun 11 23:12:02.499690 np0000002687 nova-compute[98431]: iface.discovery_logout = Jun 11 23:12:02.499690 np0000002687 nova-compute[98431]: node.discovery_address = Jun 11 23:12:02.499690 np0000002687 nova-compute[98431]: node.discovery_port = 0 Jun 11 23:12:02.499690 np0000002687 nova-compute[98431]: node.discovery_type = fw Jun 11 23:12:02.499690 np0000002687 nova-compute[98431]: node.session.initial_cmdsn = 0 Jun 11 23:12:02.499690 np0000002687 nova-compute[98431]: node.session.initial_login_retry_max = 8 Jun 11 23:12:02.499690 np0000002687 nova-compute[98431]: node.session.xmit_thread_priority = 0 Jun 11 23:12:02.499690 np0000002687 nova-compute[98431]: node.session.cmds_max = 128 Jun 11 23:12:02.499690 np0000002687 nova-compute[98431]: node.session.queue_depth = 32 Jun 11 23:12:02.499690 np0000002687 nova-compute[98431]: node.session.nr_sessions = 1 Jun 11 23:12:02.499690 np0000002687 nova-compute[98431]: node.session.auth.authmethod = None Jun 11 23:12:02.499690 np0000002687 nova-compute[98431]: node.session.auth.username = Jun 11 23:12:02.499690 np0000002687 nova-compute[98431]: node.session.auth.password = *** Jun 11 23:12:02.499690 np0000002687 nova-compute[98431]: node.session.auth.username_in = Jun 11 23:12:02.499690 np0000002687 nova-compute[98431]: node.session.auth.password_in = Jun 11 23:12:02.499690 np0000002687 nova-compute[98431]: node.session.auth.chap_algs = SHA256 Jun 11 23:12:02.499690 np0000002687 nova-compute[98431]: node.session.timeo.replacement_timeout = 120 Jun 11 23:12:02.499690 np0000002687 nova-compute[98431]: node.session.err_timeo.abort_timeout = 15 Jun 11 23:12:02.499690 np0000002687 nova-compute[98431]: node.session.err_timeo.lu_reset_timeout = 30 Jun 11 23:12:02.499690 np0000002687 nova-compute[98431]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 11 23:12:02.499690 np0000002687 nova-compute[98431]: node.session.err_timeo.host_reset_timeout = 60 Jun 11 23:12:02.499690 np0000002687 nova-compute[98431]: node.session.iscsi.FastAbort = Yes Jun 11 23:12:02.499690 np0000002687 nova-compute[98431]: node.session.iscsi.InitialR2T = No Jun 11 23:12:02.499690 np0000002687 nova-compute[98431]: node.session.iscsi.ImmediateData = Yes Jun 11 23:12:02.499690 np0000002687 nova-compute[98431]: node.session.iscsi.FirstBurstLength = 262144 Jun 11 23:12:02.499690 np0000002687 nova-compute[98431]: node.session.iscsi.MaxBurstLength = 16776192 Jun 11 23:12:02.499690 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Retain = 0 Jun 11 23:12:02.499690 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Wait = 2 Jun 11 23:12:02.499690 np0000002687 nova-compute[98431]: node.session.iscsi.MaxConnections = 1 Jun 11 23:12:02.499690 np0000002687 nova-compute[98431]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 11 23:12:02.499690 np0000002687 nova-compute[98431]: node.session.iscsi.ERL = 0 Jun 11 23:12:02.499690 np0000002687 nova-compute[98431]: node.session.scan = manual Jun 11 23:12:02.499690 np0000002687 nova-compute[98431]: node.session.reopen_max = 0 Jun 11 23:12:02.499690 np0000002687 nova-compute[98431]: node.conn[0].address = 192.168.40.100 Jun 11 23:12:02.499690 np0000002687 nova-compute[98431]: node.conn[0].port = 3260 Jun 11 23:12:02.499690 np0000002687 nova-compute[98431]: node.conn[0].startup = manual Jun 11 23:12:02.499690 np0000002687 nova-compute[98431]: node.conn[0].tcp.window_size = 524288 Jun 11 23:12:02.499690 np0000002687 nova-compute[98431]: node.conn[0].tcp.type_of_service = 0 Jun 11 23:12:02.499690 np0000002687 nova-compute[98431]: node.conn[0].timeo.logout_timeout = 15 Jun 11 23:12:02.499690 np0000002687 nova-compute[98431]: node.conn[0].timeo.login_timeout = 15 Jun 11 23:12:02.499690 np0000002687 nova-compute[98431]: node.conn[0].timeo.auth_timeout = 45 Jun 11 23:12:02.499690 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_interval = 5 Jun 11 23:12:02.499690 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_timeout = 5 Jun 11 23:12:02.499690 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 11 23:12:02.499690 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 11 23:12:02.499690 np0000002687 nova-compute[98431]: node.conn[0].iscsi.HeaderDigest = None Jun 11 23:12:02.499690 np0000002687 nova-compute[98431]: node.conn[0].iscsi.DataDigest = None Jun 11 23:12:02.499690 np0000002687 nova-compute[98431]: node.conn[0].iscsi.IFMarker = No Jun 11 23:12:02.499690 np0000002687 nova-compute[98431]: node.conn[0].iscsi.OFMarker = No Jun 11 23:12:02.499690 np0000002687 nova-compute[98431]: # END RECORD Jun 11 23:12:02.499690 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:12:02.506997 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-50d95170-3b66-43b5-8adb-e70adbf32d94 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 11 23:12:02.506997 np0000002687 nova-compute[98431]: node.name = iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce Jun 11 23:12:02.506997 np0000002687 nova-compute[98431]: node.tpgt = -1 Jun 11 23:12:02.506997 np0000002687 nova-compute[98431]: node.startup = automatic Jun 11 23:12:02.506997 np0000002687 nova-compute[98431]: node.leading_login = No Jun 11 23:12:02.506997 np0000002687 nova-compute[98431]: iface.iscsi_ifacename = default Jun 11 23:12:02.506997 np0000002687 nova-compute[98431]: iface.net_ifacename = Jun 11 23:12:02.506997 np0000002687 nova-compute[98431]: iface.ipaddress = Jun 11 23:12:02.506997 np0000002687 nova-compute[98431]: iface.prefix_len = 0 Jun 11 23:12:02.506997 np0000002687 nova-compute[98431]: iface.hwaddress = Jun 11 23:12:02.506997 np0000002687 nova-compute[98431]: iface.transport_name = tcp Jun 11 23:12:02.506997 np0000002687 nova-compute[98431]: iface.initiatorname = Jun 11 23:12:02.506997 np0000002687 nova-compute[98431]: iface.state = Jun 11 23:12:02.506997 np0000002687 nova-compute[98431]: iface.vlan_id = 0 Jun 11 23:12:02.506997 np0000002687 nova-compute[98431]: iface.vlan_priority = 0 Jun 11 23:12:02.506997 np0000002687 nova-compute[98431]: iface.vlan_state = Jun 11 23:12:02.506997 np0000002687 nova-compute[98431]: iface.iface_num = 0 Jun 11 23:12:02.506997 np0000002687 nova-compute[98431]: iface.mtu = 0 Jun 11 23:12:02.506997 np0000002687 nova-compute[98431]: iface.port = 0 Jun 11 23:12:02.506997 np0000002687 nova-compute[98431]: iface.bootproto = Jun 11 23:12:02.506997 np0000002687 nova-compute[98431]: iface.subnet_mask = Jun 11 23:12:02.506997 np0000002687 nova-compute[98431]: iface.gateway = Jun 11 23:12:02.506997 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id_state = Jun 11 23:12:02.506997 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id = Jun 11 23:12:02.506997 np0000002687 nova-compute[98431]: iface.dhcp_dns = Jun 11 23:12:02.506997 np0000002687 nova-compute[98431]: iface.dhcp_learn_iqn = Jun 11 23:12:02.506997 np0000002687 nova-compute[98431]: iface.dhcp_req_vendor_id_state = Jun 11 23:12:02.506997 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id_state = Jun 11 23:12:02.506997 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id = Jun 11 23:12:02.506997 np0000002687 nova-compute[98431]: iface.dhcp_slp_da = Jun 11 23:12:02.506997 np0000002687 nova-compute[98431]: iface.fragmentation = Jun 11 23:12:02.506997 np0000002687 nova-compute[98431]: iface.gratuitous_arp = Jun 11 23:12:02.506997 np0000002687 nova-compute[98431]: iface.incoming_forwarding = Jun 11 23:12:02.506997 np0000002687 nova-compute[98431]: iface.tos_state = Jun 11 23:12:02.506997 np0000002687 nova-compute[98431]: iface.tos = 0 Jun 11 23:12:02.506997 np0000002687 nova-compute[98431]: iface.ttl = 0 Jun 11 23:12:02.506997 np0000002687 nova-compute[98431]: iface.delayed_ack = Jun 11 23:12:02.506997 np0000002687 nova-compute[98431]: iface.tcp_nagle = Jun 11 23:12:02.506997 np0000002687 nova-compute[98431]: iface.tcp_wsf_state = Jun 11 23:12:02.506997 np0000002687 nova-compute[98431]: iface.tcp_wsf = 0 Jun 11 23:12:02.506997 np0000002687 nova-compute[98431]: iface.tcp_timer_scale = 0 Jun 11 23:12:02.506997 np0000002687 nova-compute[98431]: iface.tcp_timestamp = Jun 11 23:12:02.506997 np0000002687 nova-compute[98431]: iface.redirect = Jun 11 23:12:02.506997 np0000002687 nova-compute[98431]: iface.def_task_mgmt_timeout = 0 Jun 11 23:12:02.506997 np0000002687 nova-compute[98431]: iface.header_digest = Jun 11 23:12:02.506997 np0000002687 nova-compute[98431]: iface.data_digest = Jun 11 23:12:02.506997 np0000002687 nova-compute[98431]: iface.immediate_data = Jun 11 23:12:02.506997 np0000002687 nova-compute[98431]: iface.initial_r2t = Jun 11 23:12:02.506997 np0000002687 nova-compute[98431]: iface.data_seq_inorder = Jun 11 23:12:02.506997 np0000002687 nova-compute[98431]: iface.data_pdu_inorder = Jun 11 23:12:02.506997 np0000002687 nova-compute[98431]: iface.erl = 0 Jun 11 23:12:02.506997 np0000002687 nova-compute[98431]: iface.max_receive_data_len = 0 Jun 11 23:12:02.506997 np0000002687 nova-compute[98431]: iface.first_burst_len = 0 Jun 11 23:12:02.506997 np0000002687 nova-compute[98431]: iface.max_outstanding_r2t = 0 Jun 11 23:12:02.506997 np0000002687 nova-compute[98431]: iface.max_burst_len = 0 Jun 11 23:12:02.506997 np0000002687 nova-compute[98431]: iface.chap_auth = Jun 11 23:12:02.506997 np0000002687 nova-compute[98431]: iface.bidi_chap = Jun 11 23:12:02.506997 np0000002687 nova-compute[98431]: iface.strict_login_compliance = Jun 11 23:12:02.506997 np0000002687 nova-compute[98431]: iface.discovery_auth = Jun 11 23:12:02.506997 np0000002687 nova-compute[98431]: iface.discovery_logout = Jun 11 23:12:02.506997 np0000002687 nova-compute[98431]: node.discovery_address = Jun 11 23:12:02.506997 np0000002687 nova-compute[98431]: node.discovery_port = 0 Jun 11 23:12:02.506997 np0000002687 nova-compute[98431]: node.discovery_type = fw Jun 11 23:12:02.506997 np0000002687 nova-compute[98431]: node.session.initial_cmdsn = 0 Jun 11 23:12:02.506997 np0000002687 nova-compute[98431]: node.session.initial_login_retry_max = 8 Jun 11 23:12:02.506997 np0000002687 nova-compute[98431]: node.session.xmit_thread_priority = 0 Jun 11 23:12:02.506997 np0000002687 nova-compute[98431]: node.session.cmds_max = 128 Jun 11 23:12:02.506997 np0000002687 nova-compute[98431]: node.session.queue_depth = 32 Jun 11 23:12:02.506997 np0000002687 nova-compute[98431]: node.session.nr_sessions = 1 Jun 11 23:12:02.506997 np0000002687 nova-compute[98431]: node.session.auth.authmethod = None Jun 11 23:12:02.506997 np0000002687 nova-compute[98431]: node.session.auth.username = Jun 11 23:12:02.506997 np0000002687 nova-compute[98431]: node.session.auth.password = *** Jun 11 23:12:02.506997 np0000002687 nova-compute[98431]: node.session.auth.username_in = Jun 11 23:12:02.506997 np0000002687 nova-compute[98431]: node.session.auth.password_in = Jun 11 23:12:02.506997 np0000002687 nova-compute[98431]: node.session.auth.chap_algs = SHA256 Jun 11 23:12:02.506997 np0000002687 nova-compute[98431]: node.session.timeo.replacement_timeout = 120 Jun 11 23:12:02.506997 np0000002687 nova-compute[98431]: node.session.err_timeo.abort_timeout = 15 Jun 11 23:12:02.506997 np0000002687 nova-compute[98431]: node.session.err_timeo.lu_reset_timeout = 30 Jun 11 23:12:02.506997 np0000002687 nova-compute[98431]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 11 23:12:02.506997 np0000002687 nova-compute[98431]: node.session.err_timeo.host_reset_timeout = 60 Jun 11 23:12:02.506997 np0000002687 nova-compute[98431]: node.session.iscsi.FastAbort = Yes Jun 11 23:12:02.506997 np0000002687 nova-compute[98431]: node.session.iscsi.InitialR2T = No Jun 11 23:12:02.506997 np0000002687 nova-compute[98431]: node.session.iscsi.ImmediateData = Yes Jun 11 23:12:02.506997 np0000002687 nova-compute[98431]: node.session.iscsi.FirstBurstLength = 262144 Jun 11 23:12:02.506997 np0000002687 nova-compute[98431]: node.session.iscsi.MaxBurstLength = 16776192 Jun 11 23:12:02.506997 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Retain = 0 Jun 11 23:12:02.506997 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Wait = 2 Jun 11 23:12:02.506997 np0000002687 nova-compute[98431]: node.session.iscsi.MaxConnections = 1 Jun 11 23:12:02.506997 np0000002687 nova-compute[98431]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 11 23:12:02.506997 np0000002687 nova-compute[98431]: node.session.iscsi.ERL = 0 Jun 11 23:12:02.506997 np0000002687 nova-compute[98431]: node.session.scan = manual Jun 11 23:12:02.506997 np0000002687 nova-compute[98431]: node.session.reopen_max = 0 Jun 11 23:12:02.506997 np0000002687 nova-compute[98431]: node.conn[0].address = 192.168.50.100 Jun 11 23:12:02.506997 np0000002687 nova-compute[98431]: node.conn[0].port = 3260 Jun 11 23:12:02.506997 np0000002687 nova-compute[98431]: node.conn[0].startup = manual Jun 11 23:12:02.506997 np0000002687 nova-compute[98431]: node.conn[0].tcp.window_size = 524288 Jun 11 23:12:02.506997 np0000002687 nova-compute[98431]: node.conn[0].tcp.type_of_service = 0 Jun 11 23:12:02.506997 np0000002687 nova-compute[98431]: node.conn[0].timeo.logout_timeout = 15 Jun 11 23:12:02.506997 np0000002687 nova-compute[98431]: node.conn[0].timeo.login_timeout = 15 Jun 11 23:12:02.506997 np0000002687 nova-compute[98431]: node.conn[0].timeo.auth_timeout = 45 Jun 11 23:12:02.506997 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_interval = 5 Jun 11 23:12:02.506997 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_timeout = 5 Jun 11 23:12:02.506997 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 11 23:12:02.506997 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 11 23:12:02.506997 np0000002687 nova-compute[98431]: node.conn[0].iscsi.HeaderDigest = None Jun 11 23:12:02.506997 np0000002687 nova-compute[98431]: node.conn[0].iscsi.DataDigest = None Jun 11 23:12:02.506997 np0000002687 nova-compute[98431]: node.conn[0].iscsi.IFMarker = No Jun 11 23:12:02.506997 np0000002687 nova-compute[98431]: node.conn[0].iscsi.OFMarker = No Jun 11 23:12:02.506997 np0000002687 nova-compute[98431]: # END RECORD Jun 11 23:12:02.506997 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:12:02.513445 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-50d95170-3b66-43b5-8adb-e70adbf32d94 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:12:02.514842 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:02.520478 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:02.522843 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-50d95170-3b66-43b5-8adb-e70adbf32d94 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:12:02.534150 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-50d95170-3b66-43b5-8adb-e70adbf32d94 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:12:02.534150 np0000002687 nova-compute[98431]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:12:02.534150 np0000002687 nova-compute[98431]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:12:02.534150 np0000002687 nova-compute[98431]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:12:02.534150 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:12:02.534150 np0000002687 nova-compute[98431]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8 (non-flash) Jun 11 23:12:02.534150 np0000002687 nova-compute[98431]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8 (non-flash) Jun 11 23:12:02.534150 np0000002687 nova-compute[98431]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce (non-flash) Jun 11 23:12:02.534150 np0000002687 nova-compute[98431]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce (non-flash) Jun 11 23:12:02.534150 np0000002687 nova-compute[98431]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060 (non-flash) Jun 11 23:12:02.534150 np0000002687 nova-compute[98431]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060 (non-flash) Jun 11 23:12:02.534150 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:12:02.534150 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:12:02.534150 np0000002687 nova-compute[98431]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:12:02.534150 np0000002687 nova-compute[98431]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:12:02.534150 np0000002687 nova-compute[98431]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:12:02.534150 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:12:02.534618 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-50d95170-3b66-43b5-8adb-e70adbf32d94 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:12:02.534618 np0000002687 nova-compute[98431]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:12:02.534618 np0000002687 nova-compute[98431]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:12:02.534618 np0000002687 nova-compute[98431]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:12:02.534618 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:12:02.534618 np0000002687 nova-compute[98431]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8 (non-flash) Jun 11 23:12:02.534618 np0000002687 nova-compute[98431]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8 (non-flash) Jun 11 23:12:02.534618 np0000002687 nova-compute[98431]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce (non-flash) Jun 11 23:12:02.534618 np0000002687 nova-compute[98431]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce (non-flash) Jun 11 23:12:02.534618 np0000002687 nova-compute[98431]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060 (non-flash) Jun 11 23:12:02.534618 np0000002687 nova-compute[98431]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060 (non-flash) Jun 11 23:12:02.534618 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:12:02.534618 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:12:02.534618 np0000002687 nova-compute[98431]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:12:02.534618 np0000002687 nova-compute[98431]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:12:02.534618 np0000002687 nova-compute[98431]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:12:02.534618 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:12:02.535120 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-50d95170-3b66-43b5-8adb-e70adbf32d94 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.054s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 11 23:12:02.535120 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-50d95170-3b66-43b5-8adb-e70adbf32d94 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Connected to 192.168.40.100:3260 {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 11 23:12:02.536337 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-50d95170-3b66-43b5-8adb-e70adbf32d94 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] HCTL ('24', '0', '0', 0) found on session 22 with lun 0 {{(pid=98431) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 11 23:12:02.536512 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-50d95170-3b66-43b5-8adb-e70adbf32d94 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Scanning host 24 c: 0, t: 0, l: 0) {{(pid=98431) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 11 23:12:02.544578 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-50d95170-3b66-43b5-8adb-e70adbf32d94 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:12:02.544578 np0000002687 nova-compute[98431]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:12:02.544578 np0000002687 nova-compute[98431]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:12:02.544578 np0000002687 nova-compute[98431]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:12:02.544578 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:12:02.544578 np0000002687 nova-compute[98431]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8 (non-flash) Jun 11 23:12:02.544578 np0000002687 nova-compute[98431]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8 (non-flash) Jun 11 23:12:02.544578 np0000002687 nova-compute[98431]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce (non-flash) Jun 11 23:12:02.544578 np0000002687 nova-compute[98431]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce (non-flash) Jun 11 23:12:02.544578 np0000002687 nova-compute[98431]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060 (non-flash) Jun 11 23:12:02.544578 np0000002687 nova-compute[98431]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060 (non-flash) Jun 11 23:12:02.544578 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:12:02.544578 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:12:02.544578 np0000002687 nova-compute[98431]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:12:02.544578 np0000002687 nova-compute[98431]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:12:02.544578 np0000002687 nova-compute[98431]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:12:02.544578 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:12:02.545177 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-50d95170-3b66-43b5-8adb-e70adbf32d94 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:12:02.545177 np0000002687 nova-compute[98431]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:12:02.545177 np0000002687 nova-compute[98431]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:12:02.545177 np0000002687 nova-compute[98431]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:12:02.545177 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:12:02.545177 np0000002687 nova-compute[98431]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8 (non-flash) Jun 11 23:12:02.545177 np0000002687 nova-compute[98431]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8 (non-flash) Jun 11 23:12:02.545177 np0000002687 nova-compute[98431]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce (non-flash) Jun 11 23:12:02.545177 np0000002687 nova-compute[98431]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce (non-flash) Jun 11 23:12:02.545177 np0000002687 nova-compute[98431]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060 (non-flash) Jun 11 23:12:02.545177 np0000002687 nova-compute[98431]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060 (non-flash) Jun 11 23:12:02.545177 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:12:02.545177 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:12:02.545177 np0000002687 nova-compute[98431]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:12:02.545177 np0000002687 nova-compute[98431]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:12:02.545177 np0000002687 nova-compute[98431]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:12:02.545177 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:12:02.545177 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-50d95170-3b66-43b5-8adb-e70adbf32d94 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.063s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 11 23:12:02.545844 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-50d95170-3b66-43b5-8adb-e70adbf32d94 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Connected to 192.168.50.100:3260 {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 11 23:12:02.546114 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-50d95170-3b66-43b5-8adb-e70adbf32d94 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Searching for a device in session 22 and hctl ('24', '0', '0', 0) yield: sds {{(pid=98431) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 11 23:12:02.546719 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-50d95170-3b66-43b5-8adb-e70adbf32d94 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Connected to sds using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '65724ff3-60af-4d3f-b1bf-3aa2695037ce', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 11 23:12:02.547864 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-50d95170-3b66-43b5-8adb-e70adbf32d94 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] HCTL ('23', '0', '0', 0) found on session 21 with lun 0 {{(pid=98431) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 11 23:12:02.548085 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-50d95170-3b66-43b5-8adb-e70adbf32d94 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Scanning host 23 c: 0, t: 0, l: 0) {{(pid=98431) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 11 23:12:02.565473 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-50d95170-3b66-43b5-8adb-e70adbf32d94 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Searching for a device in session 21 and hctl ('23', '0', '0', 0) yield: sdr {{(pid=98431) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 11 23:12:02.565667 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-50d95170-3b66-43b5-8adb-e70adbf32d94 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Connected to sdr using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '65724ff3-60af-4d3f-b1bf-3aa2695037ce', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 11 23:12:02.647767 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:02.667137 np0000002687 nova-compute[98431]: DEBUG nova.utils [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Queued Task(fn=>, remaining_delay=14.999656706999986 future=) {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:12:02.668846 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [-] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Instance destroyed successfully. Jun 11 23:12:02.669538 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-064e4429-4a53-482d-9918-5822f12f669e tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lazy-loading 'numa_topology' on Instance uuid c82748e6-1c78-4372-ad4b-48d1c6448efa {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:12:02.671816 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [-] [instance: 73abd331-0bbf-432e-be1c-308801a5429f] Updating instance_info_cache with network_info: [] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:12:02.859375 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-add1989e-df80-4804-9bd2-cf702ab3d6de tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:12:02.859529 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-add1989e-df80-4804-9bd2-cf702ab3d6de tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:12:02.975537 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-fb3bafa7-57b2-4711-b982-8c208f85ff32 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Attempting to attach volume 859ffbad-3fc1-400a-a7f7-ac423851f060 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98431) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}} Jun 11 23:12:02.976861 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.guest [None req-fb3bafa7-57b2-4711-b982-8c208f85ff32 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] attach device xml: Jun 11 23:12:02.976861 np0000002687 nova-compute[98431]: Jun 11 23:12:02.976861 np0000002687 nova-compute[98431]: Jun 11 23:12:02.976861 np0000002687 nova-compute[98431]: Jun 11 23:12:02.976861 np0000002687 nova-compute[98431]: Jun 11 23:12:02.976861 np0000002687 nova-compute[98431]: 859ffbad-3fc1-400a-a7f7-ac423851f060 Jun 11 23:12:02.976861 np0000002687 nova-compute[98431]: Jun 11 23:12:02.976861 np0000002687 nova-compute[98431]: {{(pid=98431) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} Jun 11 23:12:03.171289 np0000002687 nova-compute[98431]: DEBUG nova.objects.base [None req-064e4429-4a53-482d-9918-5822f12f669e tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Object Instance lazy-loaded attributes: flavor,numa_topology {{(pid=98431) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 11 23:12:03.175827 np0000002687 nova-compute[98431]: INFO nova.compute.manager [-] [instance: 73abd331-0bbf-432e-be1c-308801a5429f] Took 1.66 seconds to deallocate network for instance. Jun 11 23:12:03.218247 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ffa4bbe-7ead-4029-aba5-28f031f6e784/disk --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:12:03.246576 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-4089a89c-b865-4eb8-b095-538b3028492e tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "8ffa4bbe-7ead-4029-aba5-28f031f6e784" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 6.548s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:12:03.311549 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ffa4bbe-7ead-4029-aba5-28f031f6e784/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:12:03.313932 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ffa4bbe-7ead-4029-aba5-28f031f6e784/disk --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:12:03.405253 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ffa4bbe-7ead-4029-aba5-28f031f6e784/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:12:03.406573 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] skipping disk /dev/dm-11 (vdb) as it is a volume {{(pid=98431) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12344}} Jun 11 23:12:03.413897 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7609742e-a3a2-4be2-ba02-227efb2101e1/disk --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:12:03.483691 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-50d95170-3b66-43b5-8adb-e70adbf32d94 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98431) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 11 23:12:03.495911 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7609742e-a3a2-4be2-ba02-227efb2101e1/disk --force-share --output=json" returned: 0 in 0.082s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:12:03.497265 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7609742e-a3a2-4be2-ba02-227efb2101e1/disk --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:12:03.525806 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-7d965e03-255d-4190-90fe-695d252284f5 req-2221cd02-7c01-4977-8305-5c7902a44002 service nova] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Received event network-vif-unplugged-852fc4ec-82e1-4185-a33c-3c45ff42351e {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:12:03.529157 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-7d965e03-255d-4190-90fe-695d252284f5 req-2221cd02-7c01-4977-8305-5c7902a44002 service nova] Acquiring lock "c82748e6-1c78-4372-ad4b-48d1c6448efa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:12:03.529516 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-7d965e03-255d-4190-90fe-695d252284f5 req-2221cd02-7c01-4977-8305-5c7902a44002 service nova] Lock "c82748e6-1c78-4372-ad4b-48d1c6448efa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:12:03.530770 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-7d965e03-255d-4190-90fe-695d252284f5 req-2221cd02-7c01-4977-8305-5c7902a44002 service nova] Lock "c82748e6-1c78-4372-ad4b-48d1c6448efa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:12:03.531417 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-7d965e03-255d-4190-90fe-695d252284f5 req-2221cd02-7c01-4977-8305-5c7902a44002 service nova] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] No waiting events found dispatching network-vif-unplugged-852fc4ec-82e1-4185-a33c-3c45ff42351e {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:12:03.531417 np0000002687 nova-compute[98431]: WARNING nova.compute.manager [req-7d965e03-255d-4190-90fe-695d252284f5 req-2221cd02-7c01-4977-8305-5c7902a44002 service nova] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Received unexpected event network-vif-unplugged-852fc4ec-82e1-4185-a33c-3c45ff42351e for instance with vm_state rescued and task_state unrescuing. Jun 11 23:12:03.531417 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-7d965e03-255d-4190-90fe-695d252284f5 req-2221cd02-7c01-4977-8305-5c7902a44002 service nova] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Received event network-vif-unplugged-852fc4ec-82e1-4185-a33c-3c45ff42351e {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:12:03.532000 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-7d965e03-255d-4190-90fe-695d252284f5 req-2221cd02-7c01-4977-8305-5c7902a44002 service nova] Acquiring lock "c82748e6-1c78-4372-ad4b-48d1c6448efa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:12:03.532000 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-7d965e03-255d-4190-90fe-695d252284f5 req-2221cd02-7c01-4977-8305-5c7902a44002 service nova] Lock "c82748e6-1c78-4372-ad4b-48d1c6448efa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:12:03.532000 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-7d965e03-255d-4190-90fe-695d252284f5 req-2221cd02-7c01-4977-8305-5c7902a44002 service nova] Lock "c82748e6-1c78-4372-ad4b-48d1c6448efa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:12:03.532106 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-7d965e03-255d-4190-90fe-695d252284f5 req-2221cd02-7c01-4977-8305-5c7902a44002 service nova] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] No waiting events found dispatching network-vif-unplugged-852fc4ec-82e1-4185-a33c-3c45ff42351e {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:12:03.532217 np0000002687 nova-compute[98431]: WARNING nova.compute.manager [req-7d965e03-255d-4190-90fe-695d252284f5 req-2221cd02-7c01-4977-8305-5c7902a44002 service nova] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Received unexpected event network-vif-unplugged-852fc4ec-82e1-4185-a33c-3c45ff42351e for instance with vm_state rescued and task_state unrescuing. Jun 11 23:12:03.598039 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7609742e-a3a2-4be2-ba02-227efb2101e1/disk --force-share --output=json" returned: 0 in 0.101s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:12:03.602114 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98431) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12344}} Jun 11 23:12:03.605587 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27ac8c84-e5db-4bd1-a148-ec5834c5b39c/disk --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:12:03.666273 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-add1989e-df80-4804-9bd2-cf702ab3d6de tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98431) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 11 23:12:03.666480 np0000002687 nova-compute[98431]: DEBUG nova.compute.provider_tree [None req-add1989e-df80-4804-9bd2-cf702ab3d6de tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Inventory has not changed in ProviderTree for provider: e3e65fe2-9de9-4821-8b4a-ccae37c66e25 {{(pid=98431) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 11 23:12:03.682841 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-91030f7c-06ab-46ce-9a29-9010afbca4e9 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:12:03.686009 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27ac8c84-e5db-4bd1-a148-ec5834c5b39c/disk --force-share --output=json" returned: 0 in 0.080s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:12:03.689874 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27ac8c84-e5db-4bd1-a148-ec5834c5b39c/disk --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:12:03.706276 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:03.729879 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:03.736029 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:03.770735 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27ac8c84-e5db-4bd1-a148-ec5834c5b39c/disk --force-share --output=json" returned: 0 in 0.084s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:12:03.776139 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] skipping disk /dev/dm-3 (vda) as it is a volume {{(pid=98431) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12344}} Jun 11 23:12:03.776311 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] skipping disk /dev/dm-6 (vdb) as it is a volume {{(pid=98431) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12344}} Jun 11 23:12:03.776403 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] skipping disk /dev/dm-7 (vdc) as it is a volume {{(pid=98431) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12344}} Jun 11 23:12:03.778191 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14699717-b93f-4e67-b841-c67de8fff8d4/disk --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:12:03.852262 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:03.873987 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14699717-b93f-4e67-b841-c67de8fff8d4/disk --force-share --output=json" returned: 0 in 0.095s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:12:03.877924 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14699717-b93f-4e67-b841-c67de8fff8d4/disk --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:12:03.904448 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:03.957865 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14699717-b93f-4e67-b841-c67de8fff8d4/disk --force-share --output=json" returned: 0 in 0.080s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:12:03.958281 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] skipping disk /dev/dm-12 (vdb) as it is a volume {{(pid=98431) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12344}} Jun 11 23:12:03.960923 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8aec3cea-109d-43f8-983c-1d5ee2f71181/disk --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:12:04.040150 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8aec3cea-109d-43f8-983c-1d5ee2f71181/disk --force-share --output=json" returned: 0 in 0.079s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:12:04.040749 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8aec3cea-109d-43f8-983c-1d5ee2f71181/disk --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:12:04.083451 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-2aaaba2c-c032-4e17-bb8a-6dcb3e5b0dab tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Acquiring lock "206476b7-d805-4c6c-b7fb-db8b5c2a94a6" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:12:04.083687 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-2aaaba2c-c032-4e17-bb8a-6dcb3e5b0dab tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "206476b7-d805-4c6c-b7fb-db8b5c2a94a6" acquired by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:12:04.133674 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8aec3cea-109d-43f8-983c-1d5ee2f71181/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:12:04.137288 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] skipping disk /dev/dm-8 (vda) as it is a volume {{(pid=98431) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12344}} Jun 11 23:12:04.139390 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb63f66c-b69e-42b0-805c-be6fe9b3aee3/disk --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:12:04.170640 np0000002687 nova-compute[98431]: DEBUG nova.scheduler.client.report [None req-add1989e-df80-4804-9bd2-cf702ab3d6de tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Inventory has not changed for provider e3e65fe2-9de9-4821-8b4a-ccae37c66e25 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98431) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 11 23:12:04.244619 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb63f66c-b69e-42b0-805c-be6fe9b3aee3/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:12:04.245100 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb63f66c-b69e-42b0-805c-be6fe9b3aee3/disk --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:12:04.336412 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb63f66c-b69e-42b0-805c-be6fe9b3aee3/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:12:04.336976 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] skipping disk /dev/dm-9 (vdb) as it is a volume {{(pid=98431) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12344}} Jun 11 23:12:04.339999 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/206476b7-d805-4c6c-b7fb-db8b5c2a94a6/disk --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:12:04.424077 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/206476b7-d805-4c6c-b7fb-db8b5c2a94a6/disk --force-share --output=json" returned: 0 in 0.084s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:12:04.424653 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/206476b7-d805-4c6c-b7fb-db8b5c2a94a6/disk --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:12:04.502255 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/206476b7-d805-4c6c-b7fb-db8b5c2a94a6/disk --force-share --output=json" returned: 0 in 0.077s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:12:04.502827 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] skipping disk /dev/dm-11 (vdb) as it is a volume {{(pid=98431) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12344}} Jun 11 23:12:04.504598 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-50d95170-3b66-43b5-8adb-e70adbf32d94 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Found WWN 330000000f7449ef5 for multipath device dm-12 {{(pid=98431) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 11 23:12:04.505248 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-50d95170-3b66-43b5-8adb-e70adbf32d94 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.041s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 11 23:12:04.505468 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-50d95170-3b66-43b5-8adb-e70adbf32d94 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] <== connect_volume: return (2070ms) {'type': 'block', 'scsi_wwn': '330000000f7449ef5', 'path': '/dev/dm-12', 'multipath_id': '330000000f7449ef5'} {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 11 23:12:04.505625 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50d95170-3b66-43b5-8adb-e70adbf32d94 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] [instance: 27ac8c84-e5db-4bd1-a148-ec5834c5b39c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000f7449ef5', 'path': '/dev/dm-12', 'multipath_id': '330000000f7449ef5'} {{(pid=98431) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 11 23:12:04.506298 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Removed pending STOPPED event for c82748e6-1c78-4372-ad4b-48d1c6448efa due to new event Resumed> {{(pid=98431) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:519}} Jun 11 23:12:04.507098 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Emitting event Resumed> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:12:04.507226 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] VM Resumed (Lifecycle Event) Jun 11 23:12:04.508870 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-064e4429-4a53-482d-9918-5822f12f669e tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:12:04.512004 np0000002687 nova-compute[98431]: WARNING nova.virt.libvirt.driver [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 11 23:12:04.512463 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:12:04.528932 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-50d95170-3b66-43b5-8adb-e70adbf32d94 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Lazy-loading 'flavor' on Instance uuid 27ac8c84-e5db-4bd1-a148-ec5834c5b39c {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:12:04.547184 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] CMD "env LANG=C uptime" returned: 0 in 0.035s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:12:04.547572 np0000002687 nova-compute[98431]: DEBUG nova.compute.resource_tracker [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Hypervisor/Node resource view: name=np0000002687 free_ram=11633MB free_disk=74.330810546875GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}] {{(pid=98431) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}} Jun 11 23:12:04.547818 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:12:04.591675 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-2aaaba2c-c032-4e17-bb8a-6dcb3e5b0dab tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 206476b7-d805-4c6c-b7fb-db8b5c2a94a6] Detaching volume 4da6c3da-4a1a-454c-b611-7fa9fc0832d8 Jun 11 23:12:04.640812 np0000002687 nova-compute[98431]: INFO nova.virt.block_device [None req-2aaaba2c-c032-4e17-bb8a-6dcb3e5b0dab tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 206476b7-d805-4c6c-b7fb-db8b5c2a94a6] Attempting to driver detach volume 4da6c3da-4a1a-454c-b611-7fa9fc0832d8 from mountpoint /dev/vdb Jun 11 23:12:04.645645 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-2aaaba2c-c032-4e17-bb8a-6dcb3e5b0dab tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Found disk vdb by alias ua-4da6c3da-4a1a-454c-b611-7fa9fc0832d8 {{(pid=98431) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}} Jun 11 23:12:04.647181 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-2aaaba2c-c032-4e17-bb8a-6dcb3e5b0dab tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Found disk vdb by alias ua-4da6c3da-4a1a-454c-b611-7fa9fc0832d8 {{(pid=98431) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}} Jun 11 23:12:04.647297 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-2aaaba2c-c032-4e17-bb8a-6dcb3e5b0dab tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Attempting to detach device vdb from instance 206476b7-d805-4c6c-b7fb-db8b5c2a94a6 from the persistent domain config. {{(pid=98431) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}} Jun 11 23:12:04.647525 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.guest [None req-2aaaba2c-c032-4e17-bb8a-6dcb3e5b0dab tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] detach device xml: Jun 11 23:12:04.647525 np0000002687 nova-compute[98431]: Jun 11 23:12:04.647525 np0000002687 nova-compute[98431]: Jun 11 23:12:04.647525 np0000002687 nova-compute[98431]: Jun 11 23:12:04.647525 np0000002687 nova-compute[98431]: Jun 11 23:12:04.647525 np0000002687 nova-compute[98431]: 4da6c3da-4a1a-454c-b611-7fa9fc0832d8 Jun 11 23:12:04.647525 np0000002687 nova-compute[98431]: Jun 11 23:12:04.647525 np0000002687 nova-compute[98431]:
Jun 11 23:12:04.647525 np0000002687 nova-compute[98431]: Jun 11 23:12:04.647525 np0000002687 nova-compute[98431]: {{(pid=98431) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jun 11 23:12:04.653680 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-2aaaba2c-c032-4e17-bb8a-6dcb3e5b0dab tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Successfully detached device vdb from instance 206476b7-d805-4c6c-b7fb-db8b5c2a94a6 from the persistent domain config. Jun 11 23:12:04.653868 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-2aaaba2c-c032-4e17-bb8a-6dcb3e5b0dab tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] (1/8): Attempting to detach device vdb with device alias ua-4da6c3da-4a1a-454c-b611-7fa9fc0832d8 from instance 206476b7-d805-4c6c-b7fb-db8b5c2a94a6 from the live domain config. {{(pid=98431) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}} Jun 11 23:12:04.654086 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.guest [None req-2aaaba2c-c032-4e17-bb8a-6dcb3e5b0dab tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] detach device xml: Jun 11 23:12:04.654086 np0000002687 nova-compute[98431]: Jun 11 23:12:04.654086 np0000002687 nova-compute[98431]: Jun 11 23:12:04.654086 np0000002687 nova-compute[98431]: Jun 11 23:12:04.654086 np0000002687 nova-compute[98431]: Jun 11 23:12:04.654086 np0000002687 nova-compute[98431]: 4da6c3da-4a1a-454c-b611-7fa9fc0832d8 Jun 11 23:12:04.654086 np0000002687 nova-compute[98431]: Jun 11 23:12:04.654086 np0000002687 nova-compute[98431]:
Jun 11 23:12:04.654086 np0000002687 nova-compute[98431]: Jun 11 23:12:04.654086 np0000002687 nova-compute[98431]: {{(pid=98431) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jun 11 23:12:04.658825 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-fb3bafa7-57b2-4711-b982-8c208f85ff32 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] No BDM found with device name vda, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:12:04.658825 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-fb3bafa7-57b2-4711-b982-8c208f85ff32 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:12:04.658825 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-fb3bafa7-57b2-4711-b982-8c208f85ff32 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] No BDM found with device name hda, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:12:04.658825 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-fb3bafa7-57b2-4711-b982-8c208f85ff32 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] No VIF found with MAC fa:16:3e:b5:6f:fd, not building metadata {{(pid=98431) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13199}} Jun 11 23:12:04.679977 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-add1989e-df80-4804-9bd2-cf702ab3d6de tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.820s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:12:04.682630 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-91030f7c-06ab-46ce-9a29-9010afbca4e9 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:12:04.765189 np0000002687 nova-compute[98431]: INFO nova.scheduler.client.report [None req-add1989e-df80-4804-9bd2-cf702ab3d6de tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Deleted allocations for instance 36688d94-68d3-4ae3-989a-b391d7ee4ad9 Jun 11 23:12:05.012034 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:12:05.016032 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98431) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 11 23:12:05.043339 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-50d95170-3b66-43b5-8adb-e70adbf32d94 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] [instance: 27ac8c84-e5db-4bd1-a148-ec5834c5b39c] Attempting to attach volume 65724ff3-60af-4d3f-b1bf-3aa2695037ce with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98431) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}} Jun 11 23:12:05.046337 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.guest [None req-50d95170-3b66-43b5-8adb-e70adbf32d94 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] attach device xml: Jun 11 23:12:05.046337 np0000002687 nova-compute[98431]: Jun 11 23:12:05.046337 np0000002687 nova-compute[98431]: Jun 11 23:12:05.046337 np0000002687 nova-compute[98431]: Jun 11 23:12:05.046337 np0000002687 nova-compute[98431]: Jun 11 23:12:05.046337 np0000002687 nova-compute[98431]: 65724ff3-60af-4d3f-b1bf-3aa2695037ce Jun 11 23:12:05.046337 np0000002687 nova-compute[98431]: Jun 11 23:12:05.046337 np0000002687 nova-compute[98431]: Jun 11 23:12:05.046337 np0000002687 nova-compute[98431]: {{(pid=98431) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} Jun 11 23:12:05.305885 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-2aaaba2c-c032-4e17-bb8a-6dcb3e5b0dab tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-4da6c3da-4a1a-454c-b611-7fa9fc0832d8 for instance 206476b7-d805-4c6c-b7fb-db8b5c2a94a6 {{(pid=98431) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}} Jun 11 23:12:05.374710 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-91030f7c-06ab-46ce-9a29-9010afbca4e9 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98431) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 11 23:12:05.375055 np0000002687 nova-compute[98431]: DEBUG nova.compute.provider_tree [None req-91030f7c-06ab-46ce-9a29-9010afbca4e9 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] Inventory has not changed in ProviderTree for provider: e3e65fe2-9de9-4821-8b4a-ccae37c66e25 {{(pid=98431) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 11 23:12:05.517230 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Emitting event Started> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:12:05.517339 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] VM Started (Lifecycle Event) Jun 11 23:12:05.597537 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-23f2b4a1-8793-4149-9c7c-ec8af0903321 req-17a72f0b-5f0f-4daf-a74a-cf8a8bdf8a75 service nova] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Received event network-vif-plugged-852fc4ec-82e1-4185-a33c-3c45ff42351e {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:12:05.598032 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-23f2b4a1-8793-4149-9c7c-ec8af0903321 req-17a72f0b-5f0f-4daf-a74a-cf8a8bdf8a75 service nova] Acquiring lock "c82748e6-1c78-4372-ad4b-48d1c6448efa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:12:05.598032 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-23f2b4a1-8793-4149-9c7c-ec8af0903321 req-17a72f0b-5f0f-4daf-a74a-cf8a8bdf8a75 service nova] Lock "c82748e6-1c78-4372-ad4b-48d1c6448efa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:12:05.598032 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-23f2b4a1-8793-4149-9c7c-ec8af0903321 req-17a72f0b-5f0f-4daf-a74a-cf8a8bdf8a75 service nova] Lock "c82748e6-1c78-4372-ad4b-48d1c6448efa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:12:05.598179 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-23f2b4a1-8793-4149-9c7c-ec8af0903321 req-17a72f0b-5f0f-4daf-a74a-cf8a8bdf8a75 service nova] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] No waiting events found dispatching network-vif-plugged-852fc4ec-82e1-4185-a33c-3c45ff42351e {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:12:05.598329 np0000002687 nova-compute[98431]: WARNING nova.compute.manager [req-23f2b4a1-8793-4149-9c7c-ec8af0903321 req-17a72f0b-5f0f-4daf-a74a-cf8a8bdf8a75 service nova] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Received unexpected event network-vif-plugged-852fc4ec-82e1-4185-a33c-3c45ff42351e for instance with vm_state active and task_state None. Jun 11 23:12:05.598452 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-23f2b4a1-8793-4149-9c7c-ec8af0903321 req-17a72f0b-5f0f-4daf-a74a-cf8a8bdf8a75 service nova] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Received event network-vif-plugged-852fc4ec-82e1-4185-a33c-3c45ff42351e {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:12:05.598974 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-23f2b4a1-8793-4149-9c7c-ec8af0903321 req-17a72f0b-5f0f-4daf-a74a-cf8a8bdf8a75 service nova] Acquiring lock "c82748e6-1c78-4372-ad4b-48d1c6448efa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:12:05.599139 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-23f2b4a1-8793-4149-9c7c-ec8af0903321 req-17a72f0b-5f0f-4daf-a74a-cf8a8bdf8a75 service nova] Lock "c82748e6-1c78-4372-ad4b-48d1c6448efa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:12:05.599270 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-23f2b4a1-8793-4149-9c7c-ec8af0903321 req-17a72f0b-5f0f-4daf-a74a-cf8a8bdf8a75 service nova] Lock "c82748e6-1c78-4372-ad4b-48d1c6448efa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:12:05.599418 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-23f2b4a1-8793-4149-9c7c-ec8af0903321 req-17a72f0b-5f0f-4daf-a74a-cf8a8bdf8a75 service nova] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] No waiting events found dispatching network-vif-plugged-852fc4ec-82e1-4185-a33c-3c45ff42351e {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:12:05.599546 np0000002687 nova-compute[98431]: WARNING nova.compute.manager [req-23f2b4a1-8793-4149-9c7c-ec8af0903321 req-17a72f0b-5f0f-4daf-a74a-cf8a8bdf8a75 service nova] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Received unexpected event network-vif-plugged-852fc4ec-82e1-4185-a33c-3c45ff42351e for instance with vm_state active and task_state None. Jun 11 23:12:05.777288 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-add1989e-df80-4804-9bd2-cf702ab3d6de tempest-AttachSCSIVolumeTestJSON-613359672 tempest-AttachSCSIVolumeTestJSON-613359672-project-member] Lock "36688d94-68d3-4ae3-989a-b391d7ee4ad9" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 7.080s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:12:05.877681 np0000002687 nova-compute[98431]: DEBUG nova.scheduler.client.report [None req-91030f7c-06ab-46ce-9a29-9010afbca4e9 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] Inventory has not changed for provider e3e65fe2-9de9-4821-8b4a-ccae37c66e25 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98431) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 11 23:12:06.001789 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:06.019535 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:12:06.021453 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98431) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 11 23:12:06.212605 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-fb3bafa7-57b2-4711-b982-8c208f85ff32 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Lock "cb63f66c-b69e-42b0-805c-be6fe9b3aee3" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 8.613s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:12:06.389407 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-91030f7c-06ab-46ce-9a29-9010afbca4e9 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.706s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:12:06.390958 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 1.841s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:12:06.421236 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-bdf7e918-03fc-449d-84f5-e72e211672f4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Acquiring lock "8641b14d-785b-44b0-ad6d-bb537cbee5c7" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:12:06.421466 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-bdf7e918-03fc-449d-84f5-e72e211672f4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lock "8641b14d-785b-44b0-ad6d-bb537cbee5c7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:12:06.487603 np0000002687 nova-compute[98431]: INFO nova.scheduler.client.report [None req-91030f7c-06ab-46ce-9a29-9010afbca4e9 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] Deleted allocations for instance 73abd331-0bbf-432e-be1c-308801a5429f Jun 11 23:12:06.524036 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Received event ua-4da6c3da-4a1a-454c-b611-7fa9fc0832d8> from libvirt while the driver is waiting for it; dispatched. {{(pid=98431) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}} Jun 11 23:12:06.529994 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-2aaaba2c-c032-4e17-bb8a-6dcb3e5b0dab tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Successfully detached device vdb from instance 206476b7-d805-4c6c-b7fb-db8b5c2a94a6 from the live domain config. Jun 11 23:12:06.715176 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-50d95170-3b66-43b5-8adb-e70adbf32d94 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] No BDM found with device name vda, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:12:06.715744 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-50d95170-3b66-43b5-8adb-e70adbf32d94 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:12:06.715744 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-50d95170-3b66-43b5-8adb-e70adbf32d94 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] No BDM found with device name hda, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:12:06.715744 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-50d95170-3b66-43b5-8adb-e70adbf32d94 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] No VIF found with MAC fa:16:3e:dc:9c:b5, not building metadata {{(pid=98431) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13199}} Jun 11 23:12:06.780245 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Rescuing Jun 11 23:12:06.780482 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Acquiring lock "refresh_cache-cb63f66c-b69e-42b0-805c-be6fe9b3aee3" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 11 23:12:06.780627 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Acquired lock "refresh_cache-cb63f66c-b69e-42b0-805c-be6fe9b3aee3" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 11 23:12:06.780825 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Building network info cache for instance {{(pid=98431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 11 23:12:06.924339 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-bdf7e918-03fc-449d-84f5-e72e211672f4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 8641b14d-785b-44b0-ad6d-bb537cbee5c7] Starting instance... {{(pid=98431) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 11 23:12:07.072355 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-2aaaba2c-c032-4e17-bb8a-6dcb3e5b0dab tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Detected multiple connections on this host for volume: 4da6c3da-4a1a-454c-b611-7fa9fc0832d8, skipping target disconnect. Jun 11 23:12:07.283175 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:12:07.466043 np0000002687 nova-compute[98431]: DEBUG nova.compute.resource_tracker [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Instance cb63f66c-b69e-42b0-805c-be6fe9b3aee3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98431) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 11 23:12:07.466157 np0000002687 nova-compute[98431]: DEBUG nova.compute.resource_tracker [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Instance 14699717-b93f-4e67-b841-c67de8fff8d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98431) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 11 23:12:07.466298 np0000002687 nova-compute[98431]: DEBUG nova.compute.resource_tracker [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Instance 27ac8c84-e5db-4bd1-a148-ec5834c5b39c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98431) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 11 23:12:07.466421 np0000002687 nova-compute[98431]: DEBUG nova.compute.resource_tracker [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Instance 49a042ba-28ba-4401-9bdf-92f96da8f80e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98431) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 11 23:12:07.466521 np0000002687 nova-compute[98431]: DEBUG nova.compute.resource_tracker [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Instance 7609742e-a3a2-4be2-ba02-227efb2101e1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98431) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 11 23:12:07.466609 np0000002687 nova-compute[98431]: DEBUG nova.compute.resource_tracker [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Instance 206476b7-d805-4c6c-b7fb-db8b5c2a94a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98431) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 11 23:12:07.466710 np0000002687 nova-compute[98431]: DEBUG nova.compute.resource_tracker [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Instance 8ffa4bbe-7ead-4029-aba5-28f031f6e784 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98431) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 11 23:12:07.466820 np0000002687 nova-compute[98431]: DEBUG nova.compute.resource_tracker [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Instance de4372a4-a0cc-4541-a5a2-87be3152c50e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98431) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 11 23:12:07.499991 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-91030f7c-06ab-46ce-9a29-9010afbca4e9 tempest-VolumesAssistedSnapshotsTest-1009218362 tempest-VolumesAssistedSnapshotsTest-1009218362-project-member] Lock "73abd331-0bbf-432e-be1c-308801a5429f" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 7.881s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:12:07.503114 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-bdf7e918-03fc-449d-84f5-e72e211672f4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:12:07.648515 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:07.654169 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-2aaaba2c-c032-4e17-bb8a-6dcb3e5b0dab tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lazy-loading 'flavor' on Instance uuid 206476b7-d805-4c6c-b7fb-db8b5c2a94a6 {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:12:07.680618 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:12:07.862071 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Updating instance_info_cache with network_info: [{"id": "2d6dd8b9-e3ff-462f-92cf-8c3a62bc27d1", "address": "fa:16:3e:b5:6f:fd", "network": {"id": "b1a1d33f-f9b6-48cf-86a1-0260d53f3bb0", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1779972098-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2d62cddce233457caf7eb43be819e513", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d6dd8b9-e3", "ovs_interfaceid": "2d6dd8b9-e3ff-462f-92cf-8c3a62bc27d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:12:07.969146 np0000002687 nova-compute[98431]: DEBUG nova.compute.resource_tracker [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Instance 8641b14d-785b-44b0-ad6d-bb537cbee5c7 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98431) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}} Jun 11 23:12:07.969322 np0000002687 nova-compute[98431]: DEBUG nova.compute.resource_tracker [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Instance 8aec3cea-109d-43f8-983c-1d5ee2f71181 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98431) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 11 23:12:07.969420 np0000002687 nova-compute[98431]: DEBUG nova.compute.resource_tracker [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Instance c82748e6-1c78-4372-ad4b-48d1c6448efa actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98431) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 11 23:12:07.970145 np0000002687 nova-compute[98431]: DEBUG nova.compute.resource_tracker [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=98431) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}} Jun 11 23:12:07.970145 np0000002687 nova-compute[98431]: DEBUG nova.compute.resource_tracker [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Final resource view: name=np0000002687 phys_ram=24030MB used_ram=2432MB phys_disk=95GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 23:12:04 up 26 min, 2 users, load average: 8.11, 3.84, 1.81\n', 'num_instances': '10', 'num_vm_active': '10', 'num_task_None': '9', 'num_os_type_None': '10', 'num_proj_aaf744af828a4a5eba1e98da63373b2b': '2', 'io_workload': '1', 'num_task_rescuing': '1', 'num_proj_2d62cddce233457caf7eb43be819e513': '1', 'num_proj_81fd45f475a04e5c8e9bd9deb7ad4c1e': '3', 'num_proj_3a092509b877483183db8610c8763b93': '2', 'num_proj_57813123648a4335a97e8fc5c245cc73': '1', 'num_proj_62f47df2e0374879b837bc7431326e62': '1'} {{(pid=98431) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}} Jun 11 23:12:08.284921 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-50d95170-3b66-43b5-8adb-e70adbf32d94 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Lock "27ac8c84-e5db-4bd1-a148-ec5834c5b39c" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 6.550s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:12:08.365008 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Releasing lock "refresh_cache-cb63f66c-b69e-42b0-805c-be6fe9b3aee3" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 11 23:12:08.650409 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-d97c24a0-db96-47f4-b31f-60cebcfefb64 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Acquiring lock "8ffa4bbe-7ead-4029-aba5-28f031f6e784" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:12:08.650593 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-d97c24a0-db96-47f4-b31f-60cebcfefb64 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "8ffa4bbe-7ead-4029-aba5-28f031f6e784" acquired by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:12:08.655468 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98431) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 11 23:12:08.655622 np0000002687 nova-compute[98431]: DEBUG nova.compute.provider_tree [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Inventory has not changed in ProviderTree for provider: e3e65fe2-9de9-4821-8b4a-ccae37c66e25 {{(pid=98431) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 11 23:12:08.666680 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-2aaaba2c-c032-4e17-bb8a-6dcb3e5b0dab tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "206476b7-d805-4c6c-b7fb-db8b5c2a94a6" "released" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: held 4.583s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:12:09.155312 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-d97c24a0-db96-47f4-b31f-60cebcfefb64 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 8ffa4bbe-7ead-4029-aba5-28f031f6e784] Detaching volume 4da6c3da-4a1a-454c-b611-7fa9fc0832d8 Jun 11 23:12:09.159426 np0000002687 nova-compute[98431]: DEBUG nova.scheduler.client.report [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Inventory has not changed for provider e3e65fe2-9de9-4821-8b4a-ccae37c66e25 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98431) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 11 23:12:09.190745 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-bfacae82-2df8-42d4-8cd8-3da0a89bb5e6 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Acquiring lock "27ac8c84-e5db-4bd1-a148-ec5834c5b39c" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:12:09.190893 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-bfacae82-2df8-42d4-8cd8-3da0a89bb5e6 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Lock "27ac8c84-e5db-4bd1-a148-ec5834c5b39c" acquired by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:12:09.205105 np0000002687 nova-compute[98431]: INFO nova.virt.block_device [None req-d97c24a0-db96-47f4-b31f-60cebcfefb64 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 8ffa4bbe-7ead-4029-aba5-28f031f6e784] Attempting to driver detach volume 4da6c3da-4a1a-454c-b611-7fa9fc0832d8 from mountpoint /dev/vdb Jun 11 23:12:09.211167 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-d97c24a0-db96-47f4-b31f-60cebcfefb64 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Found disk vdb by alias ua-4da6c3da-4a1a-454c-b611-7fa9fc0832d8 {{(pid=98431) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}} Jun 11 23:12:09.212105 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-d97c24a0-db96-47f4-b31f-60cebcfefb64 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Found disk vdb by alias ua-4da6c3da-4a1a-454c-b611-7fa9fc0832d8 {{(pid=98431) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}} Jun 11 23:12:09.212213 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-d97c24a0-db96-47f4-b31f-60cebcfefb64 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Attempting to detach device vdb from instance 8ffa4bbe-7ead-4029-aba5-28f031f6e784 from the persistent domain config. {{(pid=98431) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}} Jun 11 23:12:09.212476 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.guest [None req-d97c24a0-db96-47f4-b31f-60cebcfefb64 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] detach device xml: Jun 11 23:12:09.212476 np0000002687 nova-compute[98431]: Jun 11 23:12:09.212476 np0000002687 nova-compute[98431]: Jun 11 23:12:09.212476 np0000002687 nova-compute[98431]: Jun 11 23:12:09.212476 np0000002687 nova-compute[98431]: Jun 11 23:12:09.212476 np0000002687 nova-compute[98431]: 4da6c3da-4a1a-454c-b611-7fa9fc0832d8 Jun 11 23:12:09.212476 np0000002687 nova-compute[98431]: Jun 11 23:12:09.212476 np0000002687 nova-compute[98431]:
Jun 11 23:12:09.212476 np0000002687 nova-compute[98431]: Jun 11 23:12:09.212476 np0000002687 nova-compute[98431]: {{(pid=98431) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jun 11 23:12:09.218031 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-d97c24a0-db96-47f4-b31f-60cebcfefb64 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Successfully detached device vdb from instance 8ffa4bbe-7ead-4029-aba5-28f031f6e784 from the persistent domain config. Jun 11 23:12:09.218201 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-d97c24a0-db96-47f4-b31f-60cebcfefb64 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] (1/8): Attempting to detach device vdb with device alias ua-4da6c3da-4a1a-454c-b611-7fa9fc0832d8 from instance 8ffa4bbe-7ead-4029-aba5-28f031f6e784 from the live domain config. {{(pid=98431) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}} Jun 11 23:12:09.218492 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.guest [None req-d97c24a0-db96-47f4-b31f-60cebcfefb64 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] detach device xml: Jun 11 23:12:09.218492 np0000002687 nova-compute[98431]: Jun 11 23:12:09.218492 np0000002687 nova-compute[98431]: Jun 11 23:12:09.218492 np0000002687 nova-compute[98431]: Jun 11 23:12:09.218492 np0000002687 nova-compute[98431]: Jun 11 23:12:09.218492 np0000002687 nova-compute[98431]: 4da6c3da-4a1a-454c-b611-7fa9fc0832d8 Jun 11 23:12:09.218492 np0000002687 nova-compute[98431]: Jun 11 23:12:09.218492 np0000002687 nova-compute[98431]:
Jun 11 23:12:09.218492 np0000002687 nova-compute[98431]: Jun 11 23:12:09.218492 np0000002687 nova-compute[98431]: {{(pid=98431) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jun 11 23:12:09.668060 np0000002687 nova-compute[98431]: DEBUG nova.compute.resource_tracker [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Compute_service record updated for np0000002687:np0000002687 {{(pid=98431) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}} Jun 11 23:12:09.668235 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 3.279s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:12:09.668350 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-bdf7e918-03fc-449d-84f5-e72e211672f4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.165s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:12:09.668580 np0000002687 nova-compute[98431]: DEBUG oslo.service.backend._threading.loopingcall [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 43.36 seconds {{(pid=98431) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jun 11 23:12:09.671877 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-bdf7e918-03fc-449d-84f5-e72e211672f4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98431) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 11 23:12:09.672097 np0000002687 nova-compute[98431]: INFO nova.compute.claims [None req-bdf7e918-03fc-449d-84f5-e72e211672f4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 8641b14d-785b-44b0-ad6d-bb537cbee5c7] Claim successful on node np0000002687 Jun 11 23:12:09.679027 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:09.695458 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-bfacae82-2df8-42d4-8cd8-3da0a89bb5e6 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] [instance: 27ac8c84-e5db-4bd1-a148-ec5834c5b39c] Detaching volume 65724ff3-60af-4d3f-b1bf-3aa2695037ce Jun 11 23:12:09.727341 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:09.763396 np0000002687 nova-compute[98431]: INFO nova.virt.block_device [None req-bfacae82-2df8-42d4-8cd8-3da0a89bb5e6 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] [instance: 27ac8c84-e5db-4bd1-a148-ec5834c5b39c] Attempting to driver detach volume 65724ff3-60af-4d3f-b1bf-3aa2695037ce from mountpoint /dev/vdb Jun 11 23:12:09.770211 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-bfacae82-2df8-42d4-8cd8-3da0a89bb5e6 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Found disk vdb by alias ua-65724ff3-60af-4d3f-b1bf-3aa2695037ce {{(pid=98431) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}} Jun 11 23:12:09.772507 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-bfacae82-2df8-42d4-8cd8-3da0a89bb5e6 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Found disk vdb by alias ua-65724ff3-60af-4d3f-b1bf-3aa2695037ce {{(pid=98431) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}} Jun 11 23:12:09.772722 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-bfacae82-2df8-42d4-8cd8-3da0a89bb5e6 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Attempting to detach device vdb from instance 27ac8c84-e5db-4bd1-a148-ec5834c5b39c from the persistent domain config. {{(pid=98431) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}} Jun 11 23:12:09.773119 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.guest [None req-bfacae82-2df8-42d4-8cd8-3da0a89bb5e6 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] detach device xml: Jun 11 23:12:09.773119 np0000002687 nova-compute[98431]: Jun 11 23:12:09.773119 np0000002687 nova-compute[98431]: Jun 11 23:12:09.773119 np0000002687 nova-compute[98431]: Jun 11 23:12:09.773119 np0000002687 nova-compute[98431]: Jun 11 23:12:09.773119 np0000002687 nova-compute[98431]: 65724ff3-60af-4d3f-b1bf-3aa2695037ce Jun 11 23:12:09.773119 np0000002687 nova-compute[98431]: Jun 11 23:12:09.773119 np0000002687 nova-compute[98431]:
Jun 11 23:12:09.773119 np0000002687 nova-compute[98431]: Jun 11 23:12:09.773119 np0000002687 nova-compute[98431]: {{(pid=98431) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jun 11 23:12:09.784497 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-bfacae82-2df8-42d4-8cd8-3da0a89bb5e6 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Successfully detached device vdb from instance 27ac8c84-e5db-4bd1-a148-ec5834c5b39c from the persistent domain config. Jun 11 23:12:09.784730 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-bfacae82-2df8-42d4-8cd8-3da0a89bb5e6 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] (1/8): Attempting to detach device vdb with device alias ua-65724ff3-60af-4d3f-b1bf-3aa2695037ce from instance 27ac8c84-e5db-4bd1-a148-ec5834c5b39c from the live domain config. {{(pid=98431) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}} Jun 11 23:12:09.785081 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.guest [None req-bfacae82-2df8-42d4-8cd8-3da0a89bb5e6 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] detach device xml: Jun 11 23:12:09.785081 np0000002687 nova-compute[98431]: Jun 11 23:12:09.785081 np0000002687 nova-compute[98431]: Jun 11 23:12:09.785081 np0000002687 nova-compute[98431]: Jun 11 23:12:09.785081 np0000002687 nova-compute[98431]: Jun 11 23:12:09.785081 np0000002687 nova-compute[98431]: 65724ff3-60af-4d3f-b1bf-3aa2695037ce Jun 11 23:12:09.785081 np0000002687 nova-compute[98431]: Jun 11 23:12:09.785081 np0000002687 nova-compute[98431]:
Jun 11 23:12:09.785081 np0000002687 nova-compute[98431]: Jun 11 23:12:09.785081 np0000002687 nova-compute[98431]: {{(pid=98431) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jun 11 23:12:10.005067 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:10.012240 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:10.035881 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:10.038793 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:10.070496 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:10.075820 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:10.356502 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-0e294de8-e0f4-41d0-80da-40a0fafa5977 req-f72b1e87-25f9-4567-8be3-e52cb2981b04 service nova] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Received event network-vif-unplugged-2d6dd8b9-e3ff-462f-92cf-8c3a62bc27d1 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:12:10.359061 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-0e294de8-e0f4-41d0-80da-40a0fafa5977 req-f72b1e87-25f9-4567-8be3-e52cb2981b04 service nova] Acquiring lock "cb63f66c-b69e-42b0-805c-be6fe9b3aee3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:12:10.359887 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-0e294de8-e0f4-41d0-80da-40a0fafa5977 req-f72b1e87-25f9-4567-8be3-e52cb2981b04 service nova] Lock "cb63f66c-b69e-42b0-805c-be6fe9b3aee3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:12:10.360134 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-0e294de8-e0f4-41d0-80da-40a0fafa5977 req-f72b1e87-25f9-4567-8be3-e52cb2981b04 service nova] Lock "cb63f66c-b69e-42b0-805c-be6fe9b3aee3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:12:10.360342 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-0e294de8-e0f4-41d0-80da-40a0fafa5977 req-f72b1e87-25f9-4567-8be3-e52cb2981b04 service nova] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] No waiting events found dispatching network-vif-unplugged-2d6dd8b9-e3ff-462f-92cf-8c3a62bc27d1 {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:12:10.360534 np0000002687 nova-compute[98431]: WARNING nova.compute.manager [req-0e294de8-e0f4-41d0-80da-40a0fafa5977 req-f72b1e87-25f9-4567-8be3-e52cb2981b04 service nova] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Received unexpected event network-vif-unplugged-2d6dd8b9-e3ff-462f-92cf-8c3a62bc27d1 for instance with vm_state active and task_state rescuing. Jun 11 23:12:10.420157 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Received event ua-65724ff3-60af-4d3f-b1bf-3aa2695037ce> from libvirt while the driver is waiting for it; dispatched. {{(pid=98431) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}} Jun 11 23:12:10.426358 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-bfacae82-2df8-42d4-8cd8-3da0a89bb5e6 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-65724ff3-60af-4d3f-b1bf-3aa2695037ce for instance 27ac8c84-e5db-4bd1-a148-ec5834c5b39c {{(pid=98431) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}} Jun 11 23:12:10.434038 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-bfacae82-2df8-42d4-8cd8-3da0a89bb5e6 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Successfully detached device vdb from instance 27ac8c84-e5db-4bd1-a148-ec5834c5b39c from the live domain config. Jun 11 23:12:10.441875 np0000002687 nova-compute[98431]: DEBUG nova.utils [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Queued Task(fn=>, remaining_delay=14.999693645999969 future=) {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:12:10.445508 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [-] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Instance destroyed successfully. Jun 11 23:12:10.446165 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Lazy-loading 'numa_topology' on Instance uuid cb63f66c-b69e-42b0-805c-be6fe9b3aee3 {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:12:10.952336 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Attempting a stable device rescue Jun 11 23:12:10.986354 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-bfacae82-2df8-42d4-8cd8-3da0a89bb5e6 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Detected multiple connections on this host for volume: 65724ff3-60af-4d3f-b1bf-3aa2695037ce, skipping target disconnect. Jun 11 23:12:11.004317 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:11.082605 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=98431) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4640}} Jun 11 23:12:11.089372 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Instance directory exists: not creating {{(pid=98431) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5217}} Jun 11 23:12:11.089599 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Creating image(s) Jun 11 23:12:11.090196 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Acquiring lock "/opt/stack/data/nova/instances/cb63f66c-b69e-42b0-805c-be6fe9b3aee3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:12:11.090398 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Lock "/opt/stack/data/nova/instances/cb63f66c-b69e-42b0-805c-be6fe9b3aee3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:12:11.091002 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Lock "/opt/stack/data/nova/instances/cb63f66c-b69e-42b0-805c-be6fe9b3aee3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:12:11.091196 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Lazy-loading 'trusted_certs' on Instance uuid cb63f66c-b69e-42b0-805c-be6fe9b3aee3 {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:12:11.335893 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-bdf7e918-03fc-449d-84f5-e72e211672f4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98431) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 11 23:12:11.336162 np0000002687 nova-compute[98431]: DEBUG nova.compute.provider_tree [None req-bdf7e918-03fc-449d-84f5-e72e211672f4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Inventory has not changed in ProviderTree for provider: e3e65fe2-9de9-4821-8b4a-ccae37c66e25 {{(pid=98431) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 11 23:12:11.554746 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-bfacae82-2df8-42d4-8cd8-3da0a89bb5e6 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Lazy-loading 'flavor' on Instance uuid 27ac8c84-e5db-4bd1-a148-ec5834c5b39c {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:12:11.593077 np0000002687 nova-compute[98431]: DEBUG nova.objects.base [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs {{(pid=98431) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 11 23:12:11.593475 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Acquiring lock "88785810df80dff994f1a9de6df353db8a052831" by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:12:11.594041 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Lock "88785810df80dff994f1a9de6df353db8a052831" acquired by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:12:11.838772 np0000002687 nova-compute[98431]: DEBUG nova.scheduler.client.report [None req-bdf7e918-03fc-449d-84f5-e72e211672f4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Inventory has not changed for provider e3e65fe2-9de9-4821-8b4a-ccae37c66e25 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98431) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 11 23:12:12.043157 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:12.226957 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:12.346817 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-bdf7e918-03fc-449d-84f5-e72e211672f4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.678s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:12:12.347264 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-bdf7e918-03fc-449d-84f5-e72e211672f4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 8641b14d-785b-44b0-ad6d-bb537cbee5c7] Start building networks asynchronously for instance. {{(pid=98431) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 11 23:12:12.490403 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-c2cb4e62-3aa3-4b45-8332-6b367698bbc5 req-e972bab7-d38a-46a5-a3da-b54121909548 service nova] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Received event network-vif-unplugged-2d6dd8b9-e3ff-462f-92cf-8c3a62bc27d1 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:12:12.490570 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-c2cb4e62-3aa3-4b45-8332-6b367698bbc5 req-e972bab7-d38a-46a5-a3da-b54121909548 service nova] Acquiring lock "cb63f66c-b69e-42b0-805c-be6fe9b3aee3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:12:12.490774 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-c2cb4e62-3aa3-4b45-8332-6b367698bbc5 req-e972bab7-d38a-46a5-a3da-b54121909548 service nova] Lock "cb63f66c-b69e-42b0-805c-be6fe9b3aee3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:12:12.490967 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-c2cb4e62-3aa3-4b45-8332-6b367698bbc5 req-e972bab7-d38a-46a5-a3da-b54121909548 service nova] Lock "cb63f66c-b69e-42b0-805c-be6fe9b3aee3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:12:12.491239 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-c2cb4e62-3aa3-4b45-8332-6b367698bbc5 req-e972bab7-d38a-46a5-a3da-b54121909548 service nova] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] No waiting events found dispatching network-vif-unplugged-2d6dd8b9-e3ff-462f-92cf-8c3a62bc27d1 {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:12:12.491351 np0000002687 nova-compute[98431]: WARNING nova.compute.manager [req-c2cb4e62-3aa3-4b45-8332-6b367698bbc5 req-e972bab7-d38a-46a5-a3da-b54121909548 service nova] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Received unexpected event network-vif-unplugged-2d6dd8b9-e3ff-462f-92cf-8c3a62bc27d1 for instance with vm_state active and task_state rescuing. Jun 11 23:12:12.568853 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-bfacae82-2df8-42d4-8cd8-3da0a89bb5e6 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Lock "27ac8c84-e5db-4bd1-a148-ec5834c5b39c" "released" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: held 3.376s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:12:12.657016 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:12.768963 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:12:12.773049 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:12:12.773687 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88785810df80dff994f1a9de6df353db8a052831.part --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:12:12.858732 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-bdf7e918-03fc-449d-84f5-e72e211672f4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 8641b14d-785b-44b0-ad6d-bb537cbee5c7] Allocating IP information in the background. {{(pid=98431) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 11 23:12:12.858935 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-bdf7e918-03fc-449d-84f5-e72e211672f4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 8641b14d-785b-44b0-ad6d-bb537cbee5c7] allocate_for_instance() {{(pid=98431) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 11 23:12:12.859353 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-bdf7e918-03fc-449d-84f5-e72e211672f4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:12:12.859966 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-bdf7e918-03fc-449d-84f5-e72e211672f4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:12:12.875055 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88785810df80dff994f1a9de6df353db8a052831.part --force-share --output=json" returned: 0 in 0.101s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:12:12.875492 np0000002687 nova-compute[98431]: DEBUG nova.virt.images [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] a26a3673-c9d6-483a-b29f-e6034b118f4b was qcow2, converting to raw {{(pid=98431) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}} Jun 11 23:12:12.876921 np0000002687 nova-compute[98431]: DEBUG nova.privsep.utils [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98431) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}} Jun 11 23:12:12.876921 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/88785810df80dff994f1a9de6df353db8a052831.part /opt/stack/data/nova/instances/_base/88785810df80dff994f1a9de6df353db8a052831.converted {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:12:12.995144 np0000002687 nova-compute[98431]: DEBUG nova.policy [None req-bdf7e918-03fc-449d-84f5-e72e211672f4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '72b6dac5eb744cfba6299636227aa59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaf744af828a4a5eba1e98da63373b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98431) authorize /opt/stack/nova/nova/policy.py:192}} Jun 11 23:12:13.041063 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/88785810df80dff994f1a9de6df353db8a052831.part /opt/stack/data/nova/instances/_base/88785810df80dff994f1a9de6df353db8a052831.converted" returned: 0 in 0.164s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:12:13.057457 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88785810df80dff994f1a9de6df353db8a052831.converted --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:12:13.149785 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88785810df80dff994f1a9de6df353db8a052831.converted --force-share --output=json" returned: 0 in 0.092s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:12:13.150691 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Lock "88785810df80dff994f1a9de6df353db8a052831" "released" by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" :: held 1.557s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:12:13.151475 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:12:13.157787 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:12:13.159913 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Acquiring lock "88785810df80dff994f1a9de6df353db8a052831" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:12:13.160514 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Lock "88785810df80dff994f1a9de6df353db8a052831" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:12:13.160898 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:12:13.164624 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:12:13.165736 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88785810df80dff994f1a9de6df353db8a052831 --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:12:13.257095 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88785810df80dff994f1a9de6df353db8a052831 --force-share --output=json" returned: 0 in 0.091s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:12:13.257937 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/88785810df80dff994f1a9de6df353db8a052831,backing_fmt=raw /opt/stack/data/nova/instances/cb63f66c-b69e-42b0-805c-be6fe9b3aee3/disk.rescue {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:12:13.311821 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/88785810df80dff994f1a9de6df353db8a052831,backing_fmt=raw /opt/stack/data/nova/instances/cb63f66c-b69e-42b0-805c-be6fe9b3aee3/disk.rescue" returned: 0 in 0.054s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:12:13.312794 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Lock "88785810df80dff994f1a9de6df353db8a052831" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.152s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:12:13.313354 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Lazy-loading 'migration_context' on Instance uuid cb63f66c-b69e-42b0-805c-be6fe9b3aee3 {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:12:13.364610 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-bdf7e918-03fc-449d-84f5-e72e211672f4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 8641b14d-785b-44b0-ad6d-bb537cbee5c7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 11 23:12:13.610991 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-bdf7e918-03fc-449d-84f5-e72e211672f4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 8641b14d-785b-44b0-ad6d-bb537cbee5c7] Successfully created port: 94c6b105-4ef1-4e7b-9b98-163702859f78 {{(pid=98431) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 11 23:12:13.692830 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-5fdf1a89-26c8-4d8b-b071-edab007a4536 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Acquiring lock "14699717-b93f-4e67-b841-c67de8fff8d4" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:12:13.693102 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-5fdf1a89-26c8-4d8b-b071-edab007a4536 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Lock "14699717-b93f-4e67-b841-c67de8fff8d4" acquired by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:12:13.817016 np0000002687 nova-compute[98431]: DEBUG nova.objects.base [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=98431) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 11 23:12:13.817700 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Created local disks {{(pid=98431) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}} Jun 11 23:12:13.823658 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Start _get_guest_xml network_info=[{"id": "2d6dd8b9-e3ff-462f-92cf-8c3a62bc27d1", "address": "fa:16:3e:b5:6f:fd", "network": {"id": "b1a1d33f-f9b6-48cf-86a1-0260d53f3bb0", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1779972098-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.176", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1779972098-network", "vif_mac": "fa:16:3e:b5:6f:fd"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2d62cddce233457caf7eb43be819e513", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d6dd8b9-e3", "ovs_interfaceid": "2d6dd8b9-e3ff-462f-92cf-8c3a62bc27d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-11T23:08:20Z,direct_url=,disk_format='qcow2',id=f30640f8-7aca-4300-a085-4706a5209a79,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ce012f9fabdb4ee5a73e212437f59d97',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-11T23:08:23Z,virtual_size=,visibility=) rescue={'image_id': 'a26a3673-c9d6-483a-b29f-e6034b118f4b', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'image_id': 'f30640f8-7aca-4300-a085-4706a5209a79'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'mount_device': '/dev/vdb', 'attachment_id': '390b7f89-7212-4eae-9c33-8d8623facecc', 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060', 'iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '859ffbad-3fc1-400a-a7f7-ac423851f060', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, 'status': 'reserved', 'instance': 'cb63f66c-b69e-42b0-805c-be6fe9b3aee3', 'attached_at': '', 'detached_at': '', 'volume_id': '859ffbad-3fc1-400a-a7f7-ac423851f060', 'serial': '859ffbad-3fc1-400a-a7f7-ac423851f060'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=98431) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 11 23:12:13.825302 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Lazy-loading 'resources' on Instance uuid cb63f66c-b69e-42b0-805c-be6fe9b3aee3 {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:12:13.870937 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-bdf7e918-03fc-449d-84f5-e72e211672f4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 8641b14d-785b-44b0-ad6d-bb537cbee5c7] Start building block device mappings for instance. {{(pid=98431) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 11 23:12:13.941625 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Received event ua-4da6c3da-4a1a-454c-b611-7fa9fc0832d8> from libvirt while the driver is waiting for it; dispatched. {{(pid=98431) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}} Jun 11 23:12:13.945707 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-d97c24a0-db96-47f4-b31f-60cebcfefb64 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-4da6c3da-4a1a-454c-b611-7fa9fc0832d8 for instance 8ffa4bbe-7ead-4029-aba5-28f031f6e784 {{(pid=98431) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}} Jun 11 23:12:13.952634 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-d97c24a0-db96-47f4-b31f-60cebcfefb64 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Successfully detached device vdb from instance 8ffa4bbe-7ead-4029-aba5-28f031f6e784 from the live domain config. Jun 11 23:12:13.996379 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d97c24a0-db96-47f4-b31f-60cebcfefb64 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 8ffa4bbe-7ead-4029-aba5-28f031f6e784] calling os-brick to detach iSCSI Volume {{(pid=98431) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jun 11 23:12:13.996791 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-d97c24a0-db96-47f4-b31f-60cebcfefb64 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8', 'iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4da6c3da-4a1a-454c-b611-7fa9fc0832d8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-11'}, None), 'kwargs': {'force': False}}" {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 11 23:12:13.996973 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-d97c24a0-db96-47f4-b31f-60cebcfefb64 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 11 23:12:13.997307 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-d97c24a0-db96-47f4-b31f-60cebcfefb64 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 11 23:12:13.997621 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-d97c24a0-db96-47f4-b31f-60cebcfefb64 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8', 'iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4da6c3da-4a1a-454c-b611-7fa9fc0832d8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-11'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 11 23:12:13.997779 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-d97c24a0-db96-47f4-b31f-60cebcfefb64 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8', 0)] {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 11 23:12:14.038656 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-d97c24a0-db96-47f4-b31f-60cebcfefb64 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:12:14.038656 np0000002687 nova-compute[98431]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:12:14.038656 np0000002687 nova-compute[98431]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:12:14.038656 np0000002687 nova-compute[98431]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:12:14.038656 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:12:14.038656 np0000002687 nova-compute[98431]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8 (non-flash) Jun 11 23:12:14.038656 np0000002687 nova-compute[98431]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8 (non-flash) Jun 11 23:12:14.038656 np0000002687 nova-compute[98431]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce (non-flash) Jun 11 23:12:14.038656 np0000002687 nova-compute[98431]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce (non-flash) Jun 11 23:12:14.038656 np0000002687 nova-compute[98431]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060 (non-flash) Jun 11 23:12:14.038656 np0000002687 nova-compute[98431]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060 (non-flash) Jun 11 23:12:14.038656 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:12:14.038656 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:12:14.038656 np0000002687 nova-compute[98431]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:12:14.038656 np0000002687 nova-compute[98431]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:12:14.038656 np0000002687 nova-compute[98431]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:12:14.038656 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:12:14.039141 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-d97c24a0-db96-47f4-b31f-60cebcfefb64 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:12:14.039141 np0000002687 nova-compute[98431]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:12:14.039141 np0000002687 nova-compute[98431]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:12:14.039141 np0000002687 nova-compute[98431]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:12:14.039141 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:12:14.039141 np0000002687 nova-compute[98431]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8 (non-flash) Jun 11 23:12:14.039141 np0000002687 nova-compute[98431]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8 (non-flash) Jun 11 23:12:14.039141 np0000002687 nova-compute[98431]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce (non-flash) Jun 11 23:12:14.039141 np0000002687 nova-compute[98431]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce (non-flash) Jun 11 23:12:14.039141 np0000002687 nova-compute[98431]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060 (non-flash) Jun 11 23:12:14.039141 np0000002687 nova-compute[98431]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060 (non-flash) Jun 11 23:12:14.039141 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:12:14.039141 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:12:14.039141 np0000002687 nova-compute[98431]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:12:14.039141 np0000002687 nova-compute[98431]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:12:14.039141 np0000002687 nova-compute[98431]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:12:14.039141 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:12:14.039505 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-d97c24a0-db96-47f4-b31f-60cebcfefb64 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c', '10'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff', '11'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff', '12'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea', '13'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea', '14'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8', '19'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8', '20'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce', '21'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce', '22'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060', '23'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060', '24'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9', '3'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9', '4'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9', '7'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9', '8'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c', '9')] {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 11 23:12:14.039505 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-d97c24a0-db96-47f4-b31f-60cebcfefb64 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8', '20')] {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 11 23:12:14.041093 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-d97c24a0-db96-47f4-b31f-60cebcfefb64 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8', '19')] {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 11 23:12:14.042618 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-d97c24a0-db96-47f4-b31f-60cebcfefb64 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Resulting device map defaultdict(. at 0x7e1ea045c900>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8'): ({'sdq'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8'): ({'sdp'}, set())}) {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 11 23:12:14.043091 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-d97c24a0-db96-47f4-b31f-60cebcfefb64 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Removing multipathed devices sdq, sdp {{(pid=98431) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 11 23:12:14.043237 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-d97c24a0-db96-47f4-b31f-60cebcfefb64 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Flush multipath device 33000000073fa3d0d {{(pid=98431) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jun 11 23:12:14.077366 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-d97c24a0-db96-47f4-b31f-60cebcfefb64 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Remove SCSI device /dev/sdq with /sys/block/sdq/device/delete {{(pid=98431) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 11 23:12:14.129967 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-d97c24a0-db96-47f4-b31f-60cebcfefb64 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Remove SCSI device /dev/sdp with /sys/block/sdp/device/delete {{(pid=98431) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 11 23:12:14.173274 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-d97c24a0-db96-47f4-b31f-60cebcfefb64 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Checking to see if SCSI volumes sdq, sdp have been removed. {{(pid=98431) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 11 23:12:14.173440 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-d97c24a0-db96-47f4-b31f-60cebcfefb64 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] SCSI volumes sdq, sdp have been removed. {{(pid=98431) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 11 23:12:14.175772 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-d97c24a0-db96-47f4-b31f-60cebcfefb64 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Checking to see if device paths {'sdq', 'sdp'} are still under multipathd monitoring {{(pid=98431) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 11 23:12:14.186772 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-d97c24a0-db96-47f4-b31f-60cebcfefb64 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Device paths {'sdq', 'sdp'} have been removed from multipathd monitoring. {{(pid=98431) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 11 23:12:14.187075 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-d97c24a0-db96-47f4-b31f-60cebcfefb64 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8')] {{(pid=98431) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 11 23:12:14.197121 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-5fdf1a89-26c8-4d8b-b071-edab007a4536 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] [instance: 14699717-b93f-4e67-b841-c67de8fff8d4] Detaching volume 65724ff3-60af-4d3f-b1bf-3aa2695037ce Jun 11 23:12:14.201150 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-d97c24a0-db96-47f4-b31f-60cebcfefb64 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:12:14.221454 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-bdf7e918-03fc-449d-84f5-e72e211672f4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 8641b14d-785b-44b0-ad6d-bb537cbee5c7] Successfully updated port: 94c6b105-4ef1-4e7b-9b98-163702859f78 {{(pid=98431) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 11 23:12:14.243017 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-d97c24a0-db96-47f4-b31f-60cebcfefb64 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8, portal: 192.168.40.100,3260] Jun 11 23:12:14.243017 np0000002687 nova-compute[98431]: Logout of [sid: 20, target: iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8, portal: 192.168.40.100,3260] successful. Jun 11 23:12:14.243017 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:12:14.250837 np0000002687 nova-compute[98431]: INFO nova.virt.block_device [None req-5fdf1a89-26c8-4d8b-b071-edab007a4536 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] [instance: 14699717-b93f-4e67-b841-c67de8fff8d4] Attempting to driver detach volume 65724ff3-60af-4d3f-b1bf-3aa2695037ce from mountpoint /dev/vdb Jun 11 23:12:14.253873 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-5fdf1a89-26c8-4d8b-b071-edab007a4536 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Found disk vdb by alias ua-65724ff3-60af-4d3f-b1bf-3aa2695037ce {{(pid=98431) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}} Jun 11 23:12:14.254375 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-5fdf1a89-26c8-4d8b-b071-edab007a4536 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Found disk vdb by alias ua-65724ff3-60af-4d3f-b1bf-3aa2695037ce {{(pid=98431) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}} Jun 11 23:12:14.254497 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-5fdf1a89-26c8-4d8b-b071-edab007a4536 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Attempting to detach device vdb from instance 14699717-b93f-4e67-b841-c67de8fff8d4 from the persistent domain config. {{(pid=98431) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}} Jun 11 23:12:14.254751 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.guest [None req-5fdf1a89-26c8-4d8b-b071-edab007a4536 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] detach device xml: Jun 11 23:12:14.254751 np0000002687 nova-compute[98431]: Jun 11 23:12:14.254751 np0000002687 nova-compute[98431]: Jun 11 23:12:14.254751 np0000002687 nova-compute[98431]: Jun 11 23:12:14.254751 np0000002687 nova-compute[98431]: Jun 11 23:12:14.254751 np0000002687 nova-compute[98431]: 65724ff3-60af-4d3f-b1bf-3aa2695037ce Jun 11 23:12:14.254751 np0000002687 nova-compute[98431]: Jun 11 23:12:14.254751 np0000002687 nova-compute[98431]:
Jun 11 23:12:14.254751 np0000002687 nova-compute[98431]: Jun 11 23:12:14.254751 np0000002687 nova-compute[98431]: {{(pid=98431) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jun 11 23:12:14.259070 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-5fdf1a89-26c8-4d8b-b071-edab007a4536 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Successfully detached device vdb from instance 14699717-b93f-4e67-b841-c67de8fff8d4 from the persistent domain config. Jun 11 23:12:14.259230 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-5fdf1a89-26c8-4d8b-b071-edab007a4536 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] (1/8): Attempting to detach device vdb with device alias ua-65724ff3-60af-4d3f-b1bf-3aa2695037ce from instance 14699717-b93f-4e67-b841-c67de8fff8d4 from the live domain config. {{(pid=98431) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}} Jun 11 23:12:14.259442 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.guest [None req-5fdf1a89-26c8-4d8b-b071-edab007a4536 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] detach device xml: Jun 11 23:12:14.259442 np0000002687 nova-compute[98431]: Jun 11 23:12:14.259442 np0000002687 nova-compute[98431]: Jun 11 23:12:14.259442 np0000002687 nova-compute[98431]: Jun 11 23:12:14.259442 np0000002687 nova-compute[98431]: Jun 11 23:12:14.259442 np0000002687 nova-compute[98431]: 65724ff3-60af-4d3f-b1bf-3aa2695037ce Jun 11 23:12:14.259442 np0000002687 nova-compute[98431]: Jun 11 23:12:14.259442 np0000002687 nova-compute[98431]:
Jun 11 23:12:14.259442 np0000002687 nova-compute[98431]: Jun 11 23:12:14.259442 np0000002687 nova-compute[98431]: {{(pid=98431) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jun 11 23:12:14.274013 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-d97c24a0-db96-47f4-b31f-60cebcfefb64 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:12:14.285853 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-d97c24a0-db96-47f4-b31f-60cebcfefb64 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:12:14.324444 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-d97c24a0-db96-47f4-b31f-60cebcfefb64 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8, portal: 192.168.50.100,3260] Jun 11 23:12:14.324444 np0000002687 nova-compute[98431]: Logout of [sid: 19, target: iqn.2023-03.storpool.com:os--volume-4da6c3da-4a1a-454c-b611-7fa9fc0832d8, portal: 192.168.50.100,3260] successful. Jun 11 23:12:14.324444 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:12:14.329519 np0000002687 nova-compute[98431]: DEBUG nova.objects.base [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=98431) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 11 23:12:14.332596 np0000002687 nova-compute[98431]: WARNING nova.virt.libvirt.driver [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 11 23:12:14.334656 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='f30640f8-7aca-4300-a085-4706a5209a79', instance_meta=NovaInstanceMeta(name='tempest-ServerStableDeviceRescueTest-server-2137494624', uuid='cb63f66c-b69e-42b0-805c-be6fe9b3aee3'), owner=OwnerMeta(userid='549767ad83a94efbb0bbd85d08fdc78a', username='tempest-ServerStableDeviceRescueTest-67974016-project-member', projectid='2d62cddce233457caf7eb43be819e513', projectname='tempest-ServerStableDeviceRescueTest-67974016'), image=ImageMeta(id='f30640f8-7aca-4300-a085-4706a5209a79', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "2d6dd8b9-e3ff-462f-92cf-8c3a62bc27d1", "address": "fa:16:3e:b5:6f:fd", "network": {"id": "b1a1d33f-f9b6-48cf-86a1-0260d53f3bb0", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1779972098-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.176", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1779972098-network", "vif_mac": "fa:16:3e:b5:6f:fd"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2d62cddce233457caf7eb43be819e513", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d6dd8b9-e3", "ovs_interfaceid": "2d6dd8b9-e3ff-462f-92cf-8c3a62bc27d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1781219534.334254) {{(pid=98431) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 11 23:12:14.336033 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Searching host: 'np0000002687' for CPU controller through CGroups V1... {{(pid=98431) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 11 23:12:14.336859 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] CPU controller missing on host. {{(pid=98431) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 11 23:12:14.338165 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Searching host: 'np0000002687' for CPU controller through CGroups V2... {{(pid=98431) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 11 23:12:14.338373 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] CPU controller found on host. {{(pid=98431) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 11 23:12:14.339930 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98431) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 11 23:12:14.340460 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-11T23:08:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-11T23:08:20Z,direct_url=,disk_format='qcow2',id=f30640f8-7aca-4300-a085-4706a5209a79,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ce012f9fabdb4ee5a73e212437f59d97',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-11T23:08:23Z,virtual_size=,visibility=), allow threads: True {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 11 23:12:14.340642 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Flavor limits 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 11 23:12:14.340811 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Image limits 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 11 23:12:14.341026 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Flavor pref 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 11 23:12:14.341145 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Image pref 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 11 23:12:14.341267 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 11 23:12:14.341490 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 11 23:12:14.341590 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98431) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 11 23:12:14.341712 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Got 1 possible topologies {{(pid=98431) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 11 23:12:14.342456 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 11 23:12:14.342623 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 11 23:12:14.342793 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Lazy-loading 'vcpu_model' on Instance uuid cb63f66c-b69e-42b0-805c-be6fe9b3aee3 {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:12:14.353363 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-d97c24a0-db96-47f4-b31f-60cebcfefb64 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:12:14.354187 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-d97c24a0-db96-47f4-b31f-60cebcfefb64 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.357s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 11 23:12:14.354187 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-d97c24a0-db96-47f4-b31f-60cebcfefb64 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] <== disconnect_volume: return (357ms) None {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 11 23:12:14.354475 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d97c24a0-db96-47f4-b31f-60cebcfefb64 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 8ffa4bbe-7ead-4029-aba5-28f031f6e784] Disconnected iSCSI Volume {{(pid=98431) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jun 11 23:12:14.582588 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-fb6b0044-766d-4416-9865-d218883c24a0 req-467301fd-b3b7-40b8-86f4-4e1e0745581e service nova] [instance: 8641b14d-785b-44b0-ad6d-bb537cbee5c7] Received event network-changed-94c6b105-4ef1-4e7b-9b98-163702859f78 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:12:14.582843 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-fb6b0044-766d-4416-9865-d218883c24a0 req-467301fd-b3b7-40b8-86f4-4e1e0745581e service nova] [instance: 8641b14d-785b-44b0-ad6d-bb537cbee5c7] Refreshing instance network info cache due to event network-changed-94c6b105-4ef1-4e7b-9b98-163702859f78. {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 11 23:12:14.583110 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-fb6b0044-766d-4416-9865-d218883c24a0 req-467301fd-b3b7-40b8-86f4-4e1e0745581e service nova] Acquiring lock "refresh_cache-8641b14d-785b-44b0-ad6d-bb537cbee5c7" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 11 23:12:14.583281 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-fb6b0044-766d-4416-9865-d218883c24a0 req-467301fd-b3b7-40b8-86f4-4e1e0745581e service nova] Acquired lock "refresh_cache-8641b14d-785b-44b0-ad6d-bb537cbee5c7" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 11 23:12:14.583368 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-fb6b0044-766d-4416-9865-d218883c24a0 req-467301fd-b3b7-40b8-86f4-4e1e0745581e service nova] [instance: 8641b14d-785b-44b0-ad6d-bb537cbee5c7] Refreshing network info cache for port 94c6b105-4ef1-4e7b-9b98-163702859f78 {{(pid=98431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 11 23:12:14.724006 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-bdf7e918-03fc-449d-84f5-e72e211672f4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Acquiring lock "refresh_cache-8641b14d-785b-44b0-ad6d-bb537cbee5c7" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 11 23:12:14.844663 np0000002687 nova-compute[98431]: DEBUG nova.objects.base [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=98431) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 11 23:12:14.858272 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb63f66c-b69e-42b0-805c-be6fe9b3aee3/disk.config --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:12:14.888363 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-bdf7e918-03fc-449d-84f5-e72e211672f4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 8641b14d-785b-44b0-ad6d-bb537cbee5c7] Start spawning the instance on the hypervisor. {{(pid=98431) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 11 23:12:14.890139 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-bdf7e918-03fc-449d-84f5-e72e211672f4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 8641b14d-785b-44b0-ad6d-bb537cbee5c7] Creating instance directory {{(pid=98431) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}} Jun 11 23:12:14.890556 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-bdf7e918-03fc-449d-84f5-e72e211672f4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 8641b14d-785b-44b0-ad6d-bb537cbee5c7] Creating image(s) Jun 11 23:12:14.891317 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-bdf7e918-03fc-449d-84f5-e72e211672f4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Acquiring lock "/opt/stack/data/nova/instances/8641b14d-785b-44b0-ad6d-bb537cbee5c7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:12:14.891605 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-bdf7e918-03fc-449d-84f5-e72e211672f4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lock "/opt/stack/data/nova/instances/8641b14d-785b-44b0-ad6d-bb537cbee5c7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:12:14.893058 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-bdf7e918-03fc-449d-84f5-e72e211672f4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lock "/opt/stack/data/nova/instances/8641b14d-785b-44b0-ad6d-bb537cbee5c7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:12:14.894161 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-bdf7e918-03fc-449d-84f5-e72e211672f4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:12:14.898812 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-bdf7e918-03fc-449d-84f5-e72e211672f4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:12:14.902854 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-bdf7e918-03fc-449d-84f5-e72e211672f4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:12:14.929646 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-d97c24a0-db96-47f4-b31f-60cebcfefb64 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lazy-loading 'flavor' on Instance uuid 8ffa4bbe-7ead-4029-aba5-28f031f6e784 {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:12:14.935870 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb63f66c-b69e-42b0-805c-be6fe9b3aee3/disk.config --force-share --output=json" returned: 0 in 0.077s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:12:14.936366 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Acquiring lock "/opt/stack/data/nova/instances/cb63f66c-b69e-42b0-805c-be6fe9b3aee3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:12:14.936649 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Lock "/opt/stack/data/nova/instances/cb63f66c-b69e-42b0-805c-be6fe9b3aee3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:12:14.937377 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Lock "/opt/stack/data/nova/instances/cb63f66c-b69e-42b0-805c-be6fe9b3aee3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:12:14.937872 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Calling os-brick to attach iSCSI Volume {{(pid=98431) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 11 23:12:14.938336 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060', 'iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '859ffbad-3fc1-400a-a7f7-ac423851f060', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}}" {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 11 23:12:14.938512 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 11 23:12:14.938951 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 11 23:12:14.939349 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060', 'iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '859ffbad-3fc1-400a-a7f7-ac423851f060', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'} {{(pid=98431) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 11 23:12:14.953583 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 11 23:12:14.954474 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 11 23:12:14.955467 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 11 23:12:14.955857 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.iscsi [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 11 23:12:14.957055 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 11 23:12:14.957308 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.iscsi [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 11 23:12:14.971137 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:14.973055 np0000002687 nova-compute[98431]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0004838659999677475 future=) submitted to {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:12:14.973220 np0000002687 nova-compute[98431]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:12:14.974742 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [-] Emitting event Stopped> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:12:14.974928 np0000002687 nova-compute[98431]: INFO nova.compute.manager [-] [instance: 36688d94-68d3-4ae3-989a-b391d7ee4ad9] VM Stopped (Lifecycle Event) Jun 11 23:12:14.976144 np0000002687 nova-compute[98431]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=0.5115898700000798 future=) {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:12:14.976738 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 11 23:12:14.976738 np0000002687 nova-compute[98431]: node.name = iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060 Jun 11 23:12:14.976738 np0000002687 nova-compute[98431]: node.tpgt = -1 Jun 11 23:12:14.976738 np0000002687 nova-compute[98431]: node.startup = automatic Jun 11 23:12:14.976738 np0000002687 nova-compute[98431]: node.leading_login = No Jun 11 23:12:14.976738 np0000002687 nova-compute[98431]: iface.iscsi_ifacename = default Jun 11 23:12:14.976738 np0000002687 nova-compute[98431]: iface.net_ifacename = Jun 11 23:12:14.976738 np0000002687 nova-compute[98431]: iface.ipaddress = Jun 11 23:12:14.976738 np0000002687 nova-compute[98431]: iface.prefix_len = 0 Jun 11 23:12:14.976738 np0000002687 nova-compute[98431]: iface.hwaddress = Jun 11 23:12:14.976738 np0000002687 nova-compute[98431]: iface.transport_name = tcp Jun 11 23:12:14.976738 np0000002687 nova-compute[98431]: iface.initiatorname = Jun 11 23:12:14.976738 np0000002687 nova-compute[98431]: iface.state = Jun 11 23:12:14.976738 np0000002687 nova-compute[98431]: iface.vlan_id = 0 Jun 11 23:12:14.976738 np0000002687 nova-compute[98431]: iface.vlan_priority = 0 Jun 11 23:12:14.976738 np0000002687 nova-compute[98431]: iface.vlan_state = Jun 11 23:12:14.976738 np0000002687 nova-compute[98431]: iface.iface_num = 0 Jun 11 23:12:14.976738 np0000002687 nova-compute[98431]: iface.mtu = 0 Jun 11 23:12:14.976738 np0000002687 nova-compute[98431]: iface.port = 0 Jun 11 23:12:14.976738 np0000002687 nova-compute[98431]: iface.bootproto = Jun 11 23:12:14.976738 np0000002687 nova-compute[98431]: iface.subnet_mask = Jun 11 23:12:14.976738 np0000002687 nova-compute[98431]: iface.gateway = Jun 11 23:12:14.976738 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id_state = Jun 11 23:12:14.976738 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id = Jun 11 23:12:14.976738 np0000002687 nova-compute[98431]: iface.dhcp_dns = Jun 11 23:12:14.976738 np0000002687 nova-compute[98431]: iface.dhcp_learn_iqn = Jun 11 23:12:14.976738 np0000002687 nova-compute[98431]: iface.dhcp_req_vendor_id_state = Jun 11 23:12:14.976738 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id_state = Jun 11 23:12:14.976738 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id = Jun 11 23:12:14.976738 np0000002687 nova-compute[98431]: iface.dhcp_slp_da = Jun 11 23:12:14.976738 np0000002687 nova-compute[98431]: iface.fragmentation = Jun 11 23:12:14.976738 np0000002687 nova-compute[98431]: iface.gratuitous_arp = Jun 11 23:12:14.976738 np0000002687 nova-compute[98431]: iface.incoming_forwarding = Jun 11 23:12:14.976738 np0000002687 nova-compute[98431]: iface.tos_state = Jun 11 23:12:14.976738 np0000002687 nova-compute[98431]: iface.tos = 0 Jun 11 23:12:14.976738 np0000002687 nova-compute[98431]: iface.ttl = 0 Jun 11 23:12:14.976738 np0000002687 nova-compute[98431]: iface.delayed_ack = Jun 11 23:12:14.976738 np0000002687 nova-compute[98431]: iface.tcp_nagle = Jun 11 23:12:14.976738 np0000002687 nova-compute[98431]: iface.tcp_wsf_state = Jun 11 23:12:14.976738 np0000002687 nova-compute[98431]: iface.tcp_wsf = 0 Jun 11 23:12:14.976738 np0000002687 nova-compute[98431]: iface.tcp_timer_scale = 0 Jun 11 23:12:14.976738 np0000002687 nova-compute[98431]: iface.tcp_timestamp = Jun 11 23:12:14.976738 np0000002687 nova-compute[98431]: iface.redirect = Jun 11 23:12:14.976738 np0000002687 nova-compute[98431]: iface.def_task_mgmt_timeout = 0 Jun 11 23:12:14.976738 np0000002687 nova-compute[98431]: iface.header_digest = Jun 11 23:12:14.976738 np0000002687 nova-compute[98431]: iface.data_digest = Jun 11 23:12:14.976738 np0000002687 nova-compute[98431]: iface.immediate_data = Jun 11 23:12:14.976738 np0000002687 nova-compute[98431]: iface.initial_r2t = Jun 11 23:12:14.976738 np0000002687 nova-compute[98431]: iface.data_seq_inorder = Jun 11 23:12:14.976738 np0000002687 nova-compute[98431]: iface.data_pdu_inorder = Jun 11 23:12:14.976738 np0000002687 nova-compute[98431]: iface.erl = 0 Jun 11 23:12:14.976738 np0000002687 nova-compute[98431]: iface.max_receive_data_len = 0 Jun 11 23:12:14.976738 np0000002687 nova-compute[98431]: iface.first_burst_len = 0 Jun 11 23:12:14.976738 np0000002687 nova-compute[98431]: iface.max_outstanding_r2t = 0 Jun 11 23:12:14.976738 np0000002687 nova-compute[98431]: iface.max_burst_len = 0 Jun 11 23:12:14.976738 np0000002687 nova-compute[98431]: iface.chap_auth = Jun 11 23:12:14.976738 np0000002687 nova-compute[98431]: iface.bidi_chap = Jun 11 23:12:14.976738 np0000002687 nova-compute[98431]: iface.strict_login_compliance = Jun 11 23:12:14.976738 np0000002687 nova-compute[98431]: iface.discovery_auth = Jun 11 23:12:14.976738 np0000002687 nova-compute[98431]: iface.discovery_logout = Jun 11 23:12:14.976738 np0000002687 nova-compute[98431]: node.discovery_address = Jun 11 23:12:14.976738 np0000002687 nova-compute[98431]: node.discovery_port = 0 Jun 11 23:12:14.976738 np0000002687 nova-compute[98431]: node.discovery_type = fw Jun 11 23:12:14.976738 np0000002687 nova-compute[98431]: node.session.initial_cmdsn = 0 Jun 11 23:12:14.976738 np0000002687 nova-compute[98431]: node.session.initial_login_retry_max = 8 Jun 11 23:12:14.976738 np0000002687 nova-compute[98431]: node.session.xmit_thread_priority = 0 Jun 11 23:12:14.976738 np0000002687 nova-compute[98431]: node.session.cmds_max = 128 Jun 11 23:12:14.976738 np0000002687 nova-compute[98431]: node.session.queue_depth = 32 Jun 11 23:12:14.976738 np0000002687 nova-compute[98431]: node.session.nr_sessions = 1 Jun 11 23:12:14.976738 np0000002687 nova-compute[98431]: node.session.auth.authmethod = None Jun 11 23:12:14.976738 np0000002687 nova-compute[98431]: node.session.auth.username = Jun 11 23:12:14.976738 np0000002687 nova-compute[98431]: node.session.auth.password = *** Jun 11 23:12:14.976738 np0000002687 nova-compute[98431]: node.session.auth.username_in = Jun 11 23:12:14.976738 np0000002687 nova-compute[98431]: node.session.auth.password_in = Jun 11 23:12:14.976738 np0000002687 nova-compute[98431]: node.session.auth.chap_algs = SHA256 Jun 11 23:12:14.976738 np0000002687 nova-compute[98431]: node.session.timeo.replacement_timeout = 120 Jun 11 23:12:14.976738 np0000002687 nova-compute[98431]: node.session.err_timeo.abort_timeout = 15 Jun 11 23:12:14.976738 np0000002687 nova-compute[98431]: node.session.err_timeo.lu_reset_timeout = 30 Jun 11 23:12:14.976738 np0000002687 nova-compute[98431]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 11 23:12:14.976738 np0000002687 nova-compute[98431]: node.session.err_timeo.host_reset_timeout = 60 Jun 11 23:12:14.976738 np0000002687 nova-compute[98431]: node.session.iscsi.FastAbort = Yes Jun 11 23:12:14.976738 np0000002687 nova-compute[98431]: node.session.iscsi.InitialR2T = No Jun 11 23:12:14.976738 np0000002687 nova-compute[98431]: node.session.iscsi.ImmediateData = Yes Jun 11 23:12:14.976738 np0000002687 nova-compute[98431]: node.session.iscsi.FirstBurstLength = 262144 Jun 11 23:12:14.976738 np0000002687 nova-compute[98431]: node.session.iscsi.MaxBurstLength = 16776192 Jun 11 23:12:14.976738 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Retain = 0 Jun 11 23:12:14.976738 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Wait = 2 Jun 11 23:12:14.976738 np0000002687 nova-compute[98431]: node.session.iscsi.MaxConnections = 1 Jun 11 23:12:14.976738 np0000002687 nova-compute[98431]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 11 23:12:14.976738 np0000002687 nova-compute[98431]: node.session.iscsi.ERL = 0 Jun 11 23:12:14.976738 np0000002687 nova-compute[98431]: node.session.scan = manual Jun 11 23:12:14.976738 np0000002687 nova-compute[98431]: node.session.reopen_max = 0 Jun 11 23:12:14.976738 np0000002687 nova-compute[98431]: node.conn[0].address = 192.168.50.100 Jun 11 23:12:14.976738 np0000002687 nova-compute[98431]: node.conn[0].port = 3260 Jun 11 23:12:14.976738 np0000002687 nova-compute[98431]: node.conn[0].startup = manual Jun 11 23:12:14.976738 np0000002687 nova-compute[98431]: node.conn[0].tcp.window_size = 524288 Jun 11 23:12:14.976738 np0000002687 nova-compute[98431]: node.conn[0].tcp.type_of_service = 0 Jun 11 23:12:14.976738 np0000002687 nova-compute[98431]: node.conn[0].timeo.logout_timeout = 15 Jun 11 23:12:14.976738 np0000002687 nova-compute[98431]: node.conn[0].timeo.login_timeout = 15 Jun 11 23:12:14.976738 np0000002687 nova-compute[98431]: node.conn[0].timeo.auth_timeout = 45 Jun 11 23:12:14.976738 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_interval = 5 Jun 11 23:12:14.976738 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_timeout = 5 Jun 11 23:12:14.976738 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 11 23:12:14.976738 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 11 23:12:14.976738 np0000002687 nova-compute[98431]: node.conn[0].iscsi.HeaderDigest = None Jun 11 23:12:14.976738 np0000002687 nova-compute[98431]: node.conn[0].iscsi.DataDigest = None Jun 11 23:12:14.976738 np0000002687 nova-compute[98431]: node.conn[0].iscsi.IFMarker = No Jun 11 23:12:14.976738 np0000002687 nova-compute[98431]: node.conn[0].iscsi.OFMarker = No Jun 11 23:12:14.976738 np0000002687 nova-compute[98431]: # END RECORD Jun 11 23:12:14.976738 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:12:14.976738 np0000002687 nova-compute[98431]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=0.5110114040001008 future=) {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:12:14.985852 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 11 23:12:14.985852 np0000002687 nova-compute[98431]: node.name = iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060 Jun 11 23:12:14.985852 np0000002687 nova-compute[98431]: node.tpgt = -1 Jun 11 23:12:14.985852 np0000002687 nova-compute[98431]: node.startup = automatic Jun 11 23:12:14.985852 np0000002687 nova-compute[98431]: node.leading_login = No Jun 11 23:12:14.985852 np0000002687 nova-compute[98431]: iface.iscsi_ifacename = default Jun 11 23:12:14.985852 np0000002687 nova-compute[98431]: iface.net_ifacename = Jun 11 23:12:14.985852 np0000002687 nova-compute[98431]: iface.ipaddress = Jun 11 23:12:14.985852 np0000002687 nova-compute[98431]: iface.prefix_len = 0 Jun 11 23:12:14.985852 np0000002687 nova-compute[98431]: iface.hwaddress = Jun 11 23:12:14.985852 np0000002687 nova-compute[98431]: iface.transport_name = tcp Jun 11 23:12:14.985852 np0000002687 nova-compute[98431]: iface.initiatorname = Jun 11 23:12:14.985852 np0000002687 nova-compute[98431]: iface.state = Jun 11 23:12:14.985852 np0000002687 nova-compute[98431]: iface.vlan_id = 0 Jun 11 23:12:14.985852 np0000002687 nova-compute[98431]: iface.vlan_priority = 0 Jun 11 23:12:14.985852 np0000002687 nova-compute[98431]: iface.vlan_state = Jun 11 23:12:14.985852 np0000002687 nova-compute[98431]: iface.iface_num = 0 Jun 11 23:12:14.985852 np0000002687 nova-compute[98431]: iface.mtu = 0 Jun 11 23:12:14.985852 np0000002687 nova-compute[98431]: iface.port = 0 Jun 11 23:12:14.985852 np0000002687 nova-compute[98431]: iface.bootproto = Jun 11 23:12:14.985852 np0000002687 nova-compute[98431]: iface.subnet_mask = Jun 11 23:12:14.985852 np0000002687 nova-compute[98431]: iface.gateway = Jun 11 23:12:14.985852 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id_state = Jun 11 23:12:14.985852 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id = Jun 11 23:12:14.985852 np0000002687 nova-compute[98431]: iface.dhcp_dns = Jun 11 23:12:14.985852 np0000002687 nova-compute[98431]: iface.dhcp_learn_iqn = Jun 11 23:12:14.985852 np0000002687 nova-compute[98431]: iface.dhcp_req_vendor_id_state = Jun 11 23:12:14.985852 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id_state = Jun 11 23:12:14.985852 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id = Jun 11 23:12:14.985852 np0000002687 nova-compute[98431]: iface.dhcp_slp_da = Jun 11 23:12:14.985852 np0000002687 nova-compute[98431]: iface.fragmentation = Jun 11 23:12:14.985852 np0000002687 nova-compute[98431]: iface.gratuitous_arp = Jun 11 23:12:14.985852 np0000002687 nova-compute[98431]: iface.incoming_forwarding = Jun 11 23:12:14.985852 np0000002687 nova-compute[98431]: iface.tos_state = Jun 11 23:12:14.985852 np0000002687 nova-compute[98431]: iface.tos = 0 Jun 11 23:12:14.985852 np0000002687 nova-compute[98431]: iface.ttl = 0 Jun 11 23:12:14.985852 np0000002687 nova-compute[98431]: iface.delayed_ack = Jun 11 23:12:14.985852 np0000002687 nova-compute[98431]: iface.tcp_nagle = Jun 11 23:12:14.985852 np0000002687 nova-compute[98431]: iface.tcp_wsf_state = Jun 11 23:12:14.985852 np0000002687 nova-compute[98431]: iface.tcp_wsf = 0 Jun 11 23:12:14.985852 np0000002687 nova-compute[98431]: iface.tcp_timer_scale = 0 Jun 11 23:12:14.985852 np0000002687 nova-compute[98431]: iface.tcp_timestamp = Jun 11 23:12:14.985852 np0000002687 nova-compute[98431]: iface.redirect = Jun 11 23:12:14.985852 np0000002687 nova-compute[98431]: iface.def_task_mgmt_timeout = 0 Jun 11 23:12:14.985852 np0000002687 nova-compute[98431]: iface.header_digest = Jun 11 23:12:14.985852 np0000002687 nova-compute[98431]: iface.data_digest = Jun 11 23:12:14.985852 np0000002687 nova-compute[98431]: iface.immediate_data = Jun 11 23:12:14.985852 np0000002687 nova-compute[98431]: iface.initial_r2t = Jun 11 23:12:14.985852 np0000002687 nova-compute[98431]: iface.data_seq_inorder = Jun 11 23:12:14.985852 np0000002687 nova-compute[98431]: iface.data_pdu_inorder = Jun 11 23:12:14.985852 np0000002687 nova-compute[98431]: iface.erl = 0 Jun 11 23:12:14.985852 np0000002687 nova-compute[98431]: iface.max_receive_data_len = 0 Jun 11 23:12:14.985852 np0000002687 nova-compute[98431]: iface.first_burst_len = 0 Jun 11 23:12:14.985852 np0000002687 nova-compute[98431]: iface.max_outstanding_r2t = 0 Jun 11 23:12:14.985852 np0000002687 nova-compute[98431]: iface.max_burst_len = 0 Jun 11 23:12:14.985852 np0000002687 nova-compute[98431]: iface.chap_auth = Jun 11 23:12:14.985852 np0000002687 nova-compute[98431]: iface.bidi_chap = Jun 11 23:12:14.985852 np0000002687 nova-compute[98431]: iface.strict_login_compliance = Jun 11 23:12:14.985852 np0000002687 nova-compute[98431]: iface.discovery_auth = Jun 11 23:12:14.985852 np0000002687 nova-compute[98431]: iface.discovery_logout = Jun 11 23:12:14.985852 np0000002687 nova-compute[98431]: node.discovery_address = Jun 11 23:12:14.985852 np0000002687 nova-compute[98431]: node.discovery_port = 0 Jun 11 23:12:14.985852 np0000002687 nova-compute[98431]: node.discovery_type = fw Jun 11 23:12:14.985852 np0000002687 nova-compute[98431]: node.session.initial_cmdsn = 0 Jun 11 23:12:14.985852 np0000002687 nova-compute[98431]: node.session.initial_login_retry_max = 8 Jun 11 23:12:14.985852 np0000002687 nova-compute[98431]: node.session.xmit_thread_priority = 0 Jun 11 23:12:14.985852 np0000002687 nova-compute[98431]: node.session.cmds_max = 128 Jun 11 23:12:14.985852 np0000002687 nova-compute[98431]: node.session.queue_depth = 32 Jun 11 23:12:14.985852 np0000002687 nova-compute[98431]: node.session.nr_sessions = 1 Jun 11 23:12:14.985852 np0000002687 nova-compute[98431]: node.session.auth.authmethod = None Jun 11 23:12:14.985852 np0000002687 nova-compute[98431]: node.session.auth.username = Jun 11 23:12:14.985852 np0000002687 nova-compute[98431]: node.session.auth.password = *** Jun 11 23:12:14.985852 np0000002687 nova-compute[98431]: node.session.auth.username_in = Jun 11 23:12:14.985852 np0000002687 nova-compute[98431]: node.session.auth.password_in = Jun 11 23:12:14.985852 np0000002687 nova-compute[98431]: node.session.auth.chap_algs = SHA256 Jun 11 23:12:14.985852 np0000002687 nova-compute[98431]: node.session.timeo.replacement_timeout = 120 Jun 11 23:12:14.985852 np0000002687 nova-compute[98431]: node.session.err_timeo.abort_timeout = 15 Jun 11 23:12:14.985852 np0000002687 nova-compute[98431]: node.session.err_timeo.lu_reset_timeout = 30 Jun 11 23:12:14.985852 np0000002687 nova-compute[98431]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 11 23:12:14.985852 np0000002687 nova-compute[98431]: node.session.err_timeo.host_reset_timeout = 60 Jun 11 23:12:14.985852 np0000002687 nova-compute[98431]: node.session.iscsi.FastAbort = Yes Jun 11 23:12:14.985852 np0000002687 nova-compute[98431]: node.session.iscsi.InitialR2T = No Jun 11 23:12:14.985852 np0000002687 nova-compute[98431]: node.session.iscsi.ImmediateData = Yes Jun 11 23:12:14.985852 np0000002687 nova-compute[98431]: node.session.iscsi.FirstBurstLength = 262144 Jun 11 23:12:14.985852 np0000002687 nova-compute[98431]: node.session.iscsi.MaxBurstLength = 16776192 Jun 11 23:12:14.985852 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Retain = 0 Jun 11 23:12:14.985852 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Wait = 2 Jun 11 23:12:14.985852 np0000002687 nova-compute[98431]: node.session.iscsi.MaxConnections = 1 Jun 11 23:12:14.985852 np0000002687 nova-compute[98431]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 11 23:12:14.985852 np0000002687 nova-compute[98431]: node.session.iscsi.ERL = 0 Jun 11 23:12:14.985852 np0000002687 nova-compute[98431]: node.session.scan = manual Jun 11 23:12:14.985852 np0000002687 nova-compute[98431]: node.session.reopen_max = 0 Jun 11 23:12:14.985852 np0000002687 nova-compute[98431]: node.conn[0].address = 192.168.40.100 Jun 11 23:12:14.985852 np0000002687 nova-compute[98431]: node.conn[0].port = 3260 Jun 11 23:12:14.985852 np0000002687 nova-compute[98431]: node.conn[0].startup = manual Jun 11 23:12:14.985852 np0000002687 nova-compute[98431]: node.conn[0].tcp.window_size = 524288 Jun 11 23:12:14.985852 np0000002687 nova-compute[98431]: node.conn[0].tcp.type_of_service = 0 Jun 11 23:12:14.985852 np0000002687 nova-compute[98431]: node.conn[0].timeo.logout_timeout = 15 Jun 11 23:12:14.985852 np0000002687 nova-compute[98431]: node.conn[0].timeo.login_timeout = 15 Jun 11 23:12:14.985852 np0000002687 nova-compute[98431]: node.conn[0].timeo.auth_timeout = 45 Jun 11 23:12:14.985852 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_interval = 5 Jun 11 23:12:14.985852 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_timeout = 5 Jun 11 23:12:14.985852 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 11 23:12:14.985852 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 11 23:12:14.985852 np0000002687 nova-compute[98431]: node.conn[0].iscsi.HeaderDigest = None Jun 11 23:12:14.985852 np0000002687 nova-compute[98431]: node.conn[0].iscsi.DataDigest = None Jun 11 23:12:14.985852 np0000002687 nova-compute[98431]: node.conn[0].iscsi.IFMarker = No Jun 11 23:12:14.985852 np0000002687 nova-compute[98431]: node.conn[0].iscsi.OFMarker = No Jun 11 23:12:14.985852 np0000002687 nova-compute[98431]: # END RECORD Jun 11 23:12:14.985852 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:12:14.991251 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-bdf7e918-03fc-449d-84f5-e72e211672f4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json" returned: 0 in 0.087s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:12:14.991251 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-bdf7e918-03fc-449d-84f5-e72e211672f4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Acquiring lock "d2c441059b2992961b5de03c05b32d04aff77cb1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:12:14.991251 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-bdf7e918-03fc-449d-84f5-e72e211672f4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lock "d2c441059b2992961b5de03c05b32d04aff77cb1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:12:14.993954 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-bdf7e918-03fc-449d-84f5-e72e211672f4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:12:14.997236 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-bdf7e918-03fc-449d-84f5-e72e211672f4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:12:14.997620 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-bdf7e918-03fc-449d-84f5-e72e211672f4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:12:14.998360 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:12:15.014867 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:12:15.034265 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:12:15.034265 np0000002687 nova-compute[98431]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:12:15.034265 np0000002687 nova-compute[98431]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:12:15.034265 np0000002687 nova-compute[98431]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:12:15.034265 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:12:15.034265 np0000002687 nova-compute[98431]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce (non-flash) Jun 11 23:12:15.034265 np0000002687 nova-compute[98431]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce (non-flash) Jun 11 23:12:15.034265 np0000002687 nova-compute[98431]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060 (non-flash) Jun 11 23:12:15.034265 np0000002687 nova-compute[98431]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060 (non-flash) Jun 11 23:12:15.034265 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:12:15.034265 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:12:15.034265 np0000002687 nova-compute[98431]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:12:15.034265 np0000002687 nova-compute[98431]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:12:15.034265 np0000002687 nova-compute[98431]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:12:15.034265 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:12:15.034957 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:12:15.034957 np0000002687 nova-compute[98431]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:12:15.034957 np0000002687 nova-compute[98431]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:12:15.034957 np0000002687 nova-compute[98431]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:12:15.034957 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:12:15.034957 np0000002687 nova-compute[98431]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce (non-flash) Jun 11 23:12:15.034957 np0000002687 nova-compute[98431]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce (non-flash) Jun 11 23:12:15.034957 np0000002687 nova-compute[98431]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060 (non-flash) Jun 11 23:12:15.034957 np0000002687 nova-compute[98431]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060 (non-flash) Jun 11 23:12:15.034957 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:12:15.034957 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:12:15.034957 np0000002687 nova-compute[98431]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:12:15.034957 np0000002687 nova-compute[98431]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:12:15.034957 np0000002687 nova-compute[98431]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:12:15.034957 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:12:15.034957 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.080s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 11 23:12:15.035598 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Connected to 192.168.50.100:3260 {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 11 23:12:15.036118 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] HCTL ('18', '0', '0', 0) found on session 24 with lun 0 {{(pid=98431) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 11 23:12:15.036251 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Scanning host 18 c: 0, t: 0, l: 0) {{(pid=98431) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 11 23:12:15.044457 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:12:15.044457 np0000002687 nova-compute[98431]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:12:15.044457 np0000002687 nova-compute[98431]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:12:15.044457 np0000002687 nova-compute[98431]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:12:15.044457 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:12:15.044457 np0000002687 nova-compute[98431]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce (non-flash) Jun 11 23:12:15.044457 np0000002687 nova-compute[98431]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce (non-flash) Jun 11 23:12:15.044457 np0000002687 nova-compute[98431]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060 (non-flash) Jun 11 23:12:15.044457 np0000002687 nova-compute[98431]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060 (non-flash) Jun 11 23:12:15.044457 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:12:15.044457 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:12:15.044457 np0000002687 nova-compute[98431]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:12:15.044457 np0000002687 nova-compute[98431]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:12:15.044457 np0000002687 nova-compute[98431]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:12:15.044457 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:12:15.044457 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:12:15.044457 np0000002687 nova-compute[98431]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:12:15.044457 np0000002687 nova-compute[98431]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:12:15.044457 np0000002687 nova-compute[98431]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:12:15.044457 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:12:15.044457 np0000002687 nova-compute[98431]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce (non-flash) Jun 11 23:12:15.044457 np0000002687 nova-compute[98431]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce (non-flash) Jun 11 23:12:15.044457 np0000002687 nova-compute[98431]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060 (non-flash) Jun 11 23:12:15.044457 np0000002687 nova-compute[98431]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060 (non-flash) Jun 11 23:12:15.044457 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:12:15.044457 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:12:15.044457 np0000002687 nova-compute[98431]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:12:15.044457 np0000002687 nova-compute[98431]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:12:15.044457 np0000002687 nova-compute[98431]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:12:15.044457 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:12:15.044457 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.086s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 11 23:12:15.044457 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Connected to 192.168.40.100:3260 {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 11 23:12:15.044457 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] HCTL ('17', '0', '0', 0) found on session 23 with lun 0 {{(pid=98431) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 11 23:12:15.044457 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Scanning host 17 c: 0, t: 0, l: 0) {{(pid=98431) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 11 23:12:15.053308 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Searching for a device in session 24 and hctl ('18', '0', '0', 0) yield: sdm {{(pid=98431) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 11 23:12:15.053428 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '859ffbad-3fc1-400a-a7f7-ac423851f060', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'} {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 11 23:12:15.054664 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Searching for a device in session 23 and hctl ('17', '0', '0', 0) yield: sdl {{(pid=98431) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 11 23:12:15.055279 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '859ffbad-3fc1-400a-a7f7-ac423851f060', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'} {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 11 23:12:15.070054 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-bdf7e918-03fc-449d-84f5-e72e211672f4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json" returned: 0 in 0.072s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:12:15.070929 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-bdf7e918-03fc-449d-84f5-e72e211672f4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1,backing_fmt=raw /opt/stack/data/nova/instances/8641b14d-785b-44b0-ad6d-bb537cbee5c7/disk 1073741824 {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:12:15.095098 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [req-fb6b0044-766d-4416-9865-d218883c24a0 req-467301fd-b3b7-40b8-86f4-4e1e0745581e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:12:15.111521 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-bdf7e918-03fc-449d-84f5-e72e211672f4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1,backing_fmt=raw /opt/stack/data/nova/instances/8641b14d-785b-44b0-ad6d-bb537cbee5c7/disk 1073741824" returned: 0 in 0.040s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:12:15.111521 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-bdf7e918-03fc-449d-84f5-e72e211672f4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lock "d2c441059b2992961b5de03c05b32d04aff77cb1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.120s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:12:15.112163 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-bdf7e918-03fc-449d-84f5-e72e211672f4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:12:15.199332 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-bdf7e918-03fc-449d-84f5-e72e211672f4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json" returned: 0 in 0.087s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:12:15.199888 np0000002687 nova-compute[98431]: DEBUG nova.virt.disk.api [None req-bdf7e918-03fc-449d-84f5-e72e211672f4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8641b14d-785b-44b0-ad6d-bb537cbee5c7/disk. size=1073741824 {{(pid=98431) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 11 23:12:15.200196 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-bdf7e918-03fc-449d-84f5-e72e211672f4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8641b14d-785b-44b0-ad6d-bb537cbee5c7/disk --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:12:15.218570 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-fb6b0044-766d-4416-9865-d218883c24a0 req-467301fd-b3b7-40b8-86f4-4e1e0745581e service nova] [instance: 8641b14d-785b-44b0-ad6d-bb537cbee5c7] Instance cache missing network info. {{(pid=98431) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 11 23:12:15.295785 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-bdf7e918-03fc-449d-84f5-e72e211672f4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8641b14d-785b-44b0-ad6d-bb537cbee5c7/disk --force-share --output=json" returned: 0 in 0.095s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:12:15.296165 np0000002687 nova-compute[98431]: DEBUG nova.virt.disk.api [None req-bdf7e918-03fc-449d-84f5-e72e211672f4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Cannot resize image /opt/stack/data/nova/instances/8641b14d-785b-44b0-ad6d-bb537cbee5c7/disk to a smaller size. {{(pid=98431) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 11 23:12:15.296506 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-bdf7e918-03fc-449d-84f5-e72e211672f4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 8641b14d-785b-44b0-ad6d-bb537cbee5c7] Created local disks {{(pid=98431) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}} Jun 11 23:12:15.296718 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-bdf7e918-03fc-449d-84f5-e72e211672f4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 8641b14d-785b-44b0-ad6d-bb537cbee5c7] Ensure instance console log exists: /opt/stack/data/nova/instances/8641b14d-785b-44b0-ad6d-bb537cbee5c7/console.log {{(pid=98431) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}} Jun 11 23:12:15.297058 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-bdf7e918-03fc-449d-84f5-e72e211672f4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:12:15.297288 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-bdf7e918-03fc-449d-84f5-e72e211672f4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:12:15.297455 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-bdf7e918-03fc-449d-84f5-e72e211672f4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:12:15.460762 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-fb6b0044-766d-4416-9865-d218883c24a0 req-467301fd-b3b7-40b8-86f4-4e1e0745581e service nova] [instance: 8641b14d-785b-44b0-ad6d-bb537cbee5c7] Updating instance_info_cache with network_info: [] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:12:15.478218 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-5fb13b9c-f80a-4d3f-95ec-d4a0ba88e636 None None] [instance: 36688d94-68d3-4ae3-989a-b391d7ee4ad9] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:12:15.488517 np0000002687 nova-compute[98431]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0005797729997993883 future=) submitted to {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:12:15.488517 np0000002687 nova-compute[98431]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:12:15.488771 np0000002687 nova-compute[98431]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=2.17756958699988 future=) {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:12:15.488771 np0000002687 nova-compute[98431]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=2.1774678389999735 future=) was cancelled while queued, skipping {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:12:15.488771 np0000002687 nova-compute[98431]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:12:15.489034 np0000002687 nova-compute[98431]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=9.952612245999944 future=) {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:12:15.489034 np0000002687 nova-compute[98431]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=9.95251436500007 future=) {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:12:15.493210 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Emitting event Stopped> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:12:15.493210 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] [instance: 73abd331-0bbf-432e-be1c-308801a5429f] VM Stopped (Lifecycle Event) Jun 11 23:12:15.938724 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-d97c24a0-db96-47f4-b31f-60cebcfefb64 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "8ffa4bbe-7ead-4029-aba5-28f031f6e784" "released" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: held 7.288s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:12:15.956766 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98431) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 11 23:12:15.964219 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-fb6b0044-766d-4416-9865-d218883c24a0 req-467301fd-b3b7-40b8-86f4-4e1e0745581e service nova] Releasing lock "refresh_cache-8641b14d-785b-44b0-ad6d-bb537cbee5c7" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 11 23:12:15.964712 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-bdf7e918-03fc-449d-84f5-e72e211672f4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Acquired lock "refresh_cache-8641b14d-785b-44b0-ad6d-bb537cbee5c7" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 11 23:12:15.965893 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-bdf7e918-03fc-449d-84f5-e72e211672f4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 8641b14d-785b-44b0-ad6d-bb537cbee5c7] Building network info cache for instance {{(pid=98431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 11 23:12:16.000502 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-75f80a3c-c83e-440d-8257-21e08803b357 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] [instance: 73abd331-0bbf-432e-be1c-308801a5429f] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:12:16.005758 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:16.565182 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-bdf7e918-03fc-449d-84f5-e72e211672f4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 8641b14d-785b-44b0-ad6d-bb537cbee5c7] Instance cache missing network info. {{(pid=98431) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 11 23:12:16.689028 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Received event ua-65724ff3-60af-4d3f-b1bf-3aa2695037ce> from libvirt while the driver is waiting for it; dispatched. {{(pid=98431) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}} Jun 11 23:12:16.690863 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-5fdf1a89-26c8-4d8b-b071-edab007a4536 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-65724ff3-60af-4d3f-b1bf-3aa2695037ce for instance 14699717-b93f-4e67-b841-c67de8fff8d4 {{(pid=98431) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}} Jun 11 23:12:16.693289 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-5fdf1a89-26c8-4d8b-b071-edab007a4536 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Successfully detached device vdb from instance 14699717-b93f-4e67-b841-c67de8fff8d4 from the live domain config. Jun 11 23:12:16.743322 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5fdf1a89-26c8-4d8b-b071-edab007a4536 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] [instance: 14699717-b93f-4e67-b841-c67de8fff8d4] calling os-brick to detach iSCSI Volume {{(pid=98431) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jun 11 23:12:16.743738 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fdf1a89-26c8-4d8b-b071-edab007a4536 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce', 'iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '65724ff3-60af-4d3f-b1bf-3aa2695037ce', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-12'}, None), 'kwargs': {'force': False}}" {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 11 23:12:16.743944 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-5fdf1a89-26c8-4d8b-b071-edab007a4536 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 11 23:12:16.836152 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-bdf7e918-03fc-449d-84f5-e72e211672f4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:12:16.867744 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:16.973038 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Found WWN 330000000484693f8 for multipath device dm-9 {{(pid=98431) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 11 23:12:16.973446 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.034s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 11 23:12:16.973529 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] <== connect_volume: return (2034ms) {'type': 'block', 'scsi_wwn': '330000000484693f8', 'path': '/dev/dm-9', 'multipath_id': '330000000484693f8'} {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 11 23:12:16.973723 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000484693f8', 'path': '/dev/dm-9', 'multipath_id': '330000000484693f8'} {{(pid=98431) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 11 23:12:16.974763 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-5fdf1a89-26c8-4d8b-b071-edab007a4536 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.231s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 11 23:12:16.975269 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fdf1a89-26c8-4d8b-b071-edab007a4536 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce', 'iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '65724ff3-60af-4d3f-b1bf-3aa2695037ce', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-12'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 11 23:12:16.975462 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fdf1a89-26c8-4d8b-b071-edab007a4536 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce', 0)] {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 11 23:12:17.011201 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fdf1a89-26c8-4d8b-b071-edab007a4536 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:12:17.011201 np0000002687 nova-compute[98431]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:12:17.011201 np0000002687 nova-compute[98431]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:12:17.011201 np0000002687 nova-compute[98431]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:12:17.011201 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:12:17.011201 np0000002687 nova-compute[98431]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce (non-flash) Jun 11 23:12:17.011201 np0000002687 nova-compute[98431]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce (non-flash) Jun 11 23:12:17.011201 np0000002687 nova-compute[98431]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060 (non-flash) Jun 11 23:12:17.011201 np0000002687 nova-compute[98431]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060 (non-flash) Jun 11 23:12:17.011201 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:12:17.011201 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:12:17.011201 np0000002687 nova-compute[98431]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:12:17.011201 np0000002687 nova-compute[98431]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:12:17.011201 np0000002687 nova-compute[98431]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:12:17.011201 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:12:17.012647 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fdf1a89-26c8-4d8b-b071-edab007a4536 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:12:17.012647 np0000002687 nova-compute[98431]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:12:17.012647 np0000002687 nova-compute[98431]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:12:17.012647 np0000002687 nova-compute[98431]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:12:17.012647 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:12:17.012647 np0000002687 nova-compute[98431]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce (non-flash) Jun 11 23:12:17.012647 np0000002687 nova-compute[98431]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce (non-flash) Jun 11 23:12:17.012647 np0000002687 nova-compute[98431]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060 (non-flash) Jun 11 23:12:17.012647 np0000002687 nova-compute[98431]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060 (non-flash) Jun 11 23:12:17.012647 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:12:17.012647 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:12:17.012647 np0000002687 nova-compute[98431]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:12:17.012647 np0000002687 nova-compute[98431]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:12:17.012647 np0000002687 nova-compute[98431]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:12:17.012647 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:12:17.012647 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fdf1a89-26c8-4d8b-b071-edab007a4536 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c', '10'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff', '11'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff', '12'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea', '13'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea', '14'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce', '21'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce', '22'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060', '23'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060', '24'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9', '3'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9', '4'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9', '7'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9', '8'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c', '9')] {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 11 23:12:17.012647 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fdf1a89-26c8-4d8b-b071-edab007a4536 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce', '22')] {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 11 23:12:17.014610 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fdf1a89-26c8-4d8b-b071-edab007a4536 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce', '21')] {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 11 23:12:17.016738 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fdf1a89-26c8-4d8b-b071-edab007a4536 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Resulting device map defaultdict(. at 0x7e1ea0293ba0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce'): ({'sds'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce'): ({'sdr'}, set())}) {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 11 23:12:17.016738 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-5fdf1a89-26c8-4d8b-b071-edab007a4536 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Removing multipathed devices sds, sdr {{(pid=98431) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 11 23:12:17.016738 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-5fdf1a89-26c8-4d8b-b071-edab007a4536 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Flush multipath device 330000000f7449ef5 {{(pid=98431) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jun 11 23:12:17.025742 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-bdf7e918-03fc-449d-84f5-e72e211672f4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 8641b14d-785b-44b0-ad6d-bb537cbee5c7] Updating instance_info_cache with network_info: [{"id": "94c6b105-4ef1-4e7b-9b98-163702859f78", "address": "fa:16:3e:d6:e3:4f", "network": {"id": "2a770c99-2ec6-4fa2-945b-32830a59e7a7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-137493671-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aaf744af828a4a5eba1e98da63373b2b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap94c6b105-4e", "ovs_interfaceid": "94c6b105-4ef1-4e7b-9b98-163702859f78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:12:17.046149 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-5fdf1a89-26c8-4d8b-b071-edab007a4536 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Remove SCSI device /dev/sds with /sys/block/sds/device/delete {{(pid=98431) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 11 23:12:17.105581 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-5fdf1a89-26c8-4d8b-b071-edab007a4536 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Remove SCSI device /dev/sdr with /sys/block/sdr/device/delete {{(pid=98431) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 11 23:12:17.150244 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-5fdf1a89-26c8-4d8b-b071-edab007a4536 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Checking to see if SCSI volumes sds, sdr have been removed. {{(pid=98431) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 11 23:12:17.150244 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-5fdf1a89-26c8-4d8b-b071-edab007a4536 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] SCSI volumes sds, sdr have been removed. {{(pid=98431) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 11 23:12:17.151570 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-5fdf1a89-26c8-4d8b-b071-edab007a4536 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Checking to see if device paths {'sds', 'sdr'} are still under multipathd monitoring {{(pid=98431) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 11 23:12:17.168206 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-5fdf1a89-26c8-4d8b-b071-edab007a4536 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Device paths {'sds', 'sdr'} have been removed from multipathd monitoring. {{(pid=98431) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 11 23:12:17.168206 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fdf1a89-26c8-4d8b-b071-edab007a4536 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce')] {{(pid=98431) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 11 23:12:17.179135 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fdf1a89-26c8-4d8b-b071-edab007a4536 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:12:17.220558 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fdf1a89-26c8-4d8b-b071-edab007a4536 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce, portal: 192.168.40.100,3260] Jun 11 23:12:17.220558 np0000002687 nova-compute[98431]: Logout of [sid: 22, target: iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce, portal: 192.168.40.100,3260] successful. Jun 11 23:12:17.220558 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:12:17.256020 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fdf1a89-26c8-4d8b-b071-edab007a4536 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:12:17.271901 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Acquiring lock "64d7833a-82e8-43e9-83ed-2507197b69bf" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:12:17.271901 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "64d7833a-82e8-43e9-83ed-2507197b69bf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:12:17.272897 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fdf1a89-26c8-4d8b-b071-edab007a4536 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:12:17.309228 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fdf1a89-26c8-4d8b-b071-edab007a4536 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce, portal: 192.168.50.100,3260] Jun 11 23:12:17.309228 np0000002687 nova-compute[98431]: Logout of [sid: 21, target: iqn.2023-03.storpool.com:os--volume-65724ff3-60af-4d3f-b1bf-3aa2695037ce, portal: 192.168.50.100,3260] successful. Jun 11 23:12:17.309228 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:12:17.334247 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fdf1a89-26c8-4d8b-b071-edab007a4536 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:12:17.334247 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-5fdf1a89-26c8-4d8b-b071-edab007a4536 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.358s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 11 23:12:17.334247 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fdf1a89-26c8-4d8b-b071-edab007a4536 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] <== disconnect_volume: return (588ms) None {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 11 23:12:17.334247 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5fdf1a89-26c8-4d8b-b071-edab007a4536 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] [instance: 14699717-b93f-4e67-b841-c67de8fff8d4] Disconnected iSCSI Volume {{(pid=98431) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jun 11 23:12:17.480388 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-11T23:10:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-2137494624',display_name='tempest-ServerStableDeviceRescueTest-server-2137494624',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='tempest-serverstabledevicerescuetest-server-2137494624',id=3,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN1NkCgK8LSIP5pEhMIIs/Dp4mkiYJTYFTODVcSUZZtZrJeHfa+y2LovFgjleMmNFgpcKBJrcGsKOrecwTGqJCOsVvMRx1B6Ulwud9J9N+Drb0c4n+JfyZ0C/b9T67XJKQ==',key_name='tempest-keypair-560362554',keypairs=,launch_index=0,launched_at=2026-06-11T23:11:05Z,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='2d62cddce233457caf7eb43be819e513',ramdisk_id='',reservation_id='r-5adcxr7m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-67974016',owner_user_name='tempest-ServerStableDeviceRescueTest-67974016-project-member'},tags=,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-06-11T23:11:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='549767ad83a94efbb0bbd85d08fdc78a',uuid=cb63f66c-b69e-42b0-805c-be6fe9b3aee3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2d6dd8b9-e3ff-462f-92cf-8c3a62bc27d1", "address": "fa:16:3e:b5:6f:fd", "network": {"id": "b1a1d33f-f9b6-48cf-86a1-0260d53f3bb0", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1779972098-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.176", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1779972098-network", "vif_mac": "fa:16:3e:b5:6f:fd"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2d62cddce233457caf7eb43be819e513", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d6dd8b9-e3", "ovs_interfaceid": "2d6dd8b9-e3ff-462f-92cf-8c3a62bc27d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98431) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 11 23:12:17.480604 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Converting VIF {"id": "2d6dd8b9-e3ff-462f-92cf-8c3a62bc27d1", "address": "fa:16:3e:b5:6f:fd", "network": {"id": "b1a1d33f-f9b6-48cf-86a1-0260d53f3bb0", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1779972098-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.176", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1779972098-network", "vif_mac": "fa:16:3e:b5:6f:fd"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2d62cddce233457caf7eb43be819e513", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d6dd8b9-e3", "ovs_interfaceid": "2d6dd8b9-e3ff-462f-92cf-8c3a62bc27d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:12:17.481191 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b5:6f:fd,bridge_name='br-int',has_traffic_filtering=True,id=2d6dd8b9-e3ff-462f-92cf-8c3a62bc27d1,network=Network(b1a1d33f-f9b6-48cf-86a1-0260d53f3bb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d6dd8b9-e3') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:12:17.481951 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Lazy-loading 'pci_devices' on Instance uuid cb63f66c-b69e-42b0-805c-be6fe9b3aee3 {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:12:17.528264 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-bdf7e918-03fc-449d-84f5-e72e211672f4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Releasing lock "refresh_cache-8641b14d-785b-44b0-ad6d-bb537cbee5c7" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 11 23:12:17.528678 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-bdf7e918-03fc-449d-84f5-e72e211672f4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 8641b14d-785b-44b0-ad6d-bb537cbee5c7] Instance network_info: |[{"id": "94c6b105-4ef1-4e7b-9b98-163702859f78", "address": "fa:16:3e:d6:e3:4f", "network": {"id": "2a770c99-2ec6-4fa2-945b-32830a59e7a7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-137493671-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aaf744af828a4a5eba1e98da63373b2b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap94c6b105-4e", "ovs_interfaceid": "94c6b105-4ef1-4e7b-9b98-163702859f78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98431) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 11 23:12:17.531944 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-bdf7e918-03fc-449d-84f5-e72e211672f4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 8641b14d-785b-44b0-ad6d-bb537cbee5c7] Start _get_guest_xml network_info=[{"id": "94c6b105-4ef1-4e7b-9b98-163702859f78", "address": "fa:16:3e:d6:e3:4f", "network": {"id": "2a770c99-2ec6-4fa2-945b-32830a59e7a7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-137493671-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aaf744af828a4a5eba1e98da63373b2b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap94c6b105-4e", "ovs_interfaceid": "94c6b105-4ef1-4e7b-9b98-163702859f78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-11T23:08:20Z,direct_url=,disk_format='qcow2',id=f30640f8-7aca-4300-a085-4706a5209a79,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ce012f9fabdb4ee5a73e212437f59d97',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-11T23:08:23Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'image_id': 'f30640f8-7aca-4300-a085-4706a5209a79'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98431) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 11 23:12:17.535068 np0000002687 nova-compute[98431]: WARNING nova.virt.libvirt.driver [None req-bdf7e918-03fc-449d-84f5-e72e211672f4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 11 23:12:17.535198 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-bdf7e918-03fc-449d-84f5-e72e211672f4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='f30640f8-7aca-4300-a085-4706a5209a79', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-46603657', uuid='8641b14d-785b-44b0-ad6d-bb537cbee5c7'), owner=OwnerMeta(userid='72b6dac5eb744cfba6299636227aa59b', username='tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member', projectid='aaf744af828a4a5eba1e98da63373b2b', projectname='tempest-ServerBootFromVolumeStableRescueTest-539499192'), image=ImageMeta(id='f30640f8-7aca-4300-a085-4706a5209a79', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "94c6b105-4ef1-4e7b-9b98-163702859f78", "address": "fa:16:3e:d6:e3:4f", "network": {"id": "2a770c99-2ec6-4fa2-945b-32830a59e7a7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-137493671-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aaf744af828a4a5eba1e98da63373b2b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap94c6b105-4e", "ovs_interfaceid": "94c6b105-4ef1-4e7b-9b98-163702859f78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1781219537.5347722) {{(pid=98431) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 11 23:12:17.536762 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-bdf7e918-03fc-449d-84f5-e72e211672f4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Searching host: 'np0000002687' for CPU controller through CGroups V1... {{(pid=98431) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 11 23:12:17.536762 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-bdf7e918-03fc-449d-84f5-e72e211672f4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] CPU controller missing on host. {{(pid=98431) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 11 23:12:17.538323 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-bdf7e918-03fc-449d-84f5-e72e211672f4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Searching host: 'np0000002687' for CPU controller through CGroups V2... {{(pid=98431) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 11 23:12:17.538323 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-bdf7e918-03fc-449d-84f5-e72e211672f4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] CPU controller found on host. {{(pid=98431) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 11 23:12:17.538884 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-bdf7e918-03fc-449d-84f5-e72e211672f4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98431) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 11 23:12:17.539209 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-bdf7e918-03fc-449d-84f5-e72e211672f4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-11T23:08:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-11T23:08:20Z,direct_url=,disk_format='qcow2',id=f30640f8-7aca-4300-a085-4706a5209a79,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ce012f9fabdb4ee5a73e212437f59d97',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-11T23:08:23Z,virtual_size=,visibility=), allow threads: True {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 11 23:12:17.539384 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-bdf7e918-03fc-449d-84f5-e72e211672f4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Flavor limits 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 11 23:12:17.539508 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-bdf7e918-03fc-449d-84f5-e72e211672f4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Image limits 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 11 23:12:17.539757 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-bdf7e918-03fc-449d-84f5-e72e211672f4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Flavor pref 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 11 23:12:17.539905 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-bdf7e918-03fc-449d-84f5-e72e211672f4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Image pref 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 11 23:12:17.540037 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-bdf7e918-03fc-449d-84f5-e72e211672f4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 11 23:12:17.540234 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-bdf7e918-03fc-449d-84f5-e72e211672f4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 11 23:12:17.540384 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-bdf7e918-03fc-449d-84f5-e72e211672f4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98431) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 11 23:12:17.540527 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-bdf7e918-03fc-449d-84f5-e72e211672f4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Got 1 possible topologies {{(pid=98431) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 11 23:12:17.540677 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-bdf7e918-03fc-449d-84f5-e72e211672f4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 11 23:12:17.542524 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-bdf7e918-03fc-449d-84f5-e72e211672f4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 11 23:12:17.557464 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-bdf7e918-03fc-449d-84f5-e72e211672f4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-11T23:12:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-46603657',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='tempest-serverbootfromvolumestablerescuetest-server-46603657',id=14,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aaf744af828a4a5eba1e98da63373b2b',ramdisk_id='',reservation_id='r-o5768mnn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-539499192',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-11T23:12:14Z,user_data=None,user_id='72b6dac5eb744cfba6299636227aa59b',uuid=8641b14d-785b-44b0-ad6d-bb537cbee5c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "94c6b105-4ef1-4e7b-9b98-163702859f78", "address": "fa:16:3e:d6:e3:4f", "network": {"id": "2a770c99-2ec6-4fa2-945b-32830a59e7a7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-137493671-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aaf744af828a4a5eba1e98da63373b2b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap94c6b105-4e", "ovs_interfaceid": "94c6b105-4ef1-4e7b-9b98-163702859f78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98431) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 11 23:12:17.557744 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-bdf7e918-03fc-449d-84f5-e72e211672f4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Converting VIF {"id": "94c6b105-4ef1-4e7b-9b98-163702859f78", "address": "fa:16:3e:d6:e3:4f", "network": {"id": "2a770c99-2ec6-4fa2-945b-32830a59e7a7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-137493671-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aaf744af828a4a5eba1e98da63373b2b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap94c6b105-4e", "ovs_interfaceid": "94c6b105-4ef1-4e7b-9b98-163702859f78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:12:17.558060 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-bdf7e918-03fc-449d-84f5-e72e211672f4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:e3:4f,bridge_name='br-int',has_traffic_filtering=True,id=94c6b105-4ef1-4e7b-9b98-163702859f78,network=Network(2a770c99-2ec6-4fa2-945b-32830a59e7a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94c6b105-4e') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:12:17.558446 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-bdf7e918-03fc-449d-84f5-e72e211672f4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lazy-loading 'pci_devices' on Instance uuid 8641b14d-785b-44b0-ad6d-bb537cbee5c7 {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:12:17.656123 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:17.773636 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] Starting instance... {{(pid=98431) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 11 23:12:17.902692 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-5fdf1a89-26c8-4d8b-b071-edab007a4536 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Lazy-loading 'flavor' on Instance uuid 14699717-b93f-4e67-b841-c67de8fff8d4 {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:12:17.983995 np0000002687 nova-compute[98431]: DEBUG nova.objects.base [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=98431) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] End _get_guest_xml xml= Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: cb63f66c-b69e-42b0-805c-be6fe9b3aee3 Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: instance-00000003 Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: 196608 Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: 1 Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: tempest-ServerStableDeviceRescueTest-server-2137494624 Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: 2026-06-11 23:12:14 Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: 192 Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: 1 Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: 0 Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: 0 Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: 1 Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: True Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: bare Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: qcow2 Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: 1 Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: 0 Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: ide Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: virtio Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: pc Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: virtio Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: virtio Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: virtio Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: tempest-ServerStableDeviceRescueTest-67974016-project-member Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: tempest-ServerStableDeviceRescueTest-67974016 Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: OpenStack Foundation Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: OpenStack Nova Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: 33.1.0 Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: cb63f66c-b69e-42b0-805c-be6fe9b3aee3 Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: cb63f66c-b69e-42b0-805c-be6fe9b3aee3 Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: Virtual Machine Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: hvm Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: 128 Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: 1 Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: Nehalem Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: 859ffbad-3fc1-400a-a7f7-ac423851f060 Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: /dev/urandom Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: Jun 11 23:12:17.985049 np0000002687 nova-compute[98431]: {{(pid=98431) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 11 23:12:17.990956 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [-] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Instance destroyed successfully. Jun 11 23:12:18.061278 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-bdf7e918-03fc-449d-84f5-e72e211672f4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 8641b14d-785b-44b0-ad6d-bb537cbee5c7] End _get_guest_xml xml= Jun 11 23:12:18.061278 np0000002687 nova-compute[98431]: 8641b14d-785b-44b0-ad6d-bb537cbee5c7 Jun 11 23:12:18.061278 np0000002687 nova-compute[98431]: instance-0000000e Jun 11 23:12:18.061278 np0000002687 nova-compute[98431]: 196608 Jun 11 23:12:18.061278 np0000002687 nova-compute[98431]: 1 Jun 11 23:12:18.061278 np0000002687 nova-compute[98431]: Jun 11 23:12:18.061278 np0000002687 nova-compute[98431]: Jun 11 23:12:18.061278 np0000002687 nova-compute[98431]: Jun 11 23:12:18.061278 np0000002687 nova-compute[98431]: tempest-ServerBootFromVolumeStableRescueTest-server-46603657 Jun 11 23:12:18.061278 np0000002687 nova-compute[98431]: 2026-06-11 23:12:17 Jun 11 23:12:18.061278 np0000002687 nova-compute[98431]: Jun 11 23:12:18.061278 np0000002687 nova-compute[98431]: 192 Jun 11 23:12:18.061278 np0000002687 nova-compute[98431]: 1 Jun 11 23:12:18.061278 np0000002687 nova-compute[98431]: 0 Jun 11 23:12:18.061278 np0000002687 nova-compute[98431]: 0 Jun 11 23:12:18.061278 np0000002687 nova-compute[98431]: 1 Jun 11 23:12:18.061278 np0000002687 nova-compute[98431]: Jun 11 23:12:18.061278 np0000002687 nova-compute[98431]: True Jun 11 23:12:18.061278 np0000002687 nova-compute[98431]: Jun 11 23:12:18.061278 np0000002687 nova-compute[98431]: Jun 11 23:12:18.061278 np0000002687 nova-compute[98431]: Jun 11 23:12:18.061278 np0000002687 nova-compute[98431]: bare Jun 11 23:12:18.061278 np0000002687 nova-compute[98431]: qcow2 Jun 11 23:12:18.061278 np0000002687 nova-compute[98431]: 1 Jun 11 23:12:18.061278 np0000002687 nova-compute[98431]: 0 Jun 11 23:12:18.061278 np0000002687 nova-compute[98431]: Jun 11 23:12:18.061278 np0000002687 nova-compute[98431]: virtio Jun 11 23:12:18.061278 np0000002687 nova-compute[98431]: Jun 11 23:12:18.061278 np0000002687 nova-compute[98431]: Jun 11 23:12:18.061278 np0000002687 nova-compute[98431]: Jun 11 23:12:18.061278 np0000002687 nova-compute[98431]: tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member Jun 11 23:12:18.061278 np0000002687 nova-compute[98431]: tempest-ServerBootFromVolumeStableRescueTest-539499192 Jun 11 23:12:18.061278 np0000002687 nova-compute[98431]: Jun 11 23:12:18.061278 np0000002687 nova-compute[98431]: Jun 11 23:12:18.061278 np0000002687 nova-compute[98431]: Jun 11 23:12:18.061278 np0000002687 nova-compute[98431]: Jun 11 23:12:18.061278 np0000002687 nova-compute[98431]: Jun 11 23:12:18.061278 np0000002687 nova-compute[98431]: Jun 11 23:12:18.061278 np0000002687 nova-compute[98431]: Jun 11 23:12:18.061278 np0000002687 nova-compute[98431]: Jun 11 23:12:18.061278 np0000002687 nova-compute[98431]: Jun 11 23:12:18.061278 np0000002687 nova-compute[98431]: Jun 11 23:12:18.061278 np0000002687 nova-compute[98431]: Jun 11 23:12:18.061278 np0000002687 nova-compute[98431]: OpenStack Foundation Jun 11 23:12:18.061278 np0000002687 nova-compute[98431]: OpenStack Nova Jun 11 23:12:18.061278 np0000002687 nova-compute[98431]: 33.1.0 Jun 11 23:12:18.061278 np0000002687 nova-compute[98431]: 8641b14d-785b-44b0-ad6d-bb537cbee5c7 Jun 11 23:12:18.061278 np0000002687 nova-compute[98431]: 8641b14d-785b-44b0-ad6d-bb537cbee5c7 Jun 11 23:12:18.061278 np0000002687 nova-compute[98431]: Virtual Machine Jun 11 23:12:18.061278 np0000002687 nova-compute[98431]: Jun 11 23:12:18.061278 np0000002687 nova-compute[98431]: Jun 11 23:12:18.061278 np0000002687 nova-compute[98431]: Jun 11 23:12:18.061278 np0000002687 nova-compute[98431]: hvm Jun 11 23:12:18.061278 np0000002687 nova-compute[98431]: Jun 11 23:12:18.061278 np0000002687 nova-compute[98431]: Jun 11 23:12:18.061278 np0000002687 nova-compute[98431]: Jun 11 23:12:18.061278 np0000002687 nova-compute[98431]: Jun 11 23:12:18.061278 np0000002687 nova-compute[98431]: Jun 11 23:12:18.061278 np0000002687 nova-compute[98431]: Jun 11 23:12:18.061278 np0000002687 nova-compute[98431]: 128 Jun 11 23:12:18.061278 np0000002687 nova-compute[98431]: Jun 11 23:12:18.061278 np0000002687 nova-compute[98431]: Jun 11 23:12:18.061278 np0000002687 nova-compute[98431]: Jun 11 23:12:18.061278 np0000002687 nova-compute[98431]: 1 Jun 11 23:12:18.061278 np0000002687 nova-compute[98431]: Jun 11 23:12:18.061278 np0000002687 nova-compute[98431]: Jun 11 23:12:18.061278 np0000002687 nova-compute[98431]: Nehalem Jun 11 23:12:18.061278 np0000002687 nova-compute[98431]: Jun 11 23:12:18.061278 np0000002687 nova-compute[98431]: Jun 11 23:12:18.061278 np0000002687 nova-compute[98431]: Jun 11 23:12:18.061278 np0000002687 nova-compute[98431]: Jun 11 23:12:18.061278 np0000002687 nova-compute[98431]: Jun 11 23:12:18.061278 np0000002687 nova-compute[98431]: Jun 11 23:12:18.061278 np0000002687 nova-compute[98431]: Jun 11 23:12:18.061278 np0000002687 nova-compute[98431]: Jun 11 23:12:18.061278 np0000002687 nova-compute[98431]: Jun 11 23:12:18.061278 np0000002687 nova-compute[98431]: Jun 11 23:12:18.061278 np0000002687 nova-compute[98431]: Jun 11 23:12:18.061278 np0000002687 nova-compute[98431]: Jun 11 23:12:18.061278 np0000002687 nova-compute[98431]: Jun 11 23:12:18.061278 np0000002687 nova-compute[98431]: Jun 11 23:12:18.061278 np0000002687 nova-compute[98431]: Jun 11 23:12:18.061278 np0000002687 nova-compute[98431]: Jun 11 23:12:18.061278 np0000002687 nova-compute[98431]: Jun 11 23:12:18.061278 np0000002687 nova-compute[98431]: Jun 11 23:12:18.061278 np0000002687 nova-compute[98431]: Jun 11 23:12:18.061278 np0000002687 nova-compute[98431]: Jun 11 23:12:18.061278 np0000002687 nova-compute[98431]: Jun 11 23:12:18.061278 np0000002687 nova-compute[98431]: Jun 11 23:12:18.061278 np0000002687 nova-compute[98431]: Jun 11 23:12:18.061278 np0000002687 nova-compute[98431]: Jun 11 23:12:18.061278 np0000002687 nova-compute[98431]: Jun 11 23:12:18.061278 np0000002687 nova-compute[98431]: Jun 11 23:12:18.061278 np0000002687 nova-compute[98431]: /dev/urandom Jun 11 23:12:18.061278 np0000002687 nova-compute[98431]: Jun 11 23:12:18.061278 np0000002687 nova-compute[98431]: Jun 11 23:12:18.061278 np0000002687 nova-compute[98431]: Jun 11 23:12:18.061278 np0000002687 nova-compute[98431]: Jun 11 23:12:18.061278 np0000002687 nova-compute[98431]: Jun 11 23:12:18.061278 np0000002687 nova-compute[98431]: Jun 11 23:12:18.061278 np0000002687 nova-compute[98431]: Jun 11 23:12:18.061278 np0000002687 nova-compute[98431]: {{(pid=98431) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 11 23:12:18.063319 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-bdf7e918-03fc-449d-84f5-e72e211672f4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 8641b14d-785b-44b0-ad6d-bb537cbee5c7] Preparing to wait for external event network-vif-plugged-94c6b105-4ef1-4e7b-9b98-163702859f78 {{(pid=98431) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 11 23:12:18.063319 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-bdf7e918-03fc-449d-84f5-e72e211672f4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Acquiring lock "8641b14d-785b-44b0-ad6d-bb537cbee5c7-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:12:18.063319 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-bdf7e918-03fc-449d-84f5-e72e211672f4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lock "8641b14d-785b-44b0-ad6d-bb537cbee5c7-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:12:18.063319 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-bdf7e918-03fc-449d-84f5-e72e211672f4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lock "8641b14d-785b-44b0-ad6d-bb537cbee5c7-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:12:18.063470 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-bdf7e918-03fc-449d-84f5-e72e211672f4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-11T23:12:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-46603657',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='tempest-serverbootfromvolumestablerescuetest-server-46603657',id=14,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aaf744af828a4a5eba1e98da63373b2b',ramdisk_id='',reservation_id='r-o5768mnn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-539499192',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-11T23:12:14Z,user_data=None,user_id='72b6dac5eb744cfba6299636227aa59b',uuid=8641b14d-785b-44b0-ad6d-bb537cbee5c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "94c6b105-4ef1-4e7b-9b98-163702859f78", "address": "fa:16:3e:d6:e3:4f", "network": {"id": "2a770c99-2ec6-4fa2-945b-32830a59e7a7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-137493671-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aaf744af828a4a5eba1e98da63373b2b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap94c6b105-4e", "ovs_interfaceid": "94c6b105-4ef1-4e7b-9b98-163702859f78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 11 23:12:18.063892 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-bdf7e918-03fc-449d-84f5-e72e211672f4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Converting VIF {"id": "94c6b105-4ef1-4e7b-9b98-163702859f78", "address": "fa:16:3e:d6:e3:4f", "network": {"id": "2a770c99-2ec6-4fa2-945b-32830a59e7a7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-137493671-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aaf744af828a4a5eba1e98da63373b2b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap94c6b105-4e", "ovs_interfaceid": "94c6b105-4ef1-4e7b-9b98-163702859f78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:12:18.065108 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-bdf7e918-03fc-449d-84f5-e72e211672f4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:e3:4f,bridge_name='br-int',has_traffic_filtering=True,id=94c6b105-4ef1-4e7b-9b98-163702859f78,network=Network(2a770c99-2ec6-4fa2-945b-32830a59e7a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94c6b105-4e') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:12:18.065348 np0000002687 nova-compute[98431]: DEBUG os_vif [None req-bdf7e918-03fc-449d-84f5-e72e211672f4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:e3:4f,bridge_name='br-int',has_traffic_filtering=True,id=94c6b105-4ef1-4e7b-9b98-163702859f78,network=Network(2a770c99-2ec6-4fa2-945b-32830a59e7a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94c6b105-4e') {{(pid=98431) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 11 23:12:18.065715 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:18.066012 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:12:18.066246 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 11 23:12:18.067981 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:18.068184 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '67ddcbe7-27f3-561d-9b85-af71cdd684a5', '_type': 'linux-noop'}}, row=False) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:12:18.069196 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:18.070794 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:12:18.076047 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:18.078238 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:18.078479 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap94c6b105-4e, may_exist=True, interface_attrs={}) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:12:18.079071 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap94c6b105-4e, col_values=(('qos', UUID('c61511fe-6200-4638-88b5-2f7e4dbce9f9')),), if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:12:18.079286 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap94c6b105-4e, col_values=(('external_ids', {'iface-id': '94c6b105-4ef1-4e7b-9b98-163702859f78', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d6:e3:4f', 'vm-uuid': '8641b14d-785b-44b0-ad6d-bb537cbee5c7'}),), if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:12:18.080270 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:18.081441 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:12:18.092711 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:18.095957 np0000002687 nova-compute[98431]: INFO os_vif [None req-bdf7e918-03fc-449d-84f5-e72e211672f4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:e3:4f,bridge_name='br-int',has_traffic_filtering=True,id=94c6b105-4ef1-4e7b-9b98-163702859f78,network=Network(2a770c99-2ec6-4fa2-945b-32830a59e7a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94c6b105-4e') Jun 11 23:12:18.319408 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:12:18.319727 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:12:18.322099 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98431) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 11 23:12:18.322309 np0000002687 nova-compute[98431]: INFO nova.compute.claims [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] Claim successful on node np0000002687 Jun 11 23:12:18.754090 np0000002687 nova-compute[98431]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98431) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jun 11 23:12:18.908299 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-5fdf1a89-26c8-4d8b-b071-edab007a4536 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Lock "14699717-b93f-4e67-b841-c67de8fff8d4" "released" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: held 5.215s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:12:19.086915 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-838e82e5-13e9-4e89-b402-cc101f8beec4 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Acquiring lock "27ac8c84-e5db-4bd1-a148-ec5834c5b39c" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:12:19.087356 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-838e82e5-13e9-4e89-b402-cc101f8beec4 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Lock "27ac8c84-e5db-4bd1-a148-ec5834c5b39c" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:12:19.087356 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-838e82e5-13e9-4e89-b402-cc101f8beec4 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Acquiring lock "27ac8c84-e5db-4bd1-a148-ec5834c5b39c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:12:19.087356 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-838e82e5-13e9-4e89-b402-cc101f8beec4 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Lock "27ac8c84-e5db-4bd1-a148-ec5834c5b39c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:12:19.087470 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-838e82e5-13e9-4e89-b402-cc101f8beec4 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Lock "27ac8c84-e5db-4bd1-a148-ec5834c5b39c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:12:19.091489 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-838e82e5-13e9-4e89-b402-cc101f8beec4 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] [instance: 27ac8c84-e5db-4bd1-a148-ec5834c5b39c] Terminating instance Jun 11 23:12:19.195831 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-76b946c2-d0e7-4672-b859-2da3c872da2b tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Acquiring lock "14699717-b93f-4e67-b841-c67de8fff8d4" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:12:19.195831 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-76b946c2-d0e7-4672-b859-2da3c872da2b tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Lock "14699717-b93f-4e67-b841-c67de8fff8d4" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:12:19.196096 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-76b946c2-d0e7-4672-b859-2da3c872da2b tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Acquiring lock "14699717-b93f-4e67-b841-c67de8fff8d4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:12:19.197135 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-76b946c2-d0e7-4672-b859-2da3c872da2b tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Lock "14699717-b93f-4e67-b841-c67de8fff8d4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:12:19.197570 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-76b946c2-d0e7-4672-b859-2da3c872da2b tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Lock "14699717-b93f-4e67-b841-c67de8fff8d4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:12:19.201516 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-76b946c2-d0e7-4672-b859-2da3c872da2b tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] [instance: 14699717-b93f-4e67-b841-c67de8fff8d4] Terminating instance Jun 11 23:12:19.408448 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:19.517878 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] No BDM found with device name vda, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:12:19.518033 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:12:19.518193 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:12:19.518243 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] No BDM found with device name hda, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:12:19.518323 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] No VIF found with MAC fa:16:3e:b5:6f:fd, not building metadata {{(pid=98431) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13199}} Jun 11 23:12:19.518878 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Using config drive Jun 11 23:12:19.595163 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-838e82e5-13e9-4e89-b402-cc101f8beec4 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] [instance: 27ac8c84-e5db-4bd1-a148-ec5834c5b39c] Start destroying the instance on the hypervisor. {{(pid=98431) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}} Jun 11 23:12:19.611672 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-bdf7e918-03fc-449d-84f5-e72e211672f4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] No BDM found with device name vda, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:12:19.611878 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-bdf7e918-03fc-449d-84f5-e72e211672f4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] No BDM found with device name hda, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:12:19.611933 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-bdf7e918-03fc-449d-84f5-e72e211672f4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] No VIF found with MAC fa:16:3e:d6:e3:4f, not building metadata {{(pid=98431) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13199}} Jun 11 23:12:19.612402 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-bdf7e918-03fc-449d-84f5-e72e211672f4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 8641b14d-785b-44b0-ad6d-bb537cbee5c7] Using config drive Jun 11 23:12:19.639060 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:19.648657 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:19.672903 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:19.707528 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-76b946c2-d0e7-4672-b859-2da3c872da2b tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] [instance: 14699717-b93f-4e67-b841-c67de8fff8d4] Start destroying the instance on the hypervisor. {{(pid=98431) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}} Jun 11 23:12:19.769905 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:19.773868 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:19.804705 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:19.876156 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:19.901792 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:19.935839 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:19.942452 np0000002687 nova-compute[98431]: DEBUG nova.utils [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Queued Task(fn=>, remaining_delay=14.99971833199993 future=) {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:12:19.947134 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [-] [instance: 27ac8c84-e5db-4bd1-a148-ec5834c5b39c] Instance destroyed successfully. Jun 11 23:12:19.947572 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-838e82e5-13e9-4e89-b402-cc101f8beec4 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Lazy-loading 'resources' on Instance uuid 27ac8c84-e5db-4bd1-a148-ec5834c5b39c {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:12:19.991577 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:20.003956 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-1a367047-5a18-4854-b87d-3616a6c6ef69 req-cb2efa08-d834-4b5b-aee8-704ad103a151 service nova] [instance: 27ac8c84-e5db-4bd1-a148-ec5834c5b39c] Received event network-vif-unplugged-673175fc-0e8b-46fe-9898-7e27d61b8694 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:12:20.004221 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-1a367047-5a18-4854-b87d-3616a6c6ef69 req-cb2efa08-d834-4b5b-aee8-704ad103a151 service nova] Acquiring lock "27ac8c84-e5db-4bd1-a148-ec5834c5b39c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:12:20.004482 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-1a367047-5a18-4854-b87d-3616a6c6ef69 req-cb2efa08-d834-4b5b-aee8-704ad103a151 service nova] Lock "27ac8c84-e5db-4bd1-a148-ec5834c5b39c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:12:20.004609 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-1a367047-5a18-4854-b87d-3616a6c6ef69 req-cb2efa08-d834-4b5b-aee8-704ad103a151 service nova] Lock "27ac8c84-e5db-4bd1-a148-ec5834c5b39c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:12:20.004771 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-1a367047-5a18-4854-b87d-3616a6c6ef69 req-cb2efa08-d834-4b5b-aee8-704ad103a151 service nova] [instance: 27ac8c84-e5db-4bd1-a148-ec5834c5b39c] No waiting events found dispatching network-vif-unplugged-673175fc-0e8b-46fe-9898-7e27d61b8694 {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:12:20.007886 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-1a367047-5a18-4854-b87d-3616a6c6ef69 req-cb2efa08-d834-4b5b-aee8-704ad103a151 service nova] [instance: 27ac8c84-e5db-4bd1-a148-ec5834c5b39c] Received event network-vif-unplugged-673175fc-0e8b-46fe-9898-7e27d61b8694 for instance with task_state deleting. {{(pid=98431) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 11 23:12:20.022673 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Lazy-loading 'ec2_ids' on Instance uuid cb63f66c-b69e-42b0-805c-be6fe9b3aee3 {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:12:20.085260 np0000002687 nova-compute[98431]: DEBUG nova.utils [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Queued Task(fn=>, remaining_delay=14.999716728000067 future=) {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:12:20.089670 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [-] [instance: 14699717-b93f-4e67-b841-c67de8fff8d4] Instance destroyed successfully. Jun 11 23:12:20.090541 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-76b946c2-d0e7-4672-b859-2da3c872da2b tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Lazy-loading 'resources' on Instance uuid 14699717-b93f-4e67-b841-c67de8fff8d4 {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:12:20.124737 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-bdf7e918-03fc-449d-84f5-e72e211672f4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:12:20.161179 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98431) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 11 23:12:20.161557 np0000002687 nova-compute[98431]: DEBUG nova.compute.provider_tree [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Inventory has not changed in ProviderTree for provider: e3e65fe2-9de9-4821-8b4a-ccae37c66e25 {{(pid=98431) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 11 23:12:20.454500 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-838e82e5-13e9-4e89-b402-cc101f8beec4 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-11T23:10:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-439003148-1',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='tempest-testmultiattachvolumeswap-server-439003148-1',id=7,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJiPvaCzf6MnI1RIMFh7OGuYa8yejf4/MQ6XARcaU53VShAH2UqbgZMb0xxWuJdSGbXJNSkROJtN6eI7LOlxJllHoSwhWlfsLKPCGWl7oacshhsOrgJkm+Nq/cHNgBG2uQ==',key_name='tempest-keypair-270932437',keypairs=,launch_index=0,launched_at=2026-06-11T23:11:00Z,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='3a092509b877483183db8610c8763b93',ramdisk_id='',reservation_id='r-44bv6jg5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestMultiAttachVolumeSwap-329912157',owner_user_name='tempest-TestMultiAttachVolumeSwap-329912157-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-11T23:11:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b63bb5265a040fc8f755a27d13f43b3',uuid=27ac8c84-e5db-4bd1-a148-ec5834c5b39c,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "673175fc-0e8b-46fe-9898-7e27d61b8694", "address": "fa:16:3e:dc:9c:b5", "network": {"id": "0dc6da23-6c97-4fd1-9e59-910adaa610a9", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-968328905-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a092509b877483183db8610c8763b93", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap673175fc-0e", "ovs_interfaceid": "673175fc-0e8b-46fe-9898-7e27d61b8694", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 11 23:12:20.454788 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-838e82e5-13e9-4e89-b402-cc101f8beec4 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Converting VIF {"id": "673175fc-0e8b-46fe-9898-7e27d61b8694", "address": "fa:16:3e:dc:9c:b5", "network": {"id": "0dc6da23-6c97-4fd1-9e59-910adaa610a9", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-968328905-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a092509b877483183db8610c8763b93", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap673175fc-0e", "ovs_interfaceid": "673175fc-0e8b-46fe-9898-7e27d61b8694", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:12:20.455263 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-838e82e5-13e9-4e89-b402-cc101f8beec4 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dc:9c:b5,bridge_name='br-int',has_traffic_filtering=True,id=673175fc-0e8b-46fe-9898-7e27d61b8694,network=Network(0dc6da23-6c97-4fd1-9e59-910adaa610a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap673175fc-0e') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:12:20.455472 np0000002687 nova-compute[98431]: DEBUG os_vif [None req-838e82e5-13e9-4e89-b402-cc101f8beec4 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:dc:9c:b5,bridge_name='br-int',has_traffic_filtering=True,id=673175fc-0e8b-46fe-9898-7e27d61b8694,network=Network(0dc6da23-6c97-4fd1-9e59-910adaa610a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap673175fc-0e') {{(pid=98431) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 11 23:12:20.456784 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:20.456784 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap673175fc-0e, bridge=br-int, if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:12:20.457820 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:20.458617 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:12:20.477719 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:20.478759 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:20.478958 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=13914899-caa9-47d2-919f-ab3941b9a916) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:12:20.479513 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:20.480166 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:12:20.500812 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:20.508342 np0000002687 nova-compute[98431]: INFO os_vif [None req-838e82e5-13e9-4e89-b402-cc101f8beec4 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:dc:9c:b5,bridge_name='br-int',has_traffic_filtering=True,id=673175fc-0e8b-46fe-9898-7e27d61b8694,network=Network(0dc6da23-6c97-4fd1-9e59-910adaa610a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap673175fc-0e') Jun 11 23:12:20.508750 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-838e82e5-13e9-4e89-b402-cc101f8beec4 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] [instance: 27ac8c84-e5db-4bd1-a148-ec5834c5b39c] Deleting instance files /opt/stack/data/nova/instances/27ac8c84-e5db-4bd1-a148-ec5834c5b39c_del Jun 11 23:12:20.509555 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-838e82e5-13e9-4e89-b402-cc101f8beec4 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] [instance: 27ac8c84-e5db-4bd1-a148-ec5834c5b39c] Deletion of /opt/stack/data/nova/instances/27ac8c84-e5db-4bd1-a148-ec5834c5b39c_del complete Jun 11 23:12:20.532265 np0000002687 nova-compute[98431]: DEBUG nova.objects.base [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=98431) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 11 23:12:20.532844 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Lazy-loading 'keypairs' on Instance uuid cb63f66c-b69e-42b0-805c-be6fe9b3aee3 {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:12:20.555216 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-bdf7e918-03fc-449d-84f5-e72e211672f4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 8641b14d-785b-44b0-ad6d-bb537cbee5c7] Creating config drive at /opt/stack/data/nova/instances/8641b14d-785b-44b0-ad6d-bb537cbee5c7/disk.config Jun 11 23:12:20.561228 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-bdf7e918-03fc-449d-84f5-e72e211672f4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/8641b14d-785b-44b0-ad6d-bb537cbee5c7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp2a4wbrdm {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:12:20.595560 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-76b946c2-d0e7-4672-b859-2da3c872da2b tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-11T23:10:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-439003148-2',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='tempest-testmultiattachvolumeswap-server-439003148-2',id=8,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJiPvaCzf6MnI1RIMFh7OGuYa8yejf4/MQ6XARcaU53VShAH2UqbgZMb0xxWuJdSGbXJNSkROJtN6eI7LOlxJllHoSwhWlfsLKPCGWl7oacshhsOrgJkm+Nq/cHNgBG2uQ==',key_name='tempest-keypair-270932437',keypairs=,launch_index=1,launched_at=2026-06-11T23:11:04Z,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='3a092509b877483183db8610c8763b93',ramdisk_id='',reservation_id='r-44bv6jg5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestMultiAttachVolumeSwap-329912157',owner_user_name='tempest-TestMultiAttachVolumeSwap-329912157-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-11T23:11:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b63bb5265a040fc8f755a27d13f43b3',uuid=14699717-b93f-4e67-b841-c67de8fff8d4,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a266c7d4-9f0e-474d-a4d9-5190dbdd0fc2", "address": "fa:16:3e:8a:95:c7", "network": {"id": "0dc6da23-6c97-4fd1-9e59-910adaa610a9", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-968328905-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a092509b877483183db8610c8763b93", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa266c7d4-9f", "ovs_interfaceid": "a266c7d4-9f0e-474d-a4d9-5190dbdd0fc2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 11 23:12:20.595788 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-76b946c2-d0e7-4672-b859-2da3c872da2b tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Converting VIF {"id": "a266c7d4-9f0e-474d-a4d9-5190dbdd0fc2", "address": "fa:16:3e:8a:95:c7", "network": {"id": "0dc6da23-6c97-4fd1-9e59-910adaa610a9", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-968328905-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a092509b877483183db8610c8763b93", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa266c7d4-9f", "ovs_interfaceid": "a266c7d4-9f0e-474d-a4d9-5190dbdd0fc2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:12:20.596510 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-76b946c2-d0e7-4672-b859-2da3c872da2b tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8a:95:c7,bridge_name='br-int',has_traffic_filtering=True,id=a266c7d4-9f0e-474d-a4d9-5190dbdd0fc2,network=Network(0dc6da23-6c97-4fd1-9e59-910adaa610a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa266c7d4-9f') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:12:20.596794 np0000002687 nova-compute[98431]: DEBUG os_vif [None req-76b946c2-d0e7-4672-b859-2da3c872da2b tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8a:95:c7,bridge_name='br-int',has_traffic_filtering=True,id=a266c7d4-9f0e-474d-a4d9-5190dbdd0fc2,network=Network(0dc6da23-6c97-4fd1-9e59-910adaa610a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa266c7d4-9f') {{(pid=98431) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 11 23:12:20.607845 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:20.608364 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa266c7d4-9f, bridge=br-int, if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:12:20.610131 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-bdf7e918-03fc-449d-84f5-e72e211672f4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/8641b14d-785b-44b0-ad6d-bb537cbee5c7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp2a4wbrdm" returned: 0 in 0.051s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:12:20.611642 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:20.614442 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:12:20.622166 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:20.625595 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:20.626058 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1743eb27-0f57-46a3-a81a-f8a9e4aa4396) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:12:20.626667 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:20.627285 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:12:20.639961 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:20.645001 np0000002687 nova-compute[98431]: INFO os_vif [None req-76b946c2-d0e7-4672-b859-2da3c872da2b tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8a:95:c7,bridge_name='br-int',has_traffic_filtering=True,id=a266c7d4-9f0e-474d-a4d9-5190dbdd0fc2,network=Network(0dc6da23-6c97-4fd1-9e59-910adaa610a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa266c7d4-9f') Jun 11 23:12:20.645777 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-76b946c2-d0e7-4672-b859-2da3c872da2b tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] [instance: 14699717-b93f-4e67-b841-c67de8fff8d4] Deleting instance files /opt/stack/data/nova/instances/14699717-b93f-4e67-b841-c67de8fff8d4_del Jun 11 23:12:20.647632 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-76b946c2-d0e7-4672-b859-2da3c872da2b tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] [instance: 14699717-b93f-4e67-b841-c67de8fff8d4] Deletion of /opt/stack/data/nova/instances/14699717-b93f-4e67-b841-c67de8fff8d4_del complete Jun 11 23:12:20.666158 np0000002687 nova-compute[98431]: DEBUG nova.scheduler.client.report [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Inventory has not changed for provider e3e65fe2-9de9-4821-8b4a-ccae37c66e25 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98431) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 11 23:12:21.017694 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-838e82e5-13e9-4e89-b402-cc101f8beec4 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] [instance: 27ac8c84-e5db-4bd1-a148-ec5834c5b39c] Took 1.42 seconds to destroy the instance on the hypervisor. Jun 11 23:12:21.019198 np0000002687 nova-compute[98431]: DEBUG oslo.service.backend._common.loopingcall [None req-838e82e5-13e9-4e89-b402-cc101f8beec4 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98431) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jun 11 23:12:21.019606 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [-] [instance: 27ac8c84-e5db-4bd1-a148-ec5834c5b39c] Deallocating network for instance {{(pid=98431) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}} Jun 11 23:12:21.019826 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [-] [instance: 27ac8c84-e5db-4bd1-a148-ec5834c5b39c] deallocate_for_instance() {{(pid=98431) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jun 11 23:12:21.020385 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:12:21.039317 np0000002687 nova-compute[98431]: DEBUG nova.objects.base [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98431) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 11 23:12:21.046777 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:12:21.157787 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-76b946c2-d0e7-4672-b859-2da3c872da2b tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] [instance: 14699717-b93f-4e67-b841-c67de8fff8d4] Took 1.45 seconds to destroy the instance on the hypervisor. Jun 11 23:12:21.158369 np0000002687 nova-compute[98431]: DEBUG oslo.service.backend._common.loopingcall [None req-76b946c2-d0e7-4672-b859-2da3c872da2b tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98431) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jun 11 23:12:21.158989 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [-] [instance: 14699717-b93f-4e67-b841-c67de8fff8d4] Deallocating network for instance {{(pid=98431) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}} Jun 11 23:12:21.158989 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [-] [instance: 14699717-b93f-4e67-b841-c67de8fff8d4] deallocate_for_instance() {{(pid=98431) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jun 11 23:12:21.158989 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:12:21.171892 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:12:21.188047 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.868s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:12:21.188722 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] Start building networks asynchronously for instance. {{(pid=98431) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 11 23:12:21.193646 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:21.214337 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:21.259083 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:12:21.318826 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:21.402662 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:21.415038 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:21.707510 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] Allocating IP information in the background. {{(pid=98431) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 11 23:12:21.707510 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] allocate_for_instance() {{(pid=98431) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 11 23:12:21.707510 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:12:21.707510 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:12:22.097683 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Creating config drive at /opt/stack/data/nova/instances/cb63f66c-b69e-42b0-805c-be6fe9b3aee3/disk.config.rescue Jun 11 23:12:22.103431 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/cb63f66c-b69e-42b0-805c-be6fe9b3aee3/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp43k9bc14 {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:12:22.158477 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/cb63f66c-b69e-42b0-805c-be6fe9b3aee3/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp43k9bc14" returned: 0 in 0.055s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:12:22.211926 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 11 23:12:22.286840 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:22.346835 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Emitting event Started> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:12:22.347144 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 8641b14d-785b-44b0-ad6d-bb537cbee5c7] VM Started (Lifecycle Event) Jun 11 23:12:22.398166 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-e88f2e66-81c2-47ab-8627-7637daebb7c7 req-e97e0e05-9cf4-4905-ad2c-cc626a75501e service nova] [instance: 27ac8c84-e5db-4bd1-a148-ec5834c5b39c] Received event network-vif-deleted-673175fc-0e8b-46fe-9898-7e27d61b8694 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:12:22.398217 np0000002687 nova-compute[98431]: INFO nova.compute.manager [req-e88f2e66-81c2-47ab-8627-7637daebb7c7 req-e97e0e05-9cf4-4905-ad2c-cc626a75501e service nova] [instance: 27ac8c84-e5db-4bd1-a148-ec5834c5b39c] Neutron deleted interface 673175fc-0e8b-46fe-9898-7e27d61b8694; detaching it from the instance and deleting it from the info cache Jun 11 23:12:22.403696 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-e88f2e66-81c2-47ab-8627-7637daebb7c7 req-e97e0e05-9cf4-4905-ad2c-cc626a75501e service nova] [instance: 27ac8c84-e5db-4bd1-a148-ec5834c5b39c] Detach interface failed, port_id=673175fc-0e8b-46fe-9898-7e27d61b8694, reason: Instance 27ac8c84-e5db-4bd1-a148-ec5834c5b39c could not be found. {{(pid=98431) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}} Jun 11 23:12:22.423513 np0000002687 nova-compute[98431]: DEBUG nova.policy [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c17e84202f404c3c8e73292bb59d7b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fd45f475a04e5c8e9bd9deb7ad4c1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98431) authorize /opt/stack/nova/nova/policy.py:192}} Jun 11 23:12:22.428775 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-f300c729-f7d0-4531-b89a-f207a77f68b8 req-28587c7c-2627-4c0f-8eb1-6050819d4df3 service nova] [instance: 27ac8c84-e5db-4bd1-a148-ec5834c5b39c] Received event network-vif-unplugged-673175fc-0e8b-46fe-9898-7e27d61b8694 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:12:22.429068 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-f300c729-f7d0-4531-b89a-f207a77f68b8 req-28587c7c-2627-4c0f-8eb1-6050819d4df3 service nova] Acquiring lock "27ac8c84-e5db-4bd1-a148-ec5834c5b39c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:12:22.429952 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-f300c729-f7d0-4531-b89a-f207a77f68b8 req-28587c7c-2627-4c0f-8eb1-6050819d4df3 service nova] Lock "27ac8c84-e5db-4bd1-a148-ec5834c5b39c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:12:22.433547 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-f300c729-f7d0-4531-b89a-f207a77f68b8 req-28587c7c-2627-4c0f-8eb1-6050819d4df3 service nova] Lock "27ac8c84-e5db-4bd1-a148-ec5834c5b39c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.004s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:12:22.433824 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-f300c729-f7d0-4531-b89a-f207a77f68b8 req-28587c7c-2627-4c0f-8eb1-6050819d4df3 service nova] [instance: 27ac8c84-e5db-4bd1-a148-ec5834c5b39c] No waiting events found dispatching network-vif-unplugged-673175fc-0e8b-46fe-9898-7e27d61b8694 {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:12:22.434044 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-f300c729-f7d0-4531-b89a-f207a77f68b8 req-28587c7c-2627-4c0f-8eb1-6050819d4df3 service nova] [instance: 27ac8c84-e5db-4bd1-a148-ec5834c5b39c] Received event network-vif-unplugged-673175fc-0e8b-46fe-9898-7e27d61b8694 for instance with task_state deleting. {{(pid=98431) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 11 23:12:22.434221 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-f300c729-f7d0-4531-b89a-f207a77f68b8 req-28587c7c-2627-4c0f-8eb1-6050819d4df3 service nova] [instance: 14699717-b93f-4e67-b841-c67de8fff8d4] Received event network-vif-unplugged-a266c7d4-9f0e-474d-a4d9-5190dbdd0fc2 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:12:22.434484 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-f300c729-f7d0-4531-b89a-f207a77f68b8 req-28587c7c-2627-4c0f-8eb1-6050819d4df3 service nova] Acquiring lock "14699717-b93f-4e67-b841-c67de8fff8d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:12:22.434610 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-f300c729-f7d0-4531-b89a-f207a77f68b8 req-28587c7c-2627-4c0f-8eb1-6050819d4df3 service nova] Lock "14699717-b93f-4e67-b841-c67de8fff8d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:12:22.434765 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-f300c729-f7d0-4531-b89a-f207a77f68b8 req-28587c7c-2627-4c0f-8eb1-6050819d4df3 service nova] Lock "14699717-b93f-4e67-b841-c67de8fff8d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:12:22.434931 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-f300c729-f7d0-4531-b89a-f207a77f68b8 req-28587c7c-2627-4c0f-8eb1-6050819d4df3 service nova] [instance: 14699717-b93f-4e67-b841-c67de8fff8d4] No waiting events found dispatching network-vif-unplugged-a266c7d4-9f0e-474d-a4d9-5190dbdd0fc2 {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:12:22.435096 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-f300c729-f7d0-4531-b89a-f207a77f68b8 req-28587c7c-2627-4c0f-8eb1-6050819d4df3 service nova] [instance: 14699717-b93f-4e67-b841-c67de8fff8d4] Received event network-vif-unplugged-a266c7d4-9f0e-474d-a4d9-5190dbdd0fc2 for instance with task_state deleting. {{(pid=98431) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 11 23:12:22.435247 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-f300c729-f7d0-4531-b89a-f207a77f68b8 req-28587c7c-2627-4c0f-8eb1-6050819d4df3 service nova] [instance: 14699717-b93f-4e67-b841-c67de8fff8d4] Received event network-vif-unplugged-a266c7d4-9f0e-474d-a4d9-5190dbdd0fc2 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:12:22.436052 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-f300c729-f7d0-4531-b89a-f207a77f68b8 req-28587c7c-2627-4c0f-8eb1-6050819d4df3 service nova] Acquiring lock "14699717-b93f-4e67-b841-c67de8fff8d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:12:22.436267 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-f300c729-f7d0-4531-b89a-f207a77f68b8 req-28587c7c-2627-4c0f-8eb1-6050819d4df3 service nova] Lock "14699717-b93f-4e67-b841-c67de8fff8d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:12:22.436920 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-f300c729-f7d0-4531-b89a-f207a77f68b8 req-28587c7c-2627-4c0f-8eb1-6050819d4df3 service nova] Lock "14699717-b93f-4e67-b841-c67de8fff8d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:12:22.436920 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-f300c729-f7d0-4531-b89a-f207a77f68b8 req-28587c7c-2627-4c0f-8eb1-6050819d4df3 service nova] [instance: 14699717-b93f-4e67-b841-c67de8fff8d4] No waiting events found dispatching network-vif-unplugged-a266c7d4-9f0e-474d-a4d9-5190dbdd0fc2 {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:12:22.437004 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-f300c729-f7d0-4531-b89a-f207a77f68b8 req-28587c7c-2627-4c0f-8eb1-6050819d4df3 service nova] [instance: 14699717-b93f-4e67-b841-c67de8fff8d4] Received event network-vif-unplugged-a266c7d4-9f0e-474d-a4d9-5190dbdd0fc2 for instance with task_state deleting. {{(pid=98431) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 11 23:12:22.542043 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [-] [instance: 27ac8c84-e5db-4bd1-a148-ec5834c5b39c] Updating instance_info_cache with network_info: [] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:12:22.659994 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:22.719298 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] Start building block device mappings for instance. {{(pid=98431) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 11 23:12:22.758940 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:22.802233 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:22.853463 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 8641b14d-785b-44b0-ad6d-bb537cbee5c7] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:12:22.856876 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Emitting event Paused> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:12:22.856876 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 8641b14d-785b-44b0-ad6d-bb537cbee5c7] VM Paused (Lifecycle Event) Jun 11 23:12:22.907423 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:23.044255 np0000002687 nova-compute[98431]: INFO nova.compute.manager [-] [instance: 27ac8c84-e5db-4bd1-a148-ec5834c5b39c] Took 2.02 seconds to deallocate network for instance. Jun 11 23:12:23.204116 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:23.210338 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:23.214977 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:23.239614 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:23.299302 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] Successfully created port: 283962f2-faaf-4d85-8eda-9b77b55a5b0c {{(pid=98431) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 11 23:12:23.313984 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [-] [instance: 14699717-b93f-4e67-b841-c67de8fff8d4] Updating instance_info_cache with network_info: [] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:12:23.360218 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 8641b14d-785b-44b0-ad6d-bb537cbee5c7] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:12:23.365761 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 8641b14d-785b-44b0-ad6d-bb537cbee5c7] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98431) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 11 23:12:23.554486 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-838e82e5-13e9-4e89-b402-cc101f8beec4 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:12:23.554729 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-838e82e5-13e9-4e89-b402-cc101f8beec4 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:12:23.728028 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] Start spawning the instance on the hypervisor. {{(pid=98431) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 11 23:12:23.734156 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] Creating instance directory {{(pid=98431) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}} Jun 11 23:12:23.734156 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] Creating image(s) Jun 11 23:12:23.740691 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Acquiring lock "/opt/stack/data/nova/instances/64d7833a-82e8-43e9-83ed-2507197b69bf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:12:23.740691 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "/opt/stack/data/nova/instances/64d7833a-82e8-43e9-83ed-2507197b69bf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:12:23.740691 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "/opt/stack/data/nova/instances/64d7833a-82e8-43e9-83ed-2507197b69bf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:12:23.740691 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:12:23.751289 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:12:23.751289 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:12:23.778463 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:23.817552 np0000002687 nova-compute[98431]: INFO nova.compute.manager [-] [instance: 14699717-b93f-4e67-b841-c67de8fff8d4] Took 2.66 seconds to deallocate network for instance. Jun 11 23:12:23.852304 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json" returned: 0 in 0.107s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:12:23.853678 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Acquiring lock "d2c441059b2992961b5de03c05b32d04aff77cb1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:12:23.854437 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "d2c441059b2992961b5de03c05b32d04aff77cb1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:12:23.855130 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:12:23.860588 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:12:23.862061 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:12:23.877727 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 8641b14d-785b-44b0-ad6d-bb537cbee5c7] During sync_power_state the instance has a pending task (spawning). Skip. Jun 11 23:12:23.963603 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json" returned: 0 in 0.101s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:12:23.964661 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1,backing_fmt=raw /opt/stack/data/nova/instances/64d7833a-82e8-43e9-83ed-2507197b69bf/disk 1073741824 {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:12:23.994828 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Removed pending STOPPED event for cb63f66c-b69e-42b0-805c-be6fe9b3aee3 due to new event Resumed> {{(pid=98431) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:519}} Jun 11 23:12:24.002779 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Emitting event Resumed> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:12:24.002779 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] VM Resumed (Lifecycle Event) Jun 11 23:12:24.007412 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-b0e407ea-b337-4f36-8cf3-dada33bf8952 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:12:24.047784 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1,backing_fmt=raw /opt/stack/data/nova/instances/64d7833a-82e8-43e9-83ed-2507197b69bf/disk 1073741824" returned: 0 in 0.083s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:12:24.048342 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "d2c441059b2992961b5de03c05b32d04aff77cb1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.195s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:12:24.048766 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:12:24.128657 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] Successfully updated port: 283962f2-faaf-4d85-8eda-9b77b55a5b0c {{(pid=98431) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 11 23:12:24.163710 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json" returned: 0 in 0.114s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:12:24.165369 np0000002687 nova-compute[98431]: DEBUG nova.virt.disk.api [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Checking if we can resize image /opt/stack/data/nova/instances/64d7833a-82e8-43e9-83ed-2507197b69bf/disk. size=1073741824 {{(pid=98431) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 11 23:12:24.167908 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64d7833a-82e8-43e9-83ed-2507197b69bf/disk --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:12:24.267643 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64d7833a-82e8-43e9-83ed-2507197b69bf/disk --force-share --output=json" returned: 0 in 0.102s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:12:24.269349 np0000002687 nova-compute[98431]: DEBUG nova.virt.disk.api [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Cannot resize image /opt/stack/data/nova/instances/64d7833a-82e8-43e9-83ed-2507197b69bf/disk to a smaller size. {{(pid=98431) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 11 23:12:24.270856 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] Created local disks {{(pid=98431) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}} Jun 11 23:12:24.270856 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] Ensure instance console log exists: /opt/stack/data/nova/instances/64d7833a-82e8-43e9-83ed-2507197b69bf/console.log {{(pid=98431) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}} Jun 11 23:12:24.271187 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:12:24.271471 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:12:24.271664 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:12:24.334960 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-76b946c2-d0e7-4672-b859-2da3c872da2b tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:12:24.432210 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-149f7b79-a09c-4801-a6fc-4c88ee1b64eb req-6db8ef73-a86b-4c69-a458-b07020f0ef96 service nova] [instance: 8641b14d-785b-44b0-ad6d-bb537cbee5c7] Received event network-vif-plugged-94c6b105-4ef1-4e7b-9b98-163702859f78 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:12:24.432682 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-149f7b79-a09c-4801-a6fc-4c88ee1b64eb req-6db8ef73-a86b-4c69-a458-b07020f0ef96 service nova] Acquiring lock "8641b14d-785b-44b0-ad6d-bb537cbee5c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:12:24.432682 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-149f7b79-a09c-4801-a6fc-4c88ee1b64eb req-6db8ef73-a86b-4c69-a458-b07020f0ef96 service nova] Lock "8641b14d-785b-44b0-ad6d-bb537cbee5c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:12:24.433074 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-149f7b79-a09c-4801-a6fc-4c88ee1b64eb req-6db8ef73-a86b-4c69-a458-b07020f0ef96 service nova] Lock "8641b14d-785b-44b0-ad6d-bb537cbee5c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:12:24.433074 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-149f7b79-a09c-4801-a6fc-4c88ee1b64eb req-6db8ef73-a86b-4c69-a458-b07020f0ef96 service nova] [instance: 8641b14d-785b-44b0-ad6d-bb537cbee5c7] Processing event network-vif-plugged-94c6b105-4ef1-4e7b-9b98-163702859f78 {{(pid=98431) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 11 23:12:24.433742 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-bdf7e918-03fc-449d-84f5-e72e211672f4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 8641b14d-785b-44b0-ad6d-bb537cbee5c7] Instance event wait completed in 2 seconds for network-vif-plugged {{(pid=98431) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 11 23:12:24.439129 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-bdf7e918-03fc-449d-84f5-e72e211672f4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 8641b14d-785b-44b0-ad6d-bb537cbee5c7] Guest created on hypervisor {{(pid=98431) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}} Jun 11 23:12:24.443185 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [-] [instance: 8641b14d-785b-44b0-ad6d-bb537cbee5c7] Instance spawned successfully. Jun 11 23:12:24.445881 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-bdf7e918-03fc-449d-84f5-e72e211672f4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 8641b14d-785b-44b0-ad6d-bb537cbee5c7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 11 23:12:24.510748 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:12:24.513396 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98431) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 11 23:12:24.571564 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-eb2a4503-daaf-4ce3-970d-e71170e9dc60 req-5b002d88-94ee-4066-aedc-4de8cdc3d714 service nova] [instance: 14699717-b93f-4e67-b841-c67de8fff8d4] Received event network-vif-deleted-a266c7d4-9f0e-474d-a4d9-5190dbdd0fc2 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:12:24.604052 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-dbf529fd-8fd1-4860-9316-4508be385a81 req-4e9a7fee-4a33-47bc-81e1-f3e4bad9aabd service nova] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] Received event network-changed-283962f2-faaf-4d85-8eda-9b77b55a5b0c {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:12:24.604052 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-dbf529fd-8fd1-4860-9316-4508be385a81 req-4e9a7fee-4a33-47bc-81e1-f3e4bad9aabd service nova] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] Refreshing instance network info cache due to event network-changed-283962f2-faaf-4d85-8eda-9b77b55a5b0c. {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 11 23:12:24.604052 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-dbf529fd-8fd1-4860-9316-4508be385a81 req-4e9a7fee-4a33-47bc-81e1-f3e4bad9aabd service nova] Acquiring lock "refresh_cache-64d7833a-82e8-43e9-83ed-2507197b69bf" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 11 23:12:24.604052 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-dbf529fd-8fd1-4860-9316-4508be385a81 req-4e9a7fee-4a33-47bc-81e1-f3e4bad9aabd service nova] Acquired lock "refresh_cache-64d7833a-82e8-43e9-83ed-2507197b69bf" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 11 23:12:24.604052 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-dbf529fd-8fd1-4860-9316-4508be385a81 req-4e9a7fee-4a33-47bc-81e1-f3e4bad9aabd service nova] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] Refreshing network info cache for port 283962f2-faaf-4d85-8eda-9b77b55a5b0c {{(pid=98431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 11 23:12:24.620063 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-838e82e5-13e9-4e89-b402-cc101f8beec4 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98431) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 11 23:12:24.620595 np0000002687 nova-compute[98431]: DEBUG nova.compute.provider_tree [None req-838e82e5-13e9-4e89-b402-cc101f8beec4 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Inventory has not changed in ProviderTree for provider: e3e65fe2-9de9-4821-8b4a-ccae37c66e25 {{(pid=98431) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 11 23:12:24.635432 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Acquiring lock "refresh_cache-64d7833a-82e8-43e9-83ed-2507197b69bf" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 11 23:12:24.968563 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-bdf7e918-03fc-449d-84f5-e72e211672f4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 8641b14d-785b-44b0-ad6d-bb537cbee5c7] Found default for hw_cdrom_bus of ide {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:12:24.968744 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-bdf7e918-03fc-449d-84f5-e72e211672f4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 8641b14d-785b-44b0-ad6d-bb537cbee5c7] Found default for hw_disk_bus of virtio {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:12:24.969145 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-bdf7e918-03fc-449d-84f5-e72e211672f4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 8641b14d-785b-44b0-ad6d-bb537cbee5c7] Found default for hw_input_bus of None {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:12:24.969453 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-bdf7e918-03fc-449d-84f5-e72e211672f4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 8641b14d-785b-44b0-ad6d-bb537cbee5c7] Found default for hw_pointer_model of None {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:12:24.969865 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-bdf7e918-03fc-449d-84f5-e72e211672f4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 8641b14d-785b-44b0-ad6d-bb537cbee5c7] Found default for hw_video_model of virtio {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:12:24.970160 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-bdf7e918-03fc-449d-84f5-e72e211672f4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 8641b14d-785b-44b0-ad6d-bb537cbee5c7] Found default for hw_vif_model of virtio {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:12:25.016392 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Emitting event Started> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:12:25.017673 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] VM Started (Lifecycle Event) Jun 11 23:12:25.111457 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [req-dbf529fd-8fd1-4860-9316-4508be385a81 req-4e9a7fee-4a33-47bc-81e1-f3e4bad9aabd service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:12:25.124020 np0000002687 nova-compute[98431]: DEBUG nova.scheduler.client.report [None req-838e82e5-13e9-4e89-b402-cc101f8beec4 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Inventory has not changed for provider e3e65fe2-9de9-4821-8b4a-ccae37c66e25 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98431) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 11 23:12:25.216936 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-dbf529fd-8fd1-4860-9316-4508be385a81 req-4e9a7fee-4a33-47bc-81e1-f3e4bad9aabd service nova] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] Instance cache missing network info. {{(pid=98431) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 11 23:12:25.442124 np0000002687 nova-compute[98431]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0005473369999435818 future=) was cancelled during its delay period, skipping {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:12:25.442670 np0000002687 nova-compute[98431]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:12:25.442670 np0000002687 nova-compute[98431]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=9.499714782999945 future=) {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:12:25.442670 np0000002687 nova-compute[98431]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=9.499592597999936 future=) {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:12:25.447058 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-dbf529fd-8fd1-4860-9316-4508be385a81 req-4e9a7fee-4a33-47bc-81e1-f3e4bad9aabd service nova] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] Updating instance_info_cache with network_info: [] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:12:25.481917 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-bdf7e918-03fc-449d-84f5-e72e211672f4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 8641b14d-785b-44b0-ad6d-bb537cbee5c7] Took 10.59 seconds to spawn the instance on the hypervisor. Jun 11 23:12:25.482703 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-bdf7e918-03fc-449d-84f5-e72e211672f4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 8641b14d-785b-44b0-ad6d-bb537cbee5c7] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:12:25.521818 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:12:25.528723 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98431) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 11 23:12:25.627719 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:25.653596 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-838e82e5-13e9-4e89-b402-cc101f8beec4 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 2.099s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:12:25.661650 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-76b946c2-d0e7-4672-b859-2da3c872da2b tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.326s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:12:25.752189 np0000002687 nova-compute[98431]: INFO nova.scheduler.client.report [None req-838e82e5-13e9-4e89-b402-cc101f8beec4 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Deleted allocations for instance 27ac8c84-e5db-4bd1-a148-ec5834c5b39c Jun 11 23:12:25.952656 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-dbf529fd-8fd1-4860-9316-4508be385a81 req-4e9a7fee-4a33-47bc-81e1-f3e4bad9aabd service nova] Releasing lock "refresh_cache-64d7833a-82e8-43e9-83ed-2507197b69bf" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 11 23:12:25.952656 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Acquired lock "refresh_cache-64d7833a-82e8-43e9-83ed-2507197b69bf" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 11 23:12:25.952656 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] Building network info cache for instance {{(pid=98431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 11 23:12:26.002501 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-bdf7e918-03fc-449d-84f5-e72e211672f4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 8641b14d-785b-44b0-ad6d-bb537cbee5c7] Took 18.57 seconds to build instance. Jun 11 23:12:26.036844 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Emitting event Resumed> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:12:26.037237 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 8641b14d-785b-44b0-ad6d-bb537cbee5c7] VM Resumed (Lifecycle Event) Jun 11 23:12:26.508366 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-bdf7e918-03fc-449d-84f5-e72e211672f4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lock "8641b14d-785b-44b0-ad6d-bb537cbee5c7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 20.085s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:12:26.543444 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-76b946c2-d0e7-4672-b859-2da3c872da2b tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98431) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 11 23:12:26.543444 np0000002687 nova-compute[98431]: DEBUG nova.compute.provider_tree [None req-76b946c2-d0e7-4672-b859-2da3c872da2b tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Inventory has not changed in ProviderTree for provider: e3e65fe2-9de9-4821-8b4a-ccae37c66e25 {{(pid=98431) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 11 23:12:26.544776 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 8641b14d-785b-44b0-ad6d-bb537cbee5c7] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:12:26.549886 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 8641b14d-785b-44b0-ad6d-bb537cbee5c7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98431) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 11 23:12:26.570545 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-81ada886-9677-4937-8d85-7aa77fe777e5 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Unrescuing Jun 11 23:12:26.570639 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-81ada886-9677-4937-8d85-7aa77fe777e5 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Acquiring lock "refresh_cache-cb63f66c-b69e-42b0-805c-be6fe9b3aee3" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 11 23:12:26.570732 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-81ada886-9677-4937-8d85-7aa77fe777e5 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Acquired lock "refresh_cache-cb63f66c-b69e-42b0-805c-be6fe9b3aee3" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 11 23:12:26.570903 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-81ada886-9677-4937-8d85-7aa77fe777e5 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Building network info cache for instance {{(pid=98431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 11 23:12:26.671455 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-17a1779a-d720-4b24-8934-8650212d9289 req-3c2ca4a9-42cd-4c9b-8cbe-d6e7c5dbe7cd service nova] [instance: 8641b14d-785b-44b0-ad6d-bb537cbee5c7] Received event network-vif-plugged-94c6b105-4ef1-4e7b-9b98-163702859f78 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:12:26.671636 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-17a1779a-d720-4b24-8934-8650212d9289 req-3c2ca4a9-42cd-4c9b-8cbe-d6e7c5dbe7cd service nova] Acquiring lock "8641b14d-785b-44b0-ad6d-bb537cbee5c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:12:26.671832 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-17a1779a-d720-4b24-8934-8650212d9289 req-3c2ca4a9-42cd-4c9b-8cbe-d6e7c5dbe7cd service nova] Lock "8641b14d-785b-44b0-ad6d-bb537cbee5c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:12:26.671985 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-17a1779a-d720-4b24-8934-8650212d9289 req-3c2ca4a9-42cd-4c9b-8cbe-d6e7c5dbe7cd service nova] Lock "8641b14d-785b-44b0-ad6d-bb537cbee5c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:12:26.672245 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-17a1779a-d720-4b24-8934-8650212d9289 req-3c2ca4a9-42cd-4c9b-8cbe-d6e7c5dbe7cd service nova] [instance: 8641b14d-785b-44b0-ad6d-bb537cbee5c7] No waiting events found dispatching network-vif-plugged-94c6b105-4ef1-4e7b-9b98-163702859f78 {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:12:26.672317 np0000002687 nova-compute[98431]: WARNING nova.compute.manager [req-17a1779a-d720-4b24-8934-8650212d9289 req-3c2ca4a9-42cd-4c9b-8cbe-d6e7c5dbe7cd service nova] [instance: 8641b14d-785b-44b0-ad6d-bb537cbee5c7] Received unexpected event network-vif-plugged-94c6b105-4ef1-4e7b-9b98-163702859f78 for instance with vm_state active and task_state None. Jun 11 23:12:26.672505 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-17a1779a-d720-4b24-8934-8650212d9289 req-3c2ca4a9-42cd-4c9b-8cbe-d6e7c5dbe7cd service nova] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Received event network-vif-plugged-2d6dd8b9-e3ff-462f-92cf-8c3a62bc27d1 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:12:26.672616 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-17a1779a-d720-4b24-8934-8650212d9289 req-3c2ca4a9-42cd-4c9b-8cbe-d6e7c5dbe7cd service nova] Acquiring lock "cb63f66c-b69e-42b0-805c-be6fe9b3aee3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:12:26.672777 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-17a1779a-d720-4b24-8934-8650212d9289 req-3c2ca4a9-42cd-4c9b-8cbe-d6e7c5dbe7cd service nova] Lock "cb63f66c-b69e-42b0-805c-be6fe9b3aee3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:12:26.677848 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-17a1779a-d720-4b24-8934-8650212d9289 req-3c2ca4a9-42cd-4c9b-8cbe-d6e7c5dbe7cd service nova] Lock "cb63f66c-b69e-42b0-805c-be6fe9b3aee3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:12:26.678899 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-17a1779a-d720-4b24-8934-8650212d9289 req-3c2ca4a9-42cd-4c9b-8cbe-d6e7c5dbe7cd service nova] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] No waiting events found dispatching network-vif-plugged-2d6dd8b9-e3ff-462f-92cf-8c3a62bc27d1 {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:12:26.682935 np0000002687 nova-compute[98431]: WARNING nova.compute.manager [req-17a1779a-d720-4b24-8934-8650212d9289 req-3c2ca4a9-42cd-4c9b-8cbe-d6e7c5dbe7cd service nova] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Received unexpected event network-vif-plugged-2d6dd8b9-e3ff-462f-92cf-8c3a62bc27d1 for instance with vm_state rescued and task_state unrescuing. Jun 11 23:12:26.682935 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-17a1779a-d720-4b24-8934-8650212d9289 req-3c2ca4a9-42cd-4c9b-8cbe-d6e7c5dbe7cd service nova] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Received event network-vif-plugged-2d6dd8b9-e3ff-462f-92cf-8c3a62bc27d1 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:12:26.682935 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-17a1779a-d720-4b24-8934-8650212d9289 req-3c2ca4a9-42cd-4c9b-8cbe-d6e7c5dbe7cd service nova] Acquiring lock "cb63f66c-b69e-42b0-805c-be6fe9b3aee3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:12:26.684053 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-17a1779a-d720-4b24-8934-8650212d9289 req-3c2ca4a9-42cd-4c9b-8cbe-d6e7c5dbe7cd service nova] Lock "cb63f66c-b69e-42b0-805c-be6fe9b3aee3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:12:26.686347 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-17a1779a-d720-4b24-8934-8650212d9289 req-3c2ca4a9-42cd-4c9b-8cbe-d6e7c5dbe7cd service nova] Lock "cb63f66c-b69e-42b0-805c-be6fe9b3aee3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.002s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:12:26.686347 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-17a1779a-d720-4b24-8934-8650212d9289 req-3c2ca4a9-42cd-4c9b-8cbe-d6e7c5dbe7cd service nova] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] No waiting events found dispatching network-vif-plugged-2d6dd8b9-e3ff-462f-92cf-8c3a62bc27d1 {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:12:26.686502 np0000002687 nova-compute[98431]: WARNING nova.compute.manager [req-17a1779a-d720-4b24-8934-8650212d9289 req-3c2ca4a9-42cd-4c9b-8cbe-d6e7c5dbe7cd service nova] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Received unexpected event network-vif-plugged-2d6dd8b9-e3ff-462f-92cf-8c3a62bc27d1 for instance with vm_state rescued and task_state unrescuing. Jun 11 23:12:26.762557 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-838e82e5-13e9-4e89-b402-cc101f8beec4 tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Lock "27ac8c84-e5db-4bd1-a148-ec5834c5b39c" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 7.675s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:12:26.790626 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] Instance cache missing network info. {{(pid=98431) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 11 23:12:27.049631 np0000002687 nova-compute[98431]: DEBUG nova.scheduler.client.report [None req-76b946c2-d0e7-4672-b859-2da3c872da2b tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Inventory has not changed for provider e3e65fe2-9de9-4821-8b4a-ccae37c66e25 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98431) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 11 23:12:27.074866 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-81ada886-9677-4937-8d85-7aa77fe777e5 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:12:27.113980 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Acquiring lock "49a042ba-28ba-4401-9bdf-92f96da8f80e" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:12:27.114139 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Lock "49a042ba-28ba-4401-9bdf-92f96da8f80e" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:12:27.114357 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Acquiring lock "49a042ba-28ba-4401-9bdf-92f96da8f80e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:12:27.114722 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Lock "49a042ba-28ba-4401-9bdf-92f96da8f80e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:12:27.114722 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Lock "49a042ba-28ba-4401-9bdf-92f96da8f80e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:12:27.118630 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Terminating instance Jun 11 23:12:27.558976 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-76b946c2-d0e7-4672-b859-2da3c872da2b tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.898s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:12:27.583167 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:27.622715 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Start destroying the instance on the hypervisor. {{(pid=98431) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}} Jun 11 23:12:27.644098 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:27.647009 np0000002687 nova-compute[98431]: INFO nova.scheduler.client.report [None req-76b946c2-d0e7-4672-b859-2da3c872da2b tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Deleted allocations for instance 14699717-b93f-4e67-b841-c67de8fff8d4 Jun 11 23:12:27.652046 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:27.689185 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:27.708116 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:27.731613 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:27.857673 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:27.941090 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:28.021037 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-c8e78479-330c-4647-b641-17a40f3dc4cd tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 8641b14d-785b-44b0-ad6d-bb537cbee5c7] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:12:28.048993 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:28.101167 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:28.122731 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:28.129115 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-fbb0bdc0-67a2-4a32-a5b1-ea333d9f3d11 req-38b43bdb-2cad-49f5-8913-ea3dcf18ce96 service nova] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Received event network-changed-2d6dd8b9-e3ff-462f-92cf-8c3a62bc27d1 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:12:28.129259 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-fbb0bdc0-67a2-4a32-a5b1-ea333d9f3d11 req-38b43bdb-2cad-49f5-8913-ea3dcf18ce96 service nova] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Refreshing instance network info cache due to event network-changed-2d6dd8b9-e3ff-462f-92cf-8c3a62bc27d1. {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 11 23:12:28.129474 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-fbb0bdc0-67a2-4a32-a5b1-ea333d9f3d11 req-38b43bdb-2cad-49f5-8913-ea3dcf18ce96 service nova] Acquiring lock "refresh_cache-cb63f66c-b69e-42b0-805c-be6fe9b3aee3" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 11 23:12:28.161998 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:28.168645 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:12:28.190021 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:28.216186 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-d06c583a-2f53-46b1-8361-1433a1d6fe7a req-4bae97b0-1b5f-4577-a2f1-cdf65c8cb222 service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Received event network-vif-unplugged-7808ce0e-ec36-4dfa-84d5-0eb1ce542139 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:12:28.216444 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-d06c583a-2f53-46b1-8361-1433a1d6fe7a req-4bae97b0-1b5f-4577-a2f1-cdf65c8cb222 service nova] Acquiring lock "49a042ba-28ba-4401-9bdf-92f96da8f80e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:12:28.217336 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-d06c583a-2f53-46b1-8361-1433a1d6fe7a req-4bae97b0-1b5f-4577-a2f1-cdf65c8cb222 service nova] Lock "49a042ba-28ba-4401-9bdf-92f96da8f80e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:12:28.217586 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-d06c583a-2f53-46b1-8361-1433a1d6fe7a req-4bae97b0-1b5f-4577-a2f1-cdf65c8cb222 service nova] Lock "49a042ba-28ba-4401-9bdf-92f96da8f80e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:12:28.217969 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-d06c583a-2f53-46b1-8361-1433a1d6fe7a req-4bae97b0-1b5f-4577-a2f1-cdf65c8cb222 service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] No waiting events found dispatching network-vif-unplugged-7808ce0e-ec36-4dfa-84d5-0eb1ce542139 {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:12:28.217969 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-d06c583a-2f53-46b1-8361-1433a1d6fe7a req-4bae97b0-1b5f-4577-a2f1-cdf65c8cb222 service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Received event network-vif-unplugged-7808ce0e-ec36-4dfa-84d5-0eb1ce542139 for instance with task_state deleting. {{(pid=98431) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 11 23:12:28.237690 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:28.276695 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-8b6d9da6-6e35-402c-9b0c-3e59164eadfc tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Acquiring lock "7609742e-a3a2-4be2-ba02-227efb2101e1" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:12:28.277410 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-8b6d9da6-6e35-402c-9b0c-3e59164eadfc tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Lock "7609742e-a3a2-4be2-ba02-227efb2101e1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:12:28.343864 np0000002687 nova-compute[98431]: DEBUG nova.utils [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Queued Task(fn=>, remaining_delay=14.99965761899989 future=) {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:12:28.351463 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [-] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Instance destroyed successfully. Jun 11 23:12:28.351463 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Lazy-loading 'resources' on Instance uuid 49a042ba-28ba-4401-9bdf-92f96da8f80e {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:12:28.458052 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] Updating instance_info_cache with network_info: [{"id": "283962f2-faaf-4d85-8eda-9b77b55a5b0c", "address": "fa:16:3e:4b:26:95", "network": {"id": "17593db3-c22d-4354-ab29-933b1c6a5c3a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1094286565-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "81fd45f475a04e5c8e9bd9deb7ad4c1e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap283962f2-fa", "ovs_interfaceid": "283962f2-faaf-4d85-8eda-9b77b55a5b0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:12:28.531375 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-c8e78479-330c-4647-b641-17a40f3dc4cd tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 8641b14d-785b-44b0-ad6d-bb537cbee5c7] instance snapshotting Jun 11 23:12:28.609973 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-81ada886-9677-4937-8d85-7aa77fe777e5 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:12:28.677018 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-76b946c2-d0e7-4672-b859-2da3c872da2b tempest-TestMultiAttachVolumeSwap-329912157 tempest-TestMultiAttachVolumeSwap-329912157-project-member] Lock "14699717-b93f-4e67-b841-c67de8fff8d4" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 9.481s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:12:28.690228 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-c8e78479-330c-4647-b641-17a40f3dc4cd tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 8641b14d-785b-44b0-ad6d-bb537cbee5c7] Beginning live snapshot process Jun 11 23:12:28.785165 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-8b6d9da6-6e35-402c-9b0c-3e59164eadfc tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Lazy-loading 'flavor' on Instance uuid 7609742e-a3a2-4be2-ba02-227efb2101e1 {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:12:28.815949 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-81ada886-9677-4937-8d85-7aa77fe777e5 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Updating instance_info_cache with network_info: [{"id": "2d6dd8b9-e3ff-462f-92cf-8c3a62bc27d1", "address": "fa:16:3e:b5:6f:fd", "network": {"id": "b1a1d33f-f9b6-48cf-86a1-0260d53f3bb0", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1779972098-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2d62cddce233457caf7eb43be819e513", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d6dd8b9-e3", "ovs_interfaceid": "2d6dd8b9-e3ff-462f-92cf-8c3a62bc27d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:12:28.855714 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-11T23:10:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-55083950',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='tempest-device-tagging-server-55083950',id=9,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLYbs7b2G1by6R+g1Ak7OKaDEL6OFRfafy/x8MG8Yw4C/HTCI/qxvrM+UbOFbanu5A5mHNVFjkvtwtnsinV4q+nEVUROe2gWmd2XwuNmh27iXsdrupk64B9jYKvtsxBMlg==',key_name='tempest-keypair-900197797',keypairs=,launch_index=0,launched_at=2026-06-11T23:11:34Z,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='57813123648a4335a97e8fc5c245cc73',ramdisk_id='',reservation_id='r-qvvw2lad',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1898457247',owner_user_name='tempest-TaggedBootDevicesTest-1898457247-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-11T23:11:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c853441cf4f34e4d9cd6821201efc91a',uuid=49a042ba-28ba-4401-9bdf-92f96da8f80e,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7808ce0e-ec36-4dfa-84d5-0eb1ce542139", "address": "fa:16:3e:e8:a7:df", "network": {"id": "ef5cc6c6-1b8e-4a88-bf58-ad07356064fc", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1332694516-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57813123648a4335a97e8fc5c245cc73", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7808ce0e-ec", "ovs_interfaceid": "7808ce0e-ec36-4dfa-84d5-0eb1ce542139", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 11 23:12:28.856454 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Converting VIF {"id": "7808ce0e-ec36-4dfa-84d5-0eb1ce542139", "address": "fa:16:3e:e8:a7:df", "network": {"id": "ef5cc6c6-1b8e-4a88-bf58-ad07356064fc", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1332694516-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57813123648a4335a97e8fc5c245cc73", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7808ce0e-ec", "ovs_interfaceid": "7808ce0e-ec36-4dfa-84d5-0eb1ce542139", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:12:28.857767 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e8:a7:df,bridge_name='br-int',has_traffic_filtering=True,id=7808ce0e-ec36-4dfa-84d5-0eb1ce542139,network=Network(ef5cc6c6-1b8e-4a88-bf58-ad07356064fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7808ce0e-ec') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:12:28.860154 np0000002687 nova-compute[98431]: DEBUG os_vif [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:a7:df,bridge_name='br-int',has_traffic_filtering=True,id=7808ce0e-ec36-4dfa-84d5-0eb1ce542139,network=Network(ef5cc6c6-1b8e-4a88-bf58-ad07356064fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7808ce0e-ec') {{(pid=98431) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 11 23:12:28.864218 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:28.864218 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7808ce0e-ec, bridge=br-int, if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:12:28.866423 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:12:28.903790 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:28.905175 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:28.905175 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b0c6f5fa-4b7d-4884-95fa-d118bb4986b7) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:12:28.905840 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:28.906706 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:12:28.938768 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:28.941249 np0000002687 nova-compute[98431]: INFO os_vif [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:a7:df,bridge_name='br-int',has_traffic_filtering=True,id=7808ce0e-ec36-4dfa-84d5-0eb1ce542139,network=Network(ef5cc6c6-1b8e-4a88-bf58-ad07356064fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7808ce0e-ec') Jun 11 23:12:28.942106 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-11T23:10:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-55083950',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='tempest-device-tagging-server-55083950',id=9,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLYbs7b2G1by6R+g1Ak7OKaDEL6OFRfafy/x8MG8Yw4C/HTCI/qxvrM+UbOFbanu5A5mHNVFjkvtwtnsinV4q+nEVUROe2gWmd2XwuNmh27iXsdrupk64B9jYKvtsxBMlg==',key_name='tempest-keypair-900197797',keypairs=,launch_index=0,launched_at=2026-06-11T23:11:34Z,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='57813123648a4335a97e8fc5c245cc73',ramdisk_id='',reservation_id='r-qvvw2lad',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1898457247',owner_user_name='tempest-TaggedBootDevicesTest-1898457247-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-11T23:11:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c853441cf4f34e4d9cd6821201efc91a',uuid=49a042ba-28ba-4401-9bdf-92f96da8f80e,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7051cdff-8b40-42d6-9d8a-9b7748621f1f", "address": "fa:16:3e:9f:58:c8", "network": {"id": "b4ad3a49-46fc-4f87-83ac-2f820e779189", "bridge": "br-int", "label": "tempest-device-tagging-net1-1763764299", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.184", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57813123648a4335a97e8fc5c245cc73", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7051cdff-8b", "ovs_interfaceid": "7051cdff-8b40-42d6-9d8a-9b7748621f1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98431) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 11 23:12:28.942318 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Converting VIF {"id": "7051cdff-8b40-42d6-9d8a-9b7748621f1f", "address": "fa:16:3e:9f:58:c8", "network": {"id": "b4ad3a49-46fc-4f87-83ac-2f820e779189", "bridge": "br-int", "label": "tempest-device-tagging-net1-1763764299", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.184", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57813123648a4335a97e8fc5c245cc73", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7051cdff-8b", "ovs_interfaceid": "7051cdff-8b40-42d6-9d8a-9b7748621f1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:12:28.943367 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:58:c8,bridge_name='br-int',has_traffic_filtering=True,id=7051cdff-8b40-42d6-9d8a-9b7748621f1f,network=Network(b4ad3a49-46fc-4f87-83ac-2f820e779189),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7051cdff-8b') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:12:28.943723 np0000002687 nova-compute[98431]: DEBUG os_vif [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:58:c8,bridge_name='br-int',has_traffic_filtering=True,id=7051cdff-8b40-42d6-9d8a-9b7748621f1f,network=Network(b4ad3a49-46fc-4f87-83ac-2f820e779189),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7051cdff-8b') {{(pid=98431) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 11 23:12:28.944773 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:28.945159 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7051cdff-8b, bridge=br-int, if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:12:28.946508 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:28.947568 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:12:28.962453 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Releasing lock "refresh_cache-64d7833a-82e8-43e9-83ed-2507197b69bf" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 11 23:12:28.962761 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] Instance network_info: |[{"id": "283962f2-faaf-4d85-8eda-9b77b55a5b0c", "address": "fa:16:3e:4b:26:95", "network": {"id": "17593db3-c22d-4354-ab29-933b1c6a5c3a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1094286565-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "81fd45f475a04e5c8e9bd9deb7ad4c1e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap283962f2-fa", "ovs_interfaceid": "283962f2-faaf-4d85-8eda-9b77b55a5b0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98431) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 11 23:12:28.964774 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] Start _get_guest_xml network_info=[{"id": "283962f2-faaf-4d85-8eda-9b77b55a5b0c", "address": "fa:16:3e:4b:26:95", "network": {"id": "17593db3-c22d-4354-ab29-933b1c6a5c3a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1094286565-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "81fd45f475a04e5c8e9bd9deb7ad4c1e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap283962f2-fa", "ovs_interfaceid": "283962f2-faaf-4d85-8eda-9b77b55a5b0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-11T23:08:20Z,direct_url=,disk_format='qcow2',id=f30640f8-7aca-4300-a085-4706a5209a79,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ce012f9fabdb4ee5a73e212437f59d97',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-11T23:08:23Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'image_id': 'f30640f8-7aca-4300-a085-4706a5209a79'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98431) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 11 23:12:28.967372 np0000002687 nova-compute[98431]: WARNING nova.virt.libvirt.driver [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 11 23:12:28.968981 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='f30640f8-7aca-4300-a085-4706a5209a79', instance_meta=NovaInstanceMeta(name='multiattach-server-0', uuid='64d7833a-82e8-43e9-83ed-2507197b69bf'), owner=OwnerMeta(userid='c17e84202f404c3c8e73292bb59d7b27', username='tempest-AttachVolumeMultiAttachTest-1514006700-project-member', projectid='81fd45f475a04e5c8e9bd9deb7ad4c1e', projectname='tempest-AttachVolumeMultiAttachTest-1514006700'), image=ImageMeta(id='f30640f8-7aca-4300-a085-4706a5209a79', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "283962f2-faaf-4d85-8eda-9b77b55a5b0c", "address": "fa:16:3e:4b:26:95", "network": {"id": "17593db3-c22d-4354-ab29-933b1c6a5c3a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1094286565-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "81fd45f475a04e5c8e9bd9deb7ad4c1e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap283962f2-fa", "ovs_interfaceid": "283962f2-faaf-4d85-8eda-9b77b55a5b0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1781219548.968475) {{(pid=98431) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 11 23:12:28.972338 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Searching host: 'np0000002687' for CPU controller through CGroups V1... {{(pid=98431) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 11 23:12:28.972665 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:28.974308 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] CPU controller missing on host. {{(pid=98431) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 11 23:12:28.975913 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:28.976524 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f7ca9608-f29e-4463-b22f-de0a6317ee43) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:12:28.978051 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Searching host: 'np0000002687' for CPU controller through CGroups V2... {{(pid=98431) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 11 23:12:28.979181 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:12:28.979701 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] CPU controller found on host. {{(pid=98431) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 11 23:12:28.981093 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98431) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 11 23:12:28.981592 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-11T23:08:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-11T23:08:20Z,direct_url=,disk_format='qcow2',id=f30640f8-7aca-4300-a085-4706a5209a79,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ce012f9fabdb4ee5a73e212437f59d97',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-11T23:08:23Z,virtual_size=,visibility=), allow threads: True {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 11 23:12:28.981990 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Flavor limits 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 11 23:12:28.981990 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Image limits 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 11 23:12:28.981990 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Flavor pref 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 11 23:12:28.982157 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Image pref 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 11 23:12:28.982212 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 11 23:12:28.982449 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 11 23:12:28.982609 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98431) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 11 23:12:28.982757 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Got 1 possible topologies {{(pid=98431) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 11 23:12:28.983484 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 11 23:12:28.983703 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 11 23:12:29.004157 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-11T23:12:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='multiattach-server-0',id=15,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHngWA9S/0M7yAiCaKN7wJ0iqGBq18p6o1N91kfGTes8iMQtxmsCxH/Iqg51e2HEWFsjD10S17Kahb+vCzu07nJJQGe3fNUonThwHNf0exiWq4jZuXjSZtHJPO0dbow48A==',key_name='tempest-keypair-1974490716',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='81fd45f475a04e5c8e9bd9deb7ad4c1e',ramdisk_id='',reservation_id='r-5y4c4ios',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1514006700',owner_user_name='tempest-AttachVolumeMultiAttachTest-1514006700-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-11T23:12:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c17e84202f404c3c8e73292bb59d7b27',uuid=64d7833a-82e8-43e9-83ed-2507197b69bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "283962f2-faaf-4d85-8eda-9b77b55a5b0c", "address": "fa:16:3e:4b:26:95", "network": {"id": "17593db3-c22d-4354-ab29-933b1c6a5c3a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1094286565-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "81fd45f475a04e5c8e9bd9deb7ad4c1e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap283962f2-fa", "ovs_interfaceid": "283962f2-faaf-4d85-8eda-9b77b55a5b0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98431) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 11 23:12:29.004399 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Converting VIF {"id": "283962f2-faaf-4d85-8eda-9b77b55a5b0c", "address": "fa:16:3e:4b:26:95", "network": {"id": "17593db3-c22d-4354-ab29-933b1c6a5c3a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1094286565-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "81fd45f475a04e5c8e9bd9deb7ad4c1e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap283962f2-fa", "ovs_interfaceid": "283962f2-faaf-4d85-8eda-9b77b55a5b0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:12:29.004817 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:26:95,bridge_name='br-int',has_traffic_filtering=True,id=283962f2-faaf-4d85-8eda-9b77b55a5b0c,network=Network(17593db3-c22d-4354-ab29-933b1c6a5c3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap283962f2-fa') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:12:29.005606 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lazy-loading 'pci_devices' on Instance uuid 64d7833a-82e8-43e9-83ed-2507197b69bf {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:12:29.006819 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:29.009578 np0000002687 nova-compute[98431]: INFO os_vif [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:58:c8,bridge_name='br-int',has_traffic_filtering=True,id=7051cdff-8b40-42d6-9d8a-9b7748621f1f,network=Network(b4ad3a49-46fc-4f87-83ac-2f820e779189),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7051cdff-8b') Jun 11 23:12:29.010273 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-11T23:10:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-55083950',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='tempest-device-tagging-server-55083950',id=9,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLYbs7b2G1by6R+g1Ak7OKaDEL6OFRfafy/x8MG8Yw4C/HTCI/qxvrM+UbOFbanu5A5mHNVFjkvtwtnsinV4q+nEVUROe2gWmd2XwuNmh27iXsdrupk64B9jYKvtsxBMlg==',key_name='tempest-keypair-900197797',keypairs=,launch_index=0,launched_at=2026-06-11T23:11:34Z,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='57813123648a4335a97e8fc5c245cc73',ramdisk_id='',reservation_id='r-qvvw2lad',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1898457247',owner_user_name='tempest-TaggedBootDevicesTest-1898457247-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-11T23:11:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c853441cf4f34e4d9cd6821201efc91a',uuid=49a042ba-28ba-4401-9bdf-92f96da8f80e,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "609ed1b7-9ea3-4ae3-8c37-f0a952a45507", "address": "fa:16:3e:c3:0b:6b", "network": {"id": "b4ad3a49-46fc-4f87-83ac-2f820e779189", "bridge": "br-int", "label": "tempest-device-tagging-net1-1763764299", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.189", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57813123648a4335a97e8fc5c245cc73", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap609ed1b7-9e", "ovs_interfaceid": "609ed1b7-9ea3-4ae3-8c37-f0a952a45507", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98431) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 11 23:12:29.010470 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Converting VIF {"id": "609ed1b7-9ea3-4ae3-8c37-f0a952a45507", "address": "fa:16:3e:c3:0b:6b", "network": {"id": "b4ad3a49-46fc-4f87-83ac-2f820e779189", "bridge": "br-int", "label": "tempest-device-tagging-net1-1763764299", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.189", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57813123648a4335a97e8fc5c245cc73", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap609ed1b7-9e", "ovs_interfaceid": "609ed1b7-9ea3-4ae3-8c37-f0a952a45507", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:12:29.010969 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:0b:6b,bridge_name='br-int',has_traffic_filtering=True,id=609ed1b7-9ea3-4ae3-8c37-f0a952a45507,network=Network(b4ad3a49-46fc-4f87-83ac-2f820e779189),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap609ed1b7-9e') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:12:29.011149 np0000002687 nova-compute[98431]: DEBUG os_vif [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:0b:6b,bridge_name='br-int',has_traffic_filtering=True,id=609ed1b7-9ea3-4ae3-8c37-f0a952a45507,network=Network(b4ad3a49-46fc-4f87-83ac-2f820e779189),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap609ed1b7-9e') {{(pid=98431) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 11 23:12:29.013133 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:29.013371 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap609ed1b7-9e, bridge=br-int, if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:12:29.015254 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:29.016982 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:12:29.038875 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:29.041008 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:29.041158 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5b673243-1d64-457a-85fe-15561dbcd8cb) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:12:29.042074 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:29.042974 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:12:29.071049 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:29.073953 np0000002687 nova-compute[98431]: INFO os_vif [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:0b:6b,bridge_name='br-int',has_traffic_filtering=True,id=609ed1b7-9ea3-4ae3-8c37-f0a952a45507,network=Network(b4ad3a49-46fc-4f87-83ac-2f820e779189),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap609ed1b7-9e') Jun 11 23:12:29.074494 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-11T23:10:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-55083950',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='tempest-device-tagging-server-55083950',id=9,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLYbs7b2G1by6R+g1Ak7OKaDEL6OFRfafy/x8MG8Yw4C/HTCI/qxvrM+UbOFbanu5A5mHNVFjkvtwtnsinV4q+nEVUROe2gWmd2XwuNmh27iXsdrupk64B9jYKvtsxBMlg==',key_name='tempest-keypair-900197797',keypairs=,launch_index=0,launched_at=2026-06-11T23:11:34Z,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='57813123648a4335a97e8fc5c245cc73',ramdisk_id='',reservation_id='r-qvvw2lad',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1898457247',owner_user_name='tempest-TaggedBootDevicesTest-1898457247-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-11T23:11:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c853441cf4f34e4d9cd6821201efc91a',uuid=49a042ba-28ba-4401-9bdf-92f96da8f80e,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b54ddd43-d4cb-4d4a-840e-895e75419e25", "address": "fa:16:3e:b9:2e:2c", "network": {"id": "b4ad3a49-46fc-4f87-83ac-2f820e779189", "bridge": "br-int", "label": "tempest-device-tagging-net1-1763764299", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57813123648a4335a97e8fc5c245cc73", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb54ddd43-d4", "ovs_interfaceid": "b54ddd43-d4cb-4d4a-840e-895e75419e25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 11 23:12:29.074659 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Converting VIF {"id": "b54ddd43-d4cb-4d4a-840e-895e75419e25", "address": "fa:16:3e:b9:2e:2c", "network": {"id": "b4ad3a49-46fc-4f87-83ac-2f820e779189", "bridge": "br-int", "label": "tempest-device-tagging-net1-1763764299", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57813123648a4335a97e8fc5c245cc73", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb54ddd43-d4", "ovs_interfaceid": "b54ddd43-d4cb-4d4a-840e-895e75419e25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:12:29.075374 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:2e:2c,bridge_name='br-int',has_traffic_filtering=True,id=b54ddd43-d4cb-4d4a-840e-895e75419e25,network=Network(b4ad3a49-46fc-4f87-83ac-2f820e779189),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb54ddd43-d4') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:12:29.075724 np0000002687 nova-compute[98431]: DEBUG os_vif [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:2e:2c,bridge_name='br-int',has_traffic_filtering=True,id=b54ddd43-d4cb-4d4a-840e-895e75419e25,network=Network(b4ad3a49-46fc-4f87-83ac-2f820e779189),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb54ddd43-d4') {{(pid=98431) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 11 23:12:29.078851 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:29.079616 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb54ddd43-d4, bridge=br-int, if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:12:29.080174 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:29.081214 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:12:29.098820 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:29.100936 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:29.101816 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f8e72589-46ab-491b-8a31-d3c42522c31d) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:12:29.102833 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:29.103503 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:12:29.121111 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:29.126821 np0000002687 nova-compute[98431]: INFO os_vif [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:2e:2c,bridge_name='br-int',has_traffic_filtering=True,id=b54ddd43-d4cb-4d4a-840e-895e75419e25,network=Network(b4ad3a49-46fc-4f87-83ac-2f820e779189),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb54ddd43-d4') Jun 11 23:12:29.128296 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-11T23:10:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-55083950',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='tempest-device-tagging-server-55083950',id=9,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLYbs7b2G1by6R+g1Ak7OKaDEL6OFRfafy/x8MG8Yw4C/HTCI/qxvrM+UbOFbanu5A5mHNVFjkvtwtnsinV4q+nEVUROe2gWmd2XwuNmh27iXsdrupk64B9jYKvtsxBMlg==',key_name='tempest-keypair-900197797',keypairs=,launch_index=0,launched_at=2026-06-11T23:11:34Z,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='57813123648a4335a97e8fc5c245cc73',ramdisk_id='',reservation_id='r-qvvw2lad',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1898457247',owner_user_name='tempest-TaggedBootDevicesTest-1898457247-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-11T23:11:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c853441cf4f34e4d9cd6821201efc91a',uuid=49a042ba-28ba-4401-9bdf-92f96da8f80e,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "77424d75-6e25-4791-a44d-495051f7e89f", "address": "fa:16:3e:a0:a2:82", "network": {"id": "b4ad3a49-46fc-4f87-83ac-2f820e779189", "bridge": "br-int", "label": "tempest-device-tagging-net1-1763764299", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57813123648a4335a97e8fc5c245cc73", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap77424d75-6e", "ovs_interfaceid": "77424d75-6e25-4791-a44d-495051f7e89f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 11 23:12:29.128296 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Converting VIF {"id": "77424d75-6e25-4791-a44d-495051f7e89f", "address": "fa:16:3e:a0:a2:82", "network": {"id": "b4ad3a49-46fc-4f87-83ac-2f820e779189", "bridge": "br-int", "label": "tempest-device-tagging-net1-1763764299", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57813123648a4335a97e8fc5c245cc73", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap77424d75-6e", "ovs_interfaceid": "77424d75-6e25-4791-a44d-495051f7e89f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:12:29.128815 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:a2:82,bridge_name='br-int',has_traffic_filtering=True,id=77424d75-6e25-4791-a44d-495051f7e89f,network=Network(b4ad3a49-46fc-4f87-83ac-2f820e779189),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77424d75-6e') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:12:29.129371 np0000002687 nova-compute[98431]: DEBUG os_vif [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:a2:82,bridge_name='br-int',has_traffic_filtering=True,id=77424d75-6e25-4791-a44d-495051f7e89f,network=Network(b4ad3a49-46fc-4f87-83ac-2f820e779189),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77424d75-6e') {{(pid=98431) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 11 23:12:29.131353 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:29.131353 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap77424d75-6e, bridge=br-int, if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:12:29.132901 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:29.133759 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:12:29.148502 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:29.149171 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:29.149433 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a2611f05-da5e-42ca-80f3-0e6625818de3) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:12:29.150023 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:29.150573 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:12:29.164433 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:29.168911 np0000002687 nova-compute[98431]: INFO os_vif [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:a2:82,bridge_name='br-int',has_traffic_filtering=True,id=77424d75-6e25-4791-a44d-495051f7e89f,network=Network(b4ad3a49-46fc-4f87-83ac-2f820e779189),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77424d75-6e') Jun 11 23:12:29.170196 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-11T23:10:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-55083950',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='tempest-device-tagging-server-55083950',id=9,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLYbs7b2G1by6R+g1Ak7OKaDEL6OFRfafy/x8MG8Yw4C/HTCI/qxvrM+UbOFbanu5A5mHNVFjkvtwtnsinV4q+nEVUROe2gWmd2XwuNmh27iXsdrupk64B9jYKvtsxBMlg==',key_name='tempest-keypair-900197797',keypairs=,launch_index=0,launched_at=2026-06-11T23:11:34Z,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='57813123648a4335a97e8fc5c245cc73',ramdisk_id='',reservation_id='r-qvvw2lad',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1898457247',owner_user_name='tempest-TaggedBootDevicesTest-1898457247-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-11T23:11:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c853441cf4f34e4d9cd6821201efc91a',uuid=49a042ba-28ba-4401-9bdf-92f96da8f80e,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0263e39d-c835-4cf1-b333-265608e81a93", "address": "fa:16:3e:50:0f:6b", "network": {"id": "25259518-16fe-4690-8216-636e994936ba", "bridge": "br-int", "label": "tempest-device-tagging-net2-736260586", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57813123648a4335a97e8fc5c245cc73", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0263e39d-c8", "ovs_interfaceid": "0263e39d-c835-4cf1-b333-265608e81a93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 11 23:12:29.170621 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Converting VIF {"id": "0263e39d-c835-4cf1-b333-265608e81a93", "address": "fa:16:3e:50:0f:6b", "network": {"id": "25259518-16fe-4690-8216-636e994936ba", "bridge": "br-int", "label": "tempest-device-tagging-net2-736260586", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57813123648a4335a97e8fc5c245cc73", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0263e39d-c8", "ovs_interfaceid": "0263e39d-c835-4cf1-b333-265608e81a93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:12:29.171287 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:0f:6b,bridge_name='br-int',has_traffic_filtering=True,id=0263e39d-c835-4cf1-b333-265608e81a93,network=Network(25259518-16fe-4690-8216-636e994936ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0263e39d-c8') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:12:29.171690 np0000002687 nova-compute[98431]: DEBUG os_vif [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:0f:6b,bridge_name='br-int',has_traffic_filtering=True,id=0263e39d-c835-4cf1-b333-265608e81a93,network=Network(25259518-16fe-4690-8216-636e994936ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0263e39d-c8') {{(pid=98431) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 11 23:12:29.172695 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:29.173035 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0263e39d-c8, bridge=br-int, if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:12:29.174376 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:29.178837 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:12:29.183961 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:29.190536 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:29.190770 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=abdf5859-2564-489d-8496-17620b3c2ed0) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:12:29.191497 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:29.192108 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:12:29.203738 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:29.208462 np0000002687 nova-compute[98431]: INFO os_vif [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:0f:6b,bridge_name='br-int',has_traffic_filtering=True,id=0263e39d-c835-4cf1-b333-265608e81a93,network=Network(25259518-16fe-4690-8216-636e994936ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0263e39d-c8') Jun 11 23:12:29.209319 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-11T23:10:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-55083950',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='tempest-device-tagging-server-55083950',id=9,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLYbs7b2G1by6R+g1Ak7OKaDEL6OFRfafy/x8MG8Yw4C/HTCI/qxvrM+UbOFbanu5A5mHNVFjkvtwtnsinV4q+nEVUROe2gWmd2XwuNmh27iXsdrupk64B9jYKvtsxBMlg==',key_name='tempest-keypair-900197797',keypairs=,launch_index=0,launched_at=2026-06-11T23:11:34Z,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='57813123648a4335a97e8fc5c245cc73',ramdisk_id='',reservation_id='r-qvvw2lad',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1898457247',owner_user_name='tempest-TaggedBootDevicesTest-1898457247-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-11T23:11:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c853441cf4f34e4d9cd6821201efc91a',uuid=49a042ba-28ba-4401-9bdf-92f96da8f80e,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "09135c79-b0df-40af-b05b-2e171390f37f", "address": "fa:16:3e:c4:56:b3", "network": {"id": "25259518-16fe-4690-8216-636e994936ba", "bridge": "br-int", "label": "tempest-device-tagging-net2-736260586", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57813123648a4335a97e8fc5c245cc73", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap09135c79-b0", "ovs_interfaceid": "09135c79-b0df-40af-b05b-2e171390f37f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 11 23:12:29.211824 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Converting VIF {"id": "09135c79-b0df-40af-b05b-2e171390f37f", "address": "fa:16:3e:c4:56:b3", "network": {"id": "25259518-16fe-4690-8216-636e994936ba", "bridge": "br-int", "label": "tempest-device-tagging-net2-736260586", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57813123648a4335a97e8fc5c245cc73", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap09135c79-b0", "ovs_interfaceid": "09135c79-b0df-40af-b05b-2e171390f37f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:12:29.211824 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:56:b3,bridge_name='br-int',has_traffic_filtering=True,id=09135c79-b0df-40af-b05b-2e171390f37f,network=Network(25259518-16fe-4690-8216-636e994936ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09135c79-b0') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:12:29.211824 np0000002687 nova-compute[98431]: DEBUG os_vif [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:56:b3,bridge_name='br-int',has_traffic_filtering=True,id=09135c79-b0df-40af-b05b-2e171390f37f,network=Network(25259518-16fe-4690-8216-636e994936ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09135c79-b0') {{(pid=98431) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 11 23:12:29.213919 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:29.214097 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap09135c79-b0, bridge=br-int, if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:12:29.215718 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:29.216501 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:12:29.217543 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:29.218028 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e72af38d-2dae-4c5c-8cde-ea0c52e0076b) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:12:29.218688 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:29.219599 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:12:29.221186 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:29.226447 np0000002687 nova-compute[98431]: INFO os_vif [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:56:b3,bridge_name='br-int',has_traffic_filtering=True,id=09135c79-b0df-40af-b05b-2e171390f37f,network=Network(25259518-16fe-4690-8216-636e994936ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09135c79-b0') Jun 11 23:12:29.228235 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] calling os-brick to detach iSCSI Volume {{(pid=98431) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jun 11 23:12:29.229112 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff', 'iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0001b9c6-a8d0-4709-88d4-b91656096dff', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, None), 'kwargs': {'force': True}}" {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 11 23:12:29.229343 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 11 23:12:29.230038 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 11 23:12:29.230773 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff', 'iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0001b9c6-a8d0-4709-88d4-b91656096dff', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 11 23:12:29.231062 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff', 0)] {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 11 23:12:29.275916 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:12:29.275916 np0000002687 nova-compute[98431]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:12:29.275916 np0000002687 nova-compute[98431]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:12:29.275916 np0000002687 nova-compute[98431]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:12:29.275916 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:12:29.275916 np0000002687 nova-compute[98431]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060 (non-flash) Jun 11 23:12:29.275916 np0000002687 nova-compute[98431]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060 (non-flash) Jun 11 23:12:29.275916 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:12:29.275916 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:12:29.275916 np0000002687 nova-compute[98431]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:12:29.275916 np0000002687 nova-compute[98431]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:12:29.275916 np0000002687 nova-compute[98431]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:12:29.275916 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:12:29.276501 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:12:29.276501 np0000002687 nova-compute[98431]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:12:29.276501 np0000002687 nova-compute[98431]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff (non-flash) Jun 11 23:12:29.276501 np0000002687 nova-compute[98431]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:12:29.276501 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:12:29.276501 np0000002687 nova-compute[98431]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060 (non-flash) Jun 11 23:12:29.276501 np0000002687 nova-compute[98431]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060 (non-flash) Jun 11 23:12:29.276501 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:12:29.276501 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:12:29.276501 np0000002687 nova-compute[98431]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:12:29.276501 np0000002687 nova-compute[98431]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:12:29.276501 np0000002687 nova-compute[98431]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:12:29.276501 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:12:29.276501 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c', '10'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff', '11'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff', '12'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea', '13'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea', '14'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060', '23'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060', '24'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9', '3'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9', '4'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9', '7'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9', '8'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c', '9')] {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 11 23:12:29.277211 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff', '11')] {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 11 23:12:29.278222 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff', '12')] {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 11 23:12:29.279333 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Resulting device map defaultdict(. at 0x7e1ea015e2a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff'): ({'sdh'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff'): ({'sdi'}, set())}) {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 11 23:12:29.280233 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Removing multipathed devices sdi, sdh {{(pid=98431) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 11 23:12:29.280904 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Flush multipath device 33000000048acda8e {{(pid=98431) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jun 11 23:12:29.317841 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98431) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 11 23:12:29.322866 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-81ada886-9677-4937-8d85-7aa77fe777e5 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Releasing lock "refresh_cache-cb63f66c-b69e-42b0-805c-be6fe9b3aee3" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 11 23:12:29.323520 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-81ada886-9677-4937-8d85-7aa77fe777e5 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Lazy-loading 'flavor' on Instance uuid cb63f66c-b69e-42b0-805c-be6fe9b3aee3 {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:12:29.325838 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-fbb0bdc0-67a2-4a32-a5b1-ea333d9f3d11 req-38b43bdb-2cad-49f5-8913-ea3dcf18ce96 service nova] Acquired lock "refresh_cache-cb63f66c-b69e-42b0-805c-be6fe9b3aee3" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 11 23:12:29.325992 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-fbb0bdc0-67a2-4a32-a5b1-ea333d9f3d11 req-38b43bdb-2cad-49f5-8913-ea3dcf18ce96 service nova] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Refreshing network info cache for port 2d6dd8b9-e3ff-462f-92cf-8c3a62bc27d1 {{(pid=98431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 11 23:12:29.371684 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98431) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 11 23:12:29.427738 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Checking to see if SCSI volumes sdi, sdh have been removed. {{(pid=98431) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 11 23:12:29.428103 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] SCSI volumes sdi, sdh have been removed. {{(pid=98431) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 11 23:12:29.430711 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Checking to see if device paths {'sdi', 'sdh'} are still under multipathd monitoring {{(pid=98431) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 11 23:12:29.444116 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Device paths {'sdi', 'sdh'} have been removed from multipathd monitoring. {{(pid=98431) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 11 23:12:29.444414 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff')] {{(pid=98431) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 11 23:12:29.459237 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:12:29.509121 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] End _get_guest_xml xml= Jun 11 23:12:29.509121 np0000002687 nova-compute[98431]: 64d7833a-82e8-43e9-83ed-2507197b69bf Jun 11 23:12:29.509121 np0000002687 nova-compute[98431]: instance-0000000f Jun 11 23:12:29.509121 np0000002687 nova-compute[98431]: 196608 Jun 11 23:12:29.509121 np0000002687 nova-compute[98431]: 1 Jun 11 23:12:29.509121 np0000002687 nova-compute[98431]: Jun 11 23:12:29.509121 np0000002687 nova-compute[98431]: Jun 11 23:12:29.509121 np0000002687 nova-compute[98431]: Jun 11 23:12:29.509121 np0000002687 nova-compute[98431]: multiattach-server-0 Jun 11 23:12:29.509121 np0000002687 nova-compute[98431]: 2026-06-11 23:12:28 Jun 11 23:12:29.509121 np0000002687 nova-compute[98431]: Jun 11 23:12:29.509121 np0000002687 nova-compute[98431]: 192 Jun 11 23:12:29.509121 np0000002687 nova-compute[98431]: 1 Jun 11 23:12:29.509121 np0000002687 nova-compute[98431]: 0 Jun 11 23:12:29.509121 np0000002687 nova-compute[98431]: 0 Jun 11 23:12:29.509121 np0000002687 nova-compute[98431]: 1 Jun 11 23:12:29.509121 np0000002687 nova-compute[98431]: Jun 11 23:12:29.509121 np0000002687 nova-compute[98431]: True Jun 11 23:12:29.509121 np0000002687 nova-compute[98431]: Jun 11 23:12:29.509121 np0000002687 nova-compute[98431]: Jun 11 23:12:29.509121 np0000002687 nova-compute[98431]: Jun 11 23:12:29.509121 np0000002687 nova-compute[98431]: bare Jun 11 23:12:29.509121 np0000002687 nova-compute[98431]: qcow2 Jun 11 23:12:29.509121 np0000002687 nova-compute[98431]: 1 Jun 11 23:12:29.509121 np0000002687 nova-compute[98431]: 0 Jun 11 23:12:29.509121 np0000002687 nova-compute[98431]: Jun 11 23:12:29.509121 np0000002687 nova-compute[98431]: virtio Jun 11 23:12:29.509121 np0000002687 nova-compute[98431]: Jun 11 23:12:29.509121 np0000002687 nova-compute[98431]: Jun 11 23:12:29.509121 np0000002687 nova-compute[98431]: Jun 11 23:12:29.509121 np0000002687 nova-compute[98431]: tempest-AttachVolumeMultiAttachTest-1514006700-project-member Jun 11 23:12:29.509121 np0000002687 nova-compute[98431]: tempest-AttachVolumeMultiAttachTest-1514006700 Jun 11 23:12:29.509121 np0000002687 nova-compute[98431]: Jun 11 23:12:29.509121 np0000002687 nova-compute[98431]: Jun 11 23:12:29.509121 np0000002687 nova-compute[98431]: Jun 11 23:12:29.509121 np0000002687 nova-compute[98431]: Jun 11 23:12:29.509121 np0000002687 nova-compute[98431]: Jun 11 23:12:29.509121 np0000002687 nova-compute[98431]: Jun 11 23:12:29.509121 np0000002687 nova-compute[98431]: Jun 11 23:12:29.509121 np0000002687 nova-compute[98431]: Jun 11 23:12:29.509121 np0000002687 nova-compute[98431]: Jun 11 23:12:29.509121 np0000002687 nova-compute[98431]: Jun 11 23:12:29.509121 np0000002687 nova-compute[98431]: Jun 11 23:12:29.509121 np0000002687 nova-compute[98431]: OpenStack Foundation Jun 11 23:12:29.509121 np0000002687 nova-compute[98431]: OpenStack Nova Jun 11 23:12:29.509121 np0000002687 nova-compute[98431]: 33.1.0 Jun 11 23:12:29.509121 np0000002687 nova-compute[98431]: 64d7833a-82e8-43e9-83ed-2507197b69bf Jun 11 23:12:29.509121 np0000002687 nova-compute[98431]: 64d7833a-82e8-43e9-83ed-2507197b69bf Jun 11 23:12:29.509121 np0000002687 nova-compute[98431]: Virtual Machine Jun 11 23:12:29.509121 np0000002687 nova-compute[98431]: Jun 11 23:12:29.509121 np0000002687 nova-compute[98431]: Jun 11 23:12:29.509121 np0000002687 nova-compute[98431]: Jun 11 23:12:29.509121 np0000002687 nova-compute[98431]: hvm Jun 11 23:12:29.509121 np0000002687 nova-compute[98431]: Jun 11 23:12:29.509121 np0000002687 nova-compute[98431]: Jun 11 23:12:29.509121 np0000002687 nova-compute[98431]: Jun 11 23:12:29.509121 np0000002687 nova-compute[98431]: Jun 11 23:12:29.509121 np0000002687 nova-compute[98431]: Jun 11 23:12:29.509121 np0000002687 nova-compute[98431]: Jun 11 23:12:29.509121 np0000002687 nova-compute[98431]: 128 Jun 11 23:12:29.509121 np0000002687 nova-compute[98431]: Jun 11 23:12:29.509121 np0000002687 nova-compute[98431]: Jun 11 23:12:29.509121 np0000002687 nova-compute[98431]: Jun 11 23:12:29.509121 np0000002687 nova-compute[98431]: 1 Jun 11 23:12:29.509121 np0000002687 nova-compute[98431]: Jun 11 23:12:29.509121 np0000002687 nova-compute[98431]: Jun 11 23:12:29.509121 np0000002687 nova-compute[98431]: Nehalem Jun 11 23:12:29.509121 np0000002687 nova-compute[98431]: Jun 11 23:12:29.509121 np0000002687 nova-compute[98431]: Jun 11 23:12:29.509121 np0000002687 nova-compute[98431]: Jun 11 23:12:29.509121 np0000002687 nova-compute[98431]: Jun 11 23:12:29.509121 np0000002687 nova-compute[98431]: Jun 11 23:12:29.509121 np0000002687 nova-compute[98431]: Jun 11 23:12:29.509121 np0000002687 nova-compute[98431]: Jun 11 23:12:29.509121 np0000002687 nova-compute[98431]: Jun 11 23:12:29.509121 np0000002687 nova-compute[98431]: Jun 11 23:12:29.509121 np0000002687 nova-compute[98431]: Jun 11 23:12:29.509121 np0000002687 nova-compute[98431]: Jun 11 23:12:29.509121 np0000002687 nova-compute[98431]: Jun 11 23:12:29.509121 np0000002687 nova-compute[98431]: Jun 11 23:12:29.509121 np0000002687 nova-compute[98431]: Jun 11 23:12:29.509121 np0000002687 nova-compute[98431]: Jun 11 23:12:29.509121 np0000002687 nova-compute[98431]: Jun 11 23:12:29.509121 np0000002687 nova-compute[98431]: Jun 11 23:12:29.509121 np0000002687 nova-compute[98431]: Jun 11 23:12:29.509121 np0000002687 nova-compute[98431]: Jun 11 23:12:29.509121 np0000002687 nova-compute[98431]: Jun 11 23:12:29.509121 np0000002687 nova-compute[98431]: Jun 11 23:12:29.509121 np0000002687 nova-compute[98431]: Jun 11 23:12:29.509121 np0000002687 nova-compute[98431]: Jun 11 23:12:29.509121 np0000002687 nova-compute[98431]: Jun 11 23:12:29.509121 np0000002687 nova-compute[98431]: Jun 11 23:12:29.509121 np0000002687 nova-compute[98431]: Jun 11 23:12:29.509121 np0000002687 nova-compute[98431]: /dev/urandom Jun 11 23:12:29.509121 np0000002687 nova-compute[98431]: Jun 11 23:12:29.509121 np0000002687 nova-compute[98431]: Jun 11 23:12:29.509121 np0000002687 nova-compute[98431]: Jun 11 23:12:29.509121 np0000002687 nova-compute[98431]: Jun 11 23:12:29.509121 np0000002687 nova-compute[98431]: Jun 11 23:12:29.509121 np0000002687 nova-compute[98431]: Jun 11 23:12:29.509121 np0000002687 nova-compute[98431]: Jun 11 23:12:29.509121 np0000002687 nova-compute[98431]: {{(pid=98431) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 11 23:12:29.512665 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] Preparing to wait for external event network-vif-plugged-283962f2-faaf-4d85-8eda-9b77b55a5b0c {{(pid=98431) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 11 23:12:29.512665 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Acquiring lock "64d7833a-82e8-43e9-83ed-2507197b69bf-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:12:29.512665 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "64d7833a-82e8-43e9-83ed-2507197b69bf-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:12:29.515931 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "64d7833a-82e8-43e9-83ed-2507197b69bf-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.003s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:12:29.515931 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-11T23:12:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='multiattach-server-0',id=15,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHngWA9S/0M7yAiCaKN7wJ0iqGBq18p6o1N91kfGTes8iMQtxmsCxH/Iqg51e2HEWFsjD10S17Kahb+vCzu07nJJQGe3fNUonThwHNf0exiWq4jZuXjSZtHJPO0dbow48A==',key_name='tempest-keypair-1974490716',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='81fd45f475a04e5c8e9bd9deb7ad4c1e',ramdisk_id='',reservation_id='r-5y4c4ios',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1514006700',owner_user_name='tempest-AttachVolumeMultiAttachTest-1514006700-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-11T23:12:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c17e84202f404c3c8e73292bb59d7b27',uuid=64d7833a-82e8-43e9-83ed-2507197b69bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "283962f2-faaf-4d85-8eda-9b77b55a5b0c", "address": "fa:16:3e:4b:26:95", "network": {"id": "17593db3-c22d-4354-ab29-933b1c6a5c3a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1094286565-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "81fd45f475a04e5c8e9bd9deb7ad4c1e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap283962f2-fa", "ovs_interfaceid": "283962f2-faaf-4d85-8eda-9b77b55a5b0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 11 23:12:29.515931 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Converting VIF {"id": "283962f2-faaf-4d85-8eda-9b77b55a5b0c", "address": "fa:16:3e:4b:26:95", "network": {"id": "17593db3-c22d-4354-ab29-933b1c6a5c3a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1094286565-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "81fd45f475a04e5c8e9bd9deb7ad4c1e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap283962f2-fa", "ovs_interfaceid": "283962f2-faaf-4d85-8eda-9b77b55a5b0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:12:29.516636 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:26:95,bridge_name='br-int',has_traffic_filtering=True,id=283962f2-faaf-4d85-8eda-9b77b55a5b0c,network=Network(17593db3-c22d-4354-ab29-933b1c6a5c3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap283962f2-fa') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:12:29.517157 np0000002687 nova-compute[98431]: DEBUG os_vif [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:26:95,bridge_name='br-int',has_traffic_filtering=True,id=283962f2-faaf-4d85-8eda-9b77b55a5b0c,network=Network(17593db3-c22d-4354-ab29-933b1c6a5c3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap283962f2-fa') {{(pid=98431) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 11 23:12:29.518068 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff, portal: 192.168.40.100,3260] Jun 11 23:12:29.518068 np0000002687 nova-compute[98431]: Logout of [sid: 11, target: iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff, portal: 192.168.40.100,3260] successful. Jun 11 23:12:29.518068 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:12:29.519109 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:29.519109 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:12:29.519219 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 11 23:12:29.520846 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:29.520846 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '898bb006-bc28-5fa5-9458-725eb2b86ae7', '_type': 'linux-noop'}}, row=False) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:12:29.522992 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:29.527541 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:12:29.527541 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:29.531910 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:29.532247 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap283962f2-fa, may_exist=True, interface_attrs={}) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:12:29.533313 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap283962f2-fa, col_values=(('qos', UUID('a030b47f-a990-4f87-b0d3-f98f066a1640')),), if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:12:29.533313 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap283962f2-fa, col_values=(('external_ids', {'iface-id': '283962f2-faaf-4d85-8eda-9b77b55a5b0c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4b:26:95', 'vm-uuid': '64d7833a-82e8-43e9-83ed-2507197b69bf'}),), if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:12:29.536568 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:29.538443 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:12:29.544822 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:29.545960 np0000002687 nova-compute[98431]: INFO os_vif [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:26:95,bridge_name='br-int',has_traffic_filtering=True,id=283962f2-faaf-4d85-8eda-9b77b55a5b0c,network=Network(17593db3-c22d-4354-ab29-933b1c6a5c3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap283962f2-fa') Jun 11 23:12:29.564607 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:12:29.580705 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:12:29.624531 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff, portal: 192.168.50.100,3260] Jun 11 23:12:29.624531 np0000002687 nova-compute[98431]: Logout of [sid: 12, target: iqn.2023-03.storpool.com:os--volume-0001b9c6-a8d0-4709-88d4-b91656096dff, portal: 192.168.50.100,3260] successful. Jun 11 23:12:29.624531 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:12:29.651124 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:12:29.651431 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.421s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 11 23:12:29.651678 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] <== disconnect_volume: return (421ms) None {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 11 23:12:29.651818 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Disconnected iSCSI Volume {{(pid=98431) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jun 11 23:12:29.655390 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] calling os-brick to detach iSCSI Volume {{(pid=98431) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jun 11 23:12:29.656665 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c', 'iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '23264eac-8f91-4074-b3b0-51b6cb738b7c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, None), 'kwargs': {'force': True}}" {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 11 23:12:29.657570 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 11 23:12:29.657570 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 11 23:12:29.658063 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c', 'iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '23264eac-8f91-4074-b3b0-51b6cb738b7c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 11 23:12:29.658250 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c', 0)] {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 11 23:12:29.700509 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:12:29.700509 np0000002687 nova-compute[98431]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:12:29.700509 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:12:29.700509 np0000002687 nova-compute[98431]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060 (non-flash) Jun 11 23:12:29.700509 np0000002687 nova-compute[98431]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060 (non-flash) Jun 11 23:12:29.700509 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:12:29.700509 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:12:29.700509 np0000002687 nova-compute[98431]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:12:29.700509 np0000002687 nova-compute[98431]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:12:29.700509 np0000002687 nova-compute[98431]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:12:29.700509 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:12:29.700850 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:12:29.700850 np0000002687 nova-compute[98431]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:12:29.700850 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:12:29.700850 np0000002687 nova-compute[98431]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060 (non-flash) Jun 11 23:12:29.700850 np0000002687 nova-compute[98431]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060 (non-flash) Jun 11 23:12:29.700850 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:12:29.700850 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:12:29.700850 np0000002687 nova-compute[98431]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:12:29.700850 np0000002687 nova-compute[98431]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:12:29.700850 np0000002687 nova-compute[98431]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c (non-flash) Jun 11 23:12:29.700850 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:12:29.700850 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c', '10'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea', '13'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea', '14'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060', '23'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060', '24'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9', '3'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9', '4'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9', '7'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9', '8'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c', '9')] {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 11 23:12:29.701568 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c', '10')] {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 11 23:12:29.701991 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c', '9')] {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 11 23:12:29.703435 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Resulting device map defaultdict(. at 0x7e1ea015e2a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c'): ({'sdf'}, set())}) {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 11 23:12:29.703435 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Removing multipathed devices sdf, sdg {{(pid=98431) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 11 23:12:29.703885 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Flush multipath device 330000000e04af478 {{(pid=98431) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jun 11 23:12:29.741646 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98431) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 11 23:12:29.791828 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-8b6d9da6-6e35-402c-9b0c-3e59164eadfc tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Lock "7609742e-a3a2-4be2-ba02-227efb2101e1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.514s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:12:29.807123 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98431) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 11 23:12:29.828864 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [req-fbb0bdc0-67a2-4a32-a5b1-ea333d9f3d11 req-38b43bdb-2cad-49f5-8913-ea3dcf18ce96 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:12:29.862594 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:29.864517 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98431) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 11 23:12:29.866741 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98431) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 11 23:12:29.867923 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:29.872904 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98431) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 11 23:12:29.887048 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:29.889282 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98431) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 11 23:12:29.889507 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c')] {{(pid=98431) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 11 23:12:29.892966 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:29.906582 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:12:29.929607 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:29.932835 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:29.951848 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c, portal: 192.168.40.100,3260] Jun 11 23:12:29.951848 np0000002687 nova-compute[98431]: Logout of [sid: 10, target: iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c, portal: 192.168.40.100,3260] successful. Jun 11 23:12:29.951848 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:12:29.980719 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:12:29.995696 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:12:30.039478 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c, portal: 192.168.50.100,3260] Jun 11 23:12:30.039478 np0000002687 nova-compute[98431]: Logout of [sid: 9, target: iqn.2023-03.storpool.com:os--volume-23264eac-8f91-4074-b3b0-51b6cb738b7c, portal: 192.168.50.100,3260] successful. Jun 11 23:12:30.039478 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:12:30.063847 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:12:30.064048 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.407s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 11 23:12:30.064250 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] <== disconnect_volume: return (407ms) None {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 11 23:12:30.064547 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Disconnected iSCSI Volume {{(pid=98431) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jun 11 23:12:30.071109 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] calling os-brick to detach iSCSI Volume {{(pid=98431) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jun 11 23:12:30.072933 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9', 'iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5c45c988-5aa0-400e-ba7a-59581071a2f9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': True}}" {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 11 23:12:30.072933 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 11 23:12:30.072933 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 11 23:12:30.072933 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9', 'iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5c45c988-5aa0-400e-ba7a-59581071a2f9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 11 23:12:30.072933 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9', 0)] {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 11 23:12:30.111271 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:12:30.111271 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:12:30.111271 np0000002687 nova-compute[98431]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060 (non-flash) Jun 11 23:12:30.111271 np0000002687 nova-compute[98431]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060 (non-flash) Jun 11 23:12:30.111271 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:12:30.111271 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:12:30.111271 np0000002687 nova-compute[98431]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:12:30.111271 np0000002687 nova-compute[98431]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:12:30.111271 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:12:30.111569 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] iscsi session list stdout=tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:12:30.111569 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:12:30.111569 np0000002687 nova-compute[98431]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060 (non-flash) Jun 11 23:12:30.111569 np0000002687 nova-compute[98431]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060 (non-flash) Jun 11 23:12:30.111569 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:12:30.111569 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:12:30.111569 np0000002687 nova-compute[98431]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:12:30.111569 np0000002687 nova-compute[98431]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9 (non-flash) Jun 11 23:12:30.111569 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:12:30.111945 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea', '13'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea', '14'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060', '23'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060', '24'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9', '3'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9', '4'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9', '7'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9', '8')] {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 11 23:12:30.111945 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9', '7')] {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 11 23:12:30.113123 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9', '8')] {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 11 23:12:30.119467 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Resulting device map defaultdict(. at 0x7e1ea18931a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9'): ({'sde'}, set())}) {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 11 23:12:30.119467 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Removing multipathed devices sdd, sde {{(pid=98431) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 11 23:12:30.121190 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Flush multipath device 3300000008439a8a6 {{(pid=98431) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jun 11 23:12:30.180820 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98431) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 11 23:12:30.208143 np0000002687 nova-compute[98431]: DEBUG nova.utils [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Queued Task(fn=>, remaining_delay=14.99975217400015 future=) {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:12:30.210458 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [-] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Instance destroyed successfully. Jun 11 23:12:30.211885 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-81ada886-9677-4937-8d85-7aa77fe777e5 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Lazy-loading 'numa_topology' on Instance uuid cb63f66c-b69e-42b0-805c-be6fe9b3aee3 {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:12:30.218827 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-c8e78479-330c-4647-b641-17a40f3dc4cd tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8641b14d-785b-44b0-ad6d-bb537cbee5c7/disk --force-share --output=json -f qcow2 {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:12:30.237057 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98431) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 11 23:12:30.287518 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Checking to see if SCSI volumes sdd, sde have been removed. {{(pid=98431) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 11 23:12:30.287518 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] SCSI volumes sdd, sde have been removed. {{(pid=98431) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 11 23:12:30.291569 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Checking to see if device paths {'sdd', 'sde'} are still under multipathd monitoring {{(pid=98431) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 11 23:12:30.296594 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-3cb07ef3-b632-4527-a852-2571ffa18c48 req-d671f1b4-9411-4eb7-bced-3511734c120e service nova] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Received event network-changed-2d6dd8b9-e3ff-462f-92cf-8c3a62bc27d1 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:12:30.296594 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-3cb07ef3-b632-4527-a852-2571ffa18c48 req-d671f1b4-9411-4eb7-bced-3511734c120e service nova] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Refreshing instance network info cache due to event network-changed-2d6dd8b9-e3ff-462f-92cf-8c3a62bc27d1. {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 11 23:12:30.296594 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-3cb07ef3-b632-4527-a852-2571ffa18c48 req-d671f1b4-9411-4eb7-bced-3511734c120e service nova] Acquiring lock "refresh_cache-cb63f66c-b69e-42b0-805c-be6fe9b3aee3" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 11 23:12:30.305648 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Device paths {'sdd', 'sde'} have been removed from multipathd monitoring. {{(pid=98431) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 11 23:12:30.305919 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9')] {{(pid=98431) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 11 23:12:30.326384 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:12:30.333244 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-c8e78479-330c-4647-b641-17a40f3dc4cd tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8641b14d-785b-44b0-ad6d-bb537cbee5c7/disk --force-share --output=json -f qcow2" returned: 0 in 0.115s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:12:30.337549 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-c8e78479-330c-4647-b641-17a40f3dc4cd tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8641b14d-785b-44b0-ad6d-bb537cbee5c7/disk --force-share --output=json -f qcow2 {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:12:30.382864 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9, portal: 192.168.40.100,3260] Jun 11 23:12:30.382864 np0000002687 nova-compute[98431]: Logout of [sid: 7, target: iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9, portal: 192.168.40.100,3260] successful. Jun 11 23:12:30.382864 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:12:30.386842 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-64bc6982-149d-49af-87e4-9a9416b521a1 req-8487d24b-bf74-4d78-b30f-51cec9139e17 service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Received event network-vif-unplugged-7808ce0e-ec36-4dfa-84d5-0eb1ce542139 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:12:30.387230 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-64bc6982-149d-49af-87e4-9a9416b521a1 req-8487d24b-bf74-4d78-b30f-51cec9139e17 service nova] Acquiring lock "49a042ba-28ba-4401-9bdf-92f96da8f80e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:12:30.387576 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-64bc6982-149d-49af-87e4-9a9416b521a1 req-8487d24b-bf74-4d78-b30f-51cec9139e17 service nova] Lock "49a042ba-28ba-4401-9bdf-92f96da8f80e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:12:30.387763 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-64bc6982-149d-49af-87e4-9a9416b521a1 req-8487d24b-bf74-4d78-b30f-51cec9139e17 service nova] Lock "49a042ba-28ba-4401-9bdf-92f96da8f80e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:12:30.387971 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-64bc6982-149d-49af-87e4-9a9416b521a1 req-8487d24b-bf74-4d78-b30f-51cec9139e17 service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] No waiting events found dispatching network-vif-unplugged-7808ce0e-ec36-4dfa-84d5-0eb1ce542139 {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:12:30.388140 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-64bc6982-149d-49af-87e4-9a9416b521a1 req-8487d24b-bf74-4d78-b30f-51cec9139e17 service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Received event network-vif-unplugged-7808ce0e-ec36-4dfa-84d5-0eb1ce542139 for instance with task_state deleting. {{(pid=98431) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 11 23:12:30.388284 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-64bc6982-149d-49af-87e4-9a9416b521a1 req-8487d24b-bf74-4d78-b30f-51cec9139e17 service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Received event network-vif-unplugged-09135c79-b0df-40af-b05b-2e171390f37f {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:12:30.388542 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-64bc6982-149d-49af-87e4-9a9416b521a1 req-8487d24b-bf74-4d78-b30f-51cec9139e17 service nova] Acquiring lock "49a042ba-28ba-4401-9bdf-92f96da8f80e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:12:30.388701 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-64bc6982-149d-49af-87e4-9a9416b521a1 req-8487d24b-bf74-4d78-b30f-51cec9139e17 service nova] Lock "49a042ba-28ba-4401-9bdf-92f96da8f80e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:12:30.388879 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-64bc6982-149d-49af-87e4-9a9416b521a1 req-8487d24b-bf74-4d78-b30f-51cec9139e17 service nova] Lock "49a042ba-28ba-4401-9bdf-92f96da8f80e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:12:30.389020 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-64bc6982-149d-49af-87e4-9a9416b521a1 req-8487d24b-bf74-4d78-b30f-51cec9139e17 service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] No waiting events found dispatching network-vif-unplugged-09135c79-b0df-40af-b05b-2e171390f37f {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:12:30.389164 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-64bc6982-149d-49af-87e4-9a9416b521a1 req-8487d24b-bf74-4d78-b30f-51cec9139e17 service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Received event network-vif-unplugged-09135c79-b0df-40af-b05b-2e171390f37f for instance with task_state deleting. {{(pid=98431) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 11 23:12:30.389303 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-64bc6982-149d-49af-87e4-9a9416b521a1 req-8487d24b-bf74-4d78-b30f-51cec9139e17 service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Received event network-vif-unplugged-09135c79-b0df-40af-b05b-2e171390f37f {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:12:30.389489 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-64bc6982-149d-49af-87e4-9a9416b521a1 req-8487d24b-bf74-4d78-b30f-51cec9139e17 service nova] Acquiring lock "49a042ba-28ba-4401-9bdf-92f96da8f80e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:12:30.389746 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-64bc6982-149d-49af-87e4-9a9416b521a1 req-8487d24b-bf74-4d78-b30f-51cec9139e17 service nova] Lock "49a042ba-28ba-4401-9bdf-92f96da8f80e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:12:30.389845 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-64bc6982-149d-49af-87e4-9a9416b521a1 req-8487d24b-bf74-4d78-b30f-51cec9139e17 service nova] Lock "49a042ba-28ba-4401-9bdf-92f96da8f80e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:12:30.392557 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-64bc6982-149d-49af-87e4-9a9416b521a1 req-8487d24b-bf74-4d78-b30f-51cec9139e17 service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] No waiting events found dispatching network-vif-unplugged-09135c79-b0df-40af-b05b-2e171390f37f {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:12:30.392747 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-64bc6982-149d-49af-87e4-9a9416b521a1 req-8487d24b-bf74-4d78-b30f-51cec9139e17 service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Received event network-vif-unplugged-09135c79-b0df-40af-b05b-2e171390f37f for instance with task_state deleting. {{(pid=98431) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 11 23:12:30.392939 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-64bc6982-149d-49af-87e4-9a9416b521a1 req-8487d24b-bf74-4d78-b30f-51cec9139e17 service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Received event network-vif-unplugged-77424d75-6e25-4791-a44d-495051f7e89f {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:12:30.393126 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-64bc6982-149d-49af-87e4-9a9416b521a1 req-8487d24b-bf74-4d78-b30f-51cec9139e17 service nova] Acquiring lock "49a042ba-28ba-4401-9bdf-92f96da8f80e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:12:30.393314 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-64bc6982-149d-49af-87e4-9a9416b521a1 req-8487d24b-bf74-4d78-b30f-51cec9139e17 service nova] Lock "49a042ba-28ba-4401-9bdf-92f96da8f80e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:12:30.393589 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-64bc6982-149d-49af-87e4-9a9416b521a1 req-8487d24b-bf74-4d78-b30f-51cec9139e17 service nova] Lock "49a042ba-28ba-4401-9bdf-92f96da8f80e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:12:30.393649 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-64bc6982-149d-49af-87e4-9a9416b521a1 req-8487d24b-bf74-4d78-b30f-51cec9139e17 service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] No waiting events found dispatching network-vif-unplugged-77424d75-6e25-4791-a44d-495051f7e89f {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:12:30.393768 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-64bc6982-149d-49af-87e4-9a9416b521a1 req-8487d24b-bf74-4d78-b30f-51cec9139e17 service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Received event network-vif-unplugged-77424d75-6e25-4791-a44d-495051f7e89f for instance with task_state deleting. {{(pid=98431) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 11 23:12:30.406340 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:12:30.423505 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:12:30.445745 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-c8e78479-330c-4647-b641-17a40f3dc4cd tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8641b14d-785b-44b0-ad6d-bb537cbee5c7/disk --force-share --output=json -f qcow2" returned: 0 in 0.110s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:12:30.446872 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-c8e78479-330c-4647-b641-17a40f3dc4cd tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:12:30.465293 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-c8e78479-330c-4647-b641-17a40f3dc4cd tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:12:30.467353 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-c8e78479-330c-4647-b641-17a40f3dc4cd tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:12:30.481718 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9, portal: 192.168.50.100,3260] Jun 11 23:12:30.481718 np0000002687 nova-compute[98431]: Logout of [sid: 8, target: iqn.2023-03.storpool.com:os--volume-5c45c988-5aa0-400e-ba7a-59581071a2f9, portal: 192.168.50.100,3260] successful. Jun 11 23:12:30.481718 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:12:30.499972 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:12:30.502303 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.428s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 11 23:12:30.502303 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] <== disconnect_volume: return (429ms) None {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 11 23:12:30.502303 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Disconnected iSCSI Volume {{(pid=98431) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jun 11 23:12:30.502303 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Deleting instance files /opt/stack/data/nova/instances/49a042ba-28ba-4401-9bdf-92f96da8f80e_del Jun 11 23:12:30.502602 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Deletion of /opt/stack/data/nova/instances/49a042ba-28ba-4401-9bdf-92f96da8f80e_del complete Jun 11 23:12:30.574301 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-c8e78479-330c-4647-b641-17a40f3dc4cd tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json" returned: 0 in 0.107s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:12:30.577825 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-c8e78479-330c-4647-b641-17a40f3dc4cd tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpnanxxz8i/a34a5e1381b24f05b03a3942e8bff09d.delta 1073741824 {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:12:30.637471 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-c8e78479-330c-4647-b641-17a40f3dc4cd tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpnanxxz8i/a34a5e1381b24f05b03a3942e8bff09d.delta 1073741824" returned: 0 in 0.061s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:12:30.640140 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-c8e78479-330c-4647-b641-17a40f3dc4cd tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 8641b14d-785b-44b0-ad6d-bb537cbee5c7] Quiescing instance not available: QEMU guest agent is not enabled. Jun 11 23:12:30.718158 np0000002687 nova-compute[98431]: DEBUG nova.objects.base [None req-81ada886-9677-4937-8d85-7aa77fe777e5 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Object Instance lazy-loaded attributes: flavor,numa_topology {{(pid=98431) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 11 23:12:30.925475 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-8b6d9da6-6e35-402c-9b0c-3e59164eadfc tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Acquiring lock "7609742e-a3a2-4be2-ba02-227efb2101e1" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:12:30.925861 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-8b6d9da6-6e35-402c-9b0c-3e59164eadfc tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Lock "7609742e-a3a2-4be2-ba02-227efb2101e1" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:12:30.927919 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-8b6d9da6-6e35-402c-9b0c-3e59164eadfc tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Attaching volume 2f2d8ccb-5d26-4f0b-bc60-abf6355bf979 to /dev/vdb Jun 11 23:12:30.986825 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [req-fbb0bdc0-67a2-4a32-a5b1-ea333d9f3d11 req-38b43bdb-2cad-49f5-8913-ea3dcf18ce96 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:12:30.989378 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.guest [None req-c8e78479-330c-4647-b641-17a40f3dc4cd tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] COPY block job progress, current cursor: 1 final cursor: 1 {{(pid=98431) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}} Jun 11 23:12:30.992184 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-8b6d9da6-6e35-402c-9b0c-3e59164eadfc tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.209', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000002687', 'execute': None}" {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 11 23:12:31.000646 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-c8e78479-330c-4647-b641-17a40f3dc4cd tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 8641b14d-785b-44b0-ad6d-bb537cbee5c7] Skipping quiescing instance: QEMU guest agent is not enabled. Jun 11 23:12:31.013571 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.scaleio [None req-8b6d9da6-6e35-402c-9b0c-3e59164eadfc tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98431) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 11 23:12:31.016145 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Took 3.39 seconds to destroy the instance on the hypervisor. Jun 11 23:12:31.017275 np0000002687 nova-compute[98431]: DEBUG oslo.service.backend._common.loopingcall [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98431) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jun 11 23:12:31.017275 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [-] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Deallocating network for instance {{(pid=98431) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}} Jun 11 23:12:31.017546 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [-] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] deallocate_for_instance() {{(pid=98431) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jun 11 23:12:31.017686 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:12:31.041730 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-8b6d9da6-6e35-402c-9b0c-3e59164eadfc tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Running cmd (subprocess): nvme version {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:12:31.083946 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-8b6d9da6-6e35-402c-9b0c-3e59164eadfc tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] 'nvme version' failed. Not Retrying. {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 11 23:12:31.084976 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8b6d9da6-6e35-402c-9b0c-3e59164eadfc tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] nvme not present on system {{(pid=98431) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 11 23:12:31.096008 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.lightos [None req-8b6d9da6-6e35-402c-9b0c-3e59164eadfc tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98431) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 11 23:12:31.100411 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.lightos [None req-8b6d9da6-6e35-402c-9b0c-3e59164eadfc tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Current host hostNQN and IP(s) are ['10.4.3.209', 'fe80::f816:3eff:fea3:3707', '192.168.40.6', 'fe80::f816:3eff:fe06:bdab', '192.168.50.6', 'fe80::f816:3eff:fe7a:46f2', '192.168.10.6', 'fe80::f816:3eff:fe13:793b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::38fa:21ff:fe6c:3746', 'fe80::fc16:3eff:fe6c:eb30', 'fe80::20a8:54ff:fe51:da0a', 'fe80::fc16:3eff:fe77:488d', 'fe80::9469:f2ff:feae:5824', 'fe80::fc16:3eff:fec7:336a', 'fe80::fc16:3eff:fe61:b7fd', 'fe80::fc16:3eff:fe1d:f718', 'fe80::14a2:b8ff:feec:f607', 'fe80::fc16:3eff:fec6:c65b', 'fe80::fc16:3eff:fed6:e34f'] Jun 11 23:12:31.102848 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.lightos [None req-8b6d9da6-6e35-402c-9b0c-3e59164eadfc tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98431) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 11 23:12:31.102848 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.lightos [None req-8b6d9da6-6e35-402c-9b0c-3e59164eadfc tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] LIGHTOS: no hostnqn found. {{(pid=98431) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 11 23:12:31.102848 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-8b6d9da6-6e35-402c-9b0c-3e59164eadfc tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] <== get_connector_properties: return (109ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.209', 'host': 'np0000002687', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:798b370f1cc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad465dfe-0ed1-4637-98c3-ddaebebd61a4', 'nvme_native_multipath': False} {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 11 23:12:31.102848 np0000002687 nova-compute[98431]: DEBUG nova.virt.block_device [None req-8b6d9da6-6e35-402c-9b0c-3e59164eadfc tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Updating existing volume attachment record: 9c549f70-2a53-46bd-9be3-348211705b56 {{(pid=98431) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 11 23:12:31.109585 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] No BDM found with device name vda, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:12:31.109827 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] No BDM found with device name hda, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:12:31.111890 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] No VIF found with MAC fa:16:3e:4b:26:95, not building metadata {{(pid=98431) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13199}} Jun 11 23:12:31.112760 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] Using config drive Jun 11 23:12:31.147309 np0000002687 nova-compute[98431]: DEBUG nova.privsep.utils [None req-c8e78479-330c-4647-b641-17a40f3dc4cd tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98431) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}} Jun 11 23:12:31.147309 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-c8e78479-330c-4647-b641-17a40f3dc4cd tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpnanxxz8i/a34a5e1381b24f05b03a3942e8bff09d.delta /opt/stack/data/nova/instances/snapshots/tmpnanxxz8i/a34a5e1381b24f05b03a3942e8bff09d {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:12:31.261156 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:12:31.295234 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-c8e78479-330c-4647-b641-17a40f3dc4cd tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpnanxxz8i/a34a5e1381b24f05b03a3942e8bff09d.delta /opt/stack/data/nova/instances/snapshots/tmpnanxxz8i/a34a5e1381b24f05b03a3942e8bff09d" returned: 0 in 0.148s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:12:31.295234 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-c8e78479-330c-4647-b641-17a40f3dc4cd tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 8641b14d-785b-44b0-ad6d-bb537cbee5c7] Snapshot extracted, beginning image upload Jun 11 23:12:31.335906 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-fbb0bdc0-67a2-4a32-a5b1-ea333d9f3d11 req-38b43bdb-2cad-49f5-8913-ea3dcf18ce96 service nova] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Updated VIF entry in instance network info cache for port 2d6dd8b9-e3ff-462f-92cf-8c3a62bc27d1. {{(pid=98431) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 11 23:12:31.337474 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-fbb0bdc0-67a2-4a32-a5b1-ea333d9f3d11 req-38b43bdb-2cad-49f5-8913-ea3dcf18ce96 service nova] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Updating instance_info_cache with network_info: [{"id": "2d6dd8b9-e3ff-462f-92cf-8c3a62bc27d1", "address": "fa:16:3e:b5:6f:fd", "network": {"id": "b1a1d33f-f9b6-48cf-86a1-0260d53f3bb0", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1779972098-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2d62cddce233457caf7eb43be819e513", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d6dd8b9-e3", "ovs_interfaceid": "2d6dd8b9-e3ff-462f-92cf-8c3a62bc27d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:12:31.601845 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:31.624825 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:12:31.634670 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:31.708774 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b6d9da6-6e35-402c-9b0c-3e59164eadfc tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Calling os-brick to attach iSCSI Volume {{(pid=98431) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 11 23:12:31.709355 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b6d9da6-6e35-402c-9b0c-3e59164eadfc tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979', 'iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2f2d8ccb-5d26-4f0b-bc60-abf6355bf979', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 11 23:12:31.709594 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-8b6d9da6-6e35-402c-9b0c-3e59164eadfc tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 11 23:12:31.710219 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-8b6d9da6-6e35-402c-9b0c-3e59164eadfc tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 11 23:12:31.710373 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-8b6d9da6-6e35-402c-9b0c-3e59164eadfc tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979', 'iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2f2d8ccb-5d26-4f0b-bc60-abf6355bf979', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98431) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 11 23:12:31.734132 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-8b6d9da6-6e35-402c-9b0c-3e59164eadfc tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 11 23:12:31.735372 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-8b6d9da6-6e35-402c-9b0c-3e59164eadfc tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 11 23:12:31.736253 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-8b6d9da6-6e35-402c-9b0c-3e59164eadfc tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 11 23:12:31.736253 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.iscsi [None req-8b6d9da6-6e35-402c-9b0c-3e59164eadfc tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 11 23:12:31.737054 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-8b6d9da6-6e35-402c-9b0c-3e59164eadfc tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 11 23:12:31.737054 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.iscsi [None req-8b6d9da6-6e35-402c-9b0c-3e59164eadfc tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 11 23:12:31.757887 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:31.760476 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b6d9da6-6e35-402c-9b0c-3e59164eadfc tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 11 23:12:31.760476 np0000002687 nova-compute[98431]: {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:12:31.768656 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b6d9da6-6e35-402c-9b0c-3e59164eadfc tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 11 23:12:31.768656 np0000002687 nova-compute[98431]: {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:12:31.784771 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b6d9da6-6e35-402c-9b0c-3e59164eadfc tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979] added Jun 11 23:12:31.784771 np0000002687 nova-compute[98431]: stderr=iscsiadm: Config file line 363 does not have value Jun 11 23:12:31.784771 np0000002687 nova-compute[98431]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 11 23:12:31.784771 np0000002687 nova-compute[98431]: iscsiadm: Config file line 363 does not have value Jun 11 23:12:31.784771 np0000002687 nova-compute[98431]: iscsiadm: Config file line 363 does not have value Jun 11 23:12:31.784771 np0000002687 nova-compute[98431]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 11 23:12:31.784771 np0000002687 nova-compute[98431]: {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:12:31.785080 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b6d9da6-6e35-402c-9b0c-3e59164eadfc tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98431) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 11 23:12:31.785709 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-8b6d9da6-6e35-402c-9b0c-3e59164eadfc tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0492(s), this was the 1st time calling it. {{(pid=98431) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 11 23:12:31.785986 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-8b6d9da6-6e35-402c-9b0c-3e59164eadfc tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98431) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 11 23:12:31.786989 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b6d9da6-6e35-402c-9b0c-3e59164eadfc tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979] added Jun 11 23:12:31.786989 np0000002687 nova-compute[98431]: stderr=iscsiadm: Config file line 363 does not have value Jun 11 23:12:31.786989 np0000002687 nova-compute[98431]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 11 23:12:31.786989 np0000002687 nova-compute[98431]: iscsiadm: Config file line 363 does not have value Jun 11 23:12:31.786989 np0000002687 nova-compute[98431]: iscsiadm: Config file line 363 does not have value Jun 11 23:12:31.786989 np0000002687 nova-compute[98431]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 11 23:12:31.786989 np0000002687 nova-compute[98431]: {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:12:31.786989 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b6d9da6-6e35-402c-9b0c-3e59164eadfc tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98431) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 11 23:12:31.787339 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-8b6d9da6-6e35-402c-9b0c-3e59164eadfc tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.05(s), this was the 1st time calling it. {{(pid=98431) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 11 23:12:31.787339 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-8b6d9da6-6e35-402c-9b0c-3e59164eadfc tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98431) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 11 23:12:31.843912 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-fbb0bdc0-67a2-4a32-a5b1-ea333d9f3d11 req-38b43bdb-2cad-49f5-8913-ea3dcf18ce96 service nova] Releasing lock "refresh_cache-cb63f66c-b69e-42b0-805c-be6fe9b3aee3" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 11 23:12:31.845044 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-3cb07ef3-b632-4527-a852-2571ffa18c48 req-d671f1b4-9411-4eb7-bced-3511734c120e service nova] Acquired lock "refresh_cache-cb63f66c-b69e-42b0-805c-be6fe9b3aee3" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 11 23:12:31.845533 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-3cb07ef3-b632-4527-a852-2571ffa18c48 req-d671f1b4-9411-4eb7-bced-3511734c120e service nova] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Refreshing network info cache for port 2d6dd8b9-e3ff-462f-92cf-8c3a62bc27d1 {{(pid=98431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 11 23:12:32.064821 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:32.077996 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:32.081075 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:32.109215 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:32.117072 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:32.288519 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] Creating config drive at /opt/stack/data/nova/instances/64d7833a-82e8-43e9-83ed-2507197b69bf/disk.config Jun 11 23:12:32.299815 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/64d7833a-82e8-43e9-83ed-2507197b69bf/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmppa86b2nx {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:12:32.350453 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [req-3cb07ef3-b632-4527-a852-2571ffa18c48 req-d671f1b4-9411-4eb7-bced-3511734c120e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:12:32.353613 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/64d7833a-82e8-43e9-83ed-2507197b69bf/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmppa86b2nx" returned: 0 in 0.057s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:12:32.490225 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-130da78a-0d3b-436d-87fe-c69407cee775 req-535125ab-40b7-4844-9cf6-132ad51cee32 service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Received event network-vif-unplugged-77424d75-6e25-4791-a44d-495051f7e89f {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:12:32.490225 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-130da78a-0d3b-436d-87fe-c69407cee775 req-535125ab-40b7-4844-9cf6-132ad51cee32 service nova] Acquiring lock "49a042ba-28ba-4401-9bdf-92f96da8f80e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:12:32.490225 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-130da78a-0d3b-436d-87fe-c69407cee775 req-535125ab-40b7-4844-9cf6-132ad51cee32 service nova] Lock "49a042ba-28ba-4401-9bdf-92f96da8f80e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:12:32.490225 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-130da78a-0d3b-436d-87fe-c69407cee775 req-535125ab-40b7-4844-9cf6-132ad51cee32 service nova] Lock "49a042ba-28ba-4401-9bdf-92f96da8f80e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:12:32.490524 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-130da78a-0d3b-436d-87fe-c69407cee775 req-535125ab-40b7-4844-9cf6-132ad51cee32 service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] No waiting events found dispatching network-vif-unplugged-77424d75-6e25-4791-a44d-495051f7e89f {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:12:32.490778 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-130da78a-0d3b-436d-87fe-c69407cee775 req-535125ab-40b7-4844-9cf6-132ad51cee32 service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Received event network-vif-unplugged-77424d75-6e25-4791-a44d-495051f7e89f for instance with task_state deleting. {{(pid=98431) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 11 23:12:32.759455 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:32.787255 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.iscsi [None req-8b6d9da6-6e35-402c-9b0c-3e59164eadfc tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 11 23:12:32.787777 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.iscsi [None req-8b6d9da6-6e35-402c-9b0c-3e59164eadfc tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 11 23:12:32.804248 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b6d9da6-6e35-402c-9b0c-3e59164eadfc tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 11 23:12:32.804248 np0000002687 nova-compute[98431]: node.name = iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979 Jun 11 23:12:32.804248 np0000002687 nova-compute[98431]: node.tpgt = -1 Jun 11 23:12:32.804248 np0000002687 nova-compute[98431]: node.startup = manual Jun 11 23:12:32.804248 np0000002687 nova-compute[98431]: node.leading_login = No Jun 11 23:12:32.804248 np0000002687 nova-compute[98431]: iface.iscsi_ifacename = default Jun 11 23:12:32.804248 np0000002687 nova-compute[98431]: iface.net_ifacename = Jun 11 23:12:32.804248 np0000002687 nova-compute[98431]: iface.ipaddress = Jun 11 23:12:32.804248 np0000002687 nova-compute[98431]: iface.prefix_len = 0 Jun 11 23:12:32.804248 np0000002687 nova-compute[98431]: iface.hwaddress = Jun 11 23:12:32.804248 np0000002687 nova-compute[98431]: iface.transport_name = tcp Jun 11 23:12:32.804248 np0000002687 nova-compute[98431]: iface.initiatorname = Jun 11 23:12:32.804248 np0000002687 nova-compute[98431]: iface.state = Jun 11 23:12:32.804248 np0000002687 nova-compute[98431]: iface.vlan_id = 0 Jun 11 23:12:32.804248 np0000002687 nova-compute[98431]: iface.vlan_priority = 0 Jun 11 23:12:32.804248 np0000002687 nova-compute[98431]: iface.vlan_state = Jun 11 23:12:32.804248 np0000002687 nova-compute[98431]: iface.iface_num = 0 Jun 11 23:12:32.804248 np0000002687 nova-compute[98431]: iface.mtu = 0 Jun 11 23:12:32.804248 np0000002687 nova-compute[98431]: iface.port = 0 Jun 11 23:12:32.804248 np0000002687 nova-compute[98431]: iface.bootproto = Jun 11 23:12:32.804248 np0000002687 nova-compute[98431]: iface.subnet_mask = Jun 11 23:12:32.804248 np0000002687 nova-compute[98431]: iface.gateway = Jun 11 23:12:32.804248 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id_state = Jun 11 23:12:32.804248 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id = Jun 11 23:12:32.804248 np0000002687 nova-compute[98431]: iface.dhcp_dns = Jun 11 23:12:32.804248 np0000002687 nova-compute[98431]: iface.dhcp_learn_iqn = Jun 11 23:12:32.804248 np0000002687 nova-compute[98431]: iface.dhcp_req_vendor_id_state = Jun 11 23:12:32.804248 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id_state = Jun 11 23:12:32.804248 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id = Jun 11 23:12:32.804248 np0000002687 nova-compute[98431]: iface.dhcp_slp_da = Jun 11 23:12:32.804248 np0000002687 nova-compute[98431]: iface.fragmentation = Jun 11 23:12:32.804248 np0000002687 nova-compute[98431]: iface.gratuitous_arp = Jun 11 23:12:32.804248 np0000002687 nova-compute[98431]: iface.incoming_forwarding = Jun 11 23:12:32.804248 np0000002687 nova-compute[98431]: iface.tos_state = Jun 11 23:12:32.804248 np0000002687 nova-compute[98431]: iface.tos = 0 Jun 11 23:12:32.804248 np0000002687 nova-compute[98431]: iface.ttl = 0 Jun 11 23:12:32.804248 np0000002687 nova-compute[98431]: iface.delayed_ack = Jun 11 23:12:32.804248 np0000002687 nova-compute[98431]: iface.tcp_nagle = Jun 11 23:12:32.804248 np0000002687 nova-compute[98431]: iface.tcp_wsf_state = Jun 11 23:12:32.804248 np0000002687 nova-compute[98431]: iface.tcp_wsf = 0 Jun 11 23:12:32.804248 np0000002687 nova-compute[98431]: iface.tcp_timer_scale = 0 Jun 11 23:12:32.804248 np0000002687 nova-compute[98431]: iface.tcp_timestamp = Jun 11 23:12:32.804248 np0000002687 nova-compute[98431]: iface.redirect = Jun 11 23:12:32.804248 np0000002687 nova-compute[98431]: iface.def_task_mgmt_timeout = 0 Jun 11 23:12:32.804248 np0000002687 nova-compute[98431]: iface.header_digest = Jun 11 23:12:32.804248 np0000002687 nova-compute[98431]: iface.data_digest = Jun 11 23:12:32.804248 np0000002687 nova-compute[98431]: iface.immediate_data = Jun 11 23:12:32.804248 np0000002687 nova-compute[98431]: iface.initial_r2t = Jun 11 23:12:32.804248 np0000002687 nova-compute[98431]: iface.data_seq_inorder = Jun 11 23:12:32.804248 np0000002687 nova-compute[98431]: iface.data_pdu_inorder = Jun 11 23:12:32.804248 np0000002687 nova-compute[98431]: iface.erl = 0 Jun 11 23:12:32.804248 np0000002687 nova-compute[98431]: iface.max_receive_data_len = 0 Jun 11 23:12:32.804248 np0000002687 nova-compute[98431]: iface.first_burst_len = 0 Jun 11 23:12:32.804248 np0000002687 nova-compute[98431]: iface.max_outstanding_r2t = 0 Jun 11 23:12:32.804248 np0000002687 nova-compute[98431]: iface.max_burst_len = 0 Jun 11 23:12:32.804248 np0000002687 nova-compute[98431]: iface.chap_auth = Jun 11 23:12:32.804248 np0000002687 nova-compute[98431]: iface.bidi_chap = Jun 11 23:12:32.804248 np0000002687 nova-compute[98431]: iface.strict_login_compliance = Jun 11 23:12:32.804248 np0000002687 nova-compute[98431]: iface.discovery_auth = Jun 11 23:12:32.804248 np0000002687 nova-compute[98431]: iface.discovery_logout = Jun 11 23:12:32.804248 np0000002687 nova-compute[98431]: node.discovery_address = Jun 11 23:12:32.804248 np0000002687 nova-compute[98431]: node.discovery_port = 0 Jun 11 23:12:32.804248 np0000002687 nova-compute[98431]: node.discovery_type = fw Jun 11 23:12:32.804248 np0000002687 nova-compute[98431]: node.session.initial_cmdsn = 0 Jun 11 23:12:32.804248 np0000002687 nova-compute[98431]: node.session.initial_login_retry_max = 8 Jun 11 23:12:32.804248 np0000002687 nova-compute[98431]: node.session.xmit_thread_priority = 0 Jun 11 23:12:32.804248 np0000002687 nova-compute[98431]: node.session.cmds_max = 128 Jun 11 23:12:32.804248 np0000002687 nova-compute[98431]: node.session.queue_depth = 32 Jun 11 23:12:32.804248 np0000002687 nova-compute[98431]: node.session.nr_sessions = 1 Jun 11 23:12:32.804248 np0000002687 nova-compute[98431]: node.session.auth.authmethod = None Jun 11 23:12:32.804248 np0000002687 nova-compute[98431]: node.session.auth.username = Jun 11 23:12:32.804248 np0000002687 nova-compute[98431]: node.session.auth.password = *** Jun 11 23:12:32.804248 np0000002687 nova-compute[98431]: node.session.auth.username_in = Jun 11 23:12:32.804248 np0000002687 nova-compute[98431]: node.session.auth.password_in = Jun 11 23:12:32.804248 np0000002687 nova-compute[98431]: node.session.auth.chap_algs = SHA256 Jun 11 23:12:32.804248 np0000002687 nova-compute[98431]: node.session.timeo.replacement_timeout = 120 Jun 11 23:12:32.804248 np0000002687 nova-compute[98431]: node.session.err_timeo.abort_timeout = 15 Jun 11 23:12:32.804248 np0000002687 nova-compute[98431]: node.session.err_timeo.lu_reset_timeout = 30 Jun 11 23:12:32.804248 np0000002687 nova-compute[98431]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 11 23:12:32.804248 np0000002687 nova-compute[98431]: node.session.err_timeo.host_reset_timeout = 60 Jun 11 23:12:32.804248 np0000002687 nova-compute[98431]: node.session.iscsi.FastAbort = Yes Jun 11 23:12:32.804248 np0000002687 nova-compute[98431]: node.session.iscsi.InitialR2T = No Jun 11 23:12:32.804248 np0000002687 nova-compute[98431]: node.session.iscsi.ImmediateData = Yes Jun 11 23:12:32.804248 np0000002687 nova-compute[98431]: node.session.iscsi.FirstBurstLength = 262144 Jun 11 23:12:32.804248 np0000002687 nova-compute[98431]: node.session.iscsi.MaxBurstLength = 16776192 Jun 11 23:12:32.804248 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Retain = 0 Jun 11 23:12:32.804248 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Wait = 2 Jun 11 23:12:32.804248 np0000002687 nova-compute[98431]: node.session.iscsi.MaxConnections = 1 Jun 11 23:12:32.804248 np0000002687 nova-compute[98431]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 11 23:12:32.804248 np0000002687 nova-compute[98431]: node.session.iscsi.ERL = 0 Jun 11 23:12:32.804248 np0000002687 nova-compute[98431]: node.session.scan = auto Jun 11 23:12:32.804248 np0000002687 nova-compute[98431]: node.session.reopen_max = 0 Jun 11 23:12:32.804248 np0000002687 nova-compute[98431]: node.conn[0].address = 192.168.40.100 Jun 11 23:12:32.804248 np0000002687 nova-compute[98431]: node.conn[0].port = 3260 Jun 11 23:12:32.804248 np0000002687 nova-compute[98431]: node.conn[0].startup = manual Jun 11 23:12:32.804248 np0000002687 nova-compute[98431]: node.conn[0].tcp.window_size = 524288 Jun 11 23:12:32.804248 np0000002687 nova-compute[98431]: node.conn[0].tcp.type_of_service = 0 Jun 11 23:12:32.804248 np0000002687 nova-compute[98431]: node.conn[0].timeo.logout_timeout = 15 Jun 11 23:12:32.804248 np0000002687 nova-compute[98431]: node.conn[0].timeo.login_timeout = 15 Jun 11 23:12:32.804248 np0000002687 nova-compute[98431]: node.conn[0].timeo.auth_timeout = 45 Jun 11 23:12:32.804248 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_interval = 5 Jun 11 23:12:32.804248 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_timeout = 5 Jun 11 23:12:32.804248 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 11 23:12:32.804248 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 11 23:12:32.804248 np0000002687 nova-compute[98431]: node.conn[0].iscsi.HeaderDigest = None Jun 11 23:12:32.804248 np0000002687 nova-compute[98431]: node.conn[0].iscsi.DataDigest = None Jun 11 23:12:32.804248 np0000002687 nova-compute[98431]: node.conn[0].iscsi.IFMarker = No Jun 11 23:12:32.804248 np0000002687 nova-compute[98431]: node.conn[0].iscsi.OFMarker = No Jun 11 23:12:32.804248 np0000002687 nova-compute[98431]: # END RECORD Jun 11 23:12:32.804248 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:12:32.817090 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b6d9da6-6e35-402c-9b0c-3e59164eadfc tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 11 23:12:32.817090 np0000002687 nova-compute[98431]: node.name = iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979 Jun 11 23:12:32.817090 np0000002687 nova-compute[98431]: node.tpgt = -1 Jun 11 23:12:32.817090 np0000002687 nova-compute[98431]: node.startup = manual Jun 11 23:12:32.817090 np0000002687 nova-compute[98431]: node.leading_login = No Jun 11 23:12:32.817090 np0000002687 nova-compute[98431]: iface.iscsi_ifacename = default Jun 11 23:12:32.817090 np0000002687 nova-compute[98431]: iface.net_ifacename = Jun 11 23:12:32.817090 np0000002687 nova-compute[98431]: iface.ipaddress = Jun 11 23:12:32.817090 np0000002687 nova-compute[98431]: iface.prefix_len = 0 Jun 11 23:12:32.817090 np0000002687 nova-compute[98431]: iface.hwaddress = Jun 11 23:12:32.817090 np0000002687 nova-compute[98431]: iface.transport_name = tcp Jun 11 23:12:32.817090 np0000002687 nova-compute[98431]: iface.initiatorname = Jun 11 23:12:32.817090 np0000002687 nova-compute[98431]: iface.state = Jun 11 23:12:32.817090 np0000002687 nova-compute[98431]: iface.vlan_id = 0 Jun 11 23:12:32.817090 np0000002687 nova-compute[98431]: iface.vlan_priority = 0 Jun 11 23:12:32.817090 np0000002687 nova-compute[98431]: iface.vlan_state = Jun 11 23:12:32.817090 np0000002687 nova-compute[98431]: iface.iface_num = 0 Jun 11 23:12:32.817090 np0000002687 nova-compute[98431]: iface.mtu = 0 Jun 11 23:12:32.817090 np0000002687 nova-compute[98431]: iface.port = 0 Jun 11 23:12:32.817090 np0000002687 nova-compute[98431]: iface.bootproto = Jun 11 23:12:32.817090 np0000002687 nova-compute[98431]: iface.subnet_mask = Jun 11 23:12:32.817090 np0000002687 nova-compute[98431]: iface.gateway = Jun 11 23:12:32.817090 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id_state = Jun 11 23:12:32.817090 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id = Jun 11 23:12:32.817090 np0000002687 nova-compute[98431]: iface.dhcp_dns = Jun 11 23:12:32.817090 np0000002687 nova-compute[98431]: iface.dhcp_learn_iqn = Jun 11 23:12:32.817090 np0000002687 nova-compute[98431]: iface.dhcp_req_vendor_id_state = Jun 11 23:12:32.817090 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id_state = Jun 11 23:12:32.817090 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id = Jun 11 23:12:32.817090 np0000002687 nova-compute[98431]: iface.dhcp_slp_da = Jun 11 23:12:32.817090 np0000002687 nova-compute[98431]: iface.fragmentation = Jun 11 23:12:32.817090 np0000002687 nova-compute[98431]: iface.gratuitous_arp = Jun 11 23:12:32.817090 np0000002687 nova-compute[98431]: iface.incoming_forwarding = Jun 11 23:12:32.817090 np0000002687 nova-compute[98431]: iface.tos_state = Jun 11 23:12:32.817090 np0000002687 nova-compute[98431]: iface.tos = 0 Jun 11 23:12:32.817090 np0000002687 nova-compute[98431]: iface.ttl = 0 Jun 11 23:12:32.817090 np0000002687 nova-compute[98431]: iface.delayed_ack = Jun 11 23:12:32.817090 np0000002687 nova-compute[98431]: iface.tcp_nagle = Jun 11 23:12:32.817090 np0000002687 nova-compute[98431]: iface.tcp_wsf_state = Jun 11 23:12:32.817090 np0000002687 nova-compute[98431]: iface.tcp_wsf = 0 Jun 11 23:12:32.817090 np0000002687 nova-compute[98431]: iface.tcp_timer_scale = 0 Jun 11 23:12:32.817090 np0000002687 nova-compute[98431]: iface.tcp_timestamp = Jun 11 23:12:32.817090 np0000002687 nova-compute[98431]: iface.redirect = Jun 11 23:12:32.817090 np0000002687 nova-compute[98431]: iface.def_task_mgmt_timeout = 0 Jun 11 23:12:32.817090 np0000002687 nova-compute[98431]: iface.header_digest = Jun 11 23:12:32.817090 np0000002687 nova-compute[98431]: iface.data_digest = Jun 11 23:12:32.817090 np0000002687 nova-compute[98431]: iface.immediate_data = Jun 11 23:12:32.817090 np0000002687 nova-compute[98431]: iface.initial_r2t = Jun 11 23:12:32.817090 np0000002687 nova-compute[98431]: iface.data_seq_inorder = Jun 11 23:12:32.817090 np0000002687 nova-compute[98431]: iface.data_pdu_inorder = Jun 11 23:12:32.817090 np0000002687 nova-compute[98431]: iface.erl = 0 Jun 11 23:12:32.817090 np0000002687 nova-compute[98431]: iface.max_receive_data_len = 0 Jun 11 23:12:32.817090 np0000002687 nova-compute[98431]: iface.first_burst_len = 0 Jun 11 23:12:32.817090 np0000002687 nova-compute[98431]: iface.max_outstanding_r2t = 0 Jun 11 23:12:32.817090 np0000002687 nova-compute[98431]: iface.max_burst_len = 0 Jun 11 23:12:32.817090 np0000002687 nova-compute[98431]: iface.chap_auth = Jun 11 23:12:32.817090 np0000002687 nova-compute[98431]: iface.bidi_chap = Jun 11 23:12:32.817090 np0000002687 nova-compute[98431]: iface.strict_login_compliance = Jun 11 23:12:32.817090 np0000002687 nova-compute[98431]: iface.discovery_auth = Jun 11 23:12:32.817090 np0000002687 nova-compute[98431]: iface.discovery_logout = Jun 11 23:12:32.817090 np0000002687 nova-compute[98431]: node.discovery_address = Jun 11 23:12:32.817090 np0000002687 nova-compute[98431]: node.discovery_port = 0 Jun 11 23:12:32.817090 np0000002687 nova-compute[98431]: node.discovery_type = fw Jun 11 23:12:32.817090 np0000002687 nova-compute[98431]: node.session.initial_cmdsn = 0 Jun 11 23:12:32.817090 np0000002687 nova-compute[98431]: node.session.initial_login_retry_max = 8 Jun 11 23:12:32.817090 np0000002687 nova-compute[98431]: node.session.xmit_thread_priority = 0 Jun 11 23:12:32.817090 np0000002687 nova-compute[98431]: node.session.cmds_max = 128 Jun 11 23:12:32.817090 np0000002687 nova-compute[98431]: node.session.queue_depth = 32 Jun 11 23:12:32.817090 np0000002687 nova-compute[98431]: node.session.nr_sessions = 1 Jun 11 23:12:32.817090 np0000002687 nova-compute[98431]: node.session.auth.authmethod = None Jun 11 23:12:32.817090 np0000002687 nova-compute[98431]: node.session.auth.username = Jun 11 23:12:32.817090 np0000002687 nova-compute[98431]: node.session.auth.password = *** Jun 11 23:12:32.817090 np0000002687 nova-compute[98431]: node.session.auth.username_in = Jun 11 23:12:32.817090 np0000002687 nova-compute[98431]: node.session.auth.password_in = Jun 11 23:12:32.817090 np0000002687 nova-compute[98431]: node.session.auth.chap_algs = SHA256 Jun 11 23:12:32.817090 np0000002687 nova-compute[98431]: node.session.timeo.replacement_timeout = 120 Jun 11 23:12:32.817090 np0000002687 nova-compute[98431]: node.session.err_timeo.abort_timeout = 15 Jun 11 23:12:32.817090 np0000002687 nova-compute[98431]: node.session.err_timeo.lu_reset_timeout = 30 Jun 11 23:12:32.817090 np0000002687 nova-compute[98431]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 11 23:12:32.817090 np0000002687 nova-compute[98431]: node.session.err_timeo.host_reset_timeout = 60 Jun 11 23:12:32.817090 np0000002687 nova-compute[98431]: node.session.iscsi.FastAbort = Yes Jun 11 23:12:32.817090 np0000002687 nova-compute[98431]: node.session.iscsi.InitialR2T = No Jun 11 23:12:32.817090 np0000002687 nova-compute[98431]: node.session.iscsi.ImmediateData = Yes Jun 11 23:12:32.817090 np0000002687 nova-compute[98431]: node.session.iscsi.FirstBurstLength = 262144 Jun 11 23:12:32.817090 np0000002687 nova-compute[98431]: node.session.iscsi.MaxBurstLength = 16776192 Jun 11 23:12:32.817090 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Retain = 0 Jun 11 23:12:32.817090 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Wait = 2 Jun 11 23:12:32.817090 np0000002687 nova-compute[98431]: node.session.iscsi.MaxConnections = 1 Jun 11 23:12:32.817090 np0000002687 nova-compute[98431]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 11 23:12:32.817090 np0000002687 nova-compute[98431]: node.session.iscsi.ERL = 0 Jun 11 23:12:32.817090 np0000002687 nova-compute[98431]: node.session.scan = auto Jun 11 23:12:32.817090 np0000002687 nova-compute[98431]: node.session.reopen_max = 0 Jun 11 23:12:32.817090 np0000002687 nova-compute[98431]: node.conn[0].address = 192.168.50.100 Jun 11 23:12:32.817090 np0000002687 nova-compute[98431]: node.conn[0].port = 3260 Jun 11 23:12:32.817090 np0000002687 nova-compute[98431]: node.conn[0].startup = manual Jun 11 23:12:32.817090 np0000002687 nova-compute[98431]: node.conn[0].tcp.window_size = 524288 Jun 11 23:12:32.817090 np0000002687 nova-compute[98431]: node.conn[0].tcp.type_of_service = 0 Jun 11 23:12:32.817090 np0000002687 nova-compute[98431]: node.conn[0].timeo.logout_timeout = 15 Jun 11 23:12:32.817090 np0000002687 nova-compute[98431]: node.conn[0].timeo.login_timeout = 15 Jun 11 23:12:32.817090 np0000002687 nova-compute[98431]: node.conn[0].timeo.auth_timeout = 45 Jun 11 23:12:32.817090 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_interval = 5 Jun 11 23:12:32.817090 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_timeout = 5 Jun 11 23:12:32.817090 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 11 23:12:32.817090 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 11 23:12:32.817090 np0000002687 nova-compute[98431]: node.conn[0].iscsi.HeaderDigest = None Jun 11 23:12:32.817090 np0000002687 nova-compute[98431]: node.conn[0].iscsi.DataDigest = None Jun 11 23:12:32.817090 np0000002687 nova-compute[98431]: node.conn[0].iscsi.IFMarker = No Jun 11 23:12:32.817090 np0000002687 nova-compute[98431]: node.conn[0].iscsi.OFMarker = No Jun 11 23:12:32.817090 np0000002687 nova-compute[98431]: # END RECORD Jun 11 23:12:32.817090 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:12:32.820932 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Removed pending STOPPED event for cb63f66c-b69e-42b0-805c-be6fe9b3aee3 due to new event Resumed> {{(pid=98431) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:519}} Jun 11 23:12:32.820932 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Emitting event Resumed> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:12:32.821021 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] VM Resumed (Lifecycle Event) Jun 11 23:12:32.825870 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-81ada886-9677-4937-8d85-7aa77fe777e5 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:12:32.826901 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b6d9da6-6e35-402c-9b0c-3e59164eadfc tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:12:32.835500 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b6d9da6-6e35-402c-9b0c-3e59164eadfc tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:12:32.846933 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b6d9da6-6e35-402c-9b0c-3e59164eadfc tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:12:32.846933 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:12:32.846933 np0000002687 nova-compute[98431]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060 (non-flash) Jun 11 23:12:32.846933 np0000002687 nova-compute[98431]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060 (non-flash) Jun 11 23:12:32.846933 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:12:32.846933 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:12:32.846933 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:12:32.847284 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b6d9da6-6e35-402c-9b0c-3e59164eadfc tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] iscsi session list stdout=tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:12:32.847284 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:12:32.847284 np0000002687 nova-compute[98431]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060 (non-flash) Jun 11 23:12:32.847284 np0000002687 nova-compute[98431]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060 (non-flash) Jun 11 23:12:32.847284 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:12:32.847284 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:12:32.847284 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:12:32.849728 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:32.860477 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b6d9da6-6e35-402c-9b0c-3e59164eadfc tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:12:32.860477 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:12:32.860477 np0000002687 nova-compute[98431]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060 (non-flash) Jun 11 23:12:32.860477 np0000002687 nova-compute[98431]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060 (non-flash) Jun 11 23:12:32.860477 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:12:32.860477 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:12:32.860477 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:12:32.860477 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b6d9da6-6e35-402c-9b0c-3e59164eadfc tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] iscsi session list stdout=tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:12:32.860477 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:12:32.860477 np0000002687 nova-compute[98431]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060 (non-flash) Jun 11 23:12:32.860477 np0000002687 nova-compute[98431]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060 (non-flash) Jun 11 23:12:32.860477 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:12:32.860477 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:12:32.860477 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:12:32.907689 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b6d9da6-6e35-402c-9b0c-3e59164eadfc tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979, portal: 192.168.40.100,3260] Jun 11 23:12:32.907689 np0000002687 nova-compute[98431]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979, portal: 192.168.40.100,3260] successful. Jun 11 23:12:32.907689 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:12:32.919611 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b6d9da6-6e35-402c-9b0c-3e59164eadfc tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979, portal: 192.168.50.100,3260] Jun 11 23:12:32.919611 np0000002687 nova-compute[98431]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979, portal: 192.168.50.100,3260] successful. Jun 11 23:12:32.919611 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:12:32.931268 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:32.931268 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b6d9da6-6e35-402c-9b0c-3e59164eadfc tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:12:32.950486 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b6d9da6-6e35-402c-9b0c-3e59164eadfc tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:12:32.959310 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:32.959882 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:32.969936 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b6d9da6-6e35-402c-9b0c-3e59164eadfc tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:12:32.969936 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:12:32.969936 np0000002687 nova-compute[98431]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060 (non-flash) Jun 11 23:12:32.969936 np0000002687 nova-compute[98431]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060 (non-flash) Jun 11 23:12:32.969936 np0000002687 nova-compute[98431]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979 (non-flash) Jun 11 23:12:32.969936 np0000002687 nova-compute[98431]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979 (non-flash) Jun 11 23:12:32.969936 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:12:32.969936 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:12:32.969936 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:12:32.969936 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b6d9da6-6e35-402c-9b0c-3e59164eadfc tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] iscsi session list stdout=tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:12:32.969936 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:12:32.969936 np0000002687 nova-compute[98431]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060 (non-flash) Jun 11 23:12:32.969936 np0000002687 nova-compute[98431]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060 (non-flash) Jun 11 23:12:32.969936 np0000002687 nova-compute[98431]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979 (non-flash) Jun 11 23:12:32.969936 np0000002687 nova-compute[98431]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979 (non-flash) Jun 11 23:12:32.969936 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:12:32.969936 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:12:32.969936 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:12:32.969936 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-8b6d9da6-6e35-402c-9b0c-3e59164eadfc tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.228s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 11 23:12:32.969936 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b6d9da6-6e35-402c-9b0c-3e59164eadfc tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Connected to 192.168.40.100:3260 {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 11 23:12:32.969936 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-8b6d9da6-6e35-402c-9b0c-3e59164eadfc tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] HCTL ('9', '-', '-', 0) found on session 25 with lun 0 {{(pid=98431) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 11 23:12:32.969936 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-8b6d9da6-6e35-402c-9b0c-3e59164eadfc tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98431) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 11 23:12:32.976726 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b6d9da6-6e35-402c-9b0c-3e59164eadfc tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:12:32.976726 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:12:32.976726 np0000002687 nova-compute[98431]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060 (non-flash) Jun 11 23:12:32.976726 np0000002687 nova-compute[98431]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060 (non-flash) Jun 11 23:12:32.976726 np0000002687 nova-compute[98431]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979 (non-flash) Jun 11 23:12:32.976726 np0000002687 nova-compute[98431]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979 (non-flash) Jun 11 23:12:32.976726 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:12:32.976726 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:12:32.976726 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:12:32.979578 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b6d9da6-6e35-402c-9b0c-3e59164eadfc tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] iscsi session list stdout=tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:12:32.979578 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:12:32.979578 np0000002687 nova-compute[98431]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060 (non-flash) Jun 11 23:12:32.979578 np0000002687 nova-compute[98431]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060 (non-flash) Jun 11 23:12:32.979578 np0000002687 nova-compute[98431]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979 (non-flash) Jun 11 23:12:32.979578 np0000002687 nova-compute[98431]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979 (non-flash) Jun 11 23:12:32.979578 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:12:32.979578 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:12:32.979578 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:12:32.979578 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-8b6d9da6-6e35-402c-9b0c-3e59164eadfc tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.241s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 11 23:12:32.979578 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b6d9da6-6e35-402c-9b0c-3e59164eadfc tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Connected to 192.168.50.100:3260 {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 11 23:12:32.979578 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-8b6d9da6-6e35-402c-9b0c-3e59164eadfc tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] HCTL ('10', '-', '-', 0) found on session 26 with lun 0 {{(pid=98431) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 11 23:12:32.979578 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-8b6d9da6-6e35-402c-9b0c-3e59164eadfc tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98431) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 11 23:12:33.010365 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-8b6d9da6-6e35-402c-9b0c-3e59164eadfc tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Searching for a device in session 25 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98431) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 11 23:12:33.010365 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b6d9da6-6e35-402c-9b0c-3e59164eadfc tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2f2d8ccb-5d26-4f0b-bc60-abf6355bf979', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 11 23:12:33.010365 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-8b6d9da6-6e35-402c-9b0c-3e59164eadfc tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Searching for a device in session 26 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98431) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 11 23:12:33.010623 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b6d9da6-6e35-402c-9b0c-3e59164eadfc tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '2f2d8ccb-5d26-4f0b-bc60-abf6355bf979', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 11 23:12:33.057549 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:33.209703 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:33.214827 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:33.327265 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:12:33.332916 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98431) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 11 23:12:33.733644 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-e4dee10f-b581-4f58-98c6-adefc1f749a8 req-b9877d4c-a102-475c-a1df-ab25346306e4 service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Received event network-vif-unplugged-0263e39d-c835-4cf1-b333-265608e81a93 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:12:33.733644 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-e4dee10f-b581-4f58-98c6-adefc1f749a8 req-b9877d4c-a102-475c-a1df-ab25346306e4 service nova] Acquiring lock "49a042ba-28ba-4401-9bdf-92f96da8f80e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:12:33.733644 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-e4dee10f-b581-4f58-98c6-adefc1f749a8 req-b9877d4c-a102-475c-a1df-ab25346306e4 service nova] Lock "49a042ba-28ba-4401-9bdf-92f96da8f80e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:12:33.735174 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-e4dee10f-b581-4f58-98c6-adefc1f749a8 req-b9877d4c-a102-475c-a1df-ab25346306e4 service nova] Lock "49a042ba-28ba-4401-9bdf-92f96da8f80e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:12:33.737106 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-e4dee10f-b581-4f58-98c6-adefc1f749a8 req-b9877d4c-a102-475c-a1df-ab25346306e4 service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] No waiting events found dispatching network-vif-unplugged-0263e39d-c835-4cf1-b333-265608e81a93 {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:12:33.737709 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-e4dee10f-b581-4f58-98c6-adefc1f749a8 req-b9877d4c-a102-475c-a1df-ab25346306e4 service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Received event network-vif-unplugged-0263e39d-c835-4cf1-b333-265608e81a93 for instance with task_state deleting. {{(pid=98431) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 11 23:12:33.739637 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b6d9da6-6e35-402c-9b0c-3e59164eadfc tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98431) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 11 23:12:33.769771 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-80a70132-560a-407d-a9f4-494295cf2e38 req-3be983ee-bc99-4154-95e6-77f487a8a29d service nova] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] Received event network-vif-plugged-283962f2-faaf-4d85-8eda-9b77b55a5b0c {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:12:33.770395 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-80a70132-560a-407d-a9f4-494295cf2e38 req-3be983ee-bc99-4154-95e6-77f487a8a29d service nova] Acquiring lock "64d7833a-82e8-43e9-83ed-2507197b69bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:12:33.770999 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-80a70132-560a-407d-a9f4-494295cf2e38 req-3be983ee-bc99-4154-95e6-77f487a8a29d service nova] Lock "64d7833a-82e8-43e9-83ed-2507197b69bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:12:33.771164 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-80a70132-560a-407d-a9f4-494295cf2e38 req-3be983ee-bc99-4154-95e6-77f487a8a29d service nova] Lock "64d7833a-82e8-43e9-83ed-2507197b69bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:12:33.771698 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-80a70132-560a-407d-a9f4-494295cf2e38 req-3be983ee-bc99-4154-95e6-77f487a8a29d service nova] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] Processing event network-vif-plugged-283962f2-faaf-4d85-8eda-9b77b55a5b0c {{(pid=98431) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 11 23:12:33.836640 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Emitting event Started> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:12:33.836839 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] VM Started (Lifecycle Event) Jun 11 23:12:34.211044 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98431) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 11 23:12:34.219947 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] Guest created on hypervisor {{(pid=98431) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}} Jun 11 23:12:34.229005 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [-] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] Instance spawned successfully. Jun 11 23:12:34.229504 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 11 23:12:34.341345 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:12:34.346529 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98431) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 11 23:12:34.536566 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:34.750567 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] Found default for hw_cdrom_bus of ide {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:12:34.751484 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] Found default for hw_disk_bus of virtio {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:12:34.751484 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] Found default for hw_input_bus of None {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:12:34.759566 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] Found default for hw_pointer_model of None {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:12:34.760409 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] Found default for hw_video_model of virtio {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:12:34.760485 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] Found default for hw_vif_model of virtio {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:12:34.775815 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b6d9da6-6e35-402c-9b0c-3e59164eadfc tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Found WWN 3300000009550c01f for multipath device dm-3 {{(pid=98431) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 11 23:12:34.777071 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-8b6d9da6-6e35-402c-9b0c-3e59164eadfc tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.065s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 11 23:12:34.777071 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b6d9da6-6e35-402c-9b0c-3e59164eadfc tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] <== connect_volume: return (3066ms) {'type': 'block', 'scsi_wwn': '3300000009550c01f', 'path': '/dev/dm-3', 'multipath_id': '3300000009550c01f'} {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 11 23:12:34.777071 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b6d9da6-6e35-402c-9b0c-3e59164eadfc tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000009550c01f', 'path': '/dev/dm-3', 'multipath_id': '3300000009550c01f'} {{(pid=98431) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 11 23:12:34.780032 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-8b6d9da6-6e35-402c-9b0c-3e59164eadfc tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Lazy-loading 'flavor' on Instance uuid 7609742e-a3a2-4be2-ba02-227efb2101e1 {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:12:34.849033 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Emitting event Started> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:12:34.850927 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] VM Started (Lifecycle Event) Jun 11 23:12:34.933018 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-c8e78479-330c-4647-b641-17a40f3dc4cd tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 8641b14d-785b-44b0-ad6d-bb537cbee5c7] Snapshot image upload complete Jun 11 23:12:34.933257 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-c8e78479-330c-4647-b641-17a40f3dc4cd tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 8641b14d-785b-44b0-ad6d-bb537cbee5c7] Took 6.40 seconds to snapshot the instance on the hypervisor. Jun 11 23:12:34.942917 np0000002687 nova-compute[98431]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0006831200000760873 future=) submitted to {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:12:34.943090 np0000002687 nova-compute[98431]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:12:34.943789 np0000002687 nova-compute[98431]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=0.1417459910001071 future=) {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:12:34.943789 np0000002687 nova-compute[98431]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=0.14161067200006983 future=) {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:12:34.943789 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Emitting event Stopped> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:12:34.943941 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 27ac8c84-e5db-4bd1-a148-ec5834c5b39c] VM Stopped (Lifecycle Event) Jun 11 23:12:35.085842 np0000002687 nova-compute[98431]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0003633520000221324 future=) submitted to {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:12:35.085842 np0000002687 nova-compute[98431]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:12:35.085842 np0000002687 nova-compute[98431]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=8.257975936000093 future=) {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:12:35.085842 np0000002687 nova-compute[98431]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=8.257895679000057 future=) {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:12:35.086735 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Emitting event Stopped> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:12:35.086735 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] [instance: 14699717-b93f-4e67-b841-c67de8fff8d4] VM Stopped (Lifecycle Event) Jun 11 23:12:35.087674 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:35.233447 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-bbf7460d-63a6-4c7d-a4db-d24da4a76ad4 req-90b4bbdb-a9f4-4d6b-94ca-bf9d0a0bdb9a service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Received event network-vif-deleted-b54ddd43-d4cb-4d4a-840e-895e75419e25 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:12:35.233447 np0000002687 nova-compute[98431]: INFO nova.compute.manager [req-bbf7460d-63a6-4c7d-a4db-d24da4a76ad4 req-90b4bbdb-a9f4-4d6b-94ca-bf9d0a0bdb9a service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Neutron deleted interface b54ddd43-d4cb-4d4a-840e-895e75419e25; detaching it from the instance and deleting it from the info cache Jun 11 23:12:35.239976 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-bbf7460d-63a6-4c7d-a4db-d24da4a76ad4 req-90b4bbdb-a9f4-4d6b-94ca-bf9d0a0bdb9a service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Detach interface failed, port_id=b54ddd43-d4cb-4d4a-840e-895e75419e25, reason: Instance 49a042ba-28ba-4401-9bdf-92f96da8f80e could not be found. {{(pid=98431) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}} Jun 11 23:12:35.273143 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] Took 11.54 seconds to spawn the instance on the hypervisor. Jun 11 23:12:35.273143 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:12:35.283645 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-8b6d9da6-6e35-402c-9b0c-3e59164eadfc tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Attempting to attach volume 2f2d8ccb-5d26-4f0b-bc60-abf6355bf979 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98431) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}} Jun 11 23:12:35.285472 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.guest [None req-8b6d9da6-6e35-402c-9b0c-3e59164eadfc tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] attach device xml: Jun 11 23:12:35.285472 np0000002687 nova-compute[98431]: Jun 11 23:12:35.285472 np0000002687 nova-compute[98431]: Jun 11 23:12:35.285472 np0000002687 nova-compute[98431]: Jun 11 23:12:35.285472 np0000002687 nova-compute[98431]: Jun 11 23:12:35.285472 np0000002687 nova-compute[98431]: 2f2d8ccb-5d26-4f0b-bc60-abf6355bf979 Jun 11 23:12:35.285472 np0000002687 nova-compute[98431]: Jun 11 23:12:35.285472 np0000002687 nova-compute[98431]: {{(pid=98431) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} Jun 11 23:12:35.353813 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:12:35.356503 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98431) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 11 23:12:35.447051 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 27ac8c84-e5db-4bd1-a148-ec5834c5b39c] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:12:35.548034 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [req-3cb07ef3-b632-4527-a852-2571ffa18c48 req-d671f1b4-9411-4eb7-bced-3511734c120e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:12:35.590391 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-b895a994-c32c-4b70-adc2-c1e91be18a16 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] [instance: 14699717-b93f-4e67-b841-c67de8fff8d4] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:12:35.786657 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] Took 17.51 seconds to build instance. Jun 11 23:12:35.863396 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Emitting event Paused> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:12:35.863396 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] VM Paused (Lifecycle Event) Jun 11 23:12:35.877416 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-2be72c75-e867-4d7a-9c22-2659e6bd2fb9 req-cb957ce7-342d-46da-9242-5614917df5e3 service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Received event network-vif-deleted-0263e39d-c835-4cf1-b333-265608e81a93 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:12:35.878100 np0000002687 nova-compute[98431]: INFO nova.compute.manager [req-2be72c75-e867-4d7a-9c22-2659e6bd2fb9 req-cb957ce7-342d-46da-9242-5614917df5e3 service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Neutron deleted interface 0263e39d-c835-4cf1-b333-265608e81a93; detaching it from the instance and deleting it from the info cache Jun 11 23:12:35.880989 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-2be72c75-e867-4d7a-9c22-2659e6bd2fb9 req-cb957ce7-342d-46da-9242-5614917df5e3 service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Detach interface failed, port_id=0263e39d-c835-4cf1-b333-265608e81a93, reason: Instance 49a042ba-28ba-4401-9bdf-92f96da8f80e could not be found. {{(pid=98431) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}} Jun 11 23:12:35.882227 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-2be72c75-e867-4d7a-9c22-2659e6bd2fb9 req-cb957ce7-342d-46da-9242-5614917df5e3 service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Received event network-vif-unplugged-0263e39d-c835-4cf1-b333-265608e81a93 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:12:35.882499 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-2be72c75-e867-4d7a-9c22-2659e6bd2fb9 req-cb957ce7-342d-46da-9242-5614917df5e3 service nova] Acquiring lock "49a042ba-28ba-4401-9bdf-92f96da8f80e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:12:35.882671 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-2be72c75-e867-4d7a-9c22-2659e6bd2fb9 req-cb957ce7-342d-46da-9242-5614917df5e3 service nova] Lock "49a042ba-28ba-4401-9bdf-92f96da8f80e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:12:35.882863 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-2be72c75-e867-4d7a-9c22-2659e6bd2fb9 req-cb957ce7-342d-46da-9242-5614917df5e3 service nova] Lock "49a042ba-28ba-4401-9bdf-92f96da8f80e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:12:35.882966 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-2be72c75-e867-4d7a-9c22-2659e6bd2fb9 req-cb957ce7-342d-46da-9242-5614917df5e3 service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] No waiting events found dispatching network-vif-unplugged-0263e39d-c835-4cf1-b333-265608e81a93 {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:12:35.883079 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-2be72c75-e867-4d7a-9c22-2659e6bd2fb9 req-cb957ce7-342d-46da-9242-5614917df5e3 service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Received event network-vif-unplugged-0263e39d-c835-4cf1-b333-265608e81a93 for instance with task_state deleting. {{(pid=98431) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 11 23:12:35.883200 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-2be72c75-e867-4d7a-9c22-2659e6bd2fb9 req-cb957ce7-342d-46da-9242-5614917df5e3 service nova] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Received event network-vif-unplugged-2d6dd8b9-e3ff-462f-92cf-8c3a62bc27d1 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:12:35.883393 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-2be72c75-e867-4d7a-9c22-2659e6bd2fb9 req-cb957ce7-342d-46da-9242-5614917df5e3 service nova] Acquiring lock "cb63f66c-b69e-42b0-805c-be6fe9b3aee3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:12:35.883520 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-2be72c75-e867-4d7a-9c22-2659e6bd2fb9 req-cb957ce7-342d-46da-9242-5614917df5e3 service nova] Lock "cb63f66c-b69e-42b0-805c-be6fe9b3aee3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:12:35.883629 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-2be72c75-e867-4d7a-9c22-2659e6bd2fb9 req-cb957ce7-342d-46da-9242-5614917df5e3 service nova] Lock "cb63f66c-b69e-42b0-805c-be6fe9b3aee3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:12:35.884177 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-2be72c75-e867-4d7a-9c22-2659e6bd2fb9 req-cb957ce7-342d-46da-9242-5614917df5e3 service nova] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] No waiting events found dispatching network-vif-unplugged-2d6dd8b9-e3ff-462f-92cf-8c3a62bc27d1 {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:12:35.884502 np0000002687 nova-compute[98431]: WARNING nova.compute.manager [req-2be72c75-e867-4d7a-9c22-2659e6bd2fb9 req-cb957ce7-342d-46da-9242-5614917df5e3 service nova] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Received unexpected event network-vif-unplugged-2d6dd8b9-e3ff-462f-92cf-8c3a62bc27d1 for instance with vm_state active and task_state None. Jun 11 23:12:35.884646 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-2be72c75-e867-4d7a-9c22-2659e6bd2fb9 req-cb957ce7-342d-46da-9242-5614917df5e3 service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Received event network-vif-deleted-09135c79-b0df-40af-b05b-2e171390f37f {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:12:35.886187 np0000002687 nova-compute[98431]: INFO nova.compute.manager [req-2be72c75-e867-4d7a-9c22-2659e6bd2fb9 req-cb957ce7-342d-46da-9242-5614917df5e3 service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Neutron deleted interface 09135c79-b0df-40af-b05b-2e171390f37f; detaching it from the instance and deleting it from the info cache Jun 11 23:12:35.888874 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-2be72c75-e867-4d7a-9c22-2659e6bd2fb9 req-cb957ce7-342d-46da-9242-5614917df5e3 service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Detach interface failed, port_id=09135c79-b0df-40af-b05b-2e171390f37f, reason: Instance 49a042ba-28ba-4401-9bdf-92f96da8f80e could not be found. {{(pid=98431) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}} Jun 11 23:12:35.891765 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-2be72c75-e867-4d7a-9c22-2659e6bd2fb9 req-cb957ce7-342d-46da-9242-5614917df5e3 service nova] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Received event network-vif-unplugged-2d6dd8b9-e3ff-462f-92cf-8c3a62bc27d1 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:12:35.891982 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-2be72c75-e867-4d7a-9c22-2659e6bd2fb9 req-cb957ce7-342d-46da-9242-5614917df5e3 service nova] Acquiring lock "cb63f66c-b69e-42b0-805c-be6fe9b3aee3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:12:35.892119 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-2be72c75-e867-4d7a-9c22-2659e6bd2fb9 req-cb957ce7-342d-46da-9242-5614917df5e3 service nova] Lock "cb63f66c-b69e-42b0-805c-be6fe9b3aee3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:12:35.892235 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-2be72c75-e867-4d7a-9c22-2659e6bd2fb9 req-cb957ce7-342d-46da-9242-5614917df5e3 service nova] Lock "cb63f66c-b69e-42b0-805c-be6fe9b3aee3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:12:35.892359 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-2be72c75-e867-4d7a-9c22-2659e6bd2fb9 req-cb957ce7-342d-46da-9242-5614917df5e3 service nova] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] No waiting events found dispatching network-vif-unplugged-2d6dd8b9-e3ff-462f-92cf-8c3a62bc27d1 {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:12:35.892476 np0000002687 nova-compute[98431]: WARNING nova.compute.manager [req-2be72c75-e867-4d7a-9c22-2659e6bd2fb9 req-cb957ce7-342d-46da-9242-5614917df5e3 service nova] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Received unexpected event network-vif-unplugged-2d6dd8b9-e3ff-462f-92cf-8c3a62bc27d1 for instance with vm_state active and task_state None. Jun 11 23:12:35.892574 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-2be72c75-e867-4d7a-9c22-2659e6bd2fb9 req-cb957ce7-342d-46da-9242-5614917df5e3 service nova] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Received event network-vif-plugged-2d6dd8b9-e3ff-462f-92cf-8c3a62bc27d1 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:12:35.892681 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-2be72c75-e867-4d7a-9c22-2659e6bd2fb9 req-cb957ce7-342d-46da-9242-5614917df5e3 service nova] Acquiring lock "cb63f66c-b69e-42b0-805c-be6fe9b3aee3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:12:35.892787 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-2be72c75-e867-4d7a-9c22-2659e6bd2fb9 req-cb957ce7-342d-46da-9242-5614917df5e3 service nova] Lock "cb63f66c-b69e-42b0-805c-be6fe9b3aee3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:12:35.892969 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-2be72c75-e867-4d7a-9c22-2659e6bd2fb9 req-cb957ce7-342d-46da-9242-5614917df5e3 service nova] Lock "cb63f66c-b69e-42b0-805c-be6fe9b3aee3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:12:35.893069 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-2be72c75-e867-4d7a-9c22-2659e6bd2fb9 req-cb957ce7-342d-46da-9242-5614917df5e3 service nova] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] No waiting events found dispatching network-vif-plugged-2d6dd8b9-e3ff-462f-92cf-8c3a62bc27d1 {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:12:35.893165 np0000002687 nova-compute[98431]: WARNING nova.compute.manager [req-2be72c75-e867-4d7a-9c22-2659e6bd2fb9 req-cb957ce7-342d-46da-9242-5614917df5e3 service nova] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Received unexpected event network-vif-plugged-2d6dd8b9-e3ff-462f-92cf-8c3a62bc27d1 for instance with vm_state active and task_state None. Jun 11 23:12:35.904895 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-4d9af140-9010-4277-8983-81629714d2c8 req-951eb869-38ad-47a2-88bd-726fed035bf9 service nova] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] Received event network-vif-plugged-283962f2-faaf-4d85-8eda-9b77b55a5b0c {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:12:35.905125 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-4d9af140-9010-4277-8983-81629714d2c8 req-951eb869-38ad-47a2-88bd-726fed035bf9 service nova] Acquiring lock "64d7833a-82e8-43e9-83ed-2507197b69bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:12:35.905335 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-4d9af140-9010-4277-8983-81629714d2c8 req-951eb869-38ad-47a2-88bd-726fed035bf9 service nova] Lock "64d7833a-82e8-43e9-83ed-2507197b69bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:12:35.905971 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-4d9af140-9010-4277-8983-81629714d2c8 req-951eb869-38ad-47a2-88bd-726fed035bf9 service nova] Lock "64d7833a-82e8-43e9-83ed-2507197b69bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:12:35.906123 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-4d9af140-9010-4277-8983-81629714d2c8 req-951eb869-38ad-47a2-88bd-726fed035bf9 service nova] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] No waiting events found dispatching network-vif-plugged-283962f2-faaf-4d85-8eda-9b77b55a5b0c {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:12:35.906508 np0000002687 nova-compute[98431]: WARNING nova.compute.manager [req-4d9af140-9010-4277-8983-81629714d2c8 req-951eb869-38ad-47a2-88bd-726fed035bf9 service nova] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] Received unexpected event network-vif-plugged-283962f2-faaf-4d85-8eda-9b77b55a5b0c for instance with vm_state active and task_state None. Jun 11 23:12:35.906508 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-4d9af140-9010-4277-8983-81629714d2c8 req-951eb869-38ad-47a2-88bd-726fed035bf9 service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Received event network-vif-deleted-77424d75-6e25-4791-a44d-495051f7e89f {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:12:35.906703 np0000002687 nova-compute[98431]: INFO nova.compute.manager [req-4d9af140-9010-4277-8983-81629714d2c8 req-951eb869-38ad-47a2-88bd-726fed035bf9 service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Neutron deleted interface 77424d75-6e25-4791-a44d-495051f7e89f; detaching it from the instance and deleting it from the info cache Jun 11 23:12:35.909454 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-4d9af140-9010-4277-8983-81629714d2c8 req-951eb869-38ad-47a2-88bd-726fed035bf9 service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Detach interface failed, port_id=77424d75-6e25-4791-a44d-495051f7e89f, reason: Instance 49a042ba-28ba-4401-9bdf-92f96da8f80e could not be found. {{(pid=98431) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}} Jun 11 23:12:36.290638 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "64d7833a-82e8-43e9-83ed-2507197b69bf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 19.019s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:12:36.368218 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:12:36.375671 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Emitting event Resumed> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:12:36.375975 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] VM Resumed (Lifecycle Event) Jun 11 23:12:36.599830 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-3cb07ef3-b632-4527-a852-2571ffa18c48 req-d671f1b4-9411-4eb7-bced-3511734c120e service nova] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Updated VIF entry in instance network info cache for port 2d6dd8b9-e3ff-462f-92cf-8c3a62bc27d1. {{(pid=98431) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 11 23:12:36.599830 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-3cb07ef3-b632-4527-a852-2571ffa18c48 req-d671f1b4-9411-4eb7-bced-3511734c120e service nova] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Updating instance_info_cache with network_info: [{"id": "2d6dd8b9-e3ff-462f-92cf-8c3a62bc27d1", "address": "fa:16:3e:b5:6f:fd", "network": {"id": "b1a1d33f-f9b6-48cf-86a1-0260d53f3bb0", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1779972098-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2d62cddce233457caf7eb43be819e513", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d6dd8b9-e3", "ovs_interfaceid": "2d6dd8b9-e3ff-462f-92cf-8c3a62bc27d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:12:36.880468 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:12:36.888812 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98431) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 11 23:12:36.938466 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [-] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Updating instance_info_cache with network_info: [] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:12:37.011837 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-8b6d9da6-6e35-402c-9b0c-3e59164eadfc tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] No BDM found with device name vda, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:12:37.012348 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-8b6d9da6-6e35-402c-9b0c-3e59164eadfc tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:12:37.012604 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-8b6d9da6-6e35-402c-9b0c-3e59164eadfc tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] No BDM found with device name hda, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:12:37.015991 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-8b6d9da6-6e35-402c-9b0c-3e59164eadfc tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] No VIF found with MAC fa:16:3e:1d:f7:18, not building metadata {{(pid=98431) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13199}} Jun 11 23:12:37.111315 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-3cb07ef3-b632-4527-a852-2571ffa18c48 req-d671f1b4-9411-4eb7-bced-3511734c120e service nova] Releasing lock "refresh_cache-cb63f66c-b69e-42b0-805c-be6fe9b3aee3" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 11 23:12:37.111572 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-3cb07ef3-b632-4527-a852-2571ffa18c48 req-d671f1b4-9411-4eb7-bced-3511734c120e service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Received event network-vif-unplugged-609ed1b7-9ea3-4ae3-8c37-f0a952a45507 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:12:37.111780 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-3cb07ef3-b632-4527-a852-2571ffa18c48 req-d671f1b4-9411-4eb7-bced-3511734c120e service nova] Acquiring lock "49a042ba-28ba-4401-9bdf-92f96da8f80e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:12:37.111978 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-3cb07ef3-b632-4527-a852-2571ffa18c48 req-d671f1b4-9411-4eb7-bced-3511734c120e service nova] Lock "49a042ba-28ba-4401-9bdf-92f96da8f80e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:12:37.112115 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-3cb07ef3-b632-4527-a852-2571ffa18c48 req-d671f1b4-9411-4eb7-bced-3511734c120e service nova] Lock "49a042ba-28ba-4401-9bdf-92f96da8f80e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:12:37.112257 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-3cb07ef3-b632-4527-a852-2571ffa18c48 req-d671f1b4-9411-4eb7-bced-3511734c120e service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] No waiting events found dispatching network-vif-unplugged-609ed1b7-9ea3-4ae3-8c37-f0a952a45507 {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:12:37.112420 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-3cb07ef3-b632-4527-a852-2571ffa18c48 req-d671f1b4-9411-4eb7-bced-3511734c120e service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Received event network-vif-unplugged-609ed1b7-9ea3-4ae3-8c37-f0a952a45507 for instance with task_state deleting. {{(pid=98431) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 11 23:12:37.112555 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-3cb07ef3-b632-4527-a852-2571ffa18c48 req-d671f1b4-9411-4eb7-bced-3511734c120e service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Received event network-vif-unplugged-609ed1b7-9ea3-4ae3-8c37-f0a952a45507 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:12:37.114719 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-3cb07ef3-b632-4527-a852-2571ffa18c48 req-d671f1b4-9411-4eb7-bced-3511734c120e service nova] Acquiring lock "49a042ba-28ba-4401-9bdf-92f96da8f80e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:12:37.114719 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-3cb07ef3-b632-4527-a852-2571ffa18c48 req-d671f1b4-9411-4eb7-bced-3511734c120e service nova] Lock "49a042ba-28ba-4401-9bdf-92f96da8f80e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:12:37.114719 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-3cb07ef3-b632-4527-a852-2571ffa18c48 req-d671f1b4-9411-4eb7-bced-3511734c120e service nova] Lock "49a042ba-28ba-4401-9bdf-92f96da8f80e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:12:37.114719 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-3cb07ef3-b632-4527-a852-2571ffa18c48 req-d671f1b4-9411-4eb7-bced-3511734c120e service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] No waiting events found dispatching network-vif-unplugged-609ed1b7-9ea3-4ae3-8c37-f0a952a45507 {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:12:37.114719 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-3cb07ef3-b632-4527-a852-2571ffa18c48 req-d671f1b4-9411-4eb7-bced-3511734c120e service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Received event network-vif-unplugged-609ed1b7-9ea3-4ae3-8c37-f0a952a45507 for instance with task_state deleting. {{(pid=98431) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 11 23:12:37.114719 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-3cb07ef3-b632-4527-a852-2571ffa18c48 req-d671f1b4-9411-4eb7-bced-3511734c120e service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Received event network-vif-unplugged-b54ddd43-d4cb-4d4a-840e-895e75419e25 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:12:37.114719 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-3cb07ef3-b632-4527-a852-2571ffa18c48 req-d671f1b4-9411-4eb7-bced-3511734c120e service nova] Acquiring lock "49a042ba-28ba-4401-9bdf-92f96da8f80e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:12:37.114719 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-3cb07ef3-b632-4527-a852-2571ffa18c48 req-d671f1b4-9411-4eb7-bced-3511734c120e service nova] Lock "49a042ba-28ba-4401-9bdf-92f96da8f80e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:12:37.114719 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-3cb07ef3-b632-4527-a852-2571ffa18c48 req-d671f1b4-9411-4eb7-bced-3511734c120e service nova] Lock "49a042ba-28ba-4401-9bdf-92f96da8f80e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:12:37.114719 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-3cb07ef3-b632-4527-a852-2571ffa18c48 req-d671f1b4-9411-4eb7-bced-3511734c120e service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] No waiting events found dispatching network-vif-unplugged-b54ddd43-d4cb-4d4a-840e-895e75419e25 {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:12:37.114719 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-3cb07ef3-b632-4527-a852-2571ffa18c48 req-d671f1b4-9411-4eb7-bced-3511734c120e service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Received event network-vif-unplugged-b54ddd43-d4cb-4d4a-840e-895e75419e25 for instance with task_state deleting. {{(pid=98431) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 11 23:12:37.114719 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-3cb07ef3-b632-4527-a852-2571ffa18c48 req-d671f1b4-9411-4eb7-bced-3511734c120e service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Received event network-vif-unplugged-b54ddd43-d4cb-4d4a-840e-895e75419e25 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:12:37.114719 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-3cb07ef3-b632-4527-a852-2571ffa18c48 req-d671f1b4-9411-4eb7-bced-3511734c120e service nova] Acquiring lock "49a042ba-28ba-4401-9bdf-92f96da8f80e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:12:37.114719 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-3cb07ef3-b632-4527-a852-2571ffa18c48 req-d671f1b4-9411-4eb7-bced-3511734c120e service nova] Lock "49a042ba-28ba-4401-9bdf-92f96da8f80e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:12:37.115291 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-3cb07ef3-b632-4527-a852-2571ffa18c48 req-d671f1b4-9411-4eb7-bced-3511734c120e service nova] Lock "49a042ba-28ba-4401-9bdf-92f96da8f80e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:12:37.115291 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-3cb07ef3-b632-4527-a852-2571ffa18c48 req-d671f1b4-9411-4eb7-bced-3511734c120e service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] No waiting events found dispatching network-vif-unplugged-b54ddd43-d4cb-4d4a-840e-895e75419e25 {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:12:37.115291 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-3cb07ef3-b632-4527-a852-2571ffa18c48 req-d671f1b4-9411-4eb7-bced-3511734c120e service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Received event network-vif-unplugged-b54ddd43-d4cb-4d4a-840e-895e75419e25 for instance with task_state deleting. {{(pid=98431) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 11 23:12:37.391774 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:37.443509 np0000002687 nova-compute[98431]: INFO nova.compute.manager [-] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Took 6.43 seconds to deallocate network for instance. Jun 11 23:12:37.447657 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:37.855753 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:38.011007 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-6fac5aa8-e47a-442b-836a-39a7c039a763 req-91c51172-c7ae-49f5-a5d9-a92575bd1dda service nova] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Received event network-vif-plugged-2d6dd8b9-e3ff-462f-92cf-8c3a62bc27d1 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:12:38.011007 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-6fac5aa8-e47a-442b-836a-39a7c039a763 req-91c51172-c7ae-49f5-a5d9-a92575bd1dda service nova] Acquiring lock "cb63f66c-b69e-42b0-805c-be6fe9b3aee3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:12:38.011007 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-6fac5aa8-e47a-442b-836a-39a7c039a763 req-91c51172-c7ae-49f5-a5d9-a92575bd1dda service nova] Lock "cb63f66c-b69e-42b0-805c-be6fe9b3aee3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:12:38.011007 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-6fac5aa8-e47a-442b-836a-39a7c039a763 req-91c51172-c7ae-49f5-a5d9-a92575bd1dda service nova] Lock "cb63f66c-b69e-42b0-805c-be6fe9b3aee3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:12:38.011007 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-6fac5aa8-e47a-442b-836a-39a7c039a763 req-91c51172-c7ae-49f5-a5d9-a92575bd1dda service nova] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] No waiting events found dispatching network-vif-plugged-2d6dd8b9-e3ff-462f-92cf-8c3a62bc27d1 {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:12:38.011007 np0000002687 nova-compute[98431]: WARNING nova.compute.manager [req-6fac5aa8-e47a-442b-836a-39a7c039a763 req-91c51172-c7ae-49f5-a5d9-a92575bd1dda service nova] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Received unexpected event network-vif-plugged-2d6dd8b9-e3ff-462f-92cf-8c3a62bc27d1 for instance with vm_state active and task_state None. Jun 11 23:12:38.045824 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-2f1af699-8038-4cc5-9394-70e80bc82a61 req-3dd6b51a-e8fa-47ae-99dc-5271c4566054 service nova] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Received event network-vif-deleted-7808ce0e-ec36-4dfa-84d5-0eb1ce542139 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:12:38.549087 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Acquiring lock "0d352738-c7bf-42a2-8260-bf5574a7200d" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:12:38.549335 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lock "0d352738-c7bf-42a2-8260-bf5574a7200d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:12:38.627582 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-8b6d9da6-6e35-402c-9b0c-3e59164eadfc tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Lock "7609742e-a3a2-4be2-ba02-227efb2101e1" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 7.701s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:12:39.054128 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Starting instance... {{(pid=98431) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 11 23:12:39.222527 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Took 1.78 seconds to detach 3 volumes for instance. Jun 11 23:12:39.381831 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-3f88fa17-c2f0-4ffb-8768-4b1a41765c3a req-fc229325-47fe-438d-baf1-05015d7245b5 service nova] [instance: 8ffa4bbe-7ead-4029-aba5-28f031f6e784] Received event network-changed-591ff615-4a02-4f43-a49b-7f4052a8ed27 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:12:39.381831 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-3f88fa17-c2f0-4ffb-8768-4b1a41765c3a req-fc229325-47fe-438d-baf1-05015d7245b5 service nova] [instance: 8ffa4bbe-7ead-4029-aba5-28f031f6e784] Refreshing instance network info cache due to event network-changed-591ff615-4a02-4f43-a49b-7f4052a8ed27. {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 11 23:12:39.382869 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-3f88fa17-c2f0-4ffb-8768-4b1a41765c3a req-fc229325-47fe-438d-baf1-05015d7245b5 service nova] Acquiring lock "refresh_cache-8ffa4bbe-7ead-4029-aba5-28f031f6e784" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 11 23:12:39.383646 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-3f88fa17-c2f0-4ffb-8768-4b1a41765c3a req-fc229325-47fe-438d-baf1-05015d7245b5 service nova] Acquired lock "refresh_cache-8ffa4bbe-7ead-4029-aba5-28f031f6e784" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 11 23:12:39.383775 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-3f88fa17-c2f0-4ffb-8768-4b1a41765c3a req-fc229325-47fe-438d-baf1-05015d7245b5 service nova] [instance: 8ffa4bbe-7ead-4029-aba5-28f031f6e784] Refreshing network info cache for port 591ff615-4a02-4f43-a49b-7f4052a8ed27 {{(pid=98431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 11 23:12:39.537490 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:39.630741 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:12:39.631497 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:12:39.636281 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98431) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 11 23:12:39.636281 np0000002687 nova-compute[98431]: INFO nova.compute.claims [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Claim successful on node np0000002687 Jun 11 23:12:39.731504 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:12:39.886999 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [req-3f88fa17-c2f0-4ffb-8768-4b1a41765c3a req-fc229325-47fe-438d-baf1-05015d7245b5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:12:41.458665 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98431) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 11 23:12:41.459277 np0000002687 nova-compute[98431]: DEBUG nova.compute.provider_tree [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Inventory has not changed in ProviderTree for provider: e3e65fe2-9de9-4821-8b4a-ccae37c66e25 {{(pid=98431) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 11 23:12:41.465842 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [req-3f88fa17-c2f0-4ffb-8768-4b1a41765c3a req-fc229325-47fe-438d-baf1-05015d7245b5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:12:41.487279 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-94917b07-0927-4c0a-9303-9be78fe75b35 req-855ecd1f-0b48-4ec0-801a-f33e9f0613a6 service nova] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] Received event network-changed-283962f2-faaf-4d85-8eda-9b77b55a5b0c {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:12:41.487279 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-94917b07-0927-4c0a-9303-9be78fe75b35 req-855ecd1f-0b48-4ec0-801a-f33e9f0613a6 service nova] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] Refreshing instance network info cache due to event network-changed-283962f2-faaf-4d85-8eda-9b77b55a5b0c. {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 11 23:12:41.487453 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-94917b07-0927-4c0a-9303-9be78fe75b35 req-855ecd1f-0b48-4ec0-801a-f33e9f0613a6 service nova] Acquiring lock "refresh_cache-64d7833a-82e8-43e9-83ed-2507197b69bf" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 11 23:12:41.488268 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-94917b07-0927-4c0a-9303-9be78fe75b35 req-855ecd1f-0b48-4ec0-801a-f33e9f0613a6 service nova] Acquired lock "refresh_cache-64d7833a-82e8-43e9-83ed-2507197b69bf" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 11 23:12:41.488268 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-94917b07-0927-4c0a-9303-9be78fe75b35 req-855ecd1f-0b48-4ec0-801a-f33e9f0613a6 service nova] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] Refreshing network info cache for port 283962f2-faaf-4d85-8eda-9b77b55a5b0c {{(pid=98431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 11 23:12:41.873029 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:41.961672 np0000002687 nova-compute[98431]: DEBUG nova.scheduler.client.report [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Inventory has not changed for provider e3e65fe2-9de9-4821-8b4a-ccae37c66e25 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98431) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 11 23:12:41.995292 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [req-94917b07-0927-4c0a-9303-9be78fe75b35 req-855ecd1f-0b48-4ec0-801a-f33e9f0613a6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:12:42.248590 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-3f88fa17-c2f0-4ffb-8768-4b1a41765c3a req-fc229325-47fe-438d-baf1-05015d7245b5 service nova] [instance: 8ffa4bbe-7ead-4029-aba5-28f031f6e784] Updated VIF entry in instance network info cache for port 591ff615-4a02-4f43-a49b-7f4052a8ed27. {{(pid=98431) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 11 23:12:42.250547 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-3f88fa17-c2f0-4ffb-8768-4b1a41765c3a req-fc229325-47fe-438d-baf1-05015d7245b5 service nova] [instance: 8ffa4bbe-7ead-4029-aba5-28f031f6e784] Updating instance_info_cache with network_info: [{"id": "591ff615-4a02-4f43-a49b-7f4052a8ed27", "address": "fa:16:3e:61:b7:fd", "network": {"id": "17593db3-c22d-4354-ab29-933b1c6a5c3a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1094286565-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "81fd45f475a04e5c8e9bd9deb7ad4c1e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap591ff615-4a", "ovs_interfaceid": "591ff615-4a02-4f43-a49b-7f4052a8ed27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:12:42.481910 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.851s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:12:42.483258 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Start building networks asynchronously for instance. {{(pid=98431) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 11 23:12:42.486350 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 2.755s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:12:42.689813 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Stashing vm_state: active {{(pid=98431) _prep_resize /opt/stack/nova/nova/compute/manager.py:6338}} Jun 11 23:12:42.761516 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-3f88fa17-c2f0-4ffb-8768-4b1a41765c3a req-fc229325-47fe-438d-baf1-05015d7245b5 service nova] Releasing lock "refresh_cache-8ffa4bbe-7ead-4029-aba5-28f031f6e784" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 11 23:12:42.770238 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-e7e9f771-cf2b-4295-a312-2410df54c766 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Acquiring lock "8a45e04f-3516-4c39-bea1-820104411f17" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:12:42.770698 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-e7e9f771-cf2b-4295-a312-2410df54c766 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "8a45e04f-3516-4c39-bea1-820104411f17" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:12:42.858142 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:42.990050 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Allocating IP information in the background. {{(pid=98431) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 11 23:12:42.990345 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] allocate_for_instance() {{(pid=98431) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 11 23:12:42.991332 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:12:42.991332 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:12:43.274818 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-e7e9f771-cf2b-4295-a312-2410df54c766 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] Starting instance... {{(pid=98431) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 11 23:12:43.319593 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:12:43.344169 np0000002687 nova-compute[98431]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0006340630000067904 future=) submitted to {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:12:43.344536 np0000002687 nova-compute[98431]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:12:43.345703 np0000002687 nova-compute[98431]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=1.8626462730001094 future=) {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:12:43.345703 np0000002687 nova-compute[98431]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=1.8622946950001733 future=) was cancelled while queued, skipping {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:12:43.345703 np0000002687 nova-compute[98431]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:12:43.347057 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-751a490a-41ff-4222-88de-e87fd4942467 None None] Emitting event Stopped> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:12:43.347057 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-751a490a-41ff-4222-88de-e87fd4942467 None None] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] VM Stopped (Lifecycle Event) Jun 11 23:12:43.382039 np0000002687 nova-compute[98431]: DEBUG nova.policy [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '72b6dac5eb744cfba6299636227aa59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaf744af828a4a5eba1e98da63373b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98431) authorize /opt/stack/nova/nova/policy.py:192}} Jun 11 23:12:43.496950 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 11 23:12:43.557547 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98431) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 11 23:12:43.557838 np0000002687 nova-compute[98431]: DEBUG nova.compute.provider_tree [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Inventory has not changed in ProviderTree for provider: e3e65fe2-9de9-4821-8b4a-ccae37c66e25 {{(pid=98431) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 11 23:12:43.850824 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-751a490a-41ff-4222-88de-e87fd4942467 None None] [instance: 49a042ba-28ba-4401-9bdf-92f96da8f80e] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:12:43.864640 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-e7e9f771-cf2b-4295-a312-2410df54c766 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:12:44.001089 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Start building block device mappings for instance. {{(pid=98431) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 11 23:12:44.064517 np0000002687 nova-compute[98431]: DEBUG nova.scheduler.client.report [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Inventory has not changed for provider e3e65fe2-9de9-4821-8b4a-ccae37c66e25 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98431) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 11 23:12:44.082341 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:44.383113 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Successfully created port: 3c37ff2c-78c4-4423-b4a2-219e94df57ca {{(pid=98431) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 11 23:12:44.408622 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [req-94917b07-0927-4c0a-9303-9be78fe75b35 req-855ecd1f-0b48-4ec0-801a-f33e9f0613a6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:12:44.509817 np0000002687 nova-compute[98431]: INFO nova.virt.block_device [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Booting with volume-backed-image f30640f8-7aca-4300-a085-4706a5209a79 at /dev/vda Jun 11 23:12:44.540795 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:44.580991 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 2.094s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:12:44.582944 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 1.264s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:12:44.679430 np0000002687 nova-compute[98431]: INFO nova.scheduler.client.report [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Deleted allocations for instance 49a042ba-28ba-4401-9bdf-92f96da8f80e Jun 11 23:12:45.100114 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98431) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 11 23:12:45.100928 np0000002687 nova-compute[98431]: INFO nova.compute.claims [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Claim successful on node np0000002687 Jun 11 23:12:45.521149 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Successfully updated port: 3c37ff2c-78c4-4423-b4a2-219e94df57ca {{(pid=98431) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 11 23:12:45.611528 np0000002687 nova-compute[98431]: INFO nova.compute.resource_tracker [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Updating resource usage from migration 859c9e92-9a57-4932-9703-f13835841422 Jun 11 23:12:45.695702 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-7192fc55-bc58-4c00-ab4f-5a50945cfba6 tempest-TaggedBootDevicesTest-1898457247 tempest-TaggedBootDevicesTest-1898457247-project-member] Lock "49a042ba-28ba-4401-9bdf-92f96da8f80e" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 18.582s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:12:46.028540 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Acquiring lock "refresh_cache-0d352738-c7bf-42a2-8260-bf5574a7200d" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 11 23:12:46.028686 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Acquired lock "refresh_cache-0d352738-c7bf-42a2-8260-bf5574a7200d" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 11 23:12:46.028778 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Building network info cache for instance {{(pid=98431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 11 23:12:46.464836 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98431) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 11 23:12:46.465525 np0000002687 nova-compute[98431]: DEBUG nova.compute.provider_tree [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Inventory has not changed in ProviderTree for provider: e3e65fe2-9de9-4821-8b4a-ccae37c66e25 {{(pid=98431) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 11 23:12:46.848642 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:46.910169 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-94917b07-0927-4c0a-9303-9be78fe75b35 req-855ecd1f-0b48-4ec0-801a-f33e9f0613a6 service nova] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] Updated VIF entry in instance network info cache for port 283962f2-faaf-4d85-8eda-9b77b55a5b0c. {{(pid=98431) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 11 23:12:46.911191 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-94917b07-0927-4c0a-9303-9be78fe75b35 req-855ecd1f-0b48-4ec0-801a-f33e9f0613a6 service nova] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] Updating instance_info_cache with network_info: [{"id": "283962f2-faaf-4d85-8eda-9b77b55a5b0c", "address": "fa:16:3e:4b:26:95", "network": {"id": "17593db3-c22d-4354-ab29-933b1c6a5c3a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1094286565-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "81fd45f475a04e5c8e9bd9deb7ad4c1e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap283962f2-fa", "ovs_interfaceid": "283962f2-faaf-4d85-8eda-9b77b55a5b0c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:12:46.969830 np0000002687 nova-compute[98431]: DEBUG nova.scheduler.client.report [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Inventory has not changed for provider e3e65fe2-9de9-4821-8b4a-ccae37c66e25 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98431) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 11 23:12:47.032931 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-3ef9f8f4-f0d3-46dd-afeb-66471459ceb3 req-02a8504d-9b9a-4840-91ab-c063e71f1c5f service nova] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Received event network-changed-3c37ff2c-78c4-4423-b4a2-219e94df57ca {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:12:47.033077 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-3ef9f8f4-f0d3-46dd-afeb-66471459ceb3 req-02a8504d-9b9a-4840-91ab-c063e71f1c5f service nova] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Refreshing instance network info cache due to event network-changed-3c37ff2c-78c4-4423-b4a2-219e94df57ca. {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 11 23:12:47.033246 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-3ef9f8f4-f0d3-46dd-afeb-66471459ceb3 req-02a8504d-9b9a-4840-91ab-c063e71f1c5f service nova] Acquiring lock "refresh_cache-0d352738-c7bf-42a2-8260-bf5574a7200d" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 11 23:12:47.037848 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Instance cache missing network info. {{(pid=98431) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 11 23:12:47.099073 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:47.413873 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-94917b07-0927-4c0a-9303-9be78fe75b35 req-855ecd1f-0b48-4ec0-801a-f33e9f0613a6 service nova] Releasing lock "refresh_cache-64d7833a-82e8-43e9-83ed-2507197b69bf" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 11 23:12:47.449119 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:12:47.488124 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 2.905s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:12:47.489217 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Migrating Jun 11 23:12:47.489357 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 11 23:12:47.489503 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Acquired lock "compute-rpcapi-router" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 11 23:12:47.490851 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-e7e9f771-cf2b-4295-a312-2410df54c766 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 3.627s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:12:47.495484 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-e7e9f771-cf2b-4295-a312-2410df54c766 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98431) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 11 23:12:47.497764 np0000002687 nova-compute[98431]: INFO nova.compute.claims [None req-e7e9f771-cf2b-4295-a312-2410df54c766 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] Claim successful on node np0000002687 Jun 11 23:12:47.766206 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Updating instance_info_cache with network_info: [{"id": "3c37ff2c-78c4-4423-b4a2-219e94df57ca", "address": "fa:16:3e:8f:ae:21", "network": {"id": "2a770c99-2ec6-4fa2-945b-32830a59e7a7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-137493671-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aaf744af828a4a5eba1e98da63373b2b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c37ff2c-78", "ovs_interfaceid": "3c37ff2c-78c4-4423-b4a2-219e94df57ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:12:47.805309 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-991f8a4a-9fa3-4c33-952b-40873b7956af req-027e58d8-ecaa-4699-8e85-f84d30bcf0b9 service nova] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Received event network-vif-unplugged-3c37ff2c-78c4-4423-b4a2-219e94df57ca {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:12:47.805458 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-991f8a4a-9fa3-4c33-952b-40873b7956af req-027e58d8-ecaa-4699-8e85-f84d30bcf0b9 service nova] Acquiring lock "0d352738-c7bf-42a2-8260-bf5574a7200d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:12:47.805584 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-991f8a4a-9fa3-4c33-952b-40873b7956af req-027e58d8-ecaa-4699-8e85-f84d30bcf0b9 service nova] Lock "0d352738-c7bf-42a2-8260-bf5574a7200d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:12:47.805680 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-991f8a4a-9fa3-4c33-952b-40873b7956af req-027e58d8-ecaa-4699-8e85-f84d30bcf0b9 service nova] Lock "0d352738-c7bf-42a2-8260-bf5574a7200d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:12:47.805815 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-991f8a4a-9fa3-4c33-952b-40873b7956af req-027e58d8-ecaa-4699-8e85-f84d30bcf0b9 service nova] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] No waiting events found dispatching network-vif-unplugged-3c37ff2c-78c4-4423-b4a2-219e94df57ca {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:12:47.805935 np0000002687 nova-compute[98431]: WARNING nova.compute.manager [req-991f8a4a-9fa3-4c33-952b-40873b7956af req-027e58d8-ecaa-4699-8e85-f84d30bcf0b9 service nova] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Received unexpected event network-vif-unplugged-3c37ff2c-78c4-4423-b4a2-219e94df57ca for instance with vm_state building and task_state block_device_mapping. Jun 11 23:12:47.861159 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:47.992516 np0000002687 nova-compute[98431]: INFO nova.compute.rpcapi [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Automatically selected compute RPC version 6.5 from minimum service version 72 Jun 11 23:12:47.993522 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Releasing lock "compute-rpcapi-router" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 11 23:12:47.993522 np0000002687 nova-compute[98431]: DEBUG nova.compute.rpcapi [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98431) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}} Jun 11 23:12:48.269355 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Releasing lock "refresh_cache-0d352738-c7bf-42a2-8260-bf5574a7200d" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 11 23:12:48.269821 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Instance network_info: |[{"id": "3c37ff2c-78c4-4423-b4a2-219e94df57ca", "address": "fa:16:3e:8f:ae:21", "network": {"id": "2a770c99-2ec6-4fa2-945b-32830a59e7a7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-137493671-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aaf744af828a4a5eba1e98da63373b2b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c37ff2c-78", "ovs_interfaceid": "3c37ff2c-78c4-4423-b4a2-219e94df57ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98431) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 11 23:12:48.271702 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-3ef9f8f4-f0d3-46dd-afeb-66471459ceb3 req-02a8504d-9b9a-4840-91ab-c063e71f1c5f service nova] Acquired lock "refresh_cache-0d352738-c7bf-42a2-8260-bf5574a7200d" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 11 23:12:48.271780 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-3ef9f8f4-f0d3-46dd-afeb-66471459ceb3 req-02a8504d-9b9a-4840-91ab-c063e71f1c5f service nova] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Refreshing network info cache for port 3c37ff2c-78c4-4423-b4a2-219e94df57ca {{(pid=98431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 11 23:12:48.297626 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.209', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000002687', 'execute': None}" {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 11 23:12:48.317029 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.scaleio [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98431) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 11 23:12:48.351467 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Running cmd (subprocess): nvme version {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:12:48.388305 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] 'nvme version' failed. Not Retrying. {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 11 23:12:48.388814 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] nvme not present on system {{(pid=98431) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 11 23:12:48.401962 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.lightos [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98431) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 11 23:12:48.403925 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.lightos [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Current host hostNQN and IP(s) are ['10.4.3.209', 'fe80::f816:3eff:fea3:3707', '192.168.40.6', 'fe80::f816:3eff:fe06:bdab', '192.168.50.6', 'fe80::f816:3eff:fe7a:46f2', '192.168.10.6', 'fe80::f816:3eff:fe13:793b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::38fa:21ff:fe6c:3746', 'fe80::fc16:3eff:fe6c:eb30', 'fe80::20a8:54ff:fe51:da0a', 'fe80::fc16:3eff:fe77:488d', 'fe80::9469:f2ff:feae:5824', 'fe80::fc16:3eff:fec7:336a', 'fe80::fc16:3eff:fe61:b7fd', 'fe80::fc16:3eff:fe1d:f718', 'fe80::14a2:b8ff:feec:f607', 'fe80::fc16:3eff:fec6:c65b', 'fe80::fc16:3eff:fed6:e34f', 'fe80::fc16:3eff:feb5:6ffd', 'fe80::4cb3:64ff:fe13:8a75', 'fe80::fc16:3eff:fe4b:2695'] Jun 11 23:12:48.404091 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.lightos [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98431) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 11 23:12:48.405742 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.lightos [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] LIGHTOS: no hostnqn found. {{(pid=98431) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 11 23:12:48.405742 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] <== get_connector_properties: return (106ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.209', 'host': 'np0000002687', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:798b370f1cc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad465dfe-0ed1-4637-98c3-ddaebebd61a4', 'nvme_native_multipath': False} {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 11 23:12:48.405742 np0000002687 nova-compute[98431]: DEBUG nova.virt.block_device [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Updating existing volume attachment record: cb1a71d5-3b93-4a6e-b283-77ed93198fe1 {{(pid=98431) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 11 23:12:48.534164 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Acquiring lock "refresh_cache-7609742e-a3a2-4be2-ba02-227efb2101e1" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 11 23:12:48.535722 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Acquired lock "refresh_cache-7609742e-a3a2-4be2-ba02-227efb2101e1" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 11 23:12:48.535933 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Building network info cache for instance {{(pid=98431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 11 23:12:48.776021 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [req-3ef9f8f4-f0d3-46dd-afeb-66471459ceb3 req-02a8504d-9b9a-4840-91ab-c063e71f1c5f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:12:48.980634 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] Acquiring lock "19beb2a4-b3fe-43e9-ac92-71446c2630ee" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:12:48.982719 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] Lock "19beb2a4-b3fe-43e9-ac92-71446c2630ee" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:12:49.041006 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:12:49.258032 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [req-3ef9f8f4-f0d3-46dd-afeb-66471459ceb3 req-02a8504d-9b9a-4840-91ab-c063e71f1c5f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:12:49.414929 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-e7e9f771-cf2b-4295-a312-2410df54c766 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98431) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 11 23:12:49.415436 np0000002687 nova-compute[98431]: DEBUG nova.compute.provider_tree [None req-e7e9f771-cf2b-4295-a312-2410df54c766 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Inventory has not changed in ProviderTree for provider: e3e65fe2-9de9-4821-8b4a-ccae37c66e25 {{(pid=98431) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 11 23:12:49.462688 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-3ef9f8f4-f0d3-46dd-afeb-66471459ceb3 req-02a8504d-9b9a-4840-91ab-c063e71f1c5f service nova] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Updated VIF entry in instance network info cache for port 3c37ff2c-78c4-4423-b4a2-219e94df57ca. {{(pid=98431) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 11 23:12:49.463993 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-3ef9f8f4-f0d3-46dd-afeb-66471459ceb3 req-02a8504d-9b9a-4840-91ab-c063e71f1c5f service nova] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Updating instance_info_cache with network_info: [{"id": "3c37ff2c-78c4-4423-b4a2-219e94df57ca", "address": "fa:16:3e:8f:ae:21", "network": {"id": "2a770c99-2ec6-4fa2-945b-32830a59e7a7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-137493671-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aaf744af828a4a5eba1e98da63373b2b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c37ff2c-78", "ovs_interfaceid": "3c37ff2c-78c4-4423-b4a2-219e94df57ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:12:49.494144 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] [instance: 19beb2a4-b3fe-43e9-ac92-71446c2630ee] Starting instance... {{(pid=98431) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 11 23:12:49.548886 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:49.646867 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:12:49.885090 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Updating instance_info_cache with network_info: [{"id": "a1e7aeff-5992-43be-bb2c-d504e7019c64", "address": "fa:16:3e:1d:f7:18", "network": {"id": "710d3c5f-1a08-4a35-b3e1-e59f427989c2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2068802531-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62f47df2e0374879b837bc7431326e62", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1e7aeff-59", "ovs_interfaceid": "a1e7aeff-5992-43be-bb2c-d504e7019c64", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:12:49.921176 np0000002687 nova-compute[98431]: DEBUG nova.scheduler.client.report [None req-e7e9f771-cf2b-4295-a312-2410df54c766 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Inventory has not changed for provider e3e65fe2-9de9-4821-8b4a-ccae37c66e25 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98431) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 11 23:12:49.969440 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-3ef9f8f4-f0d3-46dd-afeb-66471459ceb3 req-02a8504d-9b9a-4840-91ab-c063e71f1c5f service nova] Releasing lock "refresh_cache-0d352738-c7bf-42a2-8260-bf5574a7200d" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 11 23:12:50.086324 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:12:50.387048 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Releasing lock "refresh_cache-7609742e-a3a2-4be2-ba02-227efb2101e1" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 11 23:12:50.429080 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-e7e9f771-cf2b-4295-a312-2410df54c766 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.938s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:12:50.429937 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.343s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:12:50.432591 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-e7e9f771-cf2b-4295-a312-2410df54c766 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] Start building networks asynchronously for instance. {{(pid=98431) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 11 23:12:50.435283 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98431) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 11 23:12:50.435454 np0000002687 nova-compute[98431]: INFO nova.compute.claims [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] [instance: 19beb2a4-b3fe-43e9-ac92-71446c2630ee] Claim successful on node np0000002687 Jun 11 23:12:50.569987 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Start spawning the instance on the hypervisor. {{(pid=98431) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 11 23:12:50.571740 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Creating instance directory {{(pid=98431) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}} Jun 11 23:12:50.572123 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Creating image(s) Jun 11 23:12:50.572645 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Did not create local disks {{(pid=98431) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}} Jun 11 23:12:50.572853 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Ensure instance console log exists: /opt/stack/data/nova/instances/0d352738-c7bf-42a2-8260-bf5574a7200d/console.log {{(pid=98431) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}} Jun 11 23:12:50.573198 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:12:50.573409 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:12:50.573562 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:12:50.574277 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Start _get_guest_xml network_info=[{"id": "3c37ff2c-78c4-4423-b4a2-219e94df57ca", "address": "fa:16:3e:8f:ae:21", "network": {"id": "2a770c99-2ec6-4fa2-945b-32830a59e7a7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-137493671-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aaf744af828a4a5eba1e98da63373b2b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c37ff2c-78", "ovs_interfaceid": "3c37ff2c-78c4-4423-b4a2-219e94df57ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-11T23:08:20Z,direct_url=,disk_format='qcow2',id=f30640f8-7aca-4300-a085-4706a5209a79,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ce012f9fabdb4ee5a73e212437f59d97',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-11T23:08:23Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'mount_device': '/dev/vda', 'attachment_id': 'cb1a71d5-3b93-4a6e-b283-77ed93198fe1', 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859', 'iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '484c7594-8b2e-4f2d-81d7-bdda56999859', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '0d352738-c7bf-42a2-8260-bf5574a7200d', 'attached_at': '', 'detached_at': '', 'volume_id': '484c7594-8b2e-4f2d-81d7-bdda56999859', 'serial': '484c7594-8b2e-4f2d-81d7-bdda56999859'}, 'disk_bus': 'virtio', 'delete_on_termination': True, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98431) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 11 23:12:50.577243 np0000002687 nova-compute[98431]: WARNING nova.virt.libvirt.driver [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 11 23:12:50.578476 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='f30640f8-7aca-4300-a085-4706a5209a79', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-916877464', uuid='0d352738-c7bf-42a2-8260-bf5574a7200d'), owner=OwnerMeta(userid='72b6dac5eb744cfba6299636227aa59b', username='tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member', projectid='aaf744af828a4a5eba1e98da63373b2b', projectname='tempest-ServerBootFromVolumeStableRescueTest-539499192'), image=ImageMeta(id='f30640f8-7aca-4300-a085-4706a5209a79', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "3c37ff2c-78c4-4423-b4a2-219e94df57ca", "address": "fa:16:3e:8f:ae:21", "network": {"id": "2a770c99-2ec6-4fa2-945b-32830a59e7a7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-137493671-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aaf744af828a4a5eba1e98da63373b2b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c37ff2c-78", "ovs_interfaceid": "3c37ff2c-78c4-4423-b4a2-219e94df57ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1781219570.5780716) {{(pid=98431) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 11 23:12:50.579686 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Searching host: 'np0000002687' for CPU controller through CGroups V1... {{(pid=98431) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 11 23:12:50.580066 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] CPU controller missing on host. {{(pid=98431) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 11 23:12:50.580972 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Searching host: 'np0000002687' for CPU controller through CGroups V2... {{(pid=98431) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 11 23:12:50.581161 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] CPU controller found on host. {{(pid=98431) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 11 23:12:50.582260 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98431) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 11 23:12:50.583695 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-11T23:08:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-11T23:08:20Z,direct_url=,disk_format='qcow2',id=f30640f8-7aca-4300-a085-4706a5209a79,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ce012f9fabdb4ee5a73e212437f59d97',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-11T23:08:23Z,virtual_size=,visibility=), allow threads: True {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 11 23:12:50.583695 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Flavor limits 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 11 23:12:50.583695 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Image limits 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 11 23:12:50.583695 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Flavor pref 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 11 23:12:50.583695 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Image pref 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 11 23:12:50.583695 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 11 23:12:50.583695 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 11 23:12:50.583695 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98431) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 11 23:12:50.583695 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Got 1 possible topologies {{(pid=98431) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 11 23:12:50.584056 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 11 23:12:50.584056 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 11 23:12:50.594030 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Calling os-brick to attach iSCSI Volume {{(pid=98431) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 11 23:12:50.594304 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859', 'iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '484c7594-8b2e-4f2d-81d7-bdda56999859', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 11 23:12:50.594496 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 11 23:12:50.594849 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 11 23:12:50.595066 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859', 'iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '484c7594-8b2e-4f2d-81d7-bdda56999859', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98431) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 11 23:12:50.608854 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 11 23:12:50.609723 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 11 23:12:50.610274 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 11 23:12:50.610512 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.iscsi [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 11 23:12:50.611174 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 11 23:12:50.611564 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.iscsi [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 11 23:12:50.625958 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 11 23:12:50.625958 np0000002687 nova-compute[98431]: {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:12:50.627426 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 11 23:12:50.627426 np0000002687 nova-compute[98431]: {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:12:50.641339 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859] added Jun 11 23:12:50.641339 np0000002687 nova-compute[98431]: stderr=iscsiadm: Config file line 363 does not have value Jun 11 23:12:50.641339 np0000002687 nova-compute[98431]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 11 23:12:50.641339 np0000002687 nova-compute[98431]: iscsiadm: Config file line 363 does not have value Jun 11 23:12:50.641339 np0000002687 nova-compute[98431]: iscsiadm: Config file line 363 does not have value Jun 11 23:12:50.641339 np0000002687 nova-compute[98431]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 11 23:12:50.641339 np0000002687 nova-compute[98431]: {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:12:50.641676 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98431) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 11 23:12:50.642187 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0305(s), this was the 1st time calling it. {{(pid=98431) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 11 23:12:50.642474 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98431) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 11 23:12:50.642766 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859] added Jun 11 23:12:50.642766 np0000002687 nova-compute[98431]: stderr=iscsiadm: Config file line 363 does not have value Jun 11 23:12:50.642766 np0000002687 nova-compute[98431]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 11 23:12:50.642766 np0000002687 nova-compute[98431]: iscsiadm: Config file line 363 does not have value Jun 11 23:12:50.642766 np0000002687 nova-compute[98431]: iscsiadm: Config file line 363 does not have value Jun 11 23:12:50.642766 np0000002687 nova-compute[98431]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 11 23:12:50.642766 np0000002687 nova-compute[98431]: {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:12:50.643003 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98431) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 11 23:12:50.643191 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0326(s), this was the 1st time calling it. {{(pid=98431) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 11 23:12:50.643333 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98431) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 11 23:12:50.952375 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-e7e9f771-cf2b-4295-a312-2410df54c766 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] Allocating IP information in the background. {{(pid=98431) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 11 23:12:50.952790 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-e7e9f771-cf2b-4295-a312-2410df54c766 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] allocate_for_instance() {{(pid=98431) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 11 23:12:50.955359 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-e7e9f771-cf2b-4295-a312-2410df54c766 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:12:50.956145 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-e7e9f771-cf2b-4295-a312-2410df54c766 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:12:51.084292 np0000002687 nova-compute[98431]: DEBUG nova.policy [None req-e7e9f771-cf2b-4295-a312-2410df54c766 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c17e84202f404c3c8e73292bb59d7b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fd45f475a04e5c8e9bd9deb7ad4c1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98431) authorize /opt/stack/nova/nova/policy.py:192}} Jun 11 23:12:51.453783 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-e7e9f771-cf2b-4295-a312-2410df54c766 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 11 23:12:51.643671 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.iscsi [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 11 23:12:51.645868 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.iscsi [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 11 23:12:51.667940 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 11 23:12:51.667940 np0000002687 nova-compute[98431]: node.name = iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 Jun 11 23:12:51.667940 np0000002687 nova-compute[98431]: node.tpgt = -1 Jun 11 23:12:51.667940 np0000002687 nova-compute[98431]: node.startup = manual Jun 11 23:12:51.667940 np0000002687 nova-compute[98431]: node.leading_login = No Jun 11 23:12:51.667940 np0000002687 nova-compute[98431]: iface.iscsi_ifacename = default Jun 11 23:12:51.667940 np0000002687 nova-compute[98431]: iface.net_ifacename = Jun 11 23:12:51.667940 np0000002687 nova-compute[98431]: iface.ipaddress = Jun 11 23:12:51.667940 np0000002687 nova-compute[98431]: iface.prefix_len = 0 Jun 11 23:12:51.667940 np0000002687 nova-compute[98431]: iface.hwaddress = Jun 11 23:12:51.667940 np0000002687 nova-compute[98431]: iface.transport_name = tcp Jun 11 23:12:51.667940 np0000002687 nova-compute[98431]: iface.initiatorname = Jun 11 23:12:51.667940 np0000002687 nova-compute[98431]: iface.state = Jun 11 23:12:51.667940 np0000002687 nova-compute[98431]: iface.vlan_id = 0 Jun 11 23:12:51.667940 np0000002687 nova-compute[98431]: iface.vlan_priority = 0 Jun 11 23:12:51.667940 np0000002687 nova-compute[98431]: iface.vlan_state = Jun 11 23:12:51.667940 np0000002687 nova-compute[98431]: iface.iface_num = 0 Jun 11 23:12:51.667940 np0000002687 nova-compute[98431]: iface.mtu = 0 Jun 11 23:12:51.667940 np0000002687 nova-compute[98431]: iface.port = 0 Jun 11 23:12:51.667940 np0000002687 nova-compute[98431]: iface.bootproto = Jun 11 23:12:51.667940 np0000002687 nova-compute[98431]: iface.subnet_mask = Jun 11 23:12:51.667940 np0000002687 nova-compute[98431]: iface.gateway = Jun 11 23:12:51.667940 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id_state = Jun 11 23:12:51.667940 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id = Jun 11 23:12:51.667940 np0000002687 nova-compute[98431]: iface.dhcp_dns = Jun 11 23:12:51.667940 np0000002687 nova-compute[98431]: iface.dhcp_learn_iqn = Jun 11 23:12:51.667940 np0000002687 nova-compute[98431]: iface.dhcp_req_vendor_id_state = Jun 11 23:12:51.667940 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id_state = Jun 11 23:12:51.667940 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id = Jun 11 23:12:51.667940 np0000002687 nova-compute[98431]: iface.dhcp_slp_da = Jun 11 23:12:51.667940 np0000002687 nova-compute[98431]: iface.fragmentation = Jun 11 23:12:51.667940 np0000002687 nova-compute[98431]: iface.gratuitous_arp = Jun 11 23:12:51.667940 np0000002687 nova-compute[98431]: iface.incoming_forwarding = Jun 11 23:12:51.667940 np0000002687 nova-compute[98431]: iface.tos_state = Jun 11 23:12:51.667940 np0000002687 nova-compute[98431]: iface.tos = 0 Jun 11 23:12:51.667940 np0000002687 nova-compute[98431]: iface.ttl = 0 Jun 11 23:12:51.667940 np0000002687 nova-compute[98431]: iface.delayed_ack = Jun 11 23:12:51.667940 np0000002687 nova-compute[98431]: iface.tcp_nagle = Jun 11 23:12:51.667940 np0000002687 nova-compute[98431]: iface.tcp_wsf_state = Jun 11 23:12:51.667940 np0000002687 nova-compute[98431]: iface.tcp_wsf = 0 Jun 11 23:12:51.667940 np0000002687 nova-compute[98431]: iface.tcp_timer_scale = 0 Jun 11 23:12:51.667940 np0000002687 nova-compute[98431]: iface.tcp_timestamp = Jun 11 23:12:51.667940 np0000002687 nova-compute[98431]: iface.redirect = Jun 11 23:12:51.667940 np0000002687 nova-compute[98431]: iface.def_task_mgmt_timeout = 0 Jun 11 23:12:51.667940 np0000002687 nova-compute[98431]: iface.header_digest = Jun 11 23:12:51.667940 np0000002687 nova-compute[98431]: iface.data_digest = Jun 11 23:12:51.667940 np0000002687 nova-compute[98431]: iface.immediate_data = Jun 11 23:12:51.667940 np0000002687 nova-compute[98431]: iface.initial_r2t = Jun 11 23:12:51.667940 np0000002687 nova-compute[98431]: iface.data_seq_inorder = Jun 11 23:12:51.667940 np0000002687 nova-compute[98431]: iface.data_pdu_inorder = Jun 11 23:12:51.667940 np0000002687 nova-compute[98431]: iface.erl = 0 Jun 11 23:12:51.667940 np0000002687 nova-compute[98431]: iface.max_receive_data_len = 0 Jun 11 23:12:51.667940 np0000002687 nova-compute[98431]: iface.first_burst_len = 0 Jun 11 23:12:51.667940 np0000002687 nova-compute[98431]: iface.max_outstanding_r2t = 0 Jun 11 23:12:51.667940 np0000002687 nova-compute[98431]: iface.max_burst_len = 0 Jun 11 23:12:51.667940 np0000002687 nova-compute[98431]: iface.chap_auth = Jun 11 23:12:51.667940 np0000002687 nova-compute[98431]: iface.bidi_chap = Jun 11 23:12:51.667940 np0000002687 nova-compute[98431]: iface.strict_login_compliance = Jun 11 23:12:51.667940 np0000002687 nova-compute[98431]: iface.discovery_auth = Jun 11 23:12:51.667940 np0000002687 nova-compute[98431]: iface.discovery_logout = Jun 11 23:12:51.667940 np0000002687 nova-compute[98431]: node.discovery_address = Jun 11 23:12:51.667940 np0000002687 nova-compute[98431]: node.discovery_port = 0 Jun 11 23:12:51.667940 np0000002687 nova-compute[98431]: node.discovery_type = fw Jun 11 23:12:51.667940 np0000002687 nova-compute[98431]: node.session.initial_cmdsn = 0 Jun 11 23:12:51.667940 np0000002687 nova-compute[98431]: node.session.initial_login_retry_max = 8 Jun 11 23:12:51.667940 np0000002687 nova-compute[98431]: node.session.xmit_thread_priority = 0 Jun 11 23:12:51.667940 np0000002687 nova-compute[98431]: node.session.cmds_max = 128 Jun 11 23:12:51.667940 np0000002687 nova-compute[98431]: node.session.queue_depth = 32 Jun 11 23:12:51.667940 np0000002687 nova-compute[98431]: node.session.nr_sessions = 1 Jun 11 23:12:51.667940 np0000002687 nova-compute[98431]: node.session.auth.authmethod = None Jun 11 23:12:51.667940 np0000002687 nova-compute[98431]: node.session.auth.username = Jun 11 23:12:51.667940 np0000002687 nova-compute[98431]: node.session.auth.password = *** Jun 11 23:12:51.667940 np0000002687 nova-compute[98431]: node.session.auth.username_in = Jun 11 23:12:51.667940 np0000002687 nova-compute[98431]: node.session.auth.password_in = Jun 11 23:12:51.667940 np0000002687 nova-compute[98431]: node.session.auth.chap_algs = SHA256 Jun 11 23:12:51.667940 np0000002687 nova-compute[98431]: node.session.timeo.replacement_timeout = 120 Jun 11 23:12:51.667940 np0000002687 nova-compute[98431]: node.session.err_timeo.abort_timeout = 15 Jun 11 23:12:51.667940 np0000002687 nova-compute[98431]: node.session.err_timeo.lu_reset_timeout = 30 Jun 11 23:12:51.667940 np0000002687 nova-compute[98431]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 11 23:12:51.667940 np0000002687 nova-compute[98431]: node.session.err_timeo.host_reset_timeout = 60 Jun 11 23:12:51.667940 np0000002687 nova-compute[98431]: node.session.iscsi.FastAbort = Yes Jun 11 23:12:51.667940 np0000002687 nova-compute[98431]: node.session.iscsi.InitialR2T = No Jun 11 23:12:51.667940 np0000002687 nova-compute[98431]: node.session.iscsi.ImmediateData = Yes Jun 11 23:12:51.667940 np0000002687 nova-compute[98431]: node.session.iscsi.FirstBurstLength = 262144 Jun 11 23:12:51.667940 np0000002687 nova-compute[98431]: node.session.iscsi.MaxBurstLength = 16776192 Jun 11 23:12:51.667940 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Retain = 0 Jun 11 23:12:51.667940 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Wait = 2 Jun 11 23:12:51.667940 np0000002687 nova-compute[98431]: node.session.iscsi.MaxConnections = 1 Jun 11 23:12:51.667940 np0000002687 nova-compute[98431]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 11 23:12:51.667940 np0000002687 nova-compute[98431]: node.session.iscsi.ERL = 0 Jun 11 23:12:51.667940 np0000002687 nova-compute[98431]: node.session.scan = auto Jun 11 23:12:51.667940 np0000002687 nova-compute[98431]: node.session.reopen_max = 0 Jun 11 23:12:51.667940 np0000002687 nova-compute[98431]: node.conn[0].address = 192.168.50.100 Jun 11 23:12:51.667940 np0000002687 nova-compute[98431]: node.conn[0].port = 3260 Jun 11 23:12:51.667940 np0000002687 nova-compute[98431]: node.conn[0].startup = manual Jun 11 23:12:51.667940 np0000002687 nova-compute[98431]: node.conn[0].tcp.window_size = 524288 Jun 11 23:12:51.667940 np0000002687 nova-compute[98431]: node.conn[0].tcp.type_of_service = 0 Jun 11 23:12:51.667940 np0000002687 nova-compute[98431]: node.conn[0].timeo.logout_timeout = 15 Jun 11 23:12:51.667940 np0000002687 nova-compute[98431]: node.conn[0].timeo.login_timeout = 15 Jun 11 23:12:51.667940 np0000002687 nova-compute[98431]: node.conn[0].timeo.auth_timeout = 45 Jun 11 23:12:51.667940 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_interval = 5 Jun 11 23:12:51.667940 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_timeout = 5 Jun 11 23:12:51.667940 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 11 23:12:51.667940 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 11 23:12:51.667940 np0000002687 nova-compute[98431]: node.conn[0].iscsi.HeaderDigest = None Jun 11 23:12:51.667940 np0000002687 nova-compute[98431]: node.conn[0].iscsi.DataDigest = None Jun 11 23:12:51.667940 np0000002687 nova-compute[98431]: node.conn[0].iscsi.IFMarker = No Jun 11 23:12:51.667940 np0000002687 nova-compute[98431]: node.conn[0].iscsi.OFMarker = No Jun 11 23:12:51.667940 np0000002687 nova-compute[98431]: # END RECORD Jun 11 23:12:51.667940 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:12:51.678474 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 11 23:12:51.678474 np0000002687 nova-compute[98431]: node.name = iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 Jun 11 23:12:51.678474 np0000002687 nova-compute[98431]: node.tpgt = -1 Jun 11 23:12:51.678474 np0000002687 nova-compute[98431]: node.startup = manual Jun 11 23:12:51.678474 np0000002687 nova-compute[98431]: node.leading_login = No Jun 11 23:12:51.678474 np0000002687 nova-compute[98431]: iface.iscsi_ifacename = default Jun 11 23:12:51.678474 np0000002687 nova-compute[98431]: iface.net_ifacename = Jun 11 23:12:51.678474 np0000002687 nova-compute[98431]: iface.ipaddress = Jun 11 23:12:51.678474 np0000002687 nova-compute[98431]: iface.prefix_len = 0 Jun 11 23:12:51.678474 np0000002687 nova-compute[98431]: iface.hwaddress = Jun 11 23:12:51.678474 np0000002687 nova-compute[98431]: iface.transport_name = tcp Jun 11 23:12:51.678474 np0000002687 nova-compute[98431]: iface.initiatorname = Jun 11 23:12:51.678474 np0000002687 nova-compute[98431]: iface.state = Jun 11 23:12:51.678474 np0000002687 nova-compute[98431]: iface.vlan_id = 0 Jun 11 23:12:51.678474 np0000002687 nova-compute[98431]: iface.vlan_priority = 0 Jun 11 23:12:51.678474 np0000002687 nova-compute[98431]: iface.vlan_state = Jun 11 23:12:51.678474 np0000002687 nova-compute[98431]: iface.iface_num = 0 Jun 11 23:12:51.678474 np0000002687 nova-compute[98431]: iface.mtu = 0 Jun 11 23:12:51.678474 np0000002687 nova-compute[98431]: iface.port = 0 Jun 11 23:12:51.678474 np0000002687 nova-compute[98431]: iface.bootproto = Jun 11 23:12:51.678474 np0000002687 nova-compute[98431]: iface.subnet_mask = Jun 11 23:12:51.678474 np0000002687 nova-compute[98431]: iface.gateway = Jun 11 23:12:51.678474 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id_state = Jun 11 23:12:51.678474 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id = Jun 11 23:12:51.678474 np0000002687 nova-compute[98431]: iface.dhcp_dns = Jun 11 23:12:51.678474 np0000002687 nova-compute[98431]: iface.dhcp_learn_iqn = Jun 11 23:12:51.678474 np0000002687 nova-compute[98431]: iface.dhcp_req_vendor_id_state = Jun 11 23:12:51.678474 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id_state = Jun 11 23:12:51.678474 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id = Jun 11 23:12:51.678474 np0000002687 nova-compute[98431]: iface.dhcp_slp_da = Jun 11 23:12:51.678474 np0000002687 nova-compute[98431]: iface.fragmentation = Jun 11 23:12:51.678474 np0000002687 nova-compute[98431]: iface.gratuitous_arp = Jun 11 23:12:51.678474 np0000002687 nova-compute[98431]: iface.incoming_forwarding = Jun 11 23:12:51.678474 np0000002687 nova-compute[98431]: iface.tos_state = Jun 11 23:12:51.678474 np0000002687 nova-compute[98431]: iface.tos = 0 Jun 11 23:12:51.678474 np0000002687 nova-compute[98431]: iface.ttl = 0 Jun 11 23:12:51.678474 np0000002687 nova-compute[98431]: iface.delayed_ack = Jun 11 23:12:51.678474 np0000002687 nova-compute[98431]: iface.tcp_nagle = Jun 11 23:12:51.678474 np0000002687 nova-compute[98431]: iface.tcp_wsf_state = Jun 11 23:12:51.678474 np0000002687 nova-compute[98431]: iface.tcp_wsf = 0 Jun 11 23:12:51.678474 np0000002687 nova-compute[98431]: iface.tcp_timer_scale = 0 Jun 11 23:12:51.678474 np0000002687 nova-compute[98431]: iface.tcp_timestamp = Jun 11 23:12:51.678474 np0000002687 nova-compute[98431]: iface.redirect = Jun 11 23:12:51.678474 np0000002687 nova-compute[98431]: iface.def_task_mgmt_timeout = 0 Jun 11 23:12:51.678474 np0000002687 nova-compute[98431]: iface.header_digest = Jun 11 23:12:51.678474 np0000002687 nova-compute[98431]: iface.data_digest = Jun 11 23:12:51.678474 np0000002687 nova-compute[98431]: iface.immediate_data = Jun 11 23:12:51.678474 np0000002687 nova-compute[98431]: iface.initial_r2t = Jun 11 23:12:51.678474 np0000002687 nova-compute[98431]: iface.data_seq_inorder = Jun 11 23:12:51.678474 np0000002687 nova-compute[98431]: iface.data_pdu_inorder = Jun 11 23:12:51.678474 np0000002687 nova-compute[98431]: iface.erl = 0 Jun 11 23:12:51.678474 np0000002687 nova-compute[98431]: iface.max_receive_data_len = 0 Jun 11 23:12:51.678474 np0000002687 nova-compute[98431]: iface.first_burst_len = 0 Jun 11 23:12:51.678474 np0000002687 nova-compute[98431]: iface.max_outstanding_r2t = 0 Jun 11 23:12:51.678474 np0000002687 nova-compute[98431]: iface.max_burst_len = 0 Jun 11 23:12:51.678474 np0000002687 nova-compute[98431]: iface.chap_auth = Jun 11 23:12:51.678474 np0000002687 nova-compute[98431]: iface.bidi_chap = Jun 11 23:12:51.678474 np0000002687 nova-compute[98431]: iface.strict_login_compliance = Jun 11 23:12:51.678474 np0000002687 nova-compute[98431]: iface.discovery_auth = Jun 11 23:12:51.678474 np0000002687 nova-compute[98431]: iface.discovery_logout = Jun 11 23:12:51.678474 np0000002687 nova-compute[98431]: node.discovery_address = Jun 11 23:12:51.678474 np0000002687 nova-compute[98431]: node.discovery_port = 0 Jun 11 23:12:51.678474 np0000002687 nova-compute[98431]: node.discovery_type = fw Jun 11 23:12:51.678474 np0000002687 nova-compute[98431]: node.session.initial_cmdsn = 0 Jun 11 23:12:51.678474 np0000002687 nova-compute[98431]: node.session.initial_login_retry_max = 8 Jun 11 23:12:51.678474 np0000002687 nova-compute[98431]: node.session.xmit_thread_priority = 0 Jun 11 23:12:51.678474 np0000002687 nova-compute[98431]: node.session.cmds_max = 128 Jun 11 23:12:51.678474 np0000002687 nova-compute[98431]: node.session.queue_depth = 32 Jun 11 23:12:51.678474 np0000002687 nova-compute[98431]: node.session.nr_sessions = 1 Jun 11 23:12:51.678474 np0000002687 nova-compute[98431]: node.session.auth.authmethod = None Jun 11 23:12:51.678474 np0000002687 nova-compute[98431]: node.session.auth.username = Jun 11 23:12:51.678474 np0000002687 nova-compute[98431]: node.session.auth.password = *** Jun 11 23:12:51.678474 np0000002687 nova-compute[98431]: node.session.auth.username_in = Jun 11 23:12:51.678474 np0000002687 nova-compute[98431]: node.session.auth.password_in = Jun 11 23:12:51.678474 np0000002687 nova-compute[98431]: node.session.auth.chap_algs = SHA256 Jun 11 23:12:51.678474 np0000002687 nova-compute[98431]: node.session.timeo.replacement_timeout = 120 Jun 11 23:12:51.678474 np0000002687 nova-compute[98431]: node.session.err_timeo.abort_timeout = 15 Jun 11 23:12:51.678474 np0000002687 nova-compute[98431]: node.session.err_timeo.lu_reset_timeout = 30 Jun 11 23:12:51.678474 np0000002687 nova-compute[98431]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 11 23:12:51.678474 np0000002687 nova-compute[98431]: node.session.err_timeo.host_reset_timeout = 60 Jun 11 23:12:51.678474 np0000002687 nova-compute[98431]: node.session.iscsi.FastAbort = Yes Jun 11 23:12:51.678474 np0000002687 nova-compute[98431]: node.session.iscsi.InitialR2T = No Jun 11 23:12:51.678474 np0000002687 nova-compute[98431]: node.session.iscsi.ImmediateData = Yes Jun 11 23:12:51.678474 np0000002687 nova-compute[98431]: node.session.iscsi.FirstBurstLength = 262144 Jun 11 23:12:51.678474 np0000002687 nova-compute[98431]: node.session.iscsi.MaxBurstLength = 16776192 Jun 11 23:12:51.678474 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Retain = 0 Jun 11 23:12:51.678474 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Wait = 2 Jun 11 23:12:51.678474 np0000002687 nova-compute[98431]: node.session.iscsi.MaxConnections = 1 Jun 11 23:12:51.678474 np0000002687 nova-compute[98431]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 11 23:12:51.678474 np0000002687 nova-compute[98431]: node.session.iscsi.ERL = 0 Jun 11 23:12:51.678474 np0000002687 nova-compute[98431]: node.session.scan = auto Jun 11 23:12:51.678474 np0000002687 nova-compute[98431]: node.session.reopen_max = 0 Jun 11 23:12:51.678474 np0000002687 nova-compute[98431]: node.conn[0].address = 192.168.40.100 Jun 11 23:12:51.678474 np0000002687 nova-compute[98431]: node.conn[0].port = 3260 Jun 11 23:12:51.678474 np0000002687 nova-compute[98431]: node.conn[0].startup = manual Jun 11 23:12:51.678474 np0000002687 nova-compute[98431]: node.conn[0].tcp.window_size = 524288 Jun 11 23:12:51.678474 np0000002687 nova-compute[98431]: node.conn[0].tcp.type_of_service = 0 Jun 11 23:12:51.678474 np0000002687 nova-compute[98431]: node.conn[0].timeo.logout_timeout = 15 Jun 11 23:12:51.678474 np0000002687 nova-compute[98431]: node.conn[0].timeo.login_timeout = 15 Jun 11 23:12:51.678474 np0000002687 nova-compute[98431]: node.conn[0].timeo.auth_timeout = 45 Jun 11 23:12:51.678474 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_interval = 5 Jun 11 23:12:51.678474 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_timeout = 5 Jun 11 23:12:51.678474 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 11 23:12:51.678474 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 11 23:12:51.678474 np0000002687 nova-compute[98431]: node.conn[0].iscsi.HeaderDigest = None Jun 11 23:12:51.678474 np0000002687 nova-compute[98431]: node.conn[0].iscsi.DataDigest = None Jun 11 23:12:51.678474 np0000002687 nova-compute[98431]: node.conn[0].iscsi.IFMarker = No Jun 11 23:12:51.678474 np0000002687 nova-compute[98431]: node.conn[0].iscsi.OFMarker = No Jun 11 23:12:51.678474 np0000002687 nova-compute[98431]: # END RECORD Jun 11 23:12:51.678474 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:12:51.691578 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:12:51.703383 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:12:51.717627 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:12:51.717627 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:12:51.717627 np0000002687 nova-compute[98431]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060 (non-flash) Jun 11 23:12:51.717627 np0000002687 nova-compute[98431]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060 (non-flash) Jun 11 23:12:51.717627 np0000002687 nova-compute[98431]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979 (non-flash) Jun 11 23:12:51.717627 np0000002687 nova-compute[98431]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979 (non-flash) Jun 11 23:12:51.717627 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:12:51.717627 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:12:51.717627 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:12:51.718129 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] iscsi session list stdout=tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:12:51.718129 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:12:51.718129 np0000002687 nova-compute[98431]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060 (non-flash) Jun 11 23:12:51.718129 np0000002687 nova-compute[98431]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060 (non-flash) Jun 11 23:12:51.718129 np0000002687 nova-compute[98431]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979 (non-flash) Jun 11 23:12:51.718129 np0000002687 nova-compute[98431]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979 (non-flash) Jun 11 23:12:51.718129 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:12:51.718129 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:12:51.718129 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:12:51.722467 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:12:51.722467 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:12:51.722467 np0000002687 nova-compute[98431]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060 (non-flash) Jun 11 23:12:51.722467 np0000002687 nova-compute[98431]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060 (non-flash) Jun 11 23:12:51.722467 np0000002687 nova-compute[98431]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979 (non-flash) Jun 11 23:12:51.722467 np0000002687 nova-compute[98431]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979 (non-flash) Jun 11 23:12:51.722467 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:12:51.722467 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:12:51.722467 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:12:51.722467 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] iscsi session list stdout=tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:12:51.722467 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:12:51.722467 np0000002687 nova-compute[98431]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060 (non-flash) Jun 11 23:12:51.722467 np0000002687 nova-compute[98431]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060 (non-flash) Jun 11 23:12:51.722467 np0000002687 nova-compute[98431]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979 (non-flash) Jun 11 23:12:51.722467 np0000002687 nova-compute[98431]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979 (non-flash) Jun 11 23:12:51.722467 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:12:51.722467 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:12:51.722467 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:12:51.782903 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859, portal: 192.168.50.100,3260] Jun 11 23:12:51.782903 np0000002687 nova-compute[98431]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859, portal: 192.168.50.100,3260] successful. Jun 11 23:12:51.782903 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:12:51.795563 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859, portal: 192.168.40.100,3260] Jun 11 23:12:51.795563 np0000002687 nova-compute[98431]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859, portal: 192.168.40.100,3260] successful. Jun 11 23:12:51.795563 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:12:51.805125 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:12:51.811832 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:12:51.827322 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:12:51.827322 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:12:51.827322 np0000002687 nova-compute[98431]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060 (non-flash) Jun 11 23:12:51.827322 np0000002687 nova-compute[98431]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060 (non-flash) Jun 11 23:12:51.827322 np0000002687 nova-compute[98431]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979 (non-flash) Jun 11 23:12:51.827322 np0000002687 nova-compute[98431]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979 (non-flash) Jun 11 23:12:51.827322 np0000002687 nova-compute[98431]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:12:51.827322 np0000002687 nova-compute[98431]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:12:51.827322 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:12:51.827322 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:12:51.827322 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:12:51.827322 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] iscsi session list stdout=tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:12:51.827322 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:12:51.827322 np0000002687 nova-compute[98431]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060 (non-flash) Jun 11 23:12:51.827322 np0000002687 nova-compute[98431]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060 (non-flash) Jun 11 23:12:51.827322 np0000002687 nova-compute[98431]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979 (non-flash) Jun 11 23:12:51.827322 np0000002687 nova-compute[98431]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979 (non-flash) Jun 11 23:12:51.827322 np0000002687 nova-compute[98431]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:12:51.827322 np0000002687 nova-compute[98431]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:12:51.827322 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:12:51.827322 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:12:51.827322 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:12:51.829539 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.217s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 11 23:12:51.829539 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Connected to 192.168.50.100:3260 {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 11 23:12:51.830360 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] HCTL ('11', '-', '-', 0) found on session 27 with lun 0 {{(pid=98431) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 11 23:12:51.830540 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98431) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 11 23:12:51.835684 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-e7e9f771-cf2b-4295-a312-2410df54c766 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] Successfully created port: 3c04202e-5ce6-4249-ba31-be06996ca75d {{(pid=98431) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 11 23:12:51.840621 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:12:51.840621 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:12:51.840621 np0000002687 nova-compute[98431]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060 (non-flash) Jun 11 23:12:51.840621 np0000002687 nova-compute[98431]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060 (non-flash) Jun 11 23:12:51.840621 np0000002687 nova-compute[98431]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979 (non-flash) Jun 11 23:12:51.840621 np0000002687 nova-compute[98431]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979 (non-flash) Jun 11 23:12:51.840621 np0000002687 nova-compute[98431]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:12:51.840621 np0000002687 nova-compute[98431]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:12:51.840621 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:12:51.840621 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:12:51.840621 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:12:51.841048 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] iscsi session list stdout=tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:12:51.841048 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:12:51.841048 np0000002687 nova-compute[98431]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060 (non-flash) Jun 11 23:12:51.841048 np0000002687 nova-compute[98431]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060 (non-flash) Jun 11 23:12:51.841048 np0000002687 nova-compute[98431]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979 (non-flash) Jun 11 23:12:51.841048 np0000002687 nova-compute[98431]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979 (non-flash) Jun 11 23:12:51.841048 np0000002687 nova-compute[98431]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:12:51.841048 np0000002687 nova-compute[98431]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:12:51.841048 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:12:51.841048 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:12:51.841048 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:12:51.842010 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.231s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 11 23:12:51.842463 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Connected to 192.168.40.100:3260 {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 11 23:12:51.851089 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] HCTL ('12', '-', '-', 0) found on session 28 with lun 0 {{(pid=98431) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 11 23:12:51.851089 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98431) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 11 23:12:51.853971 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Searching for a device in session 27 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98431) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 11 23:12:51.854328 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '484c7594-8b2e-4f2d-81d7-bdda56999859', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 11 23:12:51.879225 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Searching for a device in session 28 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98431) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 11 23:12:51.879225 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '484c7594-8b2e-4f2d-81d7-bdda56999859', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 11 23:12:51.901628 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Starting migrate_disk_and_power_off {{(pid=98431) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:12616}} Jun 11 23:12:51.929079 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:51.934873 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:51.958077 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-e7e9f771-cf2b-4295-a312-2410df54c766 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] Start building block device mappings for instance. {{(pid=98431) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 11 23:12:51.962404 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:51.968696 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:52.000644 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:52.268841 np0000002687 nova-compute[98431]: DEBUG nova.utils [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Queued Task(fn=>, remaining_delay=14.999591358000089 future=) {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:12:52.269365 np0000002687 nova-compute[98431]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=14.999162649000027 future=) {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:12:52.269702 np0000002687 nova-compute[98431]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=14.998977738000121 future=) {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:12:52.276452 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [-] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Instance destroyed successfully. Jun 11 23:12:52.279082 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-11T23:11:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-872787611',display_name='tempest-ServerActionsTestOtherB-server-872787611',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='tempest-serveractionstestotherb-server-872787611',id=13,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE8GCNW5zoKlPJg2gDz6psGsk5eAwUwS5EcLVqi+Ws93aBM9mzyZ9OA4e5k8HR4bk5PDkKar3oCgqC2LYEZaaYcONGX+UXm8H5giZlXKo/6E9eZdQg2l6SXnZTdbPKM4Aw==',key_name='tempest-keypair-1789476090',keypairs=,launch_index=0,launched_at=2026-06-11T23:11:46Z,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='62f47df2e0374879b837bc7431326e62',ramdisk_id='',reservation_id='r-92sxxj92',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1260316994',owner_user_name='tempest-ServerActionsTestOtherB-1260316994-project-member'},tags=,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2026-06-11T23:12:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2b37a00a21a249339e412bcde7a87f82',uuid=7609742e-a3a2-4be2-ba02-227efb2101e1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a1e7aeff-5992-43be-bb2c-d504e7019c64", "address": "fa:16:3e:1d:f7:18", "network": {"id": "710d3c5f-1a08-4a35-b3e1-e59f427989c2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2068802531-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.182", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2068802531-network", "vif_mac": "fa:16:3e:1d:f7:18"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62f47df2e0374879b837bc7431326e62", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1e7aeff-59", "ovs_interfaceid": "a1e7aeff-5992-43be-bb2c-d504e7019c64", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 11 23:12:52.279082 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Converting VIF {"id": "a1e7aeff-5992-43be-bb2c-d504e7019c64", "address": "fa:16:3e:1d:f7:18", "network": {"id": "710d3c5f-1a08-4a35-b3e1-e59f427989c2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2068802531-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.182", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2068802531-network", "vif_mac": "fa:16:3e:1d:f7:18"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62f47df2e0374879b837bc7431326e62", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1e7aeff-59", "ovs_interfaceid": "a1e7aeff-5992-43be-bb2c-d504e7019c64", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:12:52.279612 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1d:f7:18,bridge_name='br-int',has_traffic_filtering=True,id=a1e7aeff-5992-43be-bb2c-d504e7019c64,network=Network(710d3c5f-1a08-4a35-b3e1-e59f427989c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1e7aeff-59') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:12:52.279923 np0000002687 nova-compute[98431]: DEBUG os_vif [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1d:f7:18,bridge_name='br-int',has_traffic_filtering=True,id=a1e7aeff-5992-43be-bb2c-d504e7019c64,network=Network(710d3c5f-1a08-4a35-b3e1-e59f427989c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1e7aeff-59') {{(pid=98431) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 11 23:12:52.282424 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:52.282738 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa1e7aeff-59, bridge=br-int, if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:12:52.284248 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:52.285542 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:12:52.287116 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:52.287269 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=959156b2-e964-4dec-b084-5379d28bdb08) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:12:52.288525 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:52.288688 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:12:52.290127 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:52.297970 np0000002687 nova-compute[98431]: INFO os_vif [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1d:f7:18,bridge_name='br-int',has_traffic_filtering=True,id=a1e7aeff-5992-43be-bb2c-d504e7019c64,network=Network(710d3c5f-1a08-4a35-b3e1-e59f427989c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1e7aeff-59') Jun 11 23:12:52.305144 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] calling os-brick to detach iSCSI Volume {{(pid=98431) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jun 11 23:12:52.305638 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979', 'iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2f2d8ccb-5d26-4f0b-bc60-abf6355bf979', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': False}}" {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 11 23:12:52.305870 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 11 23:12:52.448520 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98431) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 11 23:12:52.448869 np0000002687 nova-compute[98431]: DEBUG nova.compute.provider_tree [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] Inventory has not changed in ProviderTree for provider: e3e65fe2-9de9-4821-8b4a-ccae37c66e25 {{(pid=98431) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 11 23:12:52.554392 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Acquiring lock "1d45c7ce-5760-4f59-9921-feb3e589da8a" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:12:52.554392 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Lock "1d45c7ce-5760-4f59-9921-feb3e589da8a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:12:52.611150 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98431) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 11 23:12:52.730133 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-e7e9f771-cf2b-4295-a312-2410df54c766 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] Successfully updated port: 3c04202e-5ce6-4249-ba31-be06996ca75d {{(pid=98431) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 11 23:12:52.805960 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-7707e719-2d53-4c31-964a-59a0b0db4b1d req-56cc4af0-aecf-4e80-a0cd-37aa1ad79184 service nova] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] Received event network-changed-3c04202e-5ce6-4249-ba31-be06996ca75d {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:12:52.805960 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-7707e719-2d53-4c31-964a-59a0b0db4b1d req-56cc4af0-aecf-4e80-a0cd-37aa1ad79184 service nova] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] Refreshing instance network info cache due to event network-changed-3c04202e-5ce6-4249-ba31-be06996ca75d. {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 11 23:12:52.805960 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-7707e719-2d53-4c31-964a-59a0b0db4b1d req-56cc4af0-aecf-4e80-a0cd-37aa1ad79184 service nova] Acquiring lock "refresh_cache-8a45e04f-3516-4c39-bea1-820104411f17" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 11 23:12:52.807855 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-7707e719-2d53-4c31-964a-59a0b0db4b1d req-56cc4af0-aecf-4e80-a0cd-37aa1ad79184 service nova] Acquired lock "refresh_cache-8a45e04f-3516-4c39-bea1-820104411f17" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 11 23:12:52.807855 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-7707e719-2d53-4c31-964a-59a0b0db4b1d req-56cc4af0-aecf-4e80-a0cd-37aa1ad79184 service nova] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] Refreshing network info cache for port 3c04202e-5ce6-4249-ba31-be06996ca75d {{(pid=98431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 11 23:12:52.864423 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:52.932088 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-806e89a6-221c-455e-b2b9-74d671217ab9 req-ced4ead2-d627-4531-a426-530901234e43 service nova] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Received event network-vif-unplugged-a1e7aeff-5992-43be-bb2c-d504e7019c64 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:12:52.932361 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-806e89a6-221c-455e-b2b9-74d671217ab9 req-ced4ead2-d627-4531-a426-530901234e43 service nova] Acquiring lock "7609742e-a3a2-4be2-ba02-227efb2101e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:12:52.932517 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-806e89a6-221c-455e-b2b9-74d671217ab9 req-ced4ead2-d627-4531-a426-530901234e43 service nova] Lock "7609742e-a3a2-4be2-ba02-227efb2101e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:12:52.933020 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-806e89a6-221c-455e-b2b9-74d671217ab9 req-ced4ead2-d627-4531-a426-530901234e43 service nova] Lock "7609742e-a3a2-4be2-ba02-227efb2101e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:12:52.934072 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-806e89a6-221c-455e-b2b9-74d671217ab9 req-ced4ead2-d627-4531-a426-530901234e43 service nova] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] No waiting events found dispatching network-vif-unplugged-a1e7aeff-5992-43be-bb2c-d504e7019c64 {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:12:52.934347 np0000002687 nova-compute[98431]: WARNING nova.compute.manager [req-806e89a6-221c-455e-b2b9-74d671217ab9 req-ced4ead2-d627-4531-a426-530901234e43 service nova] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Received unexpected event network-vif-unplugged-a1e7aeff-5992-43be-bb2c-d504e7019c64 for instance with vm_state active and task_state resize_migrating. Jun 11 23:12:52.952884 np0000002687 nova-compute[98431]: DEBUG nova.scheduler.client.report [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] Inventory has not changed for provider e3e65fe2-9de9-4821-8b4a-ccae37c66e25 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98431) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 11 23:12:52.976993 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-e7e9f771-cf2b-4295-a312-2410df54c766 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] Start spawning the instance on the hypervisor. {{(pid=98431) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 11 23:12:52.978283 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-e7e9f771-cf2b-4295-a312-2410df54c766 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] Creating instance directory {{(pid=98431) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}} Jun 11 23:12:52.978550 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-e7e9f771-cf2b-4295-a312-2410df54c766 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] Creating image(s) Jun 11 23:12:52.979038 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-e7e9f771-cf2b-4295-a312-2410df54c766 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Acquiring lock "/opt/stack/data/nova/instances/8a45e04f-3516-4c39-bea1-820104411f17/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:12:52.979255 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-e7e9f771-cf2b-4295-a312-2410df54c766 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "/opt/stack/data/nova/instances/8a45e04f-3516-4c39-bea1-820104411f17/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:12:52.980085 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-e7e9f771-cf2b-4295-a312-2410df54c766 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "/opt/stack/data/nova/instances/8a45e04f-3516-4c39-bea1-820104411f17/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:12:52.980903 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-e7e9f771-cf2b-4295-a312-2410df54c766 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:12:52.983725 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-e7e9f771-cf2b-4295-a312-2410df54c766 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:12:52.985040 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-e7e9f771-cf2b-4295-a312-2410df54c766 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:12:53.024596 np0000002687 nova-compute[98431]: DEBUG oslo_service.periodic_task [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 11 23:12:53.025210 np0000002687 nova-compute[98431]: DEBUG oslo_service.periodic_task [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=98431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 11 23:12:53.025425 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Cleaning up deleted instances {{(pid=98431) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12085}} Jun 11 23:12:53.058641 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Starting instance... {{(pid=98431) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 11 23:12:53.083590 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-e7e9f771-cf2b-4295-a312-2410df54c766 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json" returned: 0 in 0.098s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:12:53.083590 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-e7e9f771-cf2b-4295-a312-2410df54c766 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Acquiring lock "d2c441059b2992961b5de03c05b32d04aff77cb1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:12:53.084144 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-e7e9f771-cf2b-4295-a312-2410df54c766 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "d2c441059b2992961b5de03c05b32d04aff77cb1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:12:53.089092 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-e7e9f771-cf2b-4295-a312-2410df54c766 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:12:53.092925 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-e7e9f771-cf2b-4295-a312-2410df54c766 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:12:53.093782 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-e7e9f771-cf2b-4295-a312-2410df54c766 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:12:53.210415 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-e7e9f771-cf2b-4295-a312-2410df54c766 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json" returned: 0 in 0.116s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:12:53.210904 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-e7e9f771-cf2b-4295-a312-2410df54c766 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1,backing_fmt=raw /opt/stack/data/nova/instances/8a45e04f-3516-4c39-bea1-820104411f17/disk 1073741824 {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:12:53.235323 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-e7e9f771-cf2b-4295-a312-2410df54c766 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Acquiring lock "refresh_cache-8a45e04f-3516-4c39-bea1-820104411f17" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 11 23:12:53.257048 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-e7e9f771-cf2b-4295-a312-2410df54c766 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1,backing_fmt=raw /opt/stack/data/nova/instances/8a45e04f-3516-4c39-bea1-820104411f17/disk 1073741824" returned: 0 in 0.046s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:12:53.257459 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-e7e9f771-cf2b-4295-a312-2410df54c766 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "d2c441059b2992961b5de03c05b32d04aff77cb1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.173s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:12:53.257872 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-e7e9f771-cf2b-4295-a312-2410df54c766 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:12:53.311114 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [req-7707e719-2d53-4c31-964a-59a0b0db4b1d req-56cc4af0-aecf-4e80-a0cd-37aa1ad79184 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:12:53.342434 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-e7e9f771-cf2b-4295-a312-2410df54c766 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json" returned: 0 in 0.084s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:12:53.343124 np0000002687 nova-compute[98431]: DEBUG nova.virt.disk.api [None req-e7e9f771-cf2b-4295-a312-2410df54c766 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8a45e04f-3516-4c39-bea1-820104411f17/disk. size=1073741824 {{(pid=98431) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 11 23:12:53.343365 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-e7e9f771-cf2b-4295-a312-2410df54c766 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a45e04f-3516-4c39-bea1-820104411f17/disk --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:12:53.402397 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-7707e719-2d53-4c31-964a-59a0b0db4b1d req-56cc4af0-aecf-4e80-a0cd-37aa1ad79184 service nova] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] Instance cache missing network info. {{(pid=98431) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 11 23:12:53.425377 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-e7e9f771-cf2b-4295-a312-2410df54c766 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a45e04f-3516-4c39-bea1-820104411f17/disk --force-share --output=json" returned: 0 in 0.082s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:12:53.425662 np0000002687 nova-compute[98431]: DEBUG nova.virt.disk.api [None req-e7e9f771-cf2b-4295-a312-2410df54c766 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Cannot resize image /opt/stack/data/nova/instances/8a45e04f-3516-4c39-bea1-820104411f17/disk to a smaller size. {{(pid=98431) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 11 23:12:53.426061 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-e7e9f771-cf2b-4295-a312-2410df54c766 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] Created local disks {{(pid=98431) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}} Jun 11 23:12:53.426213 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-e7e9f771-cf2b-4295-a312-2410df54c766 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] Ensure instance console log exists: /opt/stack/data/nova/instances/8a45e04f-3516-4c39-bea1-820104411f17/console.log {{(pid=98431) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}} Jun 11 23:12:53.426505 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-e7e9f771-cf2b-4295-a312-2410df54c766 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:12:53.426665 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-e7e9f771-cf2b-4295-a312-2410df54c766 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:12:53.426848 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-e7e9f771-cf2b-4295-a312-2410df54c766 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:12:53.463278 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.034s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:12:53.463763 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] [instance: 19beb2a4-b3fe-43e9-ac92-71446c2630ee] Start building networks asynchronously for instance. {{(pid=98431) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 11 23:12:53.530525 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] There are 0 instances to clean {{(pid=98431) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12094}} Jun 11 23:12:53.530812 np0000002687 nova-compute[98431]: DEBUG oslo_service.periodic_task [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=98431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 11 23:12:53.531004 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Cleaning up deleted instances with incomplete migration {{(pid=98431) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:12123}} Jun 11 23:12:53.583744 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-7707e719-2d53-4c31-964a-59a0b0db4b1d req-56cc4af0-aecf-4e80-a0cd-37aa1ad79184 service nova] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] Updating instance_info_cache with network_info: [] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:12:53.634317 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Found WWN 330000000c1986051 for multipath device dm-4 {{(pid=98431) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 11 23:12:53.637471 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:12:53.638496 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.043s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 11 23:12:53.639372 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:12:53.640326 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.333s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 11 23:12:53.641234 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] <== connect_volume: return (3044ms) {'type': 'block', 'scsi_wwn': '330000000c1986051', 'path': '/dev/dm-4', 'multipath_id': '330000000c1986051'} {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 11 23:12:53.641619 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979', 'iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2f2d8ccb-5d26-4f0b-bc60-abf6355bf979', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 11 23:12:53.642030 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000c1986051', 'path': '/dev/dm-4', 'multipath_id': '330000000c1986051'} {{(pid=98431) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 11 23:12:53.642411 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979', 0)] {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 11 23:12:53.650167 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98431) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 11 23:12:53.650391 np0000002687 nova-compute[98431]: INFO nova.compute.claims [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Claim successful on node np0000002687 Jun 11 23:12:53.681750 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:12:53.681750 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:12:53.681750 np0000002687 nova-compute[98431]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060 (non-flash) Jun 11 23:12:53.681750 np0000002687 nova-compute[98431]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060 (non-flash) Jun 11 23:12:53.681750 np0000002687 nova-compute[98431]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979 (non-flash) Jun 11 23:12:53.681750 np0000002687 nova-compute[98431]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979 (non-flash) Jun 11 23:12:53.681750 np0000002687 nova-compute[98431]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:12:53.681750 np0000002687 nova-compute[98431]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:12:53.681750 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:12:53.681750 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:12:53.681750 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:12:53.682164 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] iscsi session list stdout=tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:12:53.682164 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:12:53.682164 np0000002687 nova-compute[98431]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060 (non-flash) Jun 11 23:12:53.682164 np0000002687 nova-compute[98431]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060 (non-flash) Jun 11 23:12:53.682164 np0000002687 nova-compute[98431]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979 (non-flash) Jun 11 23:12:53.682164 np0000002687 nova-compute[98431]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979 (non-flash) Jun 11 23:12:53.682164 np0000002687 nova-compute[98431]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:12:53.682164 np0000002687 nova-compute[98431]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:12:53.682164 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:12:53.682164 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:12:53.682164 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:12:53.682668 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea', '13'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea', '14'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060', '23'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060', '24'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979', '25'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979', '26'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859', '27'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859', '28'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9', '3'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9', '4')] {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 11 23:12:53.682907 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979', '25')] {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 11 23:12:53.688081 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979', '26')] {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 11 23:12:53.690455 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Resulting device map defaultdict(. at 0x7e1ea0321ee0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979'): ({'sde'}, set())}) {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 11 23:12:53.691519 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Removing multipathed devices sdd, sde {{(pid=98431) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 11 23:12:53.692215 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Flush multipath device 3300000009550c01f {{(pid=98431) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jun 11 23:12:53.724447 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98431) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 11 23:12:53.781070 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98431) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 11 23:12:53.827076 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Checking to see if SCSI volumes sdd, sde have been removed. {{(pid=98431) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 11 23:12:53.827076 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] SCSI volumes sdd, sde have been removed. {{(pid=98431) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 11 23:12:53.828396 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Checking to see if device paths {'sdd', 'sde'} are still under multipathd monitoring {{(pid=98431) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 11 23:12:53.841569 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Device paths {'sdd', 'sde'} have been removed from multipathd monitoring. {{(pid=98431) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 11 23:12:53.841867 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979')] {{(pid=98431) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 11 23:12:53.856053 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:12:53.892904 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:53.902163 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979, portal: 192.168.40.100,3260] Jun 11 23:12:53.902163 np0000002687 nova-compute[98431]: Logout of [sid: 25, target: iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979, portal: 192.168.40.100,3260] successful. Jun 11 23:12:53.902163 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:12:53.922338 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:12:53.935551 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:12:53.973493 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] [instance: 19beb2a4-b3fe-43e9-ac92-71446c2630ee] Allocating IP information in the background. {{(pid=98431) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 11 23:12:53.973662 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] [instance: 19beb2a4-b3fe-43e9-ac92-71446c2630ee] allocate_for_instance() {{(pid=98431) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 11 23:12:53.974382 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:12:53.974766 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:12:53.979608 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979, portal: 192.168.50.100,3260] Jun 11 23:12:53.979608 np0000002687 nova-compute[98431]: Logout of [sid: 26, target: iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979, portal: 192.168.50.100,3260] successful. Jun 11 23:12:53.979608 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:12:54.000936 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:12:54.001139 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.363s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 11 23:12:54.001259 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] <== disconnect_volume: return (1695ms) None {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 11 23:12:54.001389 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Disconnected iSCSI Volume {{(pid=98431) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jun 11 23:12:54.006419 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7609742e-a3a2-4be2-ba02-227efb2101e1/disk --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:12:54.036286 np0000002687 nova-compute[98431]: DEBUG oslo_service.periodic_task [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=98431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 11 23:12:54.078364 np0000002687 nova-compute[98431]: DEBUG nova.policy [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e502d68a0c7841379aae120e3a687632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2c5af39c7b4fcc94f857ad4db5e636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98431) authorize /opt/stack/nova/nova/policy.py:192}} Jun 11 23:12:54.087335 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-7707e719-2d53-4c31-964a-59a0b0db4b1d req-56cc4af0-aecf-4e80-a0cd-37aa1ad79184 service nova] Releasing lock "refresh_cache-8a45e04f-3516-4c39-bea1-820104411f17" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 11 23:12:54.088320 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-e7e9f771-cf2b-4295-a312-2410df54c766 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Acquired lock "refresh_cache-8a45e04f-3516-4c39-bea1-820104411f17" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 11 23:12:54.088726 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-e7e9f771-cf2b-4295-a312-2410df54c766 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] Building network info cache for instance {{(pid=98431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 11 23:12:54.101321 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7609742e-a3a2-4be2-ba02-227efb2101e1/disk --force-share --output=json" returned: 0 in 0.095s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:12:54.104251 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7609742e-a3a2-4be2-ba02-227efb2101e1/disk --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:12:54.164720 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-11T23:12:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-916877464',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='tempest-serverbootfromvolumestablerescuetest-server-916877464',id=16,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aaf744af828a4a5eba1e98da63373b2b',ramdisk_id='',reservation_id='r-nua6jkmc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-539499192',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-11T23:12:44Z,user_data=None,user_id='72b6dac5eb744cfba6299636227aa59b',uuid=0d352738-c7bf-42a2-8260-bf5574a7200d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3c37ff2c-78c4-4423-b4a2-219e94df57ca", "address": "fa:16:3e:8f:ae:21", "network": {"id": "2a770c99-2ec6-4fa2-945b-32830a59e7a7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-137493671-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aaf744af828a4a5eba1e98da63373b2b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c37ff2c-78", "ovs_interfaceid": "3c37ff2c-78c4-4423-b4a2-219e94df57ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98431) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 11 23:12:54.164720 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Converting VIF {"id": "3c37ff2c-78c4-4423-b4a2-219e94df57ca", "address": "fa:16:3e:8f:ae:21", "network": {"id": "2a770c99-2ec6-4fa2-945b-32830a59e7a7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-137493671-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aaf744af828a4a5eba1e98da63373b2b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c37ff2c-78", "ovs_interfaceid": "3c37ff2c-78c4-4423-b4a2-219e94df57ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:12:54.165341 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:ae:21,bridge_name='br-int',has_traffic_filtering=True,id=3c37ff2c-78c4-4423-b4a2-219e94df57ca,network=Network(2a770c99-2ec6-4fa2-945b-32830a59e7a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c37ff2c-78') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:12:54.166483 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lazy-loading 'pci_devices' on Instance uuid 0d352738-c7bf-42a2-8260-bf5574a7200d {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:12:54.203164 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7609742e-a3a2-4be2-ba02-227efb2101e1/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:12:54.203599 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] skipping disk /dev/dm-3 (vdb) as it is a volume {{(pid=98431) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12344}} Jun 11 23:12:54.205319 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/7609742e-a3a2-4be2-ba02-227efb2101e1_resize/disk /opt/stack/data/nova/instances/7609742e-a3a2-4be2-ba02-227efb2101e1/disk {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:12:54.285901 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] CMD "cp -r /opt/stack/data/nova/instances/7609742e-a3a2-4be2-ba02-227efb2101e1_resize/disk /opt/stack/data/nova/instances/7609742e-a3a2-4be2-ba02-227efb2101e1/disk" returned: 0 in 0.081s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:12:54.286354 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/7609742e-a3a2-4be2-ba02-227efb2101e1_resize/disk.config /opt/stack/data/nova/instances/7609742e-a3a2-4be2-ba02-227efb2101e1/disk.config {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:12:54.318769 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] CMD "cp -r /opt/stack/data/nova/instances/7609742e-a3a2-4be2-ba02-227efb2101e1_resize/disk.config /opt/stack/data/nova/instances/7609742e-a3a2-4be2-ba02-227efb2101e1/disk.config" returned: 0 in 0.032s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:12:54.319376 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/7609742e-a3a2-4be2-ba02-227efb2101e1_resize/disk.info /opt/stack/data/nova/instances/7609742e-a3a2-4be2-ba02-227efb2101e1/disk.info {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:12:54.353362 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] CMD "cp -r /opt/stack/data/nova/instances/7609742e-a3a2-4be2-ba02-227efb2101e1_resize/disk.info /opt/stack/data/nova/instances/7609742e-a3a2-4be2-ba02-227efb2101e1/disk.info" returned: 0 in 0.033s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:12:54.477151 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] [instance: 19beb2a4-b3fe-43e9-ac92-71446c2630ee] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 11 23:12:54.539455 np0000002687 nova-compute[98431]: DEBUG oslo.service.backend._threading.loopingcall [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98431) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jun 11 23:12:54.607820 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] [instance: 19beb2a4-b3fe-43e9-ac92-71446c2630ee] Successfully created port: 4c1f7e6e-b361-4522-84d4-5bf89a5eb631 {{(pid=98431) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 11 23:12:54.677857 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] End _get_guest_xml xml= Jun 11 23:12:54.677857 np0000002687 nova-compute[98431]: 0d352738-c7bf-42a2-8260-bf5574a7200d Jun 11 23:12:54.677857 np0000002687 nova-compute[98431]: instance-00000010 Jun 11 23:12:54.677857 np0000002687 nova-compute[98431]: 196608 Jun 11 23:12:54.677857 np0000002687 nova-compute[98431]: 1 Jun 11 23:12:54.677857 np0000002687 nova-compute[98431]: Jun 11 23:12:54.677857 np0000002687 nova-compute[98431]: Jun 11 23:12:54.677857 np0000002687 nova-compute[98431]: Jun 11 23:12:54.677857 np0000002687 nova-compute[98431]: tempest-ServerBootFromVolumeStableRescueTest-server-916877464 Jun 11 23:12:54.677857 np0000002687 nova-compute[98431]: 2026-06-11 23:12:50 Jun 11 23:12:54.677857 np0000002687 nova-compute[98431]: Jun 11 23:12:54.677857 np0000002687 nova-compute[98431]: 192 Jun 11 23:12:54.677857 np0000002687 nova-compute[98431]: 1 Jun 11 23:12:54.677857 np0000002687 nova-compute[98431]: 0 Jun 11 23:12:54.677857 np0000002687 nova-compute[98431]: 0 Jun 11 23:12:54.677857 np0000002687 nova-compute[98431]: 1 Jun 11 23:12:54.677857 np0000002687 nova-compute[98431]: Jun 11 23:12:54.677857 np0000002687 nova-compute[98431]: True Jun 11 23:12:54.677857 np0000002687 nova-compute[98431]: Jun 11 23:12:54.677857 np0000002687 nova-compute[98431]: Jun 11 23:12:54.677857 np0000002687 nova-compute[98431]: Jun 11 23:12:54.677857 np0000002687 nova-compute[98431]: bare Jun 11 23:12:54.677857 np0000002687 nova-compute[98431]: qcow2 Jun 11 23:12:54.677857 np0000002687 nova-compute[98431]: 1 Jun 11 23:12:54.677857 np0000002687 nova-compute[98431]: 0 Jun 11 23:12:54.677857 np0000002687 nova-compute[98431]: Jun 11 23:12:54.677857 np0000002687 nova-compute[98431]: virtio Jun 11 23:12:54.677857 np0000002687 nova-compute[98431]: Jun 11 23:12:54.677857 np0000002687 nova-compute[98431]: Jun 11 23:12:54.677857 np0000002687 nova-compute[98431]: Jun 11 23:12:54.677857 np0000002687 nova-compute[98431]: tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member Jun 11 23:12:54.677857 np0000002687 nova-compute[98431]: tempest-ServerBootFromVolumeStableRescueTest-539499192 Jun 11 23:12:54.677857 np0000002687 nova-compute[98431]: Jun 11 23:12:54.677857 np0000002687 nova-compute[98431]: Jun 11 23:12:54.677857 np0000002687 nova-compute[98431]: Jun 11 23:12:54.677857 np0000002687 nova-compute[98431]: Jun 11 23:12:54.677857 np0000002687 nova-compute[98431]: Jun 11 23:12:54.677857 np0000002687 nova-compute[98431]: Jun 11 23:12:54.677857 np0000002687 nova-compute[98431]: Jun 11 23:12:54.677857 np0000002687 nova-compute[98431]: Jun 11 23:12:54.677857 np0000002687 nova-compute[98431]: Jun 11 23:12:54.677857 np0000002687 nova-compute[98431]: Jun 11 23:12:54.677857 np0000002687 nova-compute[98431]: Jun 11 23:12:54.677857 np0000002687 nova-compute[98431]: OpenStack Foundation Jun 11 23:12:54.677857 np0000002687 nova-compute[98431]: OpenStack Nova Jun 11 23:12:54.677857 np0000002687 nova-compute[98431]: 33.1.0 Jun 11 23:12:54.677857 np0000002687 nova-compute[98431]: 0d352738-c7bf-42a2-8260-bf5574a7200d Jun 11 23:12:54.677857 np0000002687 nova-compute[98431]: 0d352738-c7bf-42a2-8260-bf5574a7200d Jun 11 23:12:54.677857 np0000002687 nova-compute[98431]: Virtual Machine Jun 11 23:12:54.677857 np0000002687 nova-compute[98431]: Jun 11 23:12:54.677857 np0000002687 nova-compute[98431]: Jun 11 23:12:54.677857 np0000002687 nova-compute[98431]: Jun 11 23:12:54.677857 np0000002687 nova-compute[98431]: hvm Jun 11 23:12:54.677857 np0000002687 nova-compute[98431]: Jun 11 23:12:54.677857 np0000002687 nova-compute[98431]: Jun 11 23:12:54.677857 np0000002687 nova-compute[98431]: Jun 11 23:12:54.677857 np0000002687 nova-compute[98431]: Jun 11 23:12:54.677857 np0000002687 nova-compute[98431]: Jun 11 23:12:54.677857 np0000002687 nova-compute[98431]: Jun 11 23:12:54.677857 np0000002687 nova-compute[98431]: 128 Jun 11 23:12:54.677857 np0000002687 nova-compute[98431]: Jun 11 23:12:54.677857 np0000002687 nova-compute[98431]: Jun 11 23:12:54.677857 np0000002687 nova-compute[98431]: Jun 11 23:12:54.677857 np0000002687 nova-compute[98431]: 1 Jun 11 23:12:54.677857 np0000002687 nova-compute[98431]: Jun 11 23:12:54.677857 np0000002687 nova-compute[98431]: Jun 11 23:12:54.677857 np0000002687 nova-compute[98431]: Nehalem Jun 11 23:12:54.677857 np0000002687 nova-compute[98431]: Jun 11 23:12:54.677857 np0000002687 nova-compute[98431]: Jun 11 23:12:54.677857 np0000002687 nova-compute[98431]: Jun 11 23:12:54.677857 np0000002687 nova-compute[98431]: Jun 11 23:12:54.677857 np0000002687 nova-compute[98431]: Jun 11 23:12:54.677857 np0000002687 nova-compute[98431]: Jun 11 23:12:54.677857 np0000002687 nova-compute[98431]: Jun 11 23:12:54.677857 np0000002687 nova-compute[98431]: Jun 11 23:12:54.677857 np0000002687 nova-compute[98431]: Jun 11 23:12:54.677857 np0000002687 nova-compute[98431]: Jun 11 23:12:54.677857 np0000002687 nova-compute[98431]: Jun 11 23:12:54.677857 np0000002687 nova-compute[98431]: Jun 11 23:12:54.677857 np0000002687 nova-compute[98431]: Jun 11 23:12:54.677857 np0000002687 nova-compute[98431]: 484c7594-8b2e-4f2d-81d7-bdda56999859 Jun 11 23:12:54.677857 np0000002687 nova-compute[98431]: Jun 11 23:12:54.677857 np0000002687 nova-compute[98431]: Jun 11 23:12:54.677857 np0000002687 nova-compute[98431]: Jun 11 23:12:54.677857 np0000002687 nova-compute[98431]: Jun 11 23:12:54.677857 np0000002687 nova-compute[98431]: Jun 11 23:12:54.677857 np0000002687 nova-compute[98431]: Jun 11 23:12:54.677857 np0000002687 nova-compute[98431]: Jun 11 23:12:54.677857 np0000002687 nova-compute[98431]: Jun 11 23:12:54.677857 np0000002687 nova-compute[98431]: Jun 11 23:12:54.677857 np0000002687 nova-compute[98431]: Jun 11 23:12:54.677857 np0000002687 nova-compute[98431]: Jun 11 23:12:54.677857 np0000002687 nova-compute[98431]: Jun 11 23:12:54.677857 np0000002687 nova-compute[98431]: Jun 11 23:12:54.677857 np0000002687 nova-compute[98431]: Jun 11 23:12:54.677857 np0000002687 nova-compute[98431]: /dev/urandom Jun 11 23:12:54.677857 np0000002687 nova-compute[98431]: Jun 11 23:12:54.677857 np0000002687 nova-compute[98431]: Jun 11 23:12:54.677857 np0000002687 nova-compute[98431]: Jun 11 23:12:54.677857 np0000002687 nova-compute[98431]: Jun 11 23:12:54.677857 np0000002687 nova-compute[98431]: Jun 11 23:12:54.677857 np0000002687 nova-compute[98431]: Jun 11 23:12:54.677857 np0000002687 nova-compute[98431]: Jun 11 23:12:54.677857 np0000002687 nova-compute[98431]: {{(pid=98431) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 11 23:12:54.684095 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Preparing to wait for external event network-vif-plugged-3c37ff2c-78c4-4423-b4a2-219e94df57ca {{(pid=98431) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 11 23:12:54.684095 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Acquiring lock "0d352738-c7bf-42a2-8260-bf5574a7200d-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:12:54.684095 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lock "0d352738-c7bf-42a2-8260-bf5574a7200d-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:12:54.684095 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lock "0d352738-c7bf-42a2-8260-bf5574a7200d-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:12:54.684095 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-11T23:12:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-916877464',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='tempest-serverbootfromvolumestablerescuetest-server-916877464',id=16,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aaf744af828a4a5eba1e98da63373b2b',ramdisk_id='',reservation_id='r-nua6jkmc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-539499192',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-11T23:12:44Z,user_data=None,user_id='72b6dac5eb744cfba6299636227aa59b',uuid=0d352738-c7bf-42a2-8260-bf5574a7200d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3c37ff2c-78c4-4423-b4a2-219e94df57ca", "address": "fa:16:3e:8f:ae:21", "network": {"id": "2a770c99-2ec6-4fa2-945b-32830a59e7a7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-137493671-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aaf744af828a4a5eba1e98da63373b2b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c37ff2c-78", "ovs_interfaceid": "3c37ff2c-78c4-4423-b4a2-219e94df57ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 11 23:12:54.684095 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Converting VIF {"id": "3c37ff2c-78c4-4423-b4a2-219e94df57ca", "address": "fa:16:3e:8f:ae:21", "network": {"id": "2a770c99-2ec6-4fa2-945b-32830a59e7a7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-137493671-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aaf744af828a4a5eba1e98da63373b2b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c37ff2c-78", "ovs_interfaceid": "3c37ff2c-78c4-4423-b4a2-219e94df57ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:12:54.684095 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:ae:21,bridge_name='br-int',has_traffic_filtering=True,id=3c37ff2c-78c4-4423-b4a2-219e94df57ca,network=Network(2a770c99-2ec6-4fa2-945b-32830a59e7a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c37ff2c-78') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:12:54.684095 np0000002687 nova-compute[98431]: DEBUG os_vif [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:ae:21,bridge_name='br-int',has_traffic_filtering=True,id=3c37ff2c-78c4-4423-b4a2-219e94df57ca,network=Network(2a770c99-2ec6-4fa2-945b-32830a59e7a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c37ff2c-78') {{(pid=98431) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 11 23:12:54.684095 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:54.684095 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:12:54.684726 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 11 23:12:54.685886 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:54.686817 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1b77f6da-47dd-56dd-ba3e-ba12c068ad1d', '_type': 'linux-noop'}}, row=False) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:12:54.688236 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:54.691188 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:12:54.696055 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:54.696337 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3c37ff2c-78, may_exist=True, interface_attrs={}) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:12:54.696894 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3c37ff2c-78, col_values=(('qos', UUID('0b9ea769-332a-49aa-88b1-bba0c2f705f9')),), if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:12:54.698108 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3c37ff2c-78, col_values=(('external_ids', {'iface-id': '3c37ff2c-78c4-4423-b4a2-219e94df57ca', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8f:ae:21', 'vm-uuid': '0d352738-c7bf-42a2-8260-bf5574a7200d'}),), if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:12:54.698108 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:54.699480 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:12:54.705903 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:54.708182 np0000002687 nova-compute[98431]: INFO os_vif [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:ae:21,bridge_name='br-int',has_traffic_filtering=True,id=3c37ff2c-78c4-4423-b4a2-219e94df57ca,network=Network(2a770c99-2ec6-4fa2-945b-32830a59e7a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c37ff2c-78') Jun 11 23:12:54.728500 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-e7e9f771-cf2b-4295-a312-2410df54c766 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] Instance cache missing network info. {{(pid=98431) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 11 23:12:54.982032 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] [instance: 19beb2a4-b3fe-43e9-ac92-71446c2630ee] Start building block device mappings for instance. {{(pid=98431) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 11 23:12:55.533439 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98431) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 11 23:12:55.533726 np0000002687 nova-compute[98431]: DEBUG nova.compute.provider_tree [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Inventory has not changed in ProviderTree for provider: e3e65fe2-9de9-4821-8b4a-ccae37c66e25 {{(pid=98431) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 11 23:12:55.536944 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:12:55.538972 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:12:55.821806 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:55.853113 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Port a1e7aeff-5992-43be-bb2c-d504e7019c64 binding to destination host np0000002687 is already ACTIVE {{(pid=98431) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3210}} Jun 11 23:12:55.863451 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-0d14d07c-c793-4da7-8f8e-1e87e29ab9bb req-5e8006db-9df7-4c62-bdc9-4e5d5dba6b9a service nova] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Received event network-vif-unplugged-a1e7aeff-5992-43be-bb2c-d504e7019c64 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:12:55.863451 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-0d14d07c-c793-4da7-8f8e-1e87e29ab9bb req-5e8006db-9df7-4c62-bdc9-4e5d5dba6b9a service nova] Acquiring lock "7609742e-a3a2-4be2-ba02-227efb2101e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:12:55.863451 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-0d14d07c-c793-4da7-8f8e-1e87e29ab9bb req-5e8006db-9df7-4c62-bdc9-4e5d5dba6b9a service nova] Lock "7609742e-a3a2-4be2-ba02-227efb2101e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:12:55.863451 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-0d14d07c-c793-4da7-8f8e-1e87e29ab9bb req-5e8006db-9df7-4c62-bdc9-4e5d5dba6b9a service nova] Lock "7609742e-a3a2-4be2-ba02-227efb2101e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:12:55.863451 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-0d14d07c-c793-4da7-8f8e-1e87e29ab9bb req-5e8006db-9df7-4c62-bdc9-4e5d5dba6b9a service nova] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] No waiting events found dispatching network-vif-unplugged-a1e7aeff-5992-43be-bb2c-d504e7019c64 {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:12:55.863725 np0000002687 nova-compute[98431]: WARNING nova.compute.manager [req-0d14d07c-c793-4da7-8f8e-1e87e29ab9bb req-5e8006db-9df7-4c62-bdc9-4e5d5dba6b9a service nova] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Received unexpected event network-vif-unplugged-a1e7aeff-5992-43be-bb2c-d504e7019c64 for instance with vm_state active and task_state resize_migrating. Jun 11 23:12:55.993484 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] [instance: 19beb2a4-b3fe-43e9-ac92-71446c2630ee] Start spawning the instance on the hypervisor. {{(pid=98431) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 11 23:12:55.994325 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] [instance: 19beb2a4-b3fe-43e9-ac92-71446c2630ee] Creating instance directory {{(pid=98431) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}} Jun 11 23:12:55.994607 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] [instance: 19beb2a4-b3fe-43e9-ac92-71446c2630ee] Creating image(s) Jun 11 23:12:55.996085 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] Acquiring lock "/opt/stack/data/nova/instances/19beb2a4-b3fe-43e9-ac92-71446c2630ee/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:12:55.996235 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] Lock "/opt/stack/data/nova/instances/19beb2a4-b3fe-43e9-ac92-71446c2630ee/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:12:55.996727 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] Lock "/opt/stack/data/nova/instances/19beb2a4-b3fe-43e9-ac92-71446c2630ee/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:12:55.997308 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:12:56.000228 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:12:56.002961 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:12:56.043074 np0000002687 nova-compute[98431]: DEBUG nova.scheduler.client.report [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Inventory has not changed for provider e3e65fe2-9de9-4821-8b4a-ccae37c66e25 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98431) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 11 23:12:56.061875 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-e7e9f771-cf2b-4295-a312-2410df54c766 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:12:56.098683 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json" returned: 0 in 0.096s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:12:56.100054 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] Acquiring lock "d2c441059b2992961b5de03c05b32d04aff77cb1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:12:56.100651 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] Lock "d2c441059b2992961b5de03c05b32d04aff77cb1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:12:56.101629 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:12:56.104894 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:12:56.105604 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:12:56.130421 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] [instance: 19beb2a4-b3fe-43e9-ac92-71446c2630ee] Successfully updated port: 4c1f7e6e-b361-4522-84d4-5bf89a5eb631 {{(pid=98431) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 11 23:12:56.176717 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-b80c51d1-853a-494c-843e-d70aeff6ad2b req-06bb7e26-4693-4529-8160-381e4413b697 service nova] [instance: 19beb2a4-b3fe-43e9-ac92-71446c2630ee] Received event network-changed-4c1f7e6e-b361-4522-84d4-5bf89a5eb631 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:12:56.176883 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-b80c51d1-853a-494c-843e-d70aeff6ad2b req-06bb7e26-4693-4529-8160-381e4413b697 service nova] [instance: 19beb2a4-b3fe-43e9-ac92-71446c2630ee] Refreshing instance network info cache due to event network-changed-4c1f7e6e-b361-4522-84d4-5bf89a5eb631. {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 11 23:12:56.177168 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-b80c51d1-853a-494c-843e-d70aeff6ad2b req-06bb7e26-4693-4529-8160-381e4413b697 service nova] Acquiring lock "refresh_cache-19beb2a4-b3fe-43e9-ac92-71446c2630ee" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 11 23:12:56.177434 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-b80c51d1-853a-494c-843e-d70aeff6ad2b req-06bb7e26-4693-4529-8160-381e4413b697 service nova] Acquired lock "refresh_cache-19beb2a4-b3fe-43e9-ac92-71446c2630ee" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 11 23:12:56.177651 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-b80c51d1-853a-494c-843e-d70aeff6ad2b req-06bb7e26-4693-4529-8160-381e4413b697 service nova] [instance: 19beb2a4-b3fe-43e9-ac92-71446c2630ee] Refreshing network info cache for port 4c1f7e6e-b361-4522-84d4-5bf89a5eb631 {{(pid=98431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 11 23:12:56.197072 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json" returned: 0 in 0.091s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:12:56.197563 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1,backing_fmt=raw /opt/stack/data/nova/instances/19beb2a4-b3fe-43e9-ac92-71446c2630ee/disk 1073741824 {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:12:56.240175 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] No BDM found with device name hda, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:12:56.240384 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] No BDM found with device name vda, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:12:56.240539 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] No VIF found with MAC fa:16:3e:8f:ae:21, not building metadata {{(pid=98431) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13199}} Jun 11 23:12:56.241345 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Using config drive Jun 11 23:12:56.245080 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1,backing_fmt=raw /opt/stack/data/nova/instances/19beb2a4-b3fe-43e9-ac92-71446c2630ee/disk 1073741824" returned: 0 in 0.047s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:12:56.245875 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] Lock "d2c441059b2992961b5de03c05b32d04aff77cb1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.145s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:12:56.246269 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:12:56.331251 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-e7e9f771-cf2b-4295-a312-2410df54c766 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] Updating instance_info_cache with network_info: [{"id": "3c04202e-5ce6-4249-ba31-be06996ca75d", "address": "fa:16:3e:6f:42:42", "network": {"id": "17593db3-c22d-4354-ab29-933b1c6a5c3a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1094286565-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "81fd45f475a04e5c8e9bd9deb7ad4c1e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c04202e-5c", "ovs_interfaceid": "3c04202e-5ce6-4249-ba31-be06996ca75d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:12:56.344536 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json" returned: 0 in 0.098s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:12:56.344937 np0000002687 nova-compute[98431]: DEBUG nova.virt.disk.api [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] Checking if we can resize image /opt/stack/data/nova/instances/19beb2a4-b3fe-43e9-ac92-71446c2630ee/disk. size=1073741824 {{(pid=98431) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 11 23:12:56.345212 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19beb2a4-b3fe-43e9-ac92-71446c2630ee/disk --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:12:56.438256 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19beb2a4-b3fe-43e9-ac92-71446c2630ee/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:12:56.438623 np0000002687 nova-compute[98431]: DEBUG nova.virt.disk.api [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] Cannot resize image /opt/stack/data/nova/instances/19beb2a4-b3fe-43e9-ac92-71446c2630ee/disk to a smaller size. {{(pid=98431) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 11 23:12:56.439336 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] [instance: 19beb2a4-b3fe-43e9-ac92-71446c2630ee] Created local disks {{(pid=98431) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}} Jun 11 23:12:56.439336 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] [instance: 19beb2a4-b3fe-43e9-ac92-71446c2630ee] Ensure instance console log exists: /opt/stack/data/nova/instances/19beb2a4-b3fe-43e9-ac92-71446c2630ee/console.log {{(pid=98431) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}} Jun 11 23:12:56.439582 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:12:56.439821 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:12:56.439972 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:12:56.538630 np0000002687 nova-compute[98431]: DEBUG oslo_service.periodic_task [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 11 23:12:56.540068 np0000002687 nova-compute[98431]: DEBUG oslo_service.periodic_task [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 11 23:12:56.540289 np0000002687 nova-compute[98431]: DEBUG oslo_service.periodic_task [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 11 23:12:56.540647 np0000002687 nova-compute[98431]: DEBUG oslo_service.periodic_task [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 11 23:12:56.540944 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98431) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}} Jun 11 23:12:56.541301 np0000002687 nova-compute[98431]: DEBUG oslo.service.backend._threading.loopingcall [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.48 seconds {{(pid=98431) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jun 11 23:12:56.558071 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.920s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:12:56.558722 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Start building networks asynchronously for instance. {{(pid=98431) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 11 23:12:56.636873 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] Acquiring lock "refresh_cache-19beb2a4-b3fe-43e9-ac92-71446c2630ee" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 11 23:12:56.684029 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [req-b80c51d1-853a-494c-843e-d70aeff6ad2b req-06bb7e26-4693-4529-8160-381e4413b697 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:12:56.767882 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:12:56.772218 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-b80c51d1-853a-494c-843e-d70aeff6ad2b req-06bb7e26-4693-4529-8160-381e4413b697 service nova] [instance: 19beb2a4-b3fe-43e9-ac92-71446c2630ee] Instance cache missing network info. {{(pid=98431) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 11 23:12:56.834269 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-e7e9f771-cf2b-4295-a312-2410df54c766 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Releasing lock "refresh_cache-8a45e04f-3516-4c39-bea1-820104411f17" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 11 23:12:56.834707 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-e7e9f771-cf2b-4295-a312-2410df54c766 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] Instance network_info: |[{"id": "3c04202e-5ce6-4249-ba31-be06996ca75d", "address": "fa:16:3e:6f:42:42", "network": {"id": "17593db3-c22d-4354-ab29-933b1c6a5c3a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1094286565-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "81fd45f475a04e5c8e9bd9deb7ad4c1e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c04202e-5c", "ovs_interfaceid": "3c04202e-5ce6-4249-ba31-be06996ca75d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98431) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 11 23:12:56.839878 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-e7e9f771-cf2b-4295-a312-2410df54c766 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] Start _get_guest_xml network_info=[{"id": "3c04202e-5ce6-4249-ba31-be06996ca75d", "address": "fa:16:3e:6f:42:42", "network": {"id": "17593db3-c22d-4354-ab29-933b1c6a5c3a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1094286565-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "81fd45f475a04e5c8e9bd9deb7ad4c1e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c04202e-5c", "ovs_interfaceid": "3c04202e-5ce6-4249-ba31-be06996ca75d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-11T23:08:20Z,direct_url=,disk_format='qcow2',id=f30640f8-7aca-4300-a085-4706a5209a79,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ce012f9fabdb4ee5a73e212437f59d97',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-11T23:08:23Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'image_id': 'f30640f8-7aca-4300-a085-4706a5209a79'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98431) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 11 23:12:56.839878 np0000002687 nova-compute[98431]: WARNING nova.virt.libvirt.driver [None req-e7e9f771-cf2b-4295-a312-2410df54c766 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 11 23:12:56.840537 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-e7e9f771-cf2b-4295-a312-2410df54c766 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='f30640f8-7aca-4300-a085-4706a5209a79', instance_meta=NovaInstanceMeta(name='multiattach-server-1', uuid='8a45e04f-3516-4c39-bea1-820104411f17'), owner=OwnerMeta(userid='c17e84202f404c3c8e73292bb59d7b27', username='tempest-AttachVolumeMultiAttachTest-1514006700-project-member', projectid='81fd45f475a04e5c8e9bd9deb7ad4c1e', projectname='tempest-AttachVolumeMultiAttachTest-1514006700'), image=ImageMeta(id='f30640f8-7aca-4300-a085-4706a5209a79', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "3c04202e-5ce6-4249-ba31-be06996ca75d", "address": "fa:16:3e:6f:42:42", "network": {"id": "17593db3-c22d-4354-ab29-933b1c6a5c3a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1094286565-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "81fd45f475a04e5c8e9bd9deb7ad4c1e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c04202e-5c", "ovs_interfaceid": "3c04202e-5ce6-4249-ba31-be06996ca75d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1781219576.8400843) {{(pid=98431) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 11 23:12:56.842070 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-e7e9f771-cf2b-4295-a312-2410df54c766 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Searching host: 'np0000002687' for CPU controller through CGroups V1... {{(pid=98431) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 11 23:12:56.845483 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-e7e9f771-cf2b-4295-a312-2410df54c766 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] CPU controller missing on host. {{(pid=98431) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 11 23:12:56.845483 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-e7e9f771-cf2b-4295-a312-2410df54c766 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Searching host: 'np0000002687' for CPU controller through CGroups V2... {{(pid=98431) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 11 23:12:56.845483 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-e7e9f771-cf2b-4295-a312-2410df54c766 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] CPU controller found on host. {{(pid=98431) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 11 23:12:56.845483 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-e7e9f771-cf2b-4295-a312-2410df54c766 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98431) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 11 23:12:56.845483 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-e7e9f771-cf2b-4295-a312-2410df54c766 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-11T23:08:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-11T23:08:20Z,direct_url=,disk_format='qcow2',id=f30640f8-7aca-4300-a085-4706a5209a79,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ce012f9fabdb4ee5a73e212437f59d97',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-11T23:08:23Z,virtual_size=,visibility=), allow threads: True {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 11 23:12:56.845483 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-e7e9f771-cf2b-4295-a312-2410df54c766 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Flavor limits 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 11 23:12:56.845483 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-e7e9f771-cf2b-4295-a312-2410df54c766 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Image limits 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 11 23:12:56.845483 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-e7e9f771-cf2b-4295-a312-2410df54c766 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Flavor pref 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 11 23:12:56.845483 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-e7e9f771-cf2b-4295-a312-2410df54c766 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Image pref 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 11 23:12:56.845483 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-e7e9f771-cf2b-4295-a312-2410df54c766 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 11 23:12:56.845959 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-e7e9f771-cf2b-4295-a312-2410df54c766 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 11 23:12:56.845959 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-e7e9f771-cf2b-4295-a312-2410df54c766 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98431) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 11 23:12:56.845959 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-e7e9f771-cf2b-4295-a312-2410df54c766 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Got 1 possible topologies {{(pid=98431) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 11 23:12:56.846109 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-e7e9f771-cf2b-4295-a312-2410df54c766 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 11 23:12:56.846164 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-e7e9f771-cf2b-4295-a312-2410df54c766 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 11 23:12:56.861515 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-e7e9f771-cf2b-4295-a312-2410df54c766 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-11T23:12:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='multiattach-server-1',id=17,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHngWA9S/0M7yAiCaKN7wJ0iqGBq18p6o1N91kfGTes8iMQtxmsCxH/Iqg51e2HEWFsjD10S17Kahb+vCzu07nJJQGe3fNUonThwHNf0exiWq4jZuXjSZtHJPO0dbow48A==',key_name='tempest-keypair-1974490716',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='81fd45f475a04e5c8e9bd9deb7ad4c1e',ramdisk_id='',reservation_id='r-n8ohee78',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1514006700',owner_user_name='tempest-AttachVolumeMultiAttachTest-1514006700-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-11T23:12:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c17e84202f404c3c8e73292bb59d7b27',uuid=8a45e04f-3516-4c39-bea1-820104411f17,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3c04202e-5ce6-4249-ba31-be06996ca75d", "address": "fa:16:3e:6f:42:42", "network": {"id": "17593db3-c22d-4354-ab29-933b1c6a5c3a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1094286565-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "81fd45f475a04e5c8e9bd9deb7ad4c1e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c04202e-5c", "ovs_interfaceid": "3c04202e-5ce6-4249-ba31-be06996ca75d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98431) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 11 23:12:56.861768 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-e7e9f771-cf2b-4295-a312-2410df54c766 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Converting VIF {"id": "3c04202e-5ce6-4249-ba31-be06996ca75d", "address": "fa:16:3e:6f:42:42", "network": {"id": "17593db3-c22d-4354-ab29-933b1c6a5c3a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1094286565-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "81fd45f475a04e5c8e9bd9deb7ad4c1e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c04202e-5c", "ovs_interfaceid": "3c04202e-5ce6-4249-ba31-be06996ca75d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:12:56.862989 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-e7e9f771-cf2b-4295-a312-2410df54c766 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:42:42,bridge_name='br-int',has_traffic_filtering=True,id=3c04202e-5ce6-4249-ba31-be06996ca75d,network=Network(17593db3-c22d-4354-ab29-933b1c6a5c3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c04202e-5c') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:12:56.863291 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-e7e9f771-cf2b-4295-a312-2410df54c766 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lazy-loading 'pci_devices' on Instance uuid 8a45e04f-3516-4c39-bea1-820104411f17 {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:12:56.877775 np0000002687 nova-compute[98431]: DEBUG nova.compute.rpcapi [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98431) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}} Jun 11 23:12:56.897444 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Acquiring lock "7609742e-a3a2-4be2-ba02-227efb2101e1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:12:56.902373 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Lock "7609742e-a3a2-4be2-ba02-227efb2101e1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.005s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:12:56.902684 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Lock "7609742e-a3a2-4be2-ba02-227efb2101e1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:12:57.022065 np0000002687 nova-compute[98431]: DEBUG oslo_service.periodic_task [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 11 23:12:57.022521 np0000002687 nova-compute[98431]: DEBUG oslo.service.backend._threading.loopingcall [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98431) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jun 11 23:12:57.057544 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-b80c51d1-853a-494c-843e-d70aeff6ad2b req-06bb7e26-4693-4529-8160-381e4413b697 service nova] [instance: 19beb2a4-b3fe-43e9-ac92-71446c2630ee] Updating instance_info_cache with network_info: [] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:12:57.069287 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Allocating IP information in the background. {{(pid=98431) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 11 23:12:57.070187 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] allocate_for_instance() {{(pid=98431) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 11 23:12:57.070545 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:12:57.070856 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:12:57.073462 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:57.096830 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Creating config drive at /opt/stack/data/nova/instances/0d352738-c7bf-42a2-8260-bf5574a7200d/disk.config Jun 11 23:12:57.102649 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/0d352738-c7bf-42a2-8260-bf5574a7200d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpo5pd1gug {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:12:57.167097 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/0d352738-c7bf-42a2-8260-bf5574a7200d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpo5pd1gug" returned: 0 in 0.064s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:12:57.371319 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-e7e9f771-cf2b-4295-a312-2410df54c766 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] End _get_guest_xml xml= Jun 11 23:12:57.371319 np0000002687 nova-compute[98431]: 8a45e04f-3516-4c39-bea1-820104411f17 Jun 11 23:12:57.371319 np0000002687 nova-compute[98431]: instance-00000011 Jun 11 23:12:57.371319 np0000002687 nova-compute[98431]: 196608 Jun 11 23:12:57.371319 np0000002687 nova-compute[98431]: 1 Jun 11 23:12:57.371319 np0000002687 nova-compute[98431]: Jun 11 23:12:57.371319 np0000002687 nova-compute[98431]: Jun 11 23:12:57.371319 np0000002687 nova-compute[98431]: Jun 11 23:12:57.371319 np0000002687 nova-compute[98431]: multiattach-server-1 Jun 11 23:12:57.371319 np0000002687 nova-compute[98431]: 2026-06-11 23:12:56 Jun 11 23:12:57.371319 np0000002687 nova-compute[98431]: Jun 11 23:12:57.371319 np0000002687 nova-compute[98431]: 192 Jun 11 23:12:57.371319 np0000002687 nova-compute[98431]: 1 Jun 11 23:12:57.371319 np0000002687 nova-compute[98431]: 0 Jun 11 23:12:57.371319 np0000002687 nova-compute[98431]: 0 Jun 11 23:12:57.371319 np0000002687 nova-compute[98431]: 1 Jun 11 23:12:57.371319 np0000002687 nova-compute[98431]: Jun 11 23:12:57.371319 np0000002687 nova-compute[98431]: True Jun 11 23:12:57.371319 np0000002687 nova-compute[98431]: Jun 11 23:12:57.371319 np0000002687 nova-compute[98431]: Jun 11 23:12:57.371319 np0000002687 nova-compute[98431]: Jun 11 23:12:57.371319 np0000002687 nova-compute[98431]: bare Jun 11 23:12:57.371319 np0000002687 nova-compute[98431]: qcow2 Jun 11 23:12:57.371319 np0000002687 nova-compute[98431]: 1 Jun 11 23:12:57.371319 np0000002687 nova-compute[98431]: 0 Jun 11 23:12:57.371319 np0000002687 nova-compute[98431]: Jun 11 23:12:57.371319 np0000002687 nova-compute[98431]: virtio Jun 11 23:12:57.371319 np0000002687 nova-compute[98431]: Jun 11 23:12:57.371319 np0000002687 nova-compute[98431]: Jun 11 23:12:57.371319 np0000002687 nova-compute[98431]: Jun 11 23:12:57.371319 np0000002687 nova-compute[98431]: tempest-AttachVolumeMultiAttachTest-1514006700-project-member Jun 11 23:12:57.371319 np0000002687 nova-compute[98431]: tempest-AttachVolumeMultiAttachTest-1514006700 Jun 11 23:12:57.371319 np0000002687 nova-compute[98431]: Jun 11 23:12:57.371319 np0000002687 nova-compute[98431]: Jun 11 23:12:57.371319 np0000002687 nova-compute[98431]: Jun 11 23:12:57.371319 np0000002687 nova-compute[98431]: Jun 11 23:12:57.371319 np0000002687 nova-compute[98431]: Jun 11 23:12:57.371319 np0000002687 nova-compute[98431]: Jun 11 23:12:57.371319 np0000002687 nova-compute[98431]: Jun 11 23:12:57.371319 np0000002687 nova-compute[98431]: Jun 11 23:12:57.371319 np0000002687 nova-compute[98431]: Jun 11 23:12:57.371319 np0000002687 nova-compute[98431]: Jun 11 23:12:57.371319 np0000002687 nova-compute[98431]: Jun 11 23:12:57.371319 np0000002687 nova-compute[98431]: OpenStack Foundation Jun 11 23:12:57.371319 np0000002687 nova-compute[98431]: OpenStack Nova Jun 11 23:12:57.371319 np0000002687 nova-compute[98431]: 33.1.0 Jun 11 23:12:57.371319 np0000002687 nova-compute[98431]: 8a45e04f-3516-4c39-bea1-820104411f17 Jun 11 23:12:57.371319 np0000002687 nova-compute[98431]: 8a45e04f-3516-4c39-bea1-820104411f17 Jun 11 23:12:57.371319 np0000002687 nova-compute[98431]: Virtual Machine Jun 11 23:12:57.371319 np0000002687 nova-compute[98431]: Jun 11 23:12:57.371319 np0000002687 nova-compute[98431]: Jun 11 23:12:57.371319 np0000002687 nova-compute[98431]: Jun 11 23:12:57.371319 np0000002687 nova-compute[98431]: hvm Jun 11 23:12:57.371319 np0000002687 nova-compute[98431]: Jun 11 23:12:57.371319 np0000002687 nova-compute[98431]: Jun 11 23:12:57.371319 np0000002687 nova-compute[98431]: Jun 11 23:12:57.371319 np0000002687 nova-compute[98431]: Jun 11 23:12:57.371319 np0000002687 nova-compute[98431]: Jun 11 23:12:57.371319 np0000002687 nova-compute[98431]: Jun 11 23:12:57.371319 np0000002687 nova-compute[98431]: 128 Jun 11 23:12:57.371319 np0000002687 nova-compute[98431]: Jun 11 23:12:57.371319 np0000002687 nova-compute[98431]: Jun 11 23:12:57.371319 np0000002687 nova-compute[98431]: Jun 11 23:12:57.371319 np0000002687 nova-compute[98431]: 1 Jun 11 23:12:57.371319 np0000002687 nova-compute[98431]: Jun 11 23:12:57.371319 np0000002687 nova-compute[98431]: Jun 11 23:12:57.371319 np0000002687 nova-compute[98431]: Nehalem Jun 11 23:12:57.371319 np0000002687 nova-compute[98431]: Jun 11 23:12:57.371319 np0000002687 nova-compute[98431]: Jun 11 23:12:57.371319 np0000002687 nova-compute[98431]: Jun 11 23:12:57.371319 np0000002687 nova-compute[98431]: Jun 11 23:12:57.371319 np0000002687 nova-compute[98431]: Jun 11 23:12:57.371319 np0000002687 nova-compute[98431]: Jun 11 23:12:57.371319 np0000002687 nova-compute[98431]: Jun 11 23:12:57.371319 np0000002687 nova-compute[98431]: Jun 11 23:12:57.371319 np0000002687 nova-compute[98431]: Jun 11 23:12:57.371319 np0000002687 nova-compute[98431]: Jun 11 23:12:57.371319 np0000002687 nova-compute[98431]: Jun 11 23:12:57.371319 np0000002687 nova-compute[98431]: Jun 11 23:12:57.371319 np0000002687 nova-compute[98431]: Jun 11 23:12:57.371319 np0000002687 nova-compute[98431]: Jun 11 23:12:57.371319 np0000002687 nova-compute[98431]: Jun 11 23:12:57.371319 np0000002687 nova-compute[98431]: Jun 11 23:12:57.371319 np0000002687 nova-compute[98431]: Jun 11 23:12:57.371319 np0000002687 nova-compute[98431]: Jun 11 23:12:57.371319 np0000002687 nova-compute[98431]: Jun 11 23:12:57.371319 np0000002687 nova-compute[98431]: Jun 11 23:12:57.371319 np0000002687 nova-compute[98431]: Jun 11 23:12:57.371319 np0000002687 nova-compute[98431]: Jun 11 23:12:57.371319 np0000002687 nova-compute[98431]: Jun 11 23:12:57.371319 np0000002687 nova-compute[98431]: Jun 11 23:12:57.371319 np0000002687 nova-compute[98431]: Jun 11 23:12:57.371319 np0000002687 nova-compute[98431]: Jun 11 23:12:57.371319 np0000002687 nova-compute[98431]: /dev/urandom Jun 11 23:12:57.371319 np0000002687 nova-compute[98431]: Jun 11 23:12:57.371319 np0000002687 nova-compute[98431]: Jun 11 23:12:57.371319 np0000002687 nova-compute[98431]: Jun 11 23:12:57.371319 np0000002687 nova-compute[98431]: Jun 11 23:12:57.371319 np0000002687 nova-compute[98431]: Jun 11 23:12:57.371319 np0000002687 nova-compute[98431]: Jun 11 23:12:57.371319 np0000002687 nova-compute[98431]: Jun 11 23:12:57.371319 np0000002687 nova-compute[98431]: {{(pid=98431) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 11 23:12:57.374230 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-e7e9f771-cf2b-4295-a312-2410df54c766 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] Preparing to wait for external event network-vif-plugged-3c04202e-5ce6-4249-ba31-be06996ca75d {{(pid=98431) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 11 23:12:57.374230 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-e7e9f771-cf2b-4295-a312-2410df54c766 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Acquiring lock "8a45e04f-3516-4c39-bea1-820104411f17-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:12:57.374230 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-e7e9f771-cf2b-4295-a312-2410df54c766 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "8a45e04f-3516-4c39-bea1-820104411f17-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:12:57.374230 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-e7e9f771-cf2b-4295-a312-2410df54c766 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "8a45e04f-3516-4c39-bea1-820104411f17-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:12:57.375862 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-e7e9f771-cf2b-4295-a312-2410df54c766 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-11T23:12:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='multiattach-server-1',id=17,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHngWA9S/0M7yAiCaKN7wJ0iqGBq18p6o1N91kfGTes8iMQtxmsCxH/Iqg51e2HEWFsjD10S17Kahb+vCzu07nJJQGe3fNUonThwHNf0exiWq4jZuXjSZtHJPO0dbow48A==',key_name='tempest-keypair-1974490716',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='81fd45f475a04e5c8e9bd9deb7ad4c1e',ramdisk_id='',reservation_id='r-n8ohee78',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1514006700',owner_user_name='tempest-AttachVolumeMultiAttachTest-1514006700-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-11T23:12:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c17e84202f404c3c8e73292bb59d7b27',uuid=8a45e04f-3516-4c39-bea1-820104411f17,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3c04202e-5ce6-4249-ba31-be06996ca75d", "address": "fa:16:3e:6f:42:42", "network": {"id": "17593db3-c22d-4354-ab29-933b1c6a5c3a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1094286565-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "81fd45f475a04e5c8e9bd9deb7ad4c1e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c04202e-5c", "ovs_interfaceid": "3c04202e-5ce6-4249-ba31-be06996ca75d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 11 23:12:57.377055 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-e7e9f771-cf2b-4295-a312-2410df54c766 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Converting VIF {"id": "3c04202e-5ce6-4249-ba31-be06996ca75d", "address": "fa:16:3e:6f:42:42", "network": {"id": "17593db3-c22d-4354-ab29-933b1c6a5c3a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1094286565-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "81fd45f475a04e5c8e9bd9deb7ad4c1e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c04202e-5c", "ovs_interfaceid": "3c04202e-5ce6-4249-ba31-be06996ca75d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:12:57.377496 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-e7e9f771-cf2b-4295-a312-2410df54c766 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:42:42,bridge_name='br-int',has_traffic_filtering=True,id=3c04202e-5ce6-4249-ba31-be06996ca75d,network=Network(17593db3-c22d-4354-ab29-933b1c6a5c3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c04202e-5c') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:12:57.378000 np0000002687 nova-compute[98431]: DEBUG os_vif [None req-e7e9f771-cf2b-4295-a312-2410df54c766 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:42:42,bridge_name='br-int',has_traffic_filtering=True,id=3c04202e-5ce6-4249-ba31-be06996ca75d,network=Network(17593db3-c22d-4354-ab29-933b1c6a5c3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c04202e-5c') {{(pid=98431) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 11 23:12:57.378370 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:57.378853 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:12:57.379123 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 11 23:12:57.383576 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:57.384134 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '427b0bac-fbf0-55a8-afea-48cbb4504a4d', '_type': 'linux-noop'}}, row=False) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:12:57.386485 np0000002687 nova-compute[98431]: DEBUG nova.policy [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3dd7997e0762451ca159ee06bf3d9c44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c1e407a42f24b34baf3ee44be9fb337', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98431) authorize /opt/stack/nova/nova/policy.py:192}} Jun 11 23:12:57.388748 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:57.389756 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:12:57.394305 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:57.400655 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:57.400961 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3c04202e-5c, may_exist=True, interface_attrs={}) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:12:57.401412 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3c04202e-5c, col_values=(('qos', UUID('eb961cb5-554a-4ab5-90ff-a7d42e4ca2c8')),), if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:12:57.401594 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3c04202e-5c, col_values=(('external_ids', {'iface-id': '3c04202e-5ce6-4249-ba31-be06996ca75d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6f:42:42', 'vm-uuid': '8a45e04f-3516-4c39-bea1-820104411f17'}),), if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:12:57.403193 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:57.406834 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:12:57.416611 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:57.418323 np0000002687 nova-compute[98431]: INFO os_vif [None req-e7e9f771-cf2b-4295-a312-2410df54c766 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:42:42,bridge_name='br-int',has_traffic_filtering=True,id=3c04202e-5ce6-4249-ba31-be06996ca75d,network=Network(17593db3-c22d-4354-ab29-933b1c6a5c3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c04202e-5c') Jun 11 23:12:57.559958 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-b80c51d1-853a-494c-843e-d70aeff6ad2b req-06bb7e26-4693-4529-8160-381e4413b697 service nova] Releasing lock "refresh_cache-19beb2a4-b3fe-43e9-ac92-71446c2630ee" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 11 23:12:57.560570 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] Acquired lock "refresh_cache-19beb2a4-b3fe-43e9-ac92-71446c2630ee" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 11 23:12:57.560792 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] [instance: 19beb2a4-b3fe-43e9-ac92-71446c2630ee] Building network info cache for instance {{(pid=98431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 11 23:12:57.574825 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 11 23:12:57.662247 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:57.703215 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:57.799131 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:57.862710 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:57.871017 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:57.911614 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:12:57.994887 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-94a4e759-65f6-42e6-8777-1b638a030fe7 req-1cbc4ee0-bd3f-444e-aa0b-d1834f5aa923 service nova] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Received event network-vif-plugged-3c37ff2c-78c4-4423-b4a2-219e94df57ca {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:12:57.995147 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-94a4e759-65f6-42e6-8777-1b638a030fe7 req-1cbc4ee0-bd3f-444e-aa0b-d1834f5aa923 service nova] Acquiring lock "0d352738-c7bf-42a2-8260-bf5574a7200d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:12:57.996914 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-94a4e759-65f6-42e6-8777-1b638a030fe7 req-1cbc4ee0-bd3f-444e-aa0b-d1834f5aa923 service nova] Lock "0d352738-c7bf-42a2-8260-bf5574a7200d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:12:57.996914 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-94a4e759-65f6-42e6-8777-1b638a030fe7 req-1cbc4ee0-bd3f-444e-aa0b-d1834f5aa923 service nova] Lock "0d352738-c7bf-42a2-8260-bf5574a7200d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:12:57.996914 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-94a4e759-65f6-42e6-8777-1b638a030fe7 req-1cbc4ee0-bd3f-444e-aa0b-d1834f5aa923 service nova] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Processing event network-vif-plugged-3c37ff2c-78c4-4423-b4a2-219e94df57ca {{(pid=98431) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 11 23:12:58.024915 np0000002687 nova-compute[98431]: DEBUG oslo_service.periodic_task [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 11 23:12:58.025493 np0000002687 nova-compute[98431]: DEBUG oslo_service.periodic_task [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running periodic task ComputeManager.update_available_resource {{(pid=98431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 11 23:12:58.300951 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Successfully created port: 5f9094e3-a3c6-48ea-bfbe-4fa25d19bcf2 {{(pid=98431) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 11 23:12:58.343111 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Acquiring lock "refresh_cache-7609742e-a3a2-4be2-ba02-227efb2101e1" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 11 23:12:58.343238 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Acquired lock "refresh_cache-7609742e-a3a2-4be2-ba02-227efb2101e1" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 11 23:12:58.343374 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Building network info cache for instance {{(pid=98431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 11 23:12:58.383703 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] [instance: 19beb2a4-b3fe-43e9-ac92-71446c2630ee] Instance cache missing network info. {{(pid=98431) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 11 23:12:58.531890 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:12:58.532277 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:12:58.532430 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:12:58.532513 np0000002687 nova-compute[98431]: DEBUG nova.compute.resource_tracker [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Auditing locally available compute resources for np0000002687 (node: np0000002687) {{(pid=98431) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}} Jun 11 23:12:58.723593 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98431) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 11 23:12:58.724611 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Emitting event Started> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:12:58.727864 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] VM Started (Lifecycle Event) Jun 11 23:12:58.730548 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Guest created on hypervisor {{(pid=98431) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}} Jun 11 23:12:58.741633 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [-] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Instance spawned successfully. Jun 11 23:12:58.744040 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 11 23:12:58.846777 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:12:58.940740 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-e7e9f771-cf2b-4295-a312-2410df54c766 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] No BDM found with device name vda, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:12:58.941211 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-e7e9f771-cf2b-4295-a312-2410df54c766 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] No BDM found with device name hda, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:12:58.941211 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-e7e9f771-cf2b-4295-a312-2410df54c766 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] No VIF found with MAC fa:16:3e:6f:42:42, not building metadata {{(pid=98431) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13199}} Jun 11 23:12:58.941417 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-e7e9f771-cf2b-4295-a312-2410df54c766 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] Using config drive Jun 11 23:12:59.050186 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Successfully created port: 37aa7cee-88a0-4428-9b2d-45700f1dcab6 {{(pid=98431) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 11 23:12:59.088864 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Start building block device mappings for instance. {{(pid=98431) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 11 23:12:59.229318 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:12:59.233578 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98431) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 11 23:12:59.254926 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Found default for hw_cdrom_bus of ide {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:12:59.254926 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Found default for hw_disk_bus of virtio {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:12:59.254926 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Found default for hw_input_bus of None {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:12:59.254926 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Found default for hw_pointer_model of None {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:12:59.254926 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Found default for hw_video_model of virtio {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:12:59.255223 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Found default for hw_vif_model of virtio {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:12:59.318652 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:12:59.424377 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:12:59.447382 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-e7e9f771-cf2b-4295-a312-2410df54c766 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:12:59.594070 np0000002687 nova-compute[98431]: INFO nova.virt.block_device [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Booting with volume 1bc89aea-2378-4237-a440-71ea160649dc at /dev/vda Jun 11 23:12:59.611700 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ffa4bbe-7ead-4029-aba5-28f031f6e784/disk --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:12:59.719273 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.209', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000002687', 'execute': None}" {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 11 23:12:59.724671 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ffa4bbe-7ead-4029-aba5-28f031f6e784/disk --force-share --output=json" returned: 0 in 0.113s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:12:59.726021 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ffa4bbe-7ead-4029-aba5-28f031f6e784/disk --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:12:59.742424 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] During sync_power_state the instance has a pending task (spawning). Skip. Jun 11 23:12:59.746499 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Emitting event Paused> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:12:59.746715 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] VM Paused (Lifecycle Event) Jun 11 23:12:59.759910 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.scaleio [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98431) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 11 23:12:59.765978 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Took 9.19 seconds to spawn the instance on the hypervisor. Jun 11 23:12:59.768097 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:12:59.796492 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Running cmd (subprocess): nvme version {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:12:59.828255 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ffa4bbe-7ead-4029-aba5-28f031f6e784/disk --force-share --output=json" returned: 0 in 0.102s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:12:59.833315 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7609742e-a3a2-4be2-ba02-227efb2101e1/disk --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:12:59.859126 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Successfully created port: e3269961-a3f1-42c8-a49e-37f728b2f3d8 {{(pid=98431) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 11 23:12:59.867280 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] 'nvme version' failed. Not Retrying. {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 11 23:12:59.867682 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] nvme not present on system {{(pid=98431) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 11 23:12:59.879532 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.lightos [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98431) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 11 23:12:59.881536 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.lightos [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Current host hostNQN and IP(s) are ['10.4.3.209', 'fe80::f816:3eff:fea3:3707', '192.168.40.6', 'fe80::f816:3eff:fe06:bdab', '192.168.50.6', 'fe80::f816:3eff:fe7a:46f2', '192.168.10.6', 'fe80::f816:3eff:fe13:793b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::38fa:21ff:fe6c:3746', 'fe80::fc16:3eff:fe6c:eb30', 'fe80::20a8:54ff:fe51:da0a', 'fe80::fc16:3eff:fe77:488d', 'fe80::9469:f2ff:feae:5824', 'fe80::fc16:3eff:fec7:336a', 'fe80::fc16:3eff:fe61:b7fd', 'fe80::fc16:3eff:fec6:c65b', 'fe80::fc16:3eff:fed6:e34f', 'fe80::fc16:3eff:feb5:6ffd', 'fe80::4cb3:64ff:fe13:8a75', 'fe80::fc16:3eff:fe4b:2695', 'fe80::fc16:3eff:fe8f:ae21'] Jun 11 23:12:59.881721 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.lightos [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98431) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 11 23:12:59.882051 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.lightos [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] LIGHTOS: no hostnqn found. {{(pid=98431) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 11 23:12:59.882600 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] <== get_connector_properties: return (162ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.209', 'host': 'np0000002687', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:798b370f1cc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad465dfe-0ed1-4637-98c3-ddaebebd61a4', 'nvme_native_multipath': False} {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 11 23:12:59.885842 np0000002687 nova-compute[98431]: DEBUG nova.virt.block_device [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Updating existing volume attachment record: 20fbe269-4aab-47d7-8973-d03dda5e90e8 {{(pid=98431) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 11 23:12:59.902900 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] [instance: 19beb2a4-b3fe-43e9-ac92-71446c2630ee] Updating instance_info_cache with network_info: [{"id": "4c1f7e6e-b361-4522-84d4-5bf89a5eb631", "address": "fa:16:3e:ed:10:1f", "network": {"id": "3af1cbf3-5c99-489d-885d-7f5f0475ce13", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1827810190-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9c2c5af39c7b4fcc94f857ad4db5e636", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c1f7e6e-b3", "ovs_interfaceid": "4c1f7e6e-b361-4522-84d4-5bf89a5eb631", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:12:59.960017 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7609742e-a3a2-4be2-ba02-227efb2101e1/disk --force-share --output=json" returned: 0 in 0.127s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:12:59.960599 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7609742e-a3a2-4be2-ba02-227efb2101e1/disk --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:13:00.052290 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-e7e9f771-cf2b-4295-a312-2410df54c766 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] Creating config drive at /opt/stack/data/nova/instances/8a45e04f-3516-4c39-bea1-820104411f17/disk.config Jun 11 23:13:00.060300 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-e7e9f771-cf2b-4295-a312-2410df54c766 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/8a45e04f-3516-4c39-bea1-820104411f17/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpglg6tipv {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:13:00.085442 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7609742e-a3a2-4be2-ba02-227efb2101e1/disk --force-share --output=json" returned: 0 in 0.124s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:13:00.087175 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] skipping disk /dev/dm-3 (vdb) as it is a volume {{(pid=98431) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12344}} Jun 11 23:13:00.092155 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98431) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12344}} Jun 11 23:13:00.095414 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a45e04f-3516-4c39-bea1-820104411f17/disk --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:13:00.123639 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-fc7e2fc7-fcf6-4cb5-95e8-e9af3308c548 req-1e5d75cb-dcb5-4350-a8c4-85f5f1d517bf service nova] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Received event network-vif-plugged-3c37ff2c-78c4-4423-b4a2-219e94df57ca {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:13:00.123639 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-fc7e2fc7-fcf6-4cb5-95e8-e9af3308c548 req-1e5d75cb-dcb5-4350-a8c4-85f5f1d517bf service nova] Acquiring lock "0d352738-c7bf-42a2-8260-bf5574a7200d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:00.124135 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-fc7e2fc7-fcf6-4cb5-95e8-e9af3308c548 req-1e5d75cb-dcb5-4350-a8c4-85f5f1d517bf service nova] Lock "0d352738-c7bf-42a2-8260-bf5574a7200d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:00.124176 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-fc7e2fc7-fcf6-4cb5-95e8-e9af3308c548 req-1e5d75cb-dcb5-4350-a8c4-85f5f1d517bf service nova] Lock "0d352738-c7bf-42a2-8260-bf5574a7200d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:00.125753 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-fc7e2fc7-fcf6-4cb5-95e8-e9af3308c548 req-1e5d75cb-dcb5-4350-a8c4-85f5f1d517bf service nova] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] No waiting events found dispatching network-vif-plugged-3c37ff2c-78c4-4423-b4a2-219e94df57ca {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:13:00.125753 np0000002687 nova-compute[98431]: WARNING nova.compute.manager [req-fc7e2fc7-fcf6-4cb5-95e8-e9af3308c548 req-1e5d75cb-dcb5-4350-a8c4-85f5f1d517bf service nova] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Received unexpected event network-vif-plugged-3c37ff2c-78c4-4423-b4a2-219e94df57ca for instance with vm_state active and task_state None. Jun 11 23:13:00.127715 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-e7e9f771-cf2b-4295-a312-2410df54c766 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/8a45e04f-3516-4c39-bea1-820104411f17/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpglg6tipv" returned: 0 in 0.065s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:13:00.159206 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:13:00.213074 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a45e04f-3516-4c39-bea1-820104411f17/disk --force-share --output=json" returned: 0 in 0.118s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:13:00.213572 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a45e04f-3516-4c39-bea1-820104411f17/disk --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:13:00.259144 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:13:00.263056 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Emitting event Resumed> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:13:00.263056 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] VM Resumed (Lifecycle Event) Jun 11 23:13:00.288149 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Took 20.73 seconds to build instance. Jun 11 23:13:00.308577 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a45e04f-3516-4c39-bea1-820104411f17/disk --force-share --output=json" returned: 0 in 0.095s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:13:00.311985 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8641b14d-785b-44b0-ad6d-bb537cbee5c7/disk --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:13:00.404983 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8641b14d-785b-44b0-ad6d-bb537cbee5c7/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:13:00.404983 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8641b14d-785b-44b0-ad6d-bb537cbee5c7/disk --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:13:00.416652 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] Releasing lock "refresh_cache-19beb2a4-b3fe-43e9-ac92-71446c2630ee" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 11 23:13:00.417774 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] [instance: 19beb2a4-b3fe-43e9-ac92-71446c2630ee] Instance network_info: |[{"id": "4c1f7e6e-b361-4522-84d4-5bf89a5eb631", "address": "fa:16:3e:ed:10:1f", "network": {"id": "3af1cbf3-5c99-489d-885d-7f5f0475ce13", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1827810190-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9c2c5af39c7b4fcc94f857ad4db5e636", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c1f7e6e-b3", "ovs_interfaceid": "4c1f7e6e-b361-4522-84d4-5bf89a5eb631", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98431) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 11 23:13:00.424945 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] [instance: 19beb2a4-b3fe-43e9-ac92-71446c2630ee] Start _get_guest_xml network_info=[{"id": "4c1f7e6e-b361-4522-84d4-5bf89a5eb631", "address": "fa:16:3e:ed:10:1f", "network": {"id": "3af1cbf3-5c99-489d-885d-7f5f0475ce13", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1827810190-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9c2c5af39c7b4fcc94f857ad4db5e636", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c1f7e6e-b3", "ovs_interfaceid": "4c1f7e6e-b361-4522-84d4-5bf89a5eb631", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-11T23:08:20Z,direct_url=,disk_format='qcow2',id=f30640f8-7aca-4300-a085-4706a5209a79,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ce012f9fabdb4ee5a73e212437f59d97',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-11T23:08:23Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'image_id': 'f30640f8-7aca-4300-a085-4706a5209a79'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98431) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 11 23:13:00.431043 np0000002687 nova-compute[98431]: WARNING nova.virt.libvirt.driver [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 11 23:13:00.434469 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='f30640f8-7aca-4300-a085-4706a5209a79', instance_meta=NovaInstanceMeta(name='tempest-VolumesAdminNegativeTest-server-314433121', uuid='19beb2a4-b3fe-43e9-ac92-71446c2630ee'), owner=OwnerMeta(userid='e502d68a0c7841379aae120e3a687632', username='tempest-VolumesAdminNegativeTest-2097592246-project-member', projectid='9c2c5af39c7b4fcc94f857ad4db5e636', projectname='tempest-VolumesAdminNegativeTest-2097592246'), image=ImageMeta(id='f30640f8-7aca-4300-a085-4706a5209a79', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "4c1f7e6e-b361-4522-84d4-5bf89a5eb631", "address": "fa:16:3e:ed:10:1f", "network": {"id": "3af1cbf3-5c99-489d-885d-7f5f0475ce13", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1827810190-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9c2c5af39c7b4fcc94f857ad4db5e636", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c1f7e6e-b3", "ovs_interfaceid": "4c1f7e6e-b361-4522-84d4-5bf89a5eb631", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1781219580.4333134) {{(pid=98431) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 11 23:13:00.440414 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] Searching host: 'np0000002687' for CPU controller through CGroups V1... {{(pid=98431) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 11 23:13:00.441286 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] CPU controller missing on host. {{(pid=98431) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 11 23:13:00.442729 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] Searching host: 'np0000002687' for CPU controller through CGroups V2... {{(pid=98431) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 11 23:13:00.445921 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] CPU controller found on host. {{(pid=98431) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 11 23:13:00.445921 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98431) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 11 23:13:00.445921 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-11T23:08:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-11T23:08:20Z,direct_url=,disk_format='qcow2',id=f30640f8-7aca-4300-a085-4706a5209a79,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ce012f9fabdb4ee5a73e212437f59d97',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-11T23:08:23Z,virtual_size=,visibility=), allow threads: True {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 11 23:13:00.445921 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] Flavor limits 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 11 23:13:00.445921 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] Image limits 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 11 23:13:00.445921 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] Flavor pref 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 11 23:13:00.445921 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] Image pref 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 11 23:13:00.445921 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 11 23:13:00.445921 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 11 23:13:00.446631 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98431) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 11 23:13:00.447115 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] Got 1 possible topologies {{(pid=98431) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 11 23:13:00.447472 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 11 23:13:00.450838 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 11 23:13:00.484051 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Updating instance_info_cache with network_info: [{"id": "a1e7aeff-5992-43be-bb2c-d504e7019c64", "address": "fa:16:3e:1d:f7:18", "network": {"id": "710d3c5f-1a08-4a35-b3e1-e59f427989c2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2068802531-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62f47df2e0374879b837bc7431326e62", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1e7aeff-59", "ovs_interfaceid": "a1e7aeff-5992-43be-bb2c-d504e7019c64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:13:00.488829 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-11T23:12:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-314433121',display_name='tempest-VolumesAdminNegativeTest-server-314433121',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='tempest-volumesadminnegativetest-server-314433121',id=18,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9c2c5af39c7b4fcc94f857ad4db5e636',ramdisk_id='',reservation_id='r-nubrf928',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-2097592246',owner_user_name='tempest-VolumesAdminNegativeTest-2097592246-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-11T23:12:55Z,user_data=None,user_id='e502d68a0c7841379aae120e3a687632',uuid=19beb2a4-b3fe-43e9-ac92-71446c2630ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c1f7e6e-b361-4522-84d4-5bf89a5eb631", "address": "fa:16:3e:ed:10:1f", "network": {"id": "3af1cbf3-5c99-489d-885d-7f5f0475ce13", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1827810190-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9c2c5af39c7b4fcc94f857ad4db5e636", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c1f7e6e-b3", "ovs_interfaceid": "4c1f7e6e-b361-4522-84d4-5bf89a5eb631", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98431) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 11 23:13:00.490526 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] Converting VIF {"id": "4c1f7e6e-b361-4522-84d4-5bf89a5eb631", "address": "fa:16:3e:ed:10:1f", "network": {"id": "3af1cbf3-5c99-489d-885d-7f5f0475ce13", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1827810190-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9c2c5af39c7b4fcc94f857ad4db5e636", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c1f7e6e-b3", "ovs_interfaceid": "4c1f7e6e-b361-4522-84d4-5bf89a5eb631", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:13:00.493317 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:10:1f,bridge_name='br-int',has_traffic_filtering=True,id=4c1f7e6e-b361-4522-84d4-5bf89a5eb631,network=Network(3af1cbf3-5c99-489d-885d-7f5f0475ce13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c1f7e6e-b3') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:13:00.497561 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] Lazy-loading 'pci_devices' on Instance uuid 19beb2a4-b3fe-43e9-ac92-71446c2630ee {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:13:00.513020 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8641b14d-785b-44b0-ad6d-bb537cbee5c7/disk --force-share --output=json" returned: 0 in 0.109s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:13:00.518714 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64d7833a-82e8-43e9-83ed-2507197b69bf/disk --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:13:00.644833 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64d7833a-82e8-43e9-83ed-2507197b69bf/disk --force-share --output=json" returned: 0 in 0.126s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:13:00.645636 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64d7833a-82e8-43e9-83ed-2507197b69bf/disk --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:13:00.745840 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:00.771041 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:13:00.785125 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:00.790621 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98431) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 11 23:13:00.796083 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-4ef0ddc4-5f24-4806-a3eb-7aca6c5c99c4 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lock "0d352738-c7bf-42a2-8260-bf5574a7200d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 22.246s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:00.827459 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64d7833a-82e8-43e9-83ed-2507197b69bf/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:13:00.832784 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8aec3cea-109d-43f8-983c-1d5ee2f71181/disk --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:13:00.915660 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:00.945588 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8aec3cea-109d-43f8-983c-1d5ee2f71181/disk --force-share --output=json" returned: 0 in 0.113s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:13:00.947219 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8aec3cea-109d-43f8-983c-1d5ee2f71181/disk --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:13:00.975216 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Successfully created port: 351eaad5-bf70-43b4-8f79-5bc0027de663 {{(pid=98431) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 11 23:13:01.000515 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Releasing lock "refresh_cache-7609742e-a3a2-4be2-ba02-227efb2101e1" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 11 23:13:01.011978 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] [instance: 19beb2a4-b3fe-43e9-ac92-71446c2630ee] End _get_guest_xml xml= Jun 11 23:13:01.011978 np0000002687 nova-compute[98431]: 19beb2a4-b3fe-43e9-ac92-71446c2630ee Jun 11 23:13:01.011978 np0000002687 nova-compute[98431]: instance-00000012 Jun 11 23:13:01.011978 np0000002687 nova-compute[98431]: 196608 Jun 11 23:13:01.011978 np0000002687 nova-compute[98431]: 1 Jun 11 23:13:01.011978 np0000002687 nova-compute[98431]: Jun 11 23:13:01.011978 np0000002687 nova-compute[98431]: Jun 11 23:13:01.011978 np0000002687 nova-compute[98431]: Jun 11 23:13:01.011978 np0000002687 nova-compute[98431]: tempest-VolumesAdminNegativeTest-server-314433121 Jun 11 23:13:01.011978 np0000002687 nova-compute[98431]: 2026-06-11 23:13:00 Jun 11 23:13:01.011978 np0000002687 nova-compute[98431]: Jun 11 23:13:01.011978 np0000002687 nova-compute[98431]: 192 Jun 11 23:13:01.011978 np0000002687 nova-compute[98431]: 1 Jun 11 23:13:01.011978 np0000002687 nova-compute[98431]: 0 Jun 11 23:13:01.011978 np0000002687 nova-compute[98431]: 0 Jun 11 23:13:01.011978 np0000002687 nova-compute[98431]: 1 Jun 11 23:13:01.011978 np0000002687 nova-compute[98431]: Jun 11 23:13:01.011978 np0000002687 nova-compute[98431]: True Jun 11 23:13:01.011978 np0000002687 nova-compute[98431]: Jun 11 23:13:01.011978 np0000002687 nova-compute[98431]: Jun 11 23:13:01.011978 np0000002687 nova-compute[98431]: Jun 11 23:13:01.011978 np0000002687 nova-compute[98431]: bare Jun 11 23:13:01.011978 np0000002687 nova-compute[98431]: qcow2 Jun 11 23:13:01.011978 np0000002687 nova-compute[98431]: 1 Jun 11 23:13:01.011978 np0000002687 nova-compute[98431]: 0 Jun 11 23:13:01.011978 np0000002687 nova-compute[98431]: Jun 11 23:13:01.011978 np0000002687 nova-compute[98431]: virtio Jun 11 23:13:01.011978 np0000002687 nova-compute[98431]: Jun 11 23:13:01.011978 np0000002687 nova-compute[98431]: Jun 11 23:13:01.011978 np0000002687 nova-compute[98431]: Jun 11 23:13:01.011978 np0000002687 nova-compute[98431]: tempest-VolumesAdminNegativeTest-2097592246-project-member Jun 11 23:13:01.011978 np0000002687 nova-compute[98431]: tempest-VolumesAdminNegativeTest-2097592246 Jun 11 23:13:01.011978 np0000002687 nova-compute[98431]: Jun 11 23:13:01.011978 np0000002687 nova-compute[98431]: Jun 11 23:13:01.011978 np0000002687 nova-compute[98431]: Jun 11 23:13:01.011978 np0000002687 nova-compute[98431]: Jun 11 23:13:01.011978 np0000002687 nova-compute[98431]: Jun 11 23:13:01.011978 np0000002687 nova-compute[98431]: Jun 11 23:13:01.011978 np0000002687 nova-compute[98431]: Jun 11 23:13:01.011978 np0000002687 nova-compute[98431]: Jun 11 23:13:01.011978 np0000002687 nova-compute[98431]: Jun 11 23:13:01.011978 np0000002687 nova-compute[98431]: Jun 11 23:13:01.011978 np0000002687 nova-compute[98431]: Jun 11 23:13:01.011978 np0000002687 nova-compute[98431]: OpenStack Foundation Jun 11 23:13:01.011978 np0000002687 nova-compute[98431]: OpenStack Nova Jun 11 23:13:01.011978 np0000002687 nova-compute[98431]: 33.1.0 Jun 11 23:13:01.011978 np0000002687 nova-compute[98431]: 19beb2a4-b3fe-43e9-ac92-71446c2630ee Jun 11 23:13:01.011978 np0000002687 nova-compute[98431]: 19beb2a4-b3fe-43e9-ac92-71446c2630ee Jun 11 23:13:01.011978 np0000002687 nova-compute[98431]: Virtual Machine Jun 11 23:13:01.011978 np0000002687 nova-compute[98431]: Jun 11 23:13:01.011978 np0000002687 nova-compute[98431]: Jun 11 23:13:01.011978 np0000002687 nova-compute[98431]: Jun 11 23:13:01.011978 np0000002687 nova-compute[98431]: hvm Jun 11 23:13:01.011978 np0000002687 nova-compute[98431]: Jun 11 23:13:01.011978 np0000002687 nova-compute[98431]: Jun 11 23:13:01.011978 np0000002687 nova-compute[98431]: Jun 11 23:13:01.011978 np0000002687 nova-compute[98431]: Jun 11 23:13:01.011978 np0000002687 nova-compute[98431]: Jun 11 23:13:01.011978 np0000002687 nova-compute[98431]: Jun 11 23:13:01.011978 np0000002687 nova-compute[98431]: 128 Jun 11 23:13:01.011978 np0000002687 nova-compute[98431]: Jun 11 23:13:01.011978 np0000002687 nova-compute[98431]: Jun 11 23:13:01.011978 np0000002687 nova-compute[98431]: Jun 11 23:13:01.011978 np0000002687 nova-compute[98431]: 1 Jun 11 23:13:01.011978 np0000002687 nova-compute[98431]: Jun 11 23:13:01.011978 np0000002687 nova-compute[98431]: Jun 11 23:13:01.011978 np0000002687 nova-compute[98431]: Nehalem Jun 11 23:13:01.011978 np0000002687 nova-compute[98431]: Jun 11 23:13:01.011978 np0000002687 nova-compute[98431]: Jun 11 23:13:01.011978 np0000002687 nova-compute[98431]: Jun 11 23:13:01.011978 np0000002687 nova-compute[98431]: Jun 11 23:13:01.011978 np0000002687 nova-compute[98431]: Jun 11 23:13:01.011978 np0000002687 nova-compute[98431]: Jun 11 23:13:01.011978 np0000002687 nova-compute[98431]: Jun 11 23:13:01.011978 np0000002687 nova-compute[98431]: Jun 11 23:13:01.011978 np0000002687 nova-compute[98431]: Jun 11 23:13:01.011978 np0000002687 nova-compute[98431]: Jun 11 23:13:01.011978 np0000002687 nova-compute[98431]: Jun 11 23:13:01.011978 np0000002687 nova-compute[98431]: Jun 11 23:13:01.011978 np0000002687 nova-compute[98431]: Jun 11 23:13:01.011978 np0000002687 nova-compute[98431]: Jun 11 23:13:01.011978 np0000002687 nova-compute[98431]: Jun 11 23:13:01.011978 np0000002687 nova-compute[98431]: Jun 11 23:13:01.011978 np0000002687 nova-compute[98431]: Jun 11 23:13:01.011978 np0000002687 nova-compute[98431]: Jun 11 23:13:01.011978 np0000002687 nova-compute[98431]: Jun 11 23:13:01.011978 np0000002687 nova-compute[98431]: Jun 11 23:13:01.011978 np0000002687 nova-compute[98431]: Jun 11 23:13:01.011978 np0000002687 nova-compute[98431]: Jun 11 23:13:01.011978 np0000002687 nova-compute[98431]: Jun 11 23:13:01.011978 np0000002687 nova-compute[98431]: Jun 11 23:13:01.011978 np0000002687 nova-compute[98431]: Jun 11 23:13:01.011978 np0000002687 nova-compute[98431]: Jun 11 23:13:01.011978 np0000002687 nova-compute[98431]: /dev/urandom Jun 11 23:13:01.011978 np0000002687 nova-compute[98431]: Jun 11 23:13:01.011978 np0000002687 nova-compute[98431]: Jun 11 23:13:01.011978 np0000002687 nova-compute[98431]: Jun 11 23:13:01.011978 np0000002687 nova-compute[98431]: Jun 11 23:13:01.011978 np0000002687 nova-compute[98431]: Jun 11 23:13:01.011978 np0000002687 nova-compute[98431]: Jun 11 23:13:01.011978 np0000002687 nova-compute[98431]: Jun 11 23:13:01.011978 np0000002687 nova-compute[98431]: {{(pid=98431) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 11 23:13:01.014613 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] [instance: 19beb2a4-b3fe-43e9-ac92-71446c2630ee] Preparing to wait for external event network-vif-plugged-4c1f7e6e-b361-4522-84d4-5bf89a5eb631 {{(pid=98431) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 11 23:13:01.015431 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] Acquiring lock "19beb2a4-b3fe-43e9-ac92-71446c2630ee-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:01.016867 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] Lock "19beb2a4-b3fe-43e9-ac92-71446c2630ee-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.003s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:01.017106 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] Lock "19beb2a4-b3fe-43e9-ac92-71446c2630ee-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:01.017872 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-11T23:12:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-314433121',display_name='tempest-VolumesAdminNegativeTest-server-314433121',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='tempest-volumesadminnegativetest-server-314433121',id=18,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9c2c5af39c7b4fcc94f857ad4db5e636',ramdisk_id='',reservation_id='r-nubrf928',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-2097592246',owner_user_name='tempest-VolumesAdminNegativeTest-2097592246-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-11T23:12:55Z,user_data=None,user_id='e502d68a0c7841379aae120e3a687632',uuid=19beb2a4-b3fe-43e9-ac92-71446c2630ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c1f7e6e-b361-4522-84d4-5bf89a5eb631", "address": "fa:16:3e:ed:10:1f", "network": {"id": "3af1cbf3-5c99-489d-885d-7f5f0475ce13", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1827810190-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9c2c5af39c7b4fcc94f857ad4db5e636", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c1f7e6e-b3", "ovs_interfaceid": "4c1f7e6e-b361-4522-84d4-5bf89a5eb631", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 11 23:13:01.018091 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] Converting VIF {"id": "4c1f7e6e-b361-4522-84d4-5bf89a5eb631", "address": "fa:16:3e:ed:10:1f", "network": {"id": "3af1cbf3-5c99-489d-885d-7f5f0475ce13", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1827810190-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9c2c5af39c7b4fcc94f857ad4db5e636", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c1f7e6e-b3", "ovs_interfaceid": "4c1f7e6e-b361-4522-84d4-5bf89a5eb631", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:13:01.018780 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:10:1f,bridge_name='br-int',has_traffic_filtering=True,id=4c1f7e6e-b361-4522-84d4-5bf89a5eb631,network=Network(3af1cbf3-5c99-489d-885d-7f5f0475ce13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c1f7e6e-b3') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:13:01.019122 np0000002687 nova-compute[98431]: DEBUG os_vif [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:10:1f,bridge_name='br-int',has_traffic_filtering=True,id=4c1f7e6e-b361-4522-84d4-5bf89a5eb631,network=Network(3af1cbf3-5c99-489d-885d-7f5f0475ce13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c1f7e6e-b3') {{(pid=98431) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 11 23:13:01.021290 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:01.022584 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:13:01.022584 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 11 23:13:01.029875 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:01.030146 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6d2b6acf-94c9-5fff-8a35-ee6546551fbf', '_type': 'linux-noop'}}, row=False) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:13:01.034179 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:01.035606 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:13:01.046647 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:01.048362 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:01.048607 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4c1f7e6e-b3, may_exist=True, interface_attrs={}) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:13:01.049190 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4c1f7e6e-b3, col_values=(('qos', UUID('54609b8b-7f33-4fbe-bbac-ab532c22f994')),), if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:13:01.049440 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4c1f7e6e-b3, col_values=(('external_ids', {'iface-id': '4c1f7e6e-b361-4522-84d4-5bf89a5eb631', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ed:10:1f', 'vm-uuid': '19beb2a4-b3fe-43e9-ac92-71446c2630ee'}),), if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:13:01.054288 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:01.056190 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:13:01.059861 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:01.061146 np0000002687 nova-compute[98431]: INFO os_vif [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:10:1f,bridge_name='br-int',has_traffic_filtering=True,id=4c1f7e6e-b361-4522-84d4-5bf89a5eb631,network=Network(3af1cbf3-5c99-489d-885d-7f5f0475ce13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c1f7e6e-b3') Jun 11 23:13:01.106791 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8aec3cea-109d-43f8-983c-1d5ee2f71181/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:13:01.112678 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] skipping disk /dev/dm-8 (vda) as it is a volume {{(pid=98431) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12344}} Jun 11 23:13:01.118968 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb63f66c-b69e-42b0-805c-be6fe9b3aee3/disk --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:13:01.236493 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb63f66c-b69e-42b0-805c-be6fe9b3aee3/disk --force-share --output=json" returned: 0 in 0.118s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:13:01.237702 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb63f66c-b69e-42b0-805c-be6fe9b3aee3/disk --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:13:01.354412 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb63f66c-b69e-42b0-805c-be6fe9b3aee3/disk --force-share --output=json" returned: 0 in 0.117s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:13:01.355873 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] skipping disk /dev/dm-9 (vdb) as it is a volume {{(pid=98431) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12344}} Jun 11 23:13:01.360038 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/206476b7-d805-4c6c-b7fb-db8b5c2a94a6/disk --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:13:01.391856 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:01.487711 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/206476b7-d805-4c6c-b7fb-db8b5c2a94a6/disk --force-share --output=json" returned: 0 in 0.126s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:13:01.488210 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/206476b7-d805-4c6c-b7fb-db8b5c2a94a6/disk --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:13:01.538096 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.209', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000002687', 'execute': None}" {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 11 23:13:01.557379 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.scaleio [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98431) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 11 23:13:01.592380 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Running cmd (subprocess): nvme version {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:13:01.617108 np0000002687 nova-compute[98431]: INFO nova.virt.block_device [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Booting with volume 0eeb4862-dd4f-442d-a749-c347a2ec29f8 at /dev/vdb Jun 11 23:13:01.624343 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/206476b7-d805-4c6c-b7fb-db8b5c2a94a6/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:13:01.637193 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] skipping disk /dev/dm-4 (vda) as it is a volume {{(pid=98431) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12344}} Jun 11 23:13:01.642451 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] 'nvme version' failed. Not Retrying. {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 11 23:13:01.643284 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.nvmeof [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] nvme not present on system {{(pid=98431) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 11 23:13:01.649532 np0000002687 nova-compute[98431]: WARNING nova.virt.libvirt.driver [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 11 23:13:01.651169 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:13:01.686905 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.lightos [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98431) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 11 23:13:01.686905 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.lightos [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Current host hostNQN and IP(s) are ['10.4.3.209', 'fe80::f816:3eff:fea3:3707', '192.168.40.6', 'fe80::f816:3eff:fe06:bdab', '192.168.50.6', 'fe80::f816:3eff:fe7a:46f2', '192.168.10.6', 'fe80::f816:3eff:fe13:793b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::38fa:21ff:fe6c:3746', 'fe80::fc16:3eff:fe6c:eb30', 'fe80::20a8:54ff:fe51:da0a', 'fe80::fc16:3eff:fe77:488d', 'fe80::9469:f2ff:feae:5824', 'fe80::fc16:3eff:fec7:336a', 'fe80::fc16:3eff:fe61:b7fd', 'fe80::fc16:3eff:fec6:c65b', 'fe80::fc16:3eff:fed6:e34f', 'fe80::fc16:3eff:feb5:6ffd', 'fe80::4cb3:64ff:fe13:8a75', 'fe80::fc16:3eff:fe4b:2695', 'fe80::fc16:3eff:fe8f:ae21', 'fe80::fc16:3eff:fe6f:4242'] Jun 11 23:13:01.686905 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.lightos [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98431) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 11 23:13:01.686905 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.lightos [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] LIGHTOS: no hostnqn found. {{(pid=98431) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 11 23:13:01.686905 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.209', 'host': 'np0000002687', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:798b370f1cc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad465dfe-0ed1-4637-98c3-ddaebebd61a4', 'nvme_native_multipath': False} {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 11 23:13:01.703332 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] CMD "env LANG=C uptime" returned: 0 in 0.052s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:13:01.704358 np0000002687 nova-compute[98431]: DEBUG nova.compute.resource_tracker [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Hypervisor/Node resource view: name=np0000002687 free_ram=12297MB free_disk=74.15112686157227GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}] {{(pid=98431) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}} Jun 11 23:13:01.705322 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:01.705684 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:01.764538 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.209', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000002687', 'execute': None}" {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 11 23:13:01.788345 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.scaleio [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98431) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 11 23:13:01.836555 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Running cmd (subprocess): nvme version {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:13:01.884862 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] 'nvme version' failed. Not Retrying. {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 11 23:13:01.886228 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] nvme not present on system {{(pid=98431) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 11 23:13:01.899456 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.lightos [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98431) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 11 23:13:01.901339 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.lightos [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Current host hostNQN and IP(s) are ['10.4.3.209', 'fe80::f816:3eff:fea3:3707', '192.168.40.6', 'fe80::f816:3eff:fe06:bdab', '192.168.50.6', 'fe80::f816:3eff:fe7a:46f2', '192.168.10.6', 'fe80::f816:3eff:fe13:793b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::38fa:21ff:fe6c:3746', 'fe80::fc16:3eff:fe6c:eb30', 'fe80::20a8:54ff:fe51:da0a', 'fe80::fc16:3eff:fe77:488d', 'fe80::9469:f2ff:feae:5824', 'fe80::fc16:3eff:fec7:336a', 'fe80::fc16:3eff:fe61:b7fd', 'fe80::fc16:3eff:fec6:c65b', 'fe80::fc16:3eff:fed6:e34f', 'fe80::fc16:3eff:feb5:6ffd', 'fe80::4cb3:64ff:fe13:8a75', 'fe80::fc16:3eff:fe4b:2695', 'fe80::fc16:3eff:fe8f:ae21', 'fe80::fc16:3eff:fe6f:4242'] Jun 11 23:13:01.901516 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.lightos [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98431) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 11 23:13:01.901706 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.lightos [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] LIGHTOS: no hostnqn found. {{(pid=98431) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 11 23:13:01.904047 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.209', 'host': 'np0000002687', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:798b370f1cc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad465dfe-0ed1-4637-98c3-ddaebebd61a4', 'nvme_native_multipath': False} {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 11 23:13:01.904047 np0000002687 nova-compute[98431]: DEBUG nova.virt.block_device [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Updating existing volume attachment record: 3f5701fe-b4ef-4c1d-90af-e131b7eff37e {{(pid=98431) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 11 23:13:02.148287 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Emitting event Started> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:13:02.152008 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] VM Started (Lifecycle Event) Jun 11 23:13:02.261535 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-8bd5774d-9180-44a4-8158-dfc45be18e16 req-290b3dff-c97c-4ed4-958b-eeb4a2140b77 service nova] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] Received event network-vif-plugged-3c04202e-5ce6-4249-ba31-be06996ca75d {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:13:02.261535 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-8bd5774d-9180-44a4-8158-dfc45be18e16 req-290b3dff-c97c-4ed4-958b-eeb4a2140b77 service nova] Acquiring lock "8a45e04f-3516-4c39-bea1-820104411f17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:02.261535 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-8bd5774d-9180-44a4-8158-dfc45be18e16 req-290b3dff-c97c-4ed4-958b-eeb4a2140b77 service nova] Lock "8a45e04f-3516-4c39-bea1-820104411f17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:02.261535 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-8bd5774d-9180-44a4-8158-dfc45be18e16 req-290b3dff-c97c-4ed4-958b-eeb4a2140b77 service nova] Lock "8a45e04f-3516-4c39-bea1-820104411f17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:02.261848 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-8bd5774d-9180-44a4-8158-dfc45be18e16 req-290b3dff-c97c-4ed4-958b-eeb4a2140b77 service nova] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] Processing event network-vif-plugged-3c04202e-5ce6-4249-ba31-be06996ca75d {{(pid=98431) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 11 23:13:02.264005 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-e7e9f771-cf2b-4295-a312-2410df54c766 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98431) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 11 23:13:02.279852 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-e7e9f771-cf2b-4295-a312-2410df54c766 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] Guest created on hypervisor {{(pid=98431) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}} Jun 11 23:13:02.296076 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [-] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] Instance spawned successfully. Jun 11 23:13:02.298302 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-e7e9f771-cf2b-4295-a312-2410df54c766 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 11 23:13:02.420485 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Rescuing Jun 11 23:13:02.421300 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Acquiring lock "refresh_cache-0d352738-c7bf-42a2-8260-bf5574a7200d" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 11 23:13:02.421300 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Acquired lock "refresh_cache-0d352738-c7bf-42a2-8260-bf5574a7200d" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 11 23:13:02.421458 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Building network info cache for instance {{(pid=98431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 11 23:13:02.646125 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] No BDM found with device name vda, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:13:02.646978 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] No BDM found with device name hda, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:13:02.646978 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] No VIF found with MAC fa:16:3e:ed:10:1f, not building metadata {{(pid=98431) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13199}} Jun 11 23:13:02.647481 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] [instance: 19beb2a4-b3fe-43e9-ac92-71446c2630ee] Using config drive Jun 11 23:13:02.657252 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Successfully created port: 004fd6c0-58df-4ceb-9733-267396cae60c {{(pid=98431) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 11 23:13:02.661177 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:13:02.669976 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98431) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 11 23:13:02.737178 np0000002687 nova-compute[98431]: DEBUG nova.compute.resource_tracker [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Applying migration context for instance 7609742e-a3a2-4be2-ba02-227efb2101e1 as it has an incoming, in-progress migration 859c9e92-9a57-4932-9703-f13835841422. Migration status is post-migrating {{(pid=98431) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1046}} Jun 11 23:13:02.737178 np0000002687 nova-compute[98431]: INFO nova.compute.resource_tracker [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Updating resource usage from migration 859c9e92-9a57-4932-9703-f13835841422 Jun 11 23:13:02.811035 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-e7e9f771-cf2b-4295-a312-2410df54c766 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] Found default for hw_cdrom_bus of ide {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:13:02.811321 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-e7e9f771-cf2b-4295-a312-2410df54c766 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] Found default for hw_disk_bus of virtio {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:13:02.812203 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-e7e9f771-cf2b-4295-a312-2410df54c766 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] Found default for hw_input_bus of None {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:13:02.812912 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-e7e9f771-cf2b-4295-a312-2410df54c766 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] Found default for hw_pointer_model of None {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:13:02.815576 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-e7e9f771-cf2b-4295-a312-2410df54c766 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] Found default for hw_video_model of virtio {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:13:02.815576 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-e7e9f771-cf2b-4295-a312-2410df54c766 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] Found default for hw_vif_model of virtio {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:13:02.833461 np0000002687 nova-compute[98431]: DEBUG nova.compute.resource_tracker [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Instance cb63f66c-b69e-42b0-805c-be6fe9b3aee3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98431) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 11 23:13:02.833461 np0000002687 nova-compute[98431]: DEBUG nova.compute.resource_tracker [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Instance 7609742e-a3a2-4be2-ba02-227efb2101e1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=98431) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 11 23:13:02.834740 np0000002687 nova-compute[98431]: DEBUG nova.compute.resource_tracker [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Migration 859c9e92-9a57-4932-9703-f13835841422 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98431) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1745}} Jun 11 23:13:02.834740 np0000002687 nova-compute[98431]: DEBUG nova.compute.resource_tracker [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Instance 1d45c7ce-5760-4f59-9921-feb3e589da8a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98431) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 11 23:13:02.834740 np0000002687 nova-compute[98431]: DEBUG nova.compute.resource_tracker [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Instance 206476b7-d805-4c6c-b7fb-db8b5c2a94a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98431) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 11 23:13:02.834740 np0000002687 nova-compute[98431]: DEBUG nova.compute.resource_tracker [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Instance 64d7833a-82e8-43e9-83ed-2507197b69bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98431) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 11 23:13:02.834740 np0000002687 nova-compute[98431]: DEBUG nova.compute.resource_tracker [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Instance 8a45e04f-3516-4c39-bea1-820104411f17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98431) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 11 23:13:02.834740 np0000002687 nova-compute[98431]: DEBUG nova.compute.resource_tracker [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Instance 8ffa4bbe-7ead-4029-aba5-28f031f6e784 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98431) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 11 23:13:02.834740 np0000002687 nova-compute[98431]: DEBUG nova.compute.resource_tracker [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Instance de4372a4-a0cc-4541-a5a2-87be3152c50e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98431) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 11 23:13:02.834740 np0000002687 nova-compute[98431]: DEBUG nova.compute.resource_tracker [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Instance 19beb2a4-b3fe-43e9-ac92-71446c2630ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98431) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 11 23:13:02.834740 np0000002687 nova-compute[98431]: DEBUG nova.compute.resource_tracker [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Instance 0d352738-c7bf-42a2-8260-bf5574a7200d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98431) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 11 23:13:02.834740 np0000002687 nova-compute[98431]: DEBUG nova.compute.resource_tracker [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Instance 8641b14d-785b-44b0-ad6d-bb537cbee5c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98431) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 11 23:13:02.836379 np0000002687 nova-compute[98431]: DEBUG nova.compute.resource_tracker [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Instance 8aec3cea-109d-43f8-983c-1d5ee2f71181 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98431) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 11 23:13:02.836379 np0000002687 nova-compute[98431]: DEBUG nova.compute.resource_tracker [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Instance c82748e6-1c78-4372-ad4b-48d1c6448efa actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98431) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 11 23:13:02.836379 np0000002687 nova-compute[98431]: DEBUG nova.compute.resource_tracker [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=98431) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}} Jun 11 23:13:02.836379 np0000002687 nova-compute[98431]: DEBUG nova.compute.resource_tracker [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Final resource view: name=np0000002687 phys_ram=24030MB used_ram=3264MB phys_disk=95GB used_disk=10GB total_vcpus=12 used_vcpus=14 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 23:13:01 up 27 min, 2 users, load average: 9.41, 4.92, 2.30\n', 'num_instances': '13', 'num_vm_active': '10', 'num_task_None': '9', 'num_os_type_None': '13', 'num_proj_aaf744af828a4a5eba1e98da63373b2b': '4', 'io_workload': '3', 'num_proj_2d62cddce233457caf7eb43be819e513': '1', 'num_proj_81fd45f475a04e5c8e9bd9deb7ad4c1e': '5', 'num_task_resize_finish': '1', 'num_proj_62f47df2e0374879b837bc7431326e62': '1', 'num_vm_building': '3', 'num_task_spawning': '2', 'num_proj_9c2c5af39c7b4fcc94f857ad4db5e636': '1', 'num_task_block_device_mapping': '1', 'num_proj_6c1e407a42f24b34baf3ee44be9fb337': '1'} {{(pid=98431) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}} Jun 11 23:13:02.875163 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:02.922248 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Starting finish_migration {{(pid=98431) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12803}} Jun 11 23:13:02.926671 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:13:02.931013 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Instance directory exists: not creating {{(pid=98431) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5217}} Jun 11 23:13:02.931013 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Creating image(s) Jun 11 23:13:02.933684 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:13:03.070983 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json" returned: 0 in 0.137s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:13:03.072341 np0000002687 nova-compute[98431]: DEBUG nova.virt.disk.api [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7609742e-a3a2-4be2-ba02-227efb2101e1/disk. size=1073741824 {{(pid=98431) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 11 23:13:03.072633 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7609742e-a3a2-4be2-ba02-227efb2101e1/disk --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:13:03.166718 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:13:03.175340 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] During sync_power_state the instance has a pending task (spawning). Skip. Jun 11 23:13:03.175722 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Emitting event Paused> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:13:03.176435 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] VM Paused (Lifecycle Event) Jun 11 23:13:03.191249 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7609742e-a3a2-4be2-ba02-227efb2101e1/disk --force-share --output=json" returned: 0 in 0.118s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:13:03.191647 np0000002687 nova-compute[98431]: DEBUG nova.virt.disk.api [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Cannot resize image /opt/stack/data/nova/instances/7609742e-a3a2-4be2-ba02-227efb2101e1/disk to a smaller size. {{(pid=98431) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 11 23:13:03.322172 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-e7e9f771-cf2b-4295-a312-2410df54c766 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] Took 10.34 seconds to spawn the instance on the hypervisor. Jun 11 23:13:03.322383 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-e7e9f771-cf2b-4295-a312-2410df54c766 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:13:03.600341 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Successfully updated port: 5f9094e3-a3c6-48ea-bfbe-4fa25d19bcf2 {{(pid=98431) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 11 23:13:03.616052 np0000002687 nova-compute[98431]: INFO nova.virt.block_device [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Booting with volume cf81e3db-e34d-4a99-b4f7-a47ab33a8f13 at /dev/vdc Jun 11 23:13:03.682455 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:13:03.688234 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Emitting event Resumed> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:13:03.691893 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] VM Resumed (Lifecycle Event) Jun 11 23:13:03.695287 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Did not create local disks {{(pid=98431) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}} Jun 11 23:13:03.698377 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Ensure instance console log exists: /opt/stack/data/nova/instances/7609742e-a3a2-4be2-ba02-227efb2101e1/console.log {{(pid=98431) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}} Jun 11 23:13:03.698930 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:03.705110 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:03.705110 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:03.706039 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Start _get_guest_xml network_info=[{"id": "a1e7aeff-5992-43be-bb2c-d504e7019c64", "address": "fa:16:3e:1d:f7:18", "network": {"id": "710d3c5f-1a08-4a35-b3e1-e59f427989c2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2068802531-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.182", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2068802531-network", "vif_mac": "fa:16:3e:1d:f7:18"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62f47df2e0374879b837bc7431326e62", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1e7aeff-59", "ovs_interfaceid": "a1e7aeff-5992-43be-bb2c-d504e7019c64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-11T23:08:20Z,direct_url=,disk_format='qcow2',id=f30640f8-7aca-4300-a085-4706a5209a79,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ce012f9fabdb4ee5a73e212437f59d97',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-11T23:08:23Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'image_id': 'f30640f8-7aca-4300-a085-4706a5209a79'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'mount_device': '/dev/vdb', 'attachment_id': '052ec07c-e15f-4850-bc5b-71605c2c891b', 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979', 'iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2f2d8ccb-5d26-4f0b-bc60-abf6355bf979', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': '7609742e-a3a2-4be2-ba02-227efb2101e1', 'attached_at': '2026-06-11T23:13:02.000000', 'detached_at': '', 'volume_id': '2f2d8ccb-5d26-4f0b-bc60-abf6355bf979', 'serial': '2f2d8ccb-5d26-4f0b-bc60-abf6355bf979'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98431) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 11 23:13:03.711703 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.209', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000002687', 'execute': None}" {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 11 23:13:03.717894 np0000002687 nova-compute[98431]: WARNING nova.virt.libvirt.driver [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 11 23:13:03.720036 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='f30640f8-7aca-4300-a085-4706a5209a79', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherB-server-872787611', uuid='7609742e-a3a2-4be2-ba02-227efb2101e1'), owner=OwnerMeta(userid='2b37a00a21a249339e412bcde7a87f82', username='tempest-ServerActionsTestOtherB-1260316994-project-member', projectid='62f47df2e0374879b837bc7431326e62', projectname='tempest-ServerActionsTestOtherB-1260316994'), image=ImageMeta(id='f30640f8-7aca-4300-a085-4706a5209a79', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.micro', flavorid='84', memory_mb=256, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "a1e7aeff-5992-43be-bb2c-d504e7019c64", "address": "fa:16:3e:1d:f7:18", "network": {"id": "710d3c5f-1a08-4a35-b3e1-e59f427989c2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2068802531-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.182", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2068802531-network", "vif_mac": "fa:16:3e:1d:f7:18"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62f47df2e0374879b837bc7431326e62", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1e7aeff-59", "ovs_interfaceid": "a1e7aeff-5992-43be-bb2c-d504e7019c64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1781219583.7192693) {{(pid=98431) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 11 23:13:03.729037 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Searching host: 'np0000002687' for CPU controller through CGroups V1... {{(pid=98431) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 11 23:13:03.729037 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] CPU controller missing on host. {{(pid=98431) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 11 23:13:03.730533 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.scaleio [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98431) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 11 23:13:03.731548 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Searching host: 'np0000002687' for CPU controller through CGroups V2... {{(pid=98431) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 11 23:13:03.731817 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] CPU controller found on host. {{(pid=98431) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 11 23:13:03.732888 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98431) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 11 23:13:03.736825 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-11T23:08:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=256,name='m1.micro',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-11T23:08:20Z,direct_url=,disk_format='qcow2',id=f30640f8-7aca-4300-a085-4706a5209a79,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ce012f9fabdb4ee5a73e212437f59d97',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-11T23:08:23Z,virtual_size=,visibility=), allow threads: True {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 11 23:13:03.736825 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Flavor limits 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 11 23:13:03.736825 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Image limits 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 11 23:13:03.736825 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Flavor pref 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 11 23:13:03.736825 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Image pref 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 11 23:13:03.736825 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 11 23:13:03.736825 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 11 23:13:03.736825 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98431) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 11 23:13:03.736825 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Got 1 possible topologies {{(pid=98431) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 11 23:13:03.736825 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 11 23:13:03.736825 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 11 23:13:03.761100 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7609742e-a3a2-4be2-ba02-227efb2101e1/disk.config --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:13:03.796020 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Running cmd (subprocess): nvme version {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:13:03.873280 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] 'nvme version' failed. Not Retrying. {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 11 23:13:03.874196 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] nvme not present on system {{(pid=98431) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 11 23:13:03.875344 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-e7e9f771-cf2b-4295-a312-2410df54c766 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] Took 20.09 seconds to build instance. Jun 11 23:13:03.884857 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7609742e-a3a2-4be2-ba02-227efb2101e1/disk.config --force-share --output=json" returned: 0 in 0.124s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:13:03.888144 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Acquiring lock "/opt/stack/data/nova/instances/7609742e-a3a2-4be2-ba02-227efb2101e1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:03.889343 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Lock "/opt/stack/data/nova/instances/7609742e-a3a2-4be2-ba02-227efb2101e1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.003s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:03.896402 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.lightos [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98431) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 11 23:13:03.899889 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Lock "/opt/stack/data/nova/instances/7609742e-a3a2-4be2-ba02-227efb2101e1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.007s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:03.900636 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.lightos [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Current host hostNQN and IP(s) are ['10.4.3.209', 'fe80::f816:3eff:fea3:3707', '192.168.40.6', 'fe80::f816:3eff:fe06:bdab', '192.168.50.6', 'fe80::f816:3eff:fe7a:46f2', '192.168.10.6', 'fe80::f816:3eff:fe13:793b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::38fa:21ff:fe6c:3746', 'fe80::fc16:3eff:fe6c:eb30', 'fe80::20a8:54ff:fe51:da0a', 'fe80::fc16:3eff:fe77:488d', 'fe80::9469:f2ff:feae:5824', 'fe80::fc16:3eff:fec7:336a', 'fe80::fc16:3eff:fe61:b7fd', 'fe80::fc16:3eff:fec6:c65b', 'fe80::fc16:3eff:fed6:e34f', 'fe80::fc16:3eff:feb5:6ffd', 'fe80::4cb3:64ff:fe13:8a75', 'fe80::fc16:3eff:fe4b:2695', 'fe80::fc16:3eff:fe8f:ae21', 'fe80::fc16:3eff:fe6f:4242'] Jun 11 23:13:03.900838 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.lightos [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98431) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 11 23:13:03.900984 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.lightos [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] LIGHTOS: no hostnqn found. {{(pid=98431) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 11 23:13:03.901309 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] <== get_connector_properties: return (189ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.209', 'host': 'np0000002687', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:798b370f1cc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad465dfe-0ed1-4637-98c3-ddaebebd61a4', 'nvme_native_multipath': False} {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 11 23:13:03.902200 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Calling os-brick to attach iSCSI Volume {{(pid=98431) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 11 23:13:03.902660 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979', 'iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2f2d8ccb-5d26-4f0b-bc60-abf6355bf979', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 11 23:13:03.902894 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 11 23:13:03.903473 np0000002687 nova-compute[98431]: DEBUG nova.virt.block_device [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Updating existing volume attachment record: 91ac0835-5052-4157-be4c-a077292d3f3d {{(pid=98431) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 11 23:13:03.905250 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 11 23:13:03.906892 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979', 'iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2f2d8ccb-5d26-4f0b-bc60-abf6355bf979', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98431) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 11 23:13:03.926848 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 11 23:13:03.927258 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 11 23:13:03.929071 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.iscsi [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 11 23:13:03.929071 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 11 23:13:03.929303 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 11 23:13:03.929431 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.iscsi [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 11 23:13:03.947835 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 11 23:13:03.947835 np0000002687 nova-compute[98431]: {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:13:03.956685 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 11 23:13:03.956685 np0000002687 nova-compute[98431]: {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:13:03.970144 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979] added Jun 11 23:13:03.970144 np0000002687 nova-compute[98431]: stderr=iscsiadm: Config file line 363 does not have value Jun 11 23:13:03.970144 np0000002687 nova-compute[98431]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 11 23:13:03.970144 np0000002687 nova-compute[98431]: iscsiadm: Config file line 363 does not have value Jun 11 23:13:03.970144 np0000002687 nova-compute[98431]: iscsiadm: Config file line 363 does not have value Jun 11 23:13:03.970144 np0000002687 nova-compute[98431]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 11 23:13:03.970144 np0000002687 nova-compute[98431]: {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:13:03.970144 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98431) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 11 23:13:03.970144 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0422(s), this was the 1st time calling it. {{(pid=98431) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 11 23:13:03.970144 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98431) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 11 23:13:03.972747 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979] added Jun 11 23:13:03.972747 np0000002687 nova-compute[98431]: stderr=iscsiadm: Config file line 363 does not have value Jun 11 23:13:03.972747 np0000002687 nova-compute[98431]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 11 23:13:03.972747 np0000002687 nova-compute[98431]: iscsiadm: Config file line 363 does not have value Jun 11 23:13:03.972747 np0000002687 nova-compute[98431]: iscsiadm: Config file line 363 does not have value Jun 11 23:13:03.972747 np0000002687 nova-compute[98431]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 11 23:13:03.972747 np0000002687 nova-compute[98431]: {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:13:03.973033 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98431) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 11 23:13:03.973282 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0438(s), this was the 1st time calling it. {{(pid=98431) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 11 23:13:03.973483 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98431) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 11 23:13:04.149009 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] [instance: 19beb2a4-b3fe-43e9-ac92-71446c2630ee] Creating config drive at /opt/stack/data/nova/instances/19beb2a4-b3fe-43e9-ac92-71446c2630ee/disk.config Jun 11 23:13:04.153852 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/19beb2a4-b3fe-43e9-ac92-71446c2630ee/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpffdvj_hf {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:13:04.202257 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:13:04.228715 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98431) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 11 23:13:04.235131 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98431) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 11 23:13:04.235131 np0000002687 nova-compute[98431]: DEBUG nova.compute.provider_tree [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Inventory has not changed in ProviderTree for provider: e3e65fe2-9de9-4821-8b4a-ccae37c66e25 {{(pid=98431) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 11 23:13:04.238998 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/19beb2a4-b3fe-43e9-ac92-71446c2630ee/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpffdvj_hf" returned: 0 in 0.086s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:13:04.383597 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-e7e9f771-cf2b-4295-a312-2410df54c766 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "8a45e04f-3516-4c39-bea1-820104411f17" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 21.613s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:04.408952 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-23e50c03-7cb3-4240-8831-a73127fed72d req-15ee1866-145f-4a67-b087-eb8ad323aadc service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Received event network-changed-5f9094e3-a3c6-48ea-bfbe-4fa25d19bcf2 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:13:04.409933 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-23e50c03-7cb3-4240-8831-a73127fed72d req-15ee1866-145f-4a67-b087-eb8ad323aadc service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Refreshing instance network info cache due to event network-changed-5f9094e3-a3c6-48ea-bfbe-4fa25d19bcf2. {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 11 23:13:04.410233 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-23e50c03-7cb3-4240-8831-a73127fed72d req-15ee1866-145f-4a67-b087-eb8ad323aadc service nova] Acquiring lock "refresh_cache-1d45c7ce-5760-4f59-9921-feb3e589da8a" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 11 23:13:04.411138 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-23e50c03-7cb3-4240-8831-a73127fed72d req-15ee1866-145f-4a67-b087-eb8ad323aadc service nova] Acquired lock "refresh_cache-1d45c7ce-5760-4f59-9921-feb3e589da8a" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 11 23:13:04.411480 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-23e50c03-7cb3-4240-8831-a73127fed72d req-15ee1866-145f-4a67-b087-eb8ad323aadc service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Refreshing network info cache for port 5f9094e3-a3c6-48ea-bfbe-4fa25d19bcf2 {{(pid=98431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 11 23:13:04.440330 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-545df8e3-d77e-4beb-90a8-9d67ef79d2fc req-67ba88f4-426c-4055-bb97-2447b802d8e8 service nova] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] Received event network-vif-plugged-3c04202e-5ce6-4249-ba31-be06996ca75d {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:13:04.440465 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-545df8e3-d77e-4beb-90a8-9d67ef79d2fc req-67ba88f4-426c-4055-bb97-2447b802d8e8 service nova] Acquiring lock "8a45e04f-3516-4c39-bea1-820104411f17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:04.440569 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-545df8e3-d77e-4beb-90a8-9d67ef79d2fc req-67ba88f4-426c-4055-bb97-2447b802d8e8 service nova] Lock "8a45e04f-3516-4c39-bea1-820104411f17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:04.440715 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-545df8e3-d77e-4beb-90a8-9d67ef79d2fc req-67ba88f4-426c-4055-bb97-2447b802d8e8 service nova] Lock "8a45e04f-3516-4c39-bea1-820104411f17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:04.440898 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-545df8e3-d77e-4beb-90a8-9d67ef79d2fc req-67ba88f4-426c-4055-bb97-2447b802d8e8 service nova] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] No waiting events found dispatching network-vif-plugged-3c04202e-5ce6-4249-ba31-be06996ca75d {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:13:04.441060 np0000002687 nova-compute[98431]: WARNING nova.compute.manager [req-545df8e3-d77e-4beb-90a8-9d67ef79d2fc req-67ba88f4-426c-4055-bb97-2447b802d8e8 service nova] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] Received unexpected event network-vif-plugged-3c04202e-5ce6-4249-ba31-be06996ca75d for instance with vm_state active and task_state None. Jun 11 23:13:04.688457 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:04.744111 np0000002687 nova-compute[98431]: DEBUG nova.scheduler.client.report [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Inventory has not changed for provider e3e65fe2-9de9-4821-8b4a-ccae37c66e25 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98431) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 11 23:13:04.812834 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:04.863938 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:04.876269 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:04.880561 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-16742e93-7360-466f-a15b-bf24d2f11af6 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Acquiring lock "cb63f66c-b69e-42b0-805c-be6fe9b3aee3" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:04.880865 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-16742e93-7360-466f-a15b-bf24d2f11af6 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Lock "cb63f66c-b69e-42b0-805c-be6fe9b3aee3" acquired by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:04.917563 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [req-23e50c03-7cb3-4240-8831-a73127fed72d req-15ee1866-145f-4a67-b087-eb8ad323aadc service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:13:04.970441 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:13:04.975679 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.iscsi [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 11 23:13:04.975679 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.iscsi [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 11 23:13:05.016641 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 11 23:13:05.016641 np0000002687 nova-compute[98431]: node.name = iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979 Jun 11 23:13:05.016641 np0000002687 nova-compute[98431]: node.tpgt = -1 Jun 11 23:13:05.016641 np0000002687 nova-compute[98431]: node.startup = manual Jun 11 23:13:05.016641 np0000002687 nova-compute[98431]: node.leading_login = No Jun 11 23:13:05.016641 np0000002687 nova-compute[98431]: iface.iscsi_ifacename = default Jun 11 23:13:05.016641 np0000002687 nova-compute[98431]: iface.net_ifacename = Jun 11 23:13:05.016641 np0000002687 nova-compute[98431]: iface.ipaddress = Jun 11 23:13:05.016641 np0000002687 nova-compute[98431]: iface.prefix_len = 0 Jun 11 23:13:05.016641 np0000002687 nova-compute[98431]: iface.hwaddress = Jun 11 23:13:05.016641 np0000002687 nova-compute[98431]: iface.transport_name = tcp Jun 11 23:13:05.016641 np0000002687 nova-compute[98431]: iface.initiatorname = Jun 11 23:13:05.016641 np0000002687 nova-compute[98431]: iface.state = Jun 11 23:13:05.016641 np0000002687 nova-compute[98431]: iface.vlan_id = 0 Jun 11 23:13:05.016641 np0000002687 nova-compute[98431]: iface.vlan_priority = 0 Jun 11 23:13:05.016641 np0000002687 nova-compute[98431]: iface.vlan_state = Jun 11 23:13:05.016641 np0000002687 nova-compute[98431]: iface.iface_num = 0 Jun 11 23:13:05.016641 np0000002687 nova-compute[98431]: iface.mtu = 0 Jun 11 23:13:05.016641 np0000002687 nova-compute[98431]: iface.port = 0 Jun 11 23:13:05.016641 np0000002687 nova-compute[98431]: iface.bootproto = Jun 11 23:13:05.016641 np0000002687 nova-compute[98431]: iface.subnet_mask = Jun 11 23:13:05.016641 np0000002687 nova-compute[98431]: iface.gateway = Jun 11 23:13:05.016641 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id_state = Jun 11 23:13:05.016641 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id = Jun 11 23:13:05.016641 np0000002687 nova-compute[98431]: iface.dhcp_dns = Jun 11 23:13:05.016641 np0000002687 nova-compute[98431]: iface.dhcp_learn_iqn = Jun 11 23:13:05.016641 np0000002687 nova-compute[98431]: iface.dhcp_req_vendor_id_state = Jun 11 23:13:05.016641 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id_state = Jun 11 23:13:05.016641 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id = Jun 11 23:13:05.016641 np0000002687 nova-compute[98431]: iface.dhcp_slp_da = Jun 11 23:13:05.016641 np0000002687 nova-compute[98431]: iface.fragmentation = Jun 11 23:13:05.016641 np0000002687 nova-compute[98431]: iface.gratuitous_arp = Jun 11 23:13:05.016641 np0000002687 nova-compute[98431]: iface.incoming_forwarding = Jun 11 23:13:05.016641 np0000002687 nova-compute[98431]: iface.tos_state = Jun 11 23:13:05.016641 np0000002687 nova-compute[98431]: iface.tos = 0 Jun 11 23:13:05.016641 np0000002687 nova-compute[98431]: iface.ttl = 0 Jun 11 23:13:05.016641 np0000002687 nova-compute[98431]: iface.delayed_ack = Jun 11 23:13:05.016641 np0000002687 nova-compute[98431]: iface.tcp_nagle = Jun 11 23:13:05.016641 np0000002687 nova-compute[98431]: iface.tcp_wsf_state = Jun 11 23:13:05.016641 np0000002687 nova-compute[98431]: iface.tcp_wsf = 0 Jun 11 23:13:05.016641 np0000002687 nova-compute[98431]: iface.tcp_timer_scale = 0 Jun 11 23:13:05.016641 np0000002687 nova-compute[98431]: iface.tcp_timestamp = Jun 11 23:13:05.016641 np0000002687 nova-compute[98431]: iface.redirect = Jun 11 23:13:05.016641 np0000002687 nova-compute[98431]: iface.def_task_mgmt_timeout = 0 Jun 11 23:13:05.016641 np0000002687 nova-compute[98431]: iface.header_digest = Jun 11 23:13:05.016641 np0000002687 nova-compute[98431]: iface.data_digest = Jun 11 23:13:05.016641 np0000002687 nova-compute[98431]: iface.immediate_data = Jun 11 23:13:05.016641 np0000002687 nova-compute[98431]: iface.initial_r2t = Jun 11 23:13:05.016641 np0000002687 nova-compute[98431]: iface.data_seq_inorder = Jun 11 23:13:05.016641 np0000002687 nova-compute[98431]: iface.data_pdu_inorder = Jun 11 23:13:05.016641 np0000002687 nova-compute[98431]: iface.erl = 0 Jun 11 23:13:05.016641 np0000002687 nova-compute[98431]: iface.max_receive_data_len = 0 Jun 11 23:13:05.016641 np0000002687 nova-compute[98431]: iface.first_burst_len = 0 Jun 11 23:13:05.016641 np0000002687 nova-compute[98431]: iface.max_outstanding_r2t = 0 Jun 11 23:13:05.016641 np0000002687 nova-compute[98431]: iface.max_burst_len = 0 Jun 11 23:13:05.016641 np0000002687 nova-compute[98431]: iface.chap_auth = Jun 11 23:13:05.016641 np0000002687 nova-compute[98431]: iface.bidi_chap = Jun 11 23:13:05.016641 np0000002687 nova-compute[98431]: iface.strict_login_compliance = Jun 11 23:13:05.016641 np0000002687 nova-compute[98431]: iface.discovery_auth = Jun 11 23:13:05.016641 np0000002687 nova-compute[98431]: iface.discovery_logout = Jun 11 23:13:05.016641 np0000002687 nova-compute[98431]: node.discovery_address = Jun 11 23:13:05.016641 np0000002687 nova-compute[98431]: node.discovery_port = 0 Jun 11 23:13:05.016641 np0000002687 nova-compute[98431]: node.discovery_type = fw Jun 11 23:13:05.016641 np0000002687 nova-compute[98431]: node.session.initial_cmdsn = 0 Jun 11 23:13:05.016641 np0000002687 nova-compute[98431]: node.session.initial_login_retry_max = 8 Jun 11 23:13:05.016641 np0000002687 nova-compute[98431]: node.session.xmit_thread_priority = 0 Jun 11 23:13:05.016641 np0000002687 nova-compute[98431]: node.session.cmds_max = 128 Jun 11 23:13:05.016641 np0000002687 nova-compute[98431]: node.session.queue_depth = 32 Jun 11 23:13:05.016641 np0000002687 nova-compute[98431]: node.session.nr_sessions = 1 Jun 11 23:13:05.016641 np0000002687 nova-compute[98431]: node.session.auth.authmethod = None Jun 11 23:13:05.016641 np0000002687 nova-compute[98431]: node.session.auth.username = Jun 11 23:13:05.016641 np0000002687 nova-compute[98431]: node.session.auth.password = *** Jun 11 23:13:05.016641 np0000002687 nova-compute[98431]: node.session.auth.username_in = Jun 11 23:13:05.016641 np0000002687 nova-compute[98431]: node.session.auth.password_in = Jun 11 23:13:05.016641 np0000002687 nova-compute[98431]: node.session.auth.chap_algs = SHA256 Jun 11 23:13:05.016641 np0000002687 nova-compute[98431]: node.session.timeo.replacement_timeout = 120 Jun 11 23:13:05.016641 np0000002687 nova-compute[98431]: node.session.err_timeo.abort_timeout = 15 Jun 11 23:13:05.016641 np0000002687 nova-compute[98431]: node.session.err_timeo.lu_reset_timeout = 30 Jun 11 23:13:05.016641 np0000002687 nova-compute[98431]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 11 23:13:05.016641 np0000002687 nova-compute[98431]: node.session.err_timeo.host_reset_timeout = 60 Jun 11 23:13:05.016641 np0000002687 nova-compute[98431]: node.session.iscsi.FastAbort = Yes Jun 11 23:13:05.016641 np0000002687 nova-compute[98431]: node.session.iscsi.InitialR2T = No Jun 11 23:13:05.016641 np0000002687 nova-compute[98431]: node.session.iscsi.ImmediateData = Yes Jun 11 23:13:05.016641 np0000002687 nova-compute[98431]: node.session.iscsi.FirstBurstLength = 262144 Jun 11 23:13:05.016641 np0000002687 nova-compute[98431]: node.session.iscsi.MaxBurstLength = 16776192 Jun 11 23:13:05.016641 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Retain = 0 Jun 11 23:13:05.016641 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Wait = 2 Jun 11 23:13:05.016641 np0000002687 nova-compute[98431]: node.session.iscsi.MaxConnections = 1 Jun 11 23:13:05.016641 np0000002687 nova-compute[98431]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 11 23:13:05.016641 np0000002687 nova-compute[98431]: node.session.iscsi.ERL = 0 Jun 11 23:13:05.016641 np0000002687 nova-compute[98431]: node.session.scan = auto Jun 11 23:13:05.016641 np0000002687 nova-compute[98431]: node.session.reopen_max = 0 Jun 11 23:13:05.016641 np0000002687 nova-compute[98431]: node.conn[0].address = 192.168.50.100 Jun 11 23:13:05.016641 np0000002687 nova-compute[98431]: node.conn[0].port = 3260 Jun 11 23:13:05.016641 np0000002687 nova-compute[98431]: node.conn[0].startup = manual Jun 11 23:13:05.016641 np0000002687 nova-compute[98431]: node.conn[0].tcp.window_size = 524288 Jun 11 23:13:05.016641 np0000002687 nova-compute[98431]: node.conn[0].tcp.type_of_service = 0 Jun 11 23:13:05.016641 np0000002687 nova-compute[98431]: node.conn[0].timeo.logout_timeout = 15 Jun 11 23:13:05.016641 np0000002687 nova-compute[98431]: node.conn[0].timeo.login_timeout = 15 Jun 11 23:13:05.016641 np0000002687 nova-compute[98431]: node.conn[0].timeo.auth_timeout = 45 Jun 11 23:13:05.016641 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_interval = 5 Jun 11 23:13:05.016641 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_timeout = 5 Jun 11 23:13:05.016641 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 11 23:13:05.016641 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 11 23:13:05.016641 np0000002687 nova-compute[98431]: node.conn[0].iscsi.HeaderDigest = None Jun 11 23:13:05.016641 np0000002687 nova-compute[98431]: node.conn[0].iscsi.DataDigest = None Jun 11 23:13:05.016641 np0000002687 nova-compute[98431]: node.conn[0].iscsi.IFMarker = No Jun 11 23:13:05.016641 np0000002687 nova-compute[98431]: node.conn[0].iscsi.OFMarker = No Jun 11 23:13:05.016641 np0000002687 nova-compute[98431]: # END RECORD Jun 11 23:13:05.016641 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:13:05.031066 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 11 23:13:05.031066 np0000002687 nova-compute[98431]: node.name = iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979 Jun 11 23:13:05.031066 np0000002687 nova-compute[98431]: node.tpgt = -1 Jun 11 23:13:05.031066 np0000002687 nova-compute[98431]: node.startup = manual Jun 11 23:13:05.031066 np0000002687 nova-compute[98431]: node.leading_login = No Jun 11 23:13:05.031066 np0000002687 nova-compute[98431]: iface.iscsi_ifacename = default Jun 11 23:13:05.031066 np0000002687 nova-compute[98431]: iface.net_ifacename = Jun 11 23:13:05.031066 np0000002687 nova-compute[98431]: iface.ipaddress = Jun 11 23:13:05.031066 np0000002687 nova-compute[98431]: iface.prefix_len = 0 Jun 11 23:13:05.031066 np0000002687 nova-compute[98431]: iface.hwaddress = Jun 11 23:13:05.031066 np0000002687 nova-compute[98431]: iface.transport_name = tcp Jun 11 23:13:05.031066 np0000002687 nova-compute[98431]: iface.initiatorname = Jun 11 23:13:05.031066 np0000002687 nova-compute[98431]: iface.state = Jun 11 23:13:05.031066 np0000002687 nova-compute[98431]: iface.vlan_id = 0 Jun 11 23:13:05.031066 np0000002687 nova-compute[98431]: iface.vlan_priority = 0 Jun 11 23:13:05.031066 np0000002687 nova-compute[98431]: iface.vlan_state = Jun 11 23:13:05.031066 np0000002687 nova-compute[98431]: iface.iface_num = 0 Jun 11 23:13:05.031066 np0000002687 nova-compute[98431]: iface.mtu = 0 Jun 11 23:13:05.031066 np0000002687 nova-compute[98431]: iface.port = 0 Jun 11 23:13:05.031066 np0000002687 nova-compute[98431]: iface.bootproto = Jun 11 23:13:05.031066 np0000002687 nova-compute[98431]: iface.subnet_mask = Jun 11 23:13:05.031066 np0000002687 nova-compute[98431]: iface.gateway = Jun 11 23:13:05.031066 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id_state = Jun 11 23:13:05.031066 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id = Jun 11 23:13:05.031066 np0000002687 nova-compute[98431]: iface.dhcp_dns = Jun 11 23:13:05.031066 np0000002687 nova-compute[98431]: iface.dhcp_learn_iqn = Jun 11 23:13:05.031066 np0000002687 nova-compute[98431]: iface.dhcp_req_vendor_id_state = Jun 11 23:13:05.031066 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id_state = Jun 11 23:13:05.031066 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id = Jun 11 23:13:05.031066 np0000002687 nova-compute[98431]: iface.dhcp_slp_da = Jun 11 23:13:05.031066 np0000002687 nova-compute[98431]: iface.fragmentation = Jun 11 23:13:05.031066 np0000002687 nova-compute[98431]: iface.gratuitous_arp = Jun 11 23:13:05.031066 np0000002687 nova-compute[98431]: iface.incoming_forwarding = Jun 11 23:13:05.031066 np0000002687 nova-compute[98431]: iface.tos_state = Jun 11 23:13:05.031066 np0000002687 nova-compute[98431]: iface.tos = 0 Jun 11 23:13:05.031066 np0000002687 nova-compute[98431]: iface.ttl = 0 Jun 11 23:13:05.031066 np0000002687 nova-compute[98431]: iface.delayed_ack = Jun 11 23:13:05.031066 np0000002687 nova-compute[98431]: iface.tcp_nagle = Jun 11 23:13:05.031066 np0000002687 nova-compute[98431]: iface.tcp_wsf_state = Jun 11 23:13:05.031066 np0000002687 nova-compute[98431]: iface.tcp_wsf = 0 Jun 11 23:13:05.031066 np0000002687 nova-compute[98431]: iface.tcp_timer_scale = 0 Jun 11 23:13:05.031066 np0000002687 nova-compute[98431]: iface.tcp_timestamp = Jun 11 23:13:05.031066 np0000002687 nova-compute[98431]: iface.redirect = Jun 11 23:13:05.031066 np0000002687 nova-compute[98431]: iface.def_task_mgmt_timeout = 0 Jun 11 23:13:05.031066 np0000002687 nova-compute[98431]: iface.header_digest = Jun 11 23:13:05.031066 np0000002687 nova-compute[98431]: iface.data_digest = Jun 11 23:13:05.031066 np0000002687 nova-compute[98431]: iface.immediate_data = Jun 11 23:13:05.031066 np0000002687 nova-compute[98431]: iface.initial_r2t = Jun 11 23:13:05.031066 np0000002687 nova-compute[98431]: iface.data_seq_inorder = Jun 11 23:13:05.031066 np0000002687 nova-compute[98431]: iface.data_pdu_inorder = Jun 11 23:13:05.031066 np0000002687 nova-compute[98431]: iface.erl = 0 Jun 11 23:13:05.031066 np0000002687 nova-compute[98431]: iface.max_receive_data_len = 0 Jun 11 23:13:05.031066 np0000002687 nova-compute[98431]: iface.first_burst_len = 0 Jun 11 23:13:05.031066 np0000002687 nova-compute[98431]: iface.max_outstanding_r2t = 0 Jun 11 23:13:05.031066 np0000002687 nova-compute[98431]: iface.max_burst_len = 0 Jun 11 23:13:05.031066 np0000002687 nova-compute[98431]: iface.chap_auth = Jun 11 23:13:05.031066 np0000002687 nova-compute[98431]: iface.bidi_chap = Jun 11 23:13:05.031066 np0000002687 nova-compute[98431]: iface.strict_login_compliance = Jun 11 23:13:05.031066 np0000002687 nova-compute[98431]: iface.discovery_auth = Jun 11 23:13:05.031066 np0000002687 nova-compute[98431]: iface.discovery_logout = Jun 11 23:13:05.031066 np0000002687 nova-compute[98431]: node.discovery_address = Jun 11 23:13:05.031066 np0000002687 nova-compute[98431]: node.discovery_port = 0 Jun 11 23:13:05.031066 np0000002687 nova-compute[98431]: node.discovery_type = fw Jun 11 23:13:05.031066 np0000002687 nova-compute[98431]: node.session.initial_cmdsn = 0 Jun 11 23:13:05.031066 np0000002687 nova-compute[98431]: node.session.initial_login_retry_max = 8 Jun 11 23:13:05.031066 np0000002687 nova-compute[98431]: node.session.xmit_thread_priority = 0 Jun 11 23:13:05.031066 np0000002687 nova-compute[98431]: node.session.cmds_max = 128 Jun 11 23:13:05.031066 np0000002687 nova-compute[98431]: node.session.queue_depth = 32 Jun 11 23:13:05.031066 np0000002687 nova-compute[98431]: node.session.nr_sessions = 1 Jun 11 23:13:05.031066 np0000002687 nova-compute[98431]: node.session.auth.authmethod = None Jun 11 23:13:05.031066 np0000002687 nova-compute[98431]: node.session.auth.username = Jun 11 23:13:05.031066 np0000002687 nova-compute[98431]: node.session.auth.password = *** Jun 11 23:13:05.031066 np0000002687 nova-compute[98431]: node.session.auth.username_in = Jun 11 23:13:05.031066 np0000002687 nova-compute[98431]: node.session.auth.password_in = Jun 11 23:13:05.031066 np0000002687 nova-compute[98431]: node.session.auth.chap_algs = SHA256 Jun 11 23:13:05.031066 np0000002687 nova-compute[98431]: node.session.timeo.replacement_timeout = 120 Jun 11 23:13:05.031066 np0000002687 nova-compute[98431]: node.session.err_timeo.abort_timeout = 15 Jun 11 23:13:05.031066 np0000002687 nova-compute[98431]: node.session.err_timeo.lu_reset_timeout = 30 Jun 11 23:13:05.031066 np0000002687 nova-compute[98431]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 11 23:13:05.031066 np0000002687 nova-compute[98431]: node.session.err_timeo.host_reset_timeout = 60 Jun 11 23:13:05.031066 np0000002687 nova-compute[98431]: node.session.iscsi.FastAbort = Yes Jun 11 23:13:05.031066 np0000002687 nova-compute[98431]: node.session.iscsi.InitialR2T = No Jun 11 23:13:05.031066 np0000002687 nova-compute[98431]: node.session.iscsi.ImmediateData = Yes Jun 11 23:13:05.031066 np0000002687 nova-compute[98431]: node.session.iscsi.FirstBurstLength = 262144 Jun 11 23:13:05.031066 np0000002687 nova-compute[98431]: node.session.iscsi.MaxBurstLength = 16776192 Jun 11 23:13:05.031066 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Retain = 0 Jun 11 23:13:05.031066 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Wait = 2 Jun 11 23:13:05.031066 np0000002687 nova-compute[98431]: node.session.iscsi.MaxConnections = 1 Jun 11 23:13:05.031066 np0000002687 nova-compute[98431]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 11 23:13:05.031066 np0000002687 nova-compute[98431]: node.session.iscsi.ERL = 0 Jun 11 23:13:05.031066 np0000002687 nova-compute[98431]: node.session.scan = auto Jun 11 23:13:05.031066 np0000002687 nova-compute[98431]: node.session.reopen_max = 0 Jun 11 23:13:05.031066 np0000002687 nova-compute[98431]: node.conn[0].address = 192.168.40.100 Jun 11 23:13:05.031066 np0000002687 nova-compute[98431]: node.conn[0].port = 3260 Jun 11 23:13:05.031066 np0000002687 nova-compute[98431]: node.conn[0].startup = manual Jun 11 23:13:05.031066 np0000002687 nova-compute[98431]: node.conn[0].tcp.window_size = 524288 Jun 11 23:13:05.031066 np0000002687 nova-compute[98431]: node.conn[0].tcp.type_of_service = 0 Jun 11 23:13:05.031066 np0000002687 nova-compute[98431]: node.conn[0].timeo.logout_timeout = 15 Jun 11 23:13:05.031066 np0000002687 nova-compute[98431]: node.conn[0].timeo.login_timeout = 15 Jun 11 23:13:05.031066 np0000002687 nova-compute[98431]: node.conn[0].timeo.auth_timeout = 45 Jun 11 23:13:05.031066 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_interval = 5 Jun 11 23:13:05.031066 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_timeout = 5 Jun 11 23:13:05.031066 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 11 23:13:05.031066 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 11 23:13:05.031066 np0000002687 nova-compute[98431]: node.conn[0].iscsi.HeaderDigest = None Jun 11 23:13:05.031066 np0000002687 nova-compute[98431]: node.conn[0].iscsi.DataDigest = None Jun 11 23:13:05.031066 np0000002687 nova-compute[98431]: node.conn[0].iscsi.IFMarker = No Jun 11 23:13:05.031066 np0000002687 nova-compute[98431]: node.conn[0].iscsi.OFMarker = No Jun 11 23:13:05.031066 np0000002687 nova-compute[98431]: # END RECORD Jun 11 23:13:05.031066 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:13:05.037459 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:05.045200 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:13:05.051404 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:13:05.058372 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-23e50c03-7cb3-4240-8831-a73127fed72d req-15ee1866-145f-4a67-b087-eb8ad323aadc service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Instance cache missing network info. {{(pid=98431) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 11 23:13:05.080505 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:05.080505 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:05.080505 np0000002687 nova-compute[98431]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060 (non-flash) Jun 11 23:13:05.080505 np0000002687 nova-compute[98431]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060 (non-flash) Jun 11 23:13:05.080505 np0000002687 nova-compute[98431]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:13:05.080505 np0000002687 nova-compute[98431]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:13:05.080505 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:05.080505 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:05.080505 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:13:05.082892 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] iscsi session list stdout=tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:05.082892 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:05.082892 np0000002687 nova-compute[98431]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060 (non-flash) Jun 11 23:13:05.082892 np0000002687 nova-compute[98431]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060 (non-flash) Jun 11 23:13:05.082892 np0000002687 nova-compute[98431]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:13:05.082892 np0000002687 nova-compute[98431]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:13:05.082892 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:05.082892 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:05.082892 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:13:05.095690 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:05.095690 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:05.095690 np0000002687 nova-compute[98431]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060 (non-flash) Jun 11 23:13:05.095690 np0000002687 nova-compute[98431]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060 (non-flash) Jun 11 23:13:05.095690 np0000002687 nova-compute[98431]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:13:05.095690 np0000002687 nova-compute[98431]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:13:05.095690 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:05.095690 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:05.095690 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:13:05.096925 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] iscsi session list stdout=tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:05.096925 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:05.096925 np0000002687 nova-compute[98431]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060 (non-flash) Jun 11 23:13:05.096925 np0000002687 nova-compute[98431]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060 (non-flash) Jun 11 23:13:05.096925 np0000002687 nova-compute[98431]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:13:05.096925 np0000002687 nova-compute[98431]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:13:05.096925 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:05.096925 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:05.096925 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:13:05.166475 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979, portal: 192.168.50.100,3260] Jun 11 23:13:05.166475 np0000002687 nova-compute[98431]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979, portal: 192.168.50.100,3260] successful. Jun 11 23:13:05.166475 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:13:05.192814 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:13:05.211954 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979, portal: 192.168.40.100,3260] Jun 11 23:13:05.211954 np0000002687 nova-compute[98431]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979, portal: 192.168.40.100,3260] successful. Jun 11 23:13:05.211954 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:13:05.237146 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:05.237146 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:05.237146 np0000002687 nova-compute[98431]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060 (non-flash) Jun 11 23:13:05.237146 np0000002687 nova-compute[98431]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060 (non-flash) Jun 11 23:13:05.237146 np0000002687 nova-compute[98431]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:13:05.237146 np0000002687 nova-compute[98431]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:13:05.237146 np0000002687 nova-compute[98431]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979 (non-flash) Jun 11 23:13:05.237146 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:05.237146 np0000002687 nova-compute[98431]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979 (non-flash) Jun 11 23:13:05.237146 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:05.237146 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:13:05.237146 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] iscsi session list stdout=tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:05.237146 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:05.237146 np0000002687 nova-compute[98431]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060 (non-flash) Jun 11 23:13:05.237146 np0000002687 nova-compute[98431]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060 (non-flash) Jun 11 23:13:05.237146 np0000002687 nova-compute[98431]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:13:05.237146 np0000002687 nova-compute[98431]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:13:05.237146 np0000002687 nova-compute[98431]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979 (non-flash) Jun 11 23:13:05.237146 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:05.237146 np0000002687 nova-compute[98431]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979 (non-flash) Jun 11 23:13:05.237146 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:05.237146 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:13:05.237146 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.308s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 11 23:13:05.237146 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Connected to 192.168.50.100:3260 {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 11 23:13:05.238310 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] HCTL ('9', '-', '-', 0) found on session 29 with lun 0 {{(pid=98431) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 11 23:13:05.238446 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98431) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 11 23:13:05.245253 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:13:05.272303 np0000002687 nova-compute[98431]: DEBUG nova.compute.resource_tracker [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Compute_service record updated for np0000002687:np0000002687 {{(pid=98431) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}} Jun 11 23:13:05.272303 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 3.563s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:05.272303 np0000002687 nova-compute[98431]: DEBUG oslo.service.backend._threading.loopingcall [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 55.00 seconds {{(pid=98431) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jun 11 23:13:05.275559 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Searching for a device in session 29 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98431) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 11 23:13:05.275662 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '2f2d8ccb-5d26-4f0b-bc60-abf6355bf979', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 11 23:13:05.278192 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:05.278192 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:05.278192 np0000002687 nova-compute[98431]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060 (non-flash) Jun 11 23:13:05.278192 np0000002687 nova-compute[98431]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060 (non-flash) Jun 11 23:13:05.278192 np0000002687 nova-compute[98431]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:13:05.278192 np0000002687 nova-compute[98431]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:13:05.278192 np0000002687 nova-compute[98431]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979 (non-flash) Jun 11 23:13:05.278192 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:05.278192 np0000002687 nova-compute[98431]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979 (non-flash) Jun 11 23:13:05.278192 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:05.278192 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:13:05.280997 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] iscsi session list stdout=tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:05.280997 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:05.280997 np0000002687 nova-compute[98431]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060 (non-flash) Jun 11 23:13:05.280997 np0000002687 nova-compute[98431]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060 (non-flash) Jun 11 23:13:05.280997 np0000002687 nova-compute[98431]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:13:05.280997 np0000002687 nova-compute[98431]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:13:05.280997 np0000002687 nova-compute[98431]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979 (non-flash) Jun 11 23:13:05.280997 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:05.280997 np0000002687 nova-compute[98431]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979 (non-flash) Jun 11 23:13:05.280997 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:05.280997 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:13:05.280997 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.352s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 11 23:13:05.280997 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Connected to 192.168.40.100:3260 {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 11 23:13:05.280997 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] HCTL ('10', '-', '-', 0) found on session 30 with lun 0 {{(pid=98431) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 11 23:13:05.280997 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98431) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 11 23:13:05.318301 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Searching for a device in session 30 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98431) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 11 23:13:05.318301 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2f2d8ccb-5d26-4f0b-bc60-abf6355bf979', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 11 23:13:05.327778 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Updating instance_info_cache with network_info: [{"id": "3c37ff2c-78c4-4423-b4a2-219e94df57ca", "address": "fa:16:3e:8f:ae:21", "network": {"id": "2a770c99-2ec6-4fa2-945b-32830a59e7a7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-137493671-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aaf744af828a4a5eba1e98da63373b2b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c37ff2c-78", "ovs_interfaceid": "3c37ff2c-78c4-4423-b4a2-219e94df57ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:13:05.386878 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-16742e93-7360-466f-a15b-bf24d2f11af6 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Detaching volume 859ffbad-3fc1-400a-a7f7-ac423851f060 Jun 11 23:13:05.437980 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:05.450033 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:05.472036 np0000002687 nova-compute[98431]: INFO nova.virt.block_device [None req-16742e93-7360-466f-a15b-bf24d2f11af6 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Attempting to driver detach volume 859ffbad-3fc1-400a-a7f7-ac423851f060 from mountpoint /dev/vdb Jun 11 23:13:05.483966 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:05.491649 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-16742e93-7360-466f-a15b-bf24d2f11af6 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Found disk vdb by alias ua-859ffbad-3fc1-400a-a7f7-ac423851f060 {{(pid=98431) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}} Jun 11 23:13:05.494742 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-16742e93-7360-466f-a15b-bf24d2f11af6 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Found disk vdb by alias ua-859ffbad-3fc1-400a-a7f7-ac423851f060 {{(pid=98431) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}} Jun 11 23:13:05.495143 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-16742e93-7360-466f-a15b-bf24d2f11af6 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Attempting to detach device vdb from instance cb63f66c-b69e-42b0-805c-be6fe9b3aee3 from the persistent domain config. {{(pid=98431) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}} Jun 11 23:13:05.495622 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.guest [None req-16742e93-7360-466f-a15b-bf24d2f11af6 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] detach device xml: Jun 11 23:13:05.495622 np0000002687 nova-compute[98431]: Jun 11 23:13:05.495622 np0000002687 nova-compute[98431]: Jun 11 23:13:05.495622 np0000002687 nova-compute[98431]: Jun 11 23:13:05.495622 np0000002687 nova-compute[98431]: Jun 11 23:13:05.495622 np0000002687 nova-compute[98431]: 859ffbad-3fc1-400a-a7f7-ac423851f060 Jun 11 23:13:05.495622 np0000002687 nova-compute[98431]:
Jun 11 23:13:05.495622 np0000002687 nova-compute[98431]: Jun 11 23:13:05.495622 np0000002687 nova-compute[98431]: {{(pid=98431) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jun 11 23:13:05.519162 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-16742e93-7360-466f-a15b-bf24d2f11af6 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Successfully detached device vdb from instance cb63f66c-b69e-42b0-805c-be6fe9b3aee3 from the persistent domain config. Jun 11 23:13:05.519162 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-16742e93-7360-466f-a15b-bf24d2f11af6 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] (1/8): Attempting to detach device vdb with device alias ua-859ffbad-3fc1-400a-a7f7-ac423851f060 from instance cb63f66c-b69e-42b0-805c-be6fe9b3aee3 from the live domain config. {{(pid=98431) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}} Jun 11 23:13:05.519162 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.guest [None req-16742e93-7360-466f-a15b-bf24d2f11af6 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] detach device xml: Jun 11 23:13:05.519162 np0000002687 nova-compute[98431]: Jun 11 23:13:05.519162 np0000002687 nova-compute[98431]: Jun 11 23:13:05.519162 np0000002687 nova-compute[98431]: Jun 11 23:13:05.519162 np0000002687 nova-compute[98431]: Jun 11 23:13:05.519162 np0000002687 nova-compute[98431]: 859ffbad-3fc1-400a-a7f7-ac423851f060 Jun 11 23:13:05.519162 np0000002687 nova-compute[98431]:
Jun 11 23:13:05.519162 np0000002687 nova-compute[98431]: Jun 11 23:13:05.519162 np0000002687 nova-compute[98431]: {{(pid=98431) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jun 11 23:13:05.758288 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Successfully updated port: fe1430ca-d60b-47c4-9ac9-96ba7d61f101 {{(pid=98431) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 11 23:13:05.838283 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Releasing lock "refresh_cache-0d352738-c7bf-42a2-8260-bf5574a7200d" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 11 23:13:05.867378 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-23e50c03-7cb3-4240-8831-a73127fed72d req-15ee1866-145f-4a67-b087-eb8ad323aadc service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Updating instance_info_cache with network_info: [] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:13:05.931409 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98431) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 11 23:13:06.057313 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:06.139177 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Start spawning the instance on the hypervisor. {{(pid=98431) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 11 23:13:06.142964 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Creating instance directory {{(pid=98431) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}} Jun 11 23:13:06.143747 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Creating image(s) Jun 11 23:13:06.144192 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Did not create local disks {{(pid=98431) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}} Jun 11 23:13:06.144371 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Ensure instance console log exists: /opt/stack/data/nova/instances/1d45c7ce-5760-4f59-9921-feb3e589da8a/console.log {{(pid=98431) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}} Jun 11 23:13:06.144668 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:06.144889 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:06.145051 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:06.193211 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Emitting event Started> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:13:06.193324 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 19beb2a4-b3fe-43e9-ac92-71446c2630ee] VM Started (Lifecycle Event) Jun 11 23:13:06.215980 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-16742e93-7360-466f-a15b-bf24d2f11af6 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-859ffbad-3fc1-400a-a7f7-ac423851f060 for instance cb63f66c-b69e-42b0-805c-be6fe9b3aee3 {{(pid=98431) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}} Jun 11 23:13:06.372780 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-23e50c03-7cb3-4240-8831-a73127fed72d req-15ee1866-145f-4a67-b087-eb8ad323aadc service nova] Releasing lock "refresh_cache-1d45c7ce-5760-4f59-9921-feb3e589da8a" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 11 23:13:06.509010 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-75be6183-7e6a-4a2a-b0cc-70ba8b47eebd req-d03b56df-1bb3-4caa-b41f-9c25792de9cf service nova] [instance: 19beb2a4-b3fe-43e9-ac92-71446c2630ee] Received event network-vif-plugged-4c1f7e6e-b361-4522-84d4-5bf89a5eb631 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:13:06.509169 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-75be6183-7e6a-4a2a-b0cc-70ba8b47eebd req-d03b56df-1bb3-4caa-b41f-9c25792de9cf service nova] Acquiring lock "19beb2a4-b3fe-43e9-ac92-71446c2630ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:06.509408 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-75be6183-7e6a-4a2a-b0cc-70ba8b47eebd req-d03b56df-1bb3-4caa-b41f-9c25792de9cf service nova] Lock "19beb2a4-b3fe-43e9-ac92-71446c2630ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:06.509472 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-75be6183-7e6a-4a2a-b0cc-70ba8b47eebd req-d03b56df-1bb3-4caa-b41f-9c25792de9cf service nova] Lock "19beb2a4-b3fe-43e9-ac92-71446c2630ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:06.509678 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-75be6183-7e6a-4a2a-b0cc-70ba8b47eebd req-d03b56df-1bb3-4caa-b41f-9c25792de9cf service nova] [instance: 19beb2a4-b3fe-43e9-ac92-71446c2630ee] Processing event network-vif-plugged-4c1f7e6e-b361-4522-84d4-5bf89a5eb631 {{(pid=98431) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 11 23:13:06.509786 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-75be6183-7e6a-4a2a-b0cc-70ba8b47eebd req-d03b56df-1bb3-4caa-b41f-9c25792de9cf service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Received event network-changed-fe1430ca-d60b-47c4-9ac9-96ba7d61f101 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:13:06.509933 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-75be6183-7e6a-4a2a-b0cc-70ba8b47eebd req-d03b56df-1bb3-4caa-b41f-9c25792de9cf service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Refreshing instance network info cache due to event network-changed-fe1430ca-d60b-47c4-9ac9-96ba7d61f101. {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 11 23:13:06.512416 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] [instance: 19beb2a4-b3fe-43e9-ac92-71446c2630ee] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98431) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 11 23:13:06.513072 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-75be6183-7e6a-4a2a-b0cc-70ba8b47eebd req-d03b56df-1bb3-4caa-b41f-9c25792de9cf service nova] Acquiring lock "refresh_cache-1d45c7ce-5760-4f59-9921-feb3e589da8a" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 11 23:13:06.513239 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-75be6183-7e6a-4a2a-b0cc-70ba8b47eebd req-d03b56df-1bb3-4caa-b41f-9c25792de9cf service nova] Acquired lock "refresh_cache-1d45c7ce-5760-4f59-9921-feb3e589da8a" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 11 23:13:06.513969 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-75be6183-7e6a-4a2a-b0cc-70ba8b47eebd req-d03b56df-1bb3-4caa-b41f-9c25792de9cf service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Refreshing network info cache for port fe1430ca-d60b-47c4-9ac9-96ba7d61f101 {{(pid=98431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 11 23:13:06.517115 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] [instance: 19beb2a4-b3fe-43e9-ac92-71446c2630ee] Guest created on hypervisor {{(pid=98431) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}} Jun 11 23:13:06.525259 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [-] [instance: 19beb2a4-b3fe-43e9-ac92-71446c2630ee] Instance spawned successfully. Jun 11 23:13:06.526584 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] [instance: 19beb2a4-b3fe-43e9-ac92-71446c2630ee] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 11 23:13:06.695822 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 19beb2a4-b3fe-43e9-ac92-71446c2630ee] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:13:06.698192 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 19beb2a4-b3fe-43e9-ac92-71446c2630ee] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98431) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 11 23:13:06.949506 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Found WWN 3300000009550c01f for multipath device dm-3 {{(pid=98431) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 11 23:13:06.950054 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.045s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 11 23:13:06.950054 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] <== connect_volume: return (3047ms) {'type': 'block', 'scsi_wwn': '3300000009550c01f', 'path': '/dev/dm-3', 'multipath_id': '3300000009550c01f'} {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 11 23:13:06.950205 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000009550c01f', 'path': '/dev/dm-3', 'multipath_id': '3300000009550c01f'} {{(pid=98431) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 11 23:13:07.016052 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [req-75be6183-7e6a-4a2a-b0cc-70ba8b47eebd req-d03b56df-1bb3-4caa-b41f-9c25792de9cf service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:13:07.037063 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] [instance: 19beb2a4-b3fe-43e9-ac92-71446c2630ee] Found default for hw_cdrom_bus of ide {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:13:07.038135 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] [instance: 19beb2a4-b3fe-43e9-ac92-71446c2630ee] Found default for hw_disk_bus of virtio {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:13:07.038135 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] [instance: 19beb2a4-b3fe-43e9-ac92-71446c2630ee] Found default for hw_input_bus of None {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:13:07.038539 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] [instance: 19beb2a4-b3fe-43e9-ac92-71446c2630ee] Found default for hw_pointer_model of None {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:13:07.039504 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] [instance: 19beb2a4-b3fe-43e9-ac92-71446c2630ee] Found default for hw_video_model of virtio {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:13:07.040012 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] [instance: 19beb2a4-b3fe-43e9-ac92-71446c2630ee] Found default for hw_vif_model of virtio {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:13:07.203495 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 19beb2a4-b3fe-43e9-ac92-71446c2630ee] During sync_power_state the instance has a pending task (spawning). Skip. Jun 11 23:13:07.204140 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Emitting event Paused> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:13:07.204487 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 19beb2a4-b3fe-43e9-ac92-71446c2630ee] VM Paused (Lifecycle Event) Jun 11 23:13:07.269310 np0000002687 nova-compute[98431]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0009381739998843841 future=) submitted to {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:13:07.270417 np0000002687 nova-compute[98431]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:13:07.270417 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] Emitting event Stopped> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:13:07.270417 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] VM Stopped (Lifecycle Event) Jun 11 23:13:07.458356 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-11T23:11:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-872787611',display_name='tempest-ServerActionsTestOtherB-server-872787611',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(12),hidden=False,host='np0000002687',hostname='tempest-serveractionstestotherb-server-872787611',id=13,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE8GCNW5zoKlPJg2gDz6psGsk5eAwUwS5EcLVqi+Ws93aBM9mzyZ9OA4e5k8HR4bk5PDkKar3oCgqC2LYEZaaYcONGX+UXm8H5giZlXKo/6E9eZdQg2l6SXnZTdbPKM4Aw==',key_name='tempest-keypair-1789476090',keypairs=,launch_index=0,launched_at=2026-06-11T23:11:46Z,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000002687',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='62f47df2e0374879b837bc7431326e62',ramdisk_id='',reservation_id='r-92sxxj92',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1260316994',owner_user_name='tempest-ServerActionsTestOtherB-1260316994-project-member'},tags=,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-06-11T23:12:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2b37a00a21a249339e412bcde7a87f82',uuid=7609742e-a3a2-4be2-ba02-227efb2101e1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a1e7aeff-5992-43be-bb2c-d504e7019c64", "address": "fa:16:3e:1d:f7:18", "network": {"id": "710d3c5f-1a08-4a35-b3e1-e59f427989c2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2068802531-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.182", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2068802531-network", "vif_mac": "fa:16:3e:1d:f7:18"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62f47df2e0374879b837bc7431326e62", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1e7aeff-59", "ovs_interfaceid": "a1e7aeff-5992-43be-bb2c-d504e7019c64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98431) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 11 23:13:07.458655 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Converting VIF {"id": "a1e7aeff-5992-43be-bb2c-d504e7019c64", "address": "fa:16:3e:1d:f7:18", "network": {"id": "710d3c5f-1a08-4a35-b3e1-e59f427989c2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2068802531-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.182", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2068802531-network", "vif_mac": "fa:16:3e:1d:f7:18"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62f47df2e0374879b837bc7431326e62", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1e7aeff-59", "ovs_interfaceid": "a1e7aeff-5992-43be-bb2c-d504e7019c64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:13:07.459240 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:f7:18,bridge_name='br-int',has_traffic_filtering=True,id=a1e7aeff-5992-43be-bb2c-d504e7019c64,network=Network(710d3c5f-1a08-4a35-b3e1-e59f427989c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1e7aeff-59') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:13:07.462438 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] End _get_guest_xml xml= Jun 11 23:13:07.462438 np0000002687 nova-compute[98431]: 7609742e-a3a2-4be2-ba02-227efb2101e1 Jun 11 23:13:07.462438 np0000002687 nova-compute[98431]: instance-0000000d Jun 11 23:13:07.462438 np0000002687 nova-compute[98431]: 262144 Jun 11 23:13:07.462438 np0000002687 nova-compute[98431]: 1 Jun 11 23:13:07.462438 np0000002687 nova-compute[98431]: Jun 11 23:13:07.462438 np0000002687 nova-compute[98431]: Jun 11 23:13:07.462438 np0000002687 nova-compute[98431]: Jun 11 23:13:07.462438 np0000002687 nova-compute[98431]: tempest-ServerActionsTestOtherB-server-872787611 Jun 11 23:13:07.462438 np0000002687 nova-compute[98431]: 2026-06-11 23:13:03 Jun 11 23:13:07.462438 np0000002687 nova-compute[98431]: Jun 11 23:13:07.462438 np0000002687 nova-compute[98431]: 256 Jun 11 23:13:07.462438 np0000002687 nova-compute[98431]: 1 Jun 11 23:13:07.462438 np0000002687 nova-compute[98431]: 0 Jun 11 23:13:07.462438 np0000002687 nova-compute[98431]: 0 Jun 11 23:13:07.462438 np0000002687 nova-compute[98431]: 1 Jun 11 23:13:07.462438 np0000002687 nova-compute[98431]: Jun 11 23:13:07.462438 np0000002687 nova-compute[98431]: True Jun 11 23:13:07.462438 np0000002687 nova-compute[98431]: Jun 11 23:13:07.462438 np0000002687 nova-compute[98431]: Jun 11 23:13:07.462438 np0000002687 nova-compute[98431]: Jun 11 23:13:07.462438 np0000002687 nova-compute[98431]: bare Jun 11 23:13:07.462438 np0000002687 nova-compute[98431]: qcow2 Jun 11 23:13:07.462438 np0000002687 nova-compute[98431]: 1 Jun 11 23:13:07.462438 np0000002687 nova-compute[98431]: 0 Jun 11 23:13:07.462438 np0000002687 nova-compute[98431]: Jun 11 23:13:07.462438 np0000002687 nova-compute[98431]: ide Jun 11 23:13:07.462438 np0000002687 nova-compute[98431]: virtio Jun 11 23:13:07.462438 np0000002687 nova-compute[98431]: pc Jun 11 23:13:07.462438 np0000002687 nova-compute[98431]: virtio Jun 11 23:13:07.462438 np0000002687 nova-compute[98431]: virtio Jun 11 23:13:07.462438 np0000002687 nova-compute[98431]: virtio Jun 11 23:13:07.462438 np0000002687 nova-compute[98431]: Jun 11 23:13:07.462438 np0000002687 nova-compute[98431]: Jun 11 23:13:07.462438 np0000002687 nova-compute[98431]: Jun 11 23:13:07.462438 np0000002687 nova-compute[98431]: tempest-ServerActionsTestOtherB-1260316994-project-member Jun 11 23:13:07.462438 np0000002687 nova-compute[98431]: tempest-ServerActionsTestOtherB-1260316994 Jun 11 23:13:07.462438 np0000002687 nova-compute[98431]: Jun 11 23:13:07.462438 np0000002687 nova-compute[98431]: Jun 11 23:13:07.462438 np0000002687 nova-compute[98431]: Jun 11 23:13:07.462438 np0000002687 nova-compute[98431]: Jun 11 23:13:07.462438 np0000002687 nova-compute[98431]: Jun 11 23:13:07.462438 np0000002687 nova-compute[98431]: Jun 11 23:13:07.462438 np0000002687 nova-compute[98431]: Jun 11 23:13:07.462438 np0000002687 nova-compute[98431]: Jun 11 23:13:07.462438 np0000002687 nova-compute[98431]: Jun 11 23:13:07.462438 np0000002687 nova-compute[98431]: Jun 11 23:13:07.462438 np0000002687 nova-compute[98431]: Jun 11 23:13:07.462438 np0000002687 nova-compute[98431]: OpenStack Foundation Jun 11 23:13:07.462438 np0000002687 nova-compute[98431]: OpenStack Nova Jun 11 23:13:07.462438 np0000002687 nova-compute[98431]: 33.1.0 Jun 11 23:13:07.462438 np0000002687 nova-compute[98431]: 7609742e-a3a2-4be2-ba02-227efb2101e1 Jun 11 23:13:07.462438 np0000002687 nova-compute[98431]: 7609742e-a3a2-4be2-ba02-227efb2101e1 Jun 11 23:13:07.462438 np0000002687 nova-compute[98431]: Virtual Machine Jun 11 23:13:07.462438 np0000002687 nova-compute[98431]: Jun 11 23:13:07.462438 np0000002687 nova-compute[98431]: Jun 11 23:13:07.462438 np0000002687 nova-compute[98431]: Jun 11 23:13:07.462438 np0000002687 nova-compute[98431]: hvm Jun 11 23:13:07.462438 np0000002687 nova-compute[98431]: Jun 11 23:13:07.462438 np0000002687 nova-compute[98431]: Jun 11 23:13:07.462438 np0000002687 nova-compute[98431]: Jun 11 23:13:07.462438 np0000002687 nova-compute[98431]: Jun 11 23:13:07.462438 np0000002687 nova-compute[98431]: Jun 11 23:13:07.462438 np0000002687 nova-compute[98431]: Jun 11 23:13:07.462438 np0000002687 nova-compute[98431]: 128 Jun 11 23:13:07.462438 np0000002687 nova-compute[98431]: Jun 11 23:13:07.462438 np0000002687 nova-compute[98431]: Jun 11 23:13:07.462438 np0000002687 nova-compute[98431]: Jun 11 23:13:07.462438 np0000002687 nova-compute[98431]: 1 Jun 11 23:13:07.462438 np0000002687 nova-compute[98431]: Jun 11 23:13:07.462438 np0000002687 nova-compute[98431]: Jun 11 23:13:07.462438 np0000002687 nova-compute[98431]: Nehalem Jun 11 23:13:07.462438 np0000002687 nova-compute[98431]: Jun 11 23:13:07.462438 np0000002687 nova-compute[98431]: Jun 11 23:13:07.462438 np0000002687 nova-compute[98431]: Jun 11 23:13:07.462438 np0000002687 nova-compute[98431]: Jun 11 23:13:07.462438 np0000002687 nova-compute[98431]: Jun 11 23:13:07.462438 np0000002687 nova-compute[98431]: Jun 11 23:13:07.462438 np0000002687 nova-compute[98431]: Jun 11 23:13:07.462438 np0000002687 nova-compute[98431]: Jun 11 23:13:07.462438 np0000002687 nova-compute[98431]: Jun 11 23:13:07.462438 np0000002687 nova-compute[98431]: Jun 11 23:13:07.462438 np0000002687 nova-compute[98431]: Jun 11 23:13:07.462438 np0000002687 nova-compute[98431]: Jun 11 23:13:07.462438 np0000002687 nova-compute[98431]: Jun 11 23:13:07.462438 np0000002687 nova-compute[98431]: Jun 11 23:13:07.462438 np0000002687 nova-compute[98431]: Jun 11 23:13:07.462438 np0000002687 nova-compute[98431]: Jun 11 23:13:07.462438 np0000002687 nova-compute[98431]: Jun 11 23:13:07.462438 np0000002687 nova-compute[98431]: Jun 11 23:13:07.462438 np0000002687 nova-compute[98431]: 2f2d8ccb-5d26-4f0b-bc60-abf6355bf979 Jun 11 23:13:07.462438 np0000002687 nova-compute[98431]: Jun 11 23:13:07.462438 np0000002687 nova-compute[98431]: Jun 11 23:13:07.462438 np0000002687 nova-compute[98431]: Jun 11 23:13:07.462438 np0000002687 nova-compute[98431]: Jun 11 23:13:07.462438 np0000002687 nova-compute[98431]: Jun 11 23:13:07.462438 np0000002687 nova-compute[98431]: Jun 11 23:13:07.462438 np0000002687 nova-compute[98431]: Jun 11 23:13:07.462438 np0000002687 nova-compute[98431]: Jun 11 23:13:07.462438 np0000002687 nova-compute[98431]: Jun 11 23:13:07.462438 np0000002687 nova-compute[98431]: Jun 11 23:13:07.462438 np0000002687 nova-compute[98431]: Jun 11 23:13:07.462438 np0000002687 nova-compute[98431]: Jun 11 23:13:07.462438 np0000002687 nova-compute[98431]: Jun 11 23:13:07.462438 np0000002687 nova-compute[98431]: Jun 11 23:13:07.462438 np0000002687 nova-compute[98431]: /dev/urandom Jun 11 23:13:07.462438 np0000002687 nova-compute[98431]: Jun 11 23:13:07.462438 np0000002687 nova-compute[98431]: Jun 11 23:13:07.462438 np0000002687 nova-compute[98431]: Jun 11 23:13:07.462438 np0000002687 nova-compute[98431]: Jun 11 23:13:07.462438 np0000002687 nova-compute[98431]: Jun 11 23:13:07.462438 np0000002687 nova-compute[98431]: Jun 11 23:13:07.462438 np0000002687 nova-compute[98431]: Jun 11 23:13:07.462438 np0000002687 nova-compute[98431]: {{(pid=98431) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 11 23:13:07.465763 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-11T23:11:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-872787611',display_name='tempest-ServerActionsTestOtherB-server-872787611',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(12),hidden=False,host='np0000002687',hostname='tempest-serveractionstestotherb-server-872787611',id=13,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE8GCNW5zoKlPJg2gDz6psGsk5eAwUwS5EcLVqi+Ws93aBM9mzyZ9OA4e5k8HR4bk5PDkKar3oCgqC2LYEZaaYcONGX+UXm8H5giZlXKo/6E9eZdQg2l6SXnZTdbPKM4Aw==',key_name='tempest-keypair-1789476090',keypairs=,launch_index=0,launched_at=2026-06-11T23:11:46Z,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000002687',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='62f47df2e0374879b837bc7431326e62',ramdisk_id='',reservation_id='r-92sxxj92',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1260316994',owner_user_name='tempest-ServerActionsTestOtherB-1260316994-project-member'},tags=,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-06-11T23:12:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2b37a00a21a249339e412bcde7a87f82',uuid=7609742e-a3a2-4be2-ba02-227efb2101e1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a1e7aeff-5992-43be-bb2c-d504e7019c64", "address": "fa:16:3e:1d:f7:18", "network": {"id": "710d3c5f-1a08-4a35-b3e1-e59f427989c2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2068802531-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.182", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2068802531-network", "vif_mac": "fa:16:3e:1d:f7:18"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62f47df2e0374879b837bc7431326e62", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1e7aeff-59", "ovs_interfaceid": "a1e7aeff-5992-43be-bb2c-d504e7019c64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 11 23:13:07.465763 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Converting VIF {"id": "a1e7aeff-5992-43be-bb2c-d504e7019c64", "address": "fa:16:3e:1d:f7:18", "network": {"id": "710d3c5f-1a08-4a35-b3e1-e59f427989c2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2068802531-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.182", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2068802531-network", "vif_mac": "fa:16:3e:1d:f7:18"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62f47df2e0374879b837bc7431326e62", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1e7aeff-59", "ovs_interfaceid": "a1e7aeff-5992-43be-bb2c-d504e7019c64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:13:07.465763 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:f7:18,bridge_name='br-int',has_traffic_filtering=True,id=a1e7aeff-5992-43be-bb2c-d504e7019c64,network=Network(710d3c5f-1a08-4a35-b3e1-e59f427989c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1e7aeff-59') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:13:07.465763 np0000002687 nova-compute[98431]: DEBUG os_vif [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:f7:18,bridge_name='br-int',has_traffic_filtering=True,id=a1e7aeff-5992-43be-bb2c-d504e7019c64,network=Network(710d3c5f-1a08-4a35-b3e1-e59f427989c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1e7aeff-59') {{(pid=98431) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 11 23:13:07.466223 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:07.466223 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:13:07.466792 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 11 23:13:07.468745 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:07.468841 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '101d37d4-89c4-59c2-8f44-98622c0abb71', '_type': 'linux-noop'}}, row=False) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:13:07.473554 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:07.475334 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:13:07.483944 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:07.483944 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa1e7aeff-59, may_exist=True, interface_attrs={}) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:13:07.483944 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa1e7aeff-59, col_values=(('qos', UUID('2000b22a-44e2-43c5-9213-033e821b3d8c')),), if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:13:07.483944 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa1e7aeff-59, col_values=(('external_ids', {'iface-id': 'a1e7aeff-5992-43be-bb2c-d504e7019c64', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1d:f7:18', 'vm-uuid': '7609742e-a3a2-4be2-ba02-227efb2101e1'}),), if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:13:07.486112 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Successfully updated port: a39a55c7-874a-4a19-a069-8383a5f0bc5a {{(pid=98431) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 11 23:13:07.495826 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:13:07.503275 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:07.505678 np0000002687 nova-compute[98431]: INFO os_vif [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:f7:18,bridge_name='br-int',has_traffic_filtering=True,id=a1e7aeff-5992-43be-bb2c-d504e7019c64,network=Network(710d3c5f-1a08-4a35-b3e1-e59f427989c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1e7aeff-59') Jun 11 23:13:07.527735 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:07.533362 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:07.547278 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] [instance: 19beb2a4-b3fe-43e9-ac92-71446c2630ee] Took 11.55 seconds to spawn the instance on the hypervisor. Jun 11 23:13:07.547528 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] [instance: 19beb2a4-b3fe-43e9-ac92-71446c2630ee] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:13:07.563621 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:07.707315 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 19beb2a4-b3fe-43e9-ac92-71446c2630ee] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:13:07.712318 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Received event ua-859ffbad-3fc1-400a-a7f7-ac423851f060> from libvirt while the driver is waiting for it; dispatched. {{(pid=98431) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}} Jun 11 23:13:07.712904 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Emitting event Resumed> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:13:07.713013 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 19beb2a4-b3fe-43e9-ac92-71446c2630ee] VM Resumed (Lifecycle Event) Jun 11 23:13:07.726550 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-16742e93-7360-466f-a15b-bf24d2f11af6 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Successfully detached device vdb from instance cb63f66c-b69e-42b0-805c-be6fe9b3aee3 from the live domain config. Jun 11 23:13:07.733874 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16742e93-7360-466f-a15b-bf24d2f11af6 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] calling os-brick to detach iSCSI Volume {{(pid=98431) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jun 11 23:13:07.733874 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-16742e93-7360-466f-a15b-bf24d2f11af6 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060', 'iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '859ffbad-3fc1-400a-a7f7-ac423851f060', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, None), 'kwargs': {'force': False}}" {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 11 23:13:07.733874 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-16742e93-7360-466f-a15b-bf24d2f11af6 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 11 23:13:07.733874 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-16742e93-7360-466f-a15b-bf24d2f11af6 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 11 23:13:07.733874 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-16742e93-7360-466f-a15b-bf24d2f11af6 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060', 'iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '859ffbad-3fc1-400a-a7f7-ac423851f060', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 11 23:13:07.733874 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-16742e93-7360-466f-a15b-bf24d2f11af6 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060', 0)] {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 11 23:13:07.766619 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:07.774202 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:13:07.779138 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-75be6183-7e6a-4a2a-b0cc-70ba8b47eebd req-d03b56df-1bb3-4caa-b41f-9c25792de9cf service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Instance cache missing network info. {{(pid=98431) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 11 23:13:07.784879 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=98431) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 11 23:13:07.789490 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-16742e93-7360-466f-a15b-bf24d2f11af6 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:07.789490 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:07.789490 np0000002687 nova-compute[98431]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060 (non-flash) Jun 11 23:13:07.789490 np0000002687 nova-compute[98431]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060 (non-flash) Jun 11 23:13:07.789490 np0000002687 nova-compute[98431]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:13:07.789490 np0000002687 nova-compute[98431]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:13:07.789490 np0000002687 nova-compute[98431]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979 (non-flash) Jun 11 23:13:07.789490 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:07.789490 np0000002687 nova-compute[98431]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979 (non-flash) Jun 11 23:13:07.789490 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:07.789490 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:13:07.789490 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-16742e93-7360-466f-a15b-bf24d2f11af6 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] iscsi session list stdout=tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:07.789490 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:07.789490 np0000002687 nova-compute[98431]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060 (non-flash) Jun 11 23:13:07.789490 np0000002687 nova-compute[98431]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060 (non-flash) Jun 11 23:13:07.789490 np0000002687 nova-compute[98431]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:13:07.789490 np0000002687 nova-compute[98431]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:13:07.789490 np0000002687 nova-compute[98431]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979 (non-flash) Jun 11 23:13:07.789490 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:07.789490 np0000002687 nova-compute[98431]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979 (non-flash) Jun 11 23:13:07.789490 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:07.789490 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:13:07.794210 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-16742e93-7360-466f-a15b-bf24d2f11af6 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea', '13'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea', '14'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060', '23'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060', '24'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859', '27'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859', '28'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979', '29'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9', '3'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979', '30'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9', '4')] {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 11 23:13:07.794210 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-16742e93-7360-466f-a15b-bf24d2f11af6 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060', '23')] {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 11 23:13:07.794210 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:07.794210 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-16742e93-7360-466f-a15b-bf24d2f11af6 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060', '24')] {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 11 23:13:07.794210 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-16742e93-7360-466f-a15b-bf24d2f11af6 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Resulting device map defaultdict(. at 0x7e1e94712a20>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060'): ({'sdl'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060'): ({'sdm'}, set())}) {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 11 23:13:07.794639 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-16742e93-7360-466f-a15b-bf24d2f11af6 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Removing multipathed devices sdm, sdl {{(pid=98431) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 11 23:13:07.794639 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-16742e93-7360-466f-a15b-bf24d2f11af6 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Flush multipath device 330000000484693f8 {{(pid=98431) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jun 11 23:13:07.826681 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-16742e93-7360-466f-a15b-bf24d2f11af6 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=98431) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 11 23:13:07.869619 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-16742e93-7360-466f-a15b-bf24d2f11af6 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=98431) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 11 23:13:07.883447 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:07.895228 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [-] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Instance destroyed successfully. Jun 11 23:13:07.897003 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lazy-loading 'numa_topology' on Instance uuid 0d352738-c7bf-42a2-8260-bf5574a7200d {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:13:07.910517 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-16742e93-7360-466f-a15b-bf24d2f11af6 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Checking to see if SCSI volumes sdm, sdl have been removed. {{(pid=98431) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 11 23:13:07.911815 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-16742e93-7360-466f-a15b-bf24d2f11af6 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] SCSI volumes sdm, sdl have been removed. {{(pid=98431) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 11 23:13:07.912753 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-16742e93-7360-466f-a15b-bf24d2f11af6 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Checking to see if device paths {'sdm', 'sdl'} are still under multipathd monitoring {{(pid=98431) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 11 23:13:07.928908 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-16742e93-7360-466f-a15b-bf24d2f11af6 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Device paths {'sdm', 'sdl'} have been removed from multipathd monitoring. {{(pid=98431) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 11 23:13:07.928908 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-16742e93-7360-466f-a15b-bf24d2f11af6 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060')] {{(pid=98431) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 11 23:13:07.944262 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-16742e93-7360-466f-a15b-bf24d2f11af6 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:13:07.988870 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-16742e93-7360-466f-a15b-bf24d2f11af6 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060, portal: 192.168.40.100,3260] Jun 11 23:13:07.988870 np0000002687 nova-compute[98431]: Logout of [sid: 23, target: iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060, portal: 192.168.40.100,3260] successful. Jun 11 23:13:07.988870 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:13:08.010315 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-16742e93-7360-466f-a15b-bf24d2f11af6 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:13:08.032867 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-16742e93-7360-466f-a15b-bf24d2f11af6 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:13:08.055899 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-cf15697d-e9fa-4df4-924f-bf7f269b5c01 req-03692d47-39db-487b-a587-3a11c84b51e9 service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Received event network-changed-a39a55c7-874a-4a19-a069-8383a5f0bc5a {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:13:08.056042 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-cf15697d-e9fa-4df4-924f-bf7f269b5c01 req-03692d47-39db-487b-a587-3a11c84b51e9 service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Refreshing instance network info cache due to event network-changed-a39a55c7-874a-4a19-a069-8383a5f0bc5a. {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 11 23:13:08.056819 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-cf15697d-e9fa-4df4-924f-bf7f269b5c01 req-03692d47-39db-487b-a587-3a11c84b51e9 service nova] Acquiring lock "refresh_cache-1d45c7ce-5760-4f59-9921-feb3e589da8a" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 11 23:13:08.071470 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-16742e93-7360-466f-a15b-bf24d2f11af6 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060, portal: 192.168.50.100,3260] Jun 11 23:13:08.071470 np0000002687 nova-compute[98431]: Logout of [sid: 24, target: iqn.2023-03.storpool.com:os--volume-859ffbad-3fc1-400a-a7f7-ac423851f060, portal: 192.168.50.100,3260] successful. Jun 11 23:13:08.071470 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:13:08.072055 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] [instance: 19beb2a4-b3fe-43e9-ac92-71446c2630ee] Took 18.07 seconds to build instance. Jun 11 23:13:08.095566 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-16742e93-7360-466f-a15b-bf24d2f11af6 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:13:08.096205 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-16742e93-7360-466f-a15b-bf24d2f11af6 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.366s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 11 23:13:08.096614 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-16742e93-7360-466f-a15b-bf24d2f11af6 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] <== disconnect_volume: return (366ms) None {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 11 23:13:08.096861 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16742e93-7360-466f-a15b-bf24d2f11af6 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Disconnected iSCSI Volume {{(pid=98431) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jun 11 23:13:08.159545 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-75be6183-7e6a-4a2a-b0cc-70ba8b47eebd req-d03b56df-1bb3-4caa-b41f-9c25792de9cf service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Updating instance_info_cache with network_info: [] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:13:08.224877 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 19beb2a4-b3fe-43e9-ac92-71446c2630ee] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:13:08.227782 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 19beb2a4-b3fe-43e9-ac92-71446c2630ee] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98431) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 11 23:13:08.292011 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] During sync_power_state the instance has a pending task (resize_finish). Skip. Jun 11 23:13:08.401243 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Attempting a stable device rescue Jun 11 23:13:08.514591 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=98431) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4640}} Jun 11 23:13:08.520390 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Instance directory exists: not creating {{(pid=98431) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5217}} Jun 11 23:13:08.520530 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Creating image(s) Jun 11 23:13:08.521144 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Acquiring lock "/opt/stack/data/nova/instances/0d352738-c7bf-42a2-8260-bf5574a7200d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:08.521315 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lock "/opt/stack/data/nova/instances/0d352738-c7bf-42a2-8260-bf5574a7200d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:08.521795 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lock "/opt/stack/data/nova/instances/0d352738-c7bf-42a2-8260-bf5574a7200d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:08.522015 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lazy-loading 'trusted_certs' on Instance uuid 0d352738-c7bf-42a2-8260-bf5574a7200d {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:13:08.577593 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] Lock "19beb2a4-b3fe-43e9-ac92-71446c2630ee" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 19.594s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:08.662028 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-75be6183-7e6a-4a2a-b0cc-70ba8b47eebd req-d03b56df-1bb3-4caa-b41f-9c25792de9cf service nova] Releasing lock "refresh_cache-1d45c7ce-5760-4f59-9921-feb3e589da8a" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 11 23:13:08.662327 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-75be6183-7e6a-4a2a-b0cc-70ba8b47eebd req-d03b56df-1bb3-4caa-b41f-9c25792de9cf service nova] [instance: 19beb2a4-b3fe-43e9-ac92-71446c2630ee] Received event network-vif-plugged-4c1f7e6e-b361-4522-84d4-5bf89a5eb631 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:13:08.662464 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-75be6183-7e6a-4a2a-b0cc-70ba8b47eebd req-d03b56df-1bb3-4caa-b41f-9c25792de9cf service nova] Acquiring lock "19beb2a4-b3fe-43e9-ac92-71446c2630ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:08.662625 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-75be6183-7e6a-4a2a-b0cc-70ba8b47eebd req-d03b56df-1bb3-4caa-b41f-9c25792de9cf service nova] Lock "19beb2a4-b3fe-43e9-ac92-71446c2630ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:08.665755 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-75be6183-7e6a-4a2a-b0cc-70ba8b47eebd req-d03b56df-1bb3-4caa-b41f-9c25792de9cf service nova] Lock "19beb2a4-b3fe-43e9-ac92-71446c2630ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:08.666388 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-cf15697d-e9fa-4df4-924f-bf7f269b5c01 req-03692d47-39db-487b-a587-3a11c84b51e9 service nova] Acquired lock "refresh_cache-1d45c7ce-5760-4f59-9921-feb3e589da8a" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 11 23:13:08.666388 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-cf15697d-e9fa-4df4-924f-bf7f269b5c01 req-03692d47-39db-487b-a587-3a11c84b51e9 service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Refreshing network info cache for port a39a55c7-874a-4a19-a069-8383a5f0bc5a {{(pid=98431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 11 23:13:08.667521 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-75be6183-7e6a-4a2a-b0cc-70ba8b47eebd req-d03b56df-1bb3-4caa-b41f-9c25792de9cf service nova] [instance: 19beb2a4-b3fe-43e9-ac92-71446c2630ee] No waiting events found dispatching network-vif-plugged-4c1f7e6e-b361-4522-84d4-5bf89a5eb631 {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:13:08.667521 np0000002687 nova-compute[98431]: WARNING nova.compute.manager [req-75be6183-7e6a-4a2a-b0cc-70ba8b47eebd req-d03b56df-1bb3-4caa-b41f-9c25792de9cf service nova] [instance: 19beb2a4-b3fe-43e9-ac92-71446c2630ee] Received unexpected event network-vif-plugged-4c1f7e6e-b361-4522-84d4-5bf89a5eb631 for instance with vm_state building and task_state spawning. Jun 11 23:13:08.696253 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-16742e93-7360-466f-a15b-bf24d2f11af6 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Lazy-loading 'flavor' on Instance uuid cb63f66c-b69e-42b0-805c-be6fe9b3aee3 {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:13:08.730515 np0000002687 nova-compute[98431]: DEBUG nova.utils [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Queued Task(fn=>, remaining_delay=14.999714956000162 future=) {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:13:08.734327 np0000002687 nova-compute[98431]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=14.996661097000015 future=) {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:13:08.734327 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:08.736441 np0000002687 nova-compute[98431]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=14.995128428000044 future=) {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:13:08.806268 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Successfully updated port: 37aa7cee-88a0-4428-9b2d-45700f1dcab6 {{(pid=98431) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 11 23:13:08.911991 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-60a5c753-cef7-4ccd-9fdd-45bc4b83cd71 req-8739fc75-416f-485e-b20a-e7887762910e service nova] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] Received event network-changed-283962f2-faaf-4d85-8eda-9b77b55a5b0c {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:13:08.911991 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-60a5c753-cef7-4ccd-9fdd-45bc4b83cd71 req-8739fc75-416f-485e-b20a-e7887762910e service nova] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] Refreshing instance network info cache due to event network-changed-283962f2-faaf-4d85-8eda-9b77b55a5b0c. {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 11 23:13:08.911991 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-60a5c753-cef7-4ccd-9fdd-45bc4b83cd71 req-8739fc75-416f-485e-b20a-e7887762910e service nova] Acquiring lock "refresh_cache-64d7833a-82e8-43e9-83ed-2507197b69bf" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 11 23:13:08.912260 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-60a5c753-cef7-4ccd-9fdd-45bc4b83cd71 req-8739fc75-416f-485e-b20a-e7887762910e service nova] Acquired lock "refresh_cache-64d7833a-82e8-43e9-83ed-2507197b69bf" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 11 23:13:08.912260 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-60a5c753-cef7-4ccd-9fdd-45bc4b83cd71 req-8739fc75-416f-485e-b20a-e7887762910e service nova] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] Refreshing network info cache for port 283962f2-faaf-4d85-8eda-9b77b55a5b0c {{(pid=98431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 11 23:13:09.024543 np0000002687 nova-compute[98431]: DEBUG nova.objects.base [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Object Instance<0d352738-c7bf-42a2-8260-bf5574a7200d> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=98431) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 11 23:13:09.024925 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Acquiring lock "e386bfba0b3bd9f976cb2c397ddae6656820043e" by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:09.025275 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lock "e386bfba0b3bd9f976cb2c397ddae6656820043e" acquired by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:09.039865 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] No BDM found with device name vda, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:13:09.040009 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:13:09.040101 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] No BDM found with device name hda, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:13:09.040201 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] No VIF found with MAC fa:16:3e:1d:f7:18, not building metadata {{(pid=98431) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13199}} Jun 11 23:13:09.040669 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Using config drive Jun 11 23:13:09.168527 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [req-cf15697d-e9fa-4df4-924f-bf7f269b5c01 req-03692d47-39db-487b-a587-3a11c84b51e9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:13:09.417212 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-cf15697d-e9fa-4df4-924f-bf7f269b5c01 req-03692d47-39db-487b-a587-3a11c84b51e9 service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Instance cache missing network info. {{(pid=98431) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 11 23:13:09.419399 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [req-60a5c753-cef7-4ccd-9fdd-45bc4b83cd71 req-8739fc75-416f-485e-b20a-e7887762910e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:13:09.714834 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-16742e93-7360-466f-a15b-bf24d2f11af6 tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Lock "cb63f66c-b69e-42b0-805c-be6fe9b3aee3" "released" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: held 4.831s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:09.717420 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:09.752702 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:09.755136 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:09.891243 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:09.962536 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:13:09.965915 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:13:09.966308 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e386bfba0b3bd9f976cb2c397ddae6656820043e.part --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:13:10.070695 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e386bfba0b3bd9f976cb2c397ddae6656820043e.part --force-share --output=json" returned: 0 in 0.104s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:13:10.071998 np0000002687 nova-compute[98431]: DEBUG nova.virt.images [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] 1a8d942d-db56-4bd5-90e0-78b53f54426f was qcow2, converting to raw {{(pid=98431) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}} Jun 11 23:13:10.073220 np0000002687 nova-compute[98431]: DEBUG nova.privsep.utils [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98431) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}} Jun 11 23:13:10.074087 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e386bfba0b3bd9f976cb2c397ddae6656820043e.part /opt/stack/data/nova/instances/_base/e386bfba0b3bd9f976cb2c397ddae6656820043e.converted {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:13:10.181249 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e386bfba0b3bd9f976cb2c397ddae6656820043e.part /opt/stack/data/nova/instances/_base/e386bfba0b3bd9f976cb2c397ddae6656820043e.converted" returned: 0 in 0.107s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:13:10.189495 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e386bfba0b3bd9f976cb2c397ddae6656820043e.converted --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:13:10.202945 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:10.222100 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:10.224995 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Successfully updated port: e3269961-a3f1-42c8-a49e-37f728b2f3d8 {{(pid=98431) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 11 23:13:10.244480 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:10.259221 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:10.286878 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e386bfba0b3bd9f976cb2c397ddae6656820043e.converted --force-share --output=json" returned: 0 in 0.097s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:13:10.289560 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lock "e386bfba0b3bd9f976cb2c397ddae6656820043e" "released" by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" :: held 1.264s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:10.291567 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:13:10.296379 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:13:10.297576 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Acquiring lock "e386bfba0b3bd9f976cb2c397ddae6656820043e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:10.298068 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lock "e386bfba0b3bd9f976cb2c397ddae6656820043e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:10.298447 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:13:10.303163 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:13:10.303595 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e386bfba0b3bd9f976cb2c397ddae6656820043e --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:13:10.411794 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e386bfba0b3bd9f976cb2c397ddae6656820043e --force-share --output=json" returned: 0 in 0.108s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:13:10.412220 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e386bfba0b3bd9f976cb2c397ddae6656820043e,backing_fmt=raw /opt/stack/data/nova/instances/0d352738-c7bf-42a2-8260-bf5574a7200d/disk.rescue {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:13:10.483825 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-cf15697d-e9fa-4df4-924f-bf7f269b5c01 req-03692d47-39db-487b-a587-3a11c84b51e9 service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Updating instance_info_cache with network_info: [] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:13:10.485151 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e386bfba0b3bd9f976cb2c397ddae6656820043e,backing_fmt=raw /opt/stack/data/nova/instances/0d352738-c7bf-42a2-8260-bf5574a7200d/disk.rescue" returned: 0 in 0.073s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:13:10.485658 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lock "e386bfba0b3bd9f976cb2c397ddae6656820043e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.188s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:10.485982 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lazy-loading 'migration_context' on Instance uuid 0d352738-c7bf-42a2-8260-bf5574a7200d {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:13:10.581824 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-1bead5b8-f6b8-42f7-bee0-dd13dab84bfc req-bdb16d34-37fd-40d3-a9e9-1ab8ea95ade6 service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Received event network-changed-37aa7cee-88a0-4428-9b2d-45700f1dcab6 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:13:10.581824 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-1bead5b8-f6b8-42f7-bee0-dd13dab84bfc req-bdb16d34-37fd-40d3-a9e9-1ab8ea95ade6 service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Refreshing instance network info cache due to event network-changed-37aa7cee-88a0-4428-9b2d-45700f1dcab6. {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 11 23:13:10.582926 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-1bead5b8-f6b8-42f7-bee0-dd13dab84bfc req-bdb16d34-37fd-40d3-a9e9-1ab8ea95ade6 service nova] Acquiring lock "refresh_cache-1d45c7ce-5760-4f59-9921-feb3e589da8a" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 11 23:13:10.708541 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-74ce3945-e947-4bae-97d5-8f9b1119d6b5 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Acquiring lock "64d7833a-82e8-43e9-83ed-2507197b69bf" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:10.708765 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-74ce3945-e947-4bae-97d5-8f9b1119d6b5 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "64d7833a-82e8-43e9-83ed-2507197b69bf" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:10.750937 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [req-60a5c753-cef7-4ccd-9fdd-45bc4b83cd71 req-8739fc75-416f-485e-b20a-e7887762910e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:13:10.927829 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:10.955782 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Instance event wait completed in 0 seconds for {{(pid=98431) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 11 23:13:10.956103 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Emitting event Resumed> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:13:10.958763 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] VM Resumed (Lifecycle Event) Jun 11 23:13:10.969217 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [-] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Instance running successfully. Jun 11 23:13:10.975147 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.guest [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Failed to set time: agent not configured {{(pid=98431) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:194}} Jun 11 23:13:10.975147 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-01cc83df-0b66-46b1-a052-d6dc04d986c3 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] finish_migration finished successfully. {{(pid=98431) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12898}} Jun 11 23:13:10.989468 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-cf15697d-e9fa-4df4-924f-bf7f269b5c01 req-03692d47-39db-487b-a587-3a11c84b51e9 service nova] Releasing lock "refresh_cache-1d45c7ce-5760-4f59-9921-feb3e589da8a" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 11 23:13:10.994079 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-1bead5b8-f6b8-42f7-bee0-dd13dab84bfc req-bdb16d34-37fd-40d3-a9e9-1ab8ea95ade6 service nova] Acquired lock "refresh_cache-1d45c7ce-5760-4f59-9921-feb3e589da8a" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 11 23:13:10.995974 np0000002687 nova-compute[98431]: DEBUG nova.objects.base [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Object Instance<0d352738-c7bf-42a2-8260-bf5574a7200d> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=98431) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 11 23:13:11.002691 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-1bead5b8-f6b8-42f7-bee0-dd13dab84bfc req-bdb16d34-37fd-40d3-a9e9-1ab8ea95ade6 service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Refreshing network info cache for port 37aa7cee-88a0-4428-9b2d-45700f1dcab6 {{(pid=98431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 11 23:13:11.005723 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Created local disks {{(pid=98431) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}} Jun 11 23:13:11.006614 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Start _get_guest_xml network_info=[{"id": "3c37ff2c-78c4-4423-b4a2-219e94df57ca", "address": "fa:16:3e:8f:ae:21", "network": {"id": "2a770c99-2ec6-4fa2-945b-32830a59e7a7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-137493671-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-137493671-network", "vif_mac": "fa:16:3e:8f:ae:21"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aaf744af828a4a5eba1e98da63373b2b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c37ff2c-78", "ovs_interfaceid": "3c37ff2c-78c4-4423-b4a2-219e94df57ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-11T23:08:20Z,direct_url=,disk_format='qcow2',id=f30640f8-7aca-4300-a085-4706a5209a79,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ce012f9fabdb4ee5a73e212437f59d97',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-11T23:08:23Z,virtual_size=,visibility=) rescue={'image_id': '1a8d942d-db56-4bd5-90e0-78b53f54426f', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'mount_device': '/dev/vda', 'attachment_id': 'cb1a71d5-3b93-4a6e-b283-77ed93198fe1', 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859', 'iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '484c7594-8b2e-4f2d-81d7-bdda56999859', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, 'status': 'reserved', 'instance': '0d352738-c7bf-42a2-8260-bf5574a7200d', 'attached_at': '', 'detached_at': '', 'volume_id': '484c7594-8b2e-4f2d-81d7-bdda56999859', 'serial': '484c7594-8b2e-4f2d-81d7-bdda56999859'}, 'disk_bus': 'virtio', 'delete_on_termination': True, 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=98431) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 11 23:13:11.006887 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lazy-loading 'resources' on Instance uuid 0d352738-c7bf-42a2-8260-bf5574a7200d {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:13:11.098086 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-891351da-3e4e-4770-a9d2-e84eccd2cf16 req-351cc8b6-9b31-4b41-b61f-9bba89ca1e44 service nova] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Received event network-vif-plugged-a1e7aeff-5992-43be-bb2c-d504e7019c64 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:13:11.098952 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-891351da-3e4e-4770-a9d2-e84eccd2cf16 req-351cc8b6-9b31-4b41-b61f-9bba89ca1e44 service nova] Acquiring lock "7609742e-a3a2-4be2-ba02-227efb2101e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:11.099504 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-891351da-3e4e-4770-a9d2-e84eccd2cf16 req-351cc8b6-9b31-4b41-b61f-9bba89ca1e44 service nova] Lock "7609742e-a3a2-4be2-ba02-227efb2101e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:11.099712 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-891351da-3e4e-4770-a9d2-e84eccd2cf16 req-351cc8b6-9b31-4b41-b61f-9bba89ca1e44 service nova] Lock "7609742e-a3a2-4be2-ba02-227efb2101e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:11.099883 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-891351da-3e4e-4770-a9d2-e84eccd2cf16 req-351cc8b6-9b31-4b41-b61f-9bba89ca1e44 service nova] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] No waiting events found dispatching network-vif-plugged-a1e7aeff-5992-43be-bb2c-d504e7019c64 {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:13:11.100067 np0000002687 nova-compute[98431]: WARNING nova.compute.manager [req-891351da-3e4e-4770-a9d2-e84eccd2cf16 req-351cc8b6-9b31-4b41-b61f-9bba89ca1e44 service nova] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Received unexpected event network-vif-plugged-a1e7aeff-5992-43be-bb2c-d504e7019c64 for instance with vm_state active and task_state resize_finish. Jun 11 23:13:11.100210 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-891351da-3e4e-4770-a9d2-e84eccd2cf16 req-351cc8b6-9b31-4b41-b61f-9bba89ca1e44 service nova] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Received event network-vif-plugged-a1e7aeff-5992-43be-bb2c-d504e7019c64 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:13:11.100418 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-891351da-3e4e-4770-a9d2-e84eccd2cf16 req-351cc8b6-9b31-4b41-b61f-9bba89ca1e44 service nova] Acquiring lock "7609742e-a3a2-4be2-ba02-227efb2101e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:11.100616 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-891351da-3e4e-4770-a9d2-e84eccd2cf16 req-351cc8b6-9b31-4b41-b61f-9bba89ca1e44 service nova] Lock "7609742e-a3a2-4be2-ba02-227efb2101e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:11.100756 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-891351da-3e4e-4770-a9d2-e84eccd2cf16 req-351cc8b6-9b31-4b41-b61f-9bba89ca1e44 service nova] Lock "7609742e-a3a2-4be2-ba02-227efb2101e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:11.100934 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-891351da-3e4e-4770-a9d2-e84eccd2cf16 req-351cc8b6-9b31-4b41-b61f-9bba89ca1e44 service nova] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] No waiting events found dispatching network-vif-plugged-a1e7aeff-5992-43be-bb2c-d504e7019c64 {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:13:11.101275 np0000002687 nova-compute[98431]: WARNING nova.compute.manager [req-891351da-3e4e-4770-a9d2-e84eccd2cf16 req-351cc8b6-9b31-4b41-b61f-9bba89ca1e44 service nova] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Received unexpected event network-vif-plugged-a1e7aeff-5992-43be-bb2c-d504e7019c64 for instance with vm_state active and task_state resize_finish. Jun 11 23:13:11.219481 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-74ce3945-e947-4bae-97d5-8f9b1119d6b5 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lazy-loading 'flavor' on Instance uuid 64d7833a-82e8-43e9-83ed-2507197b69bf {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:13:11.465305 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:13:11.467320 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=98431) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 11 23:13:11.516303 np0000002687 nova-compute[98431]: DEBUG nova.objects.base [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Object Instance<0d352738-c7bf-42a2-8260-bf5574a7200d> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=98431) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 11 23:13:11.518371 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [req-1bead5b8-f6b8-42f7-bee0-dd13dab84bfc req-bdb16d34-37fd-40d3-a9e9-1ab8ea95ade6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:13:11.532853 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-f5716233-3f0d-42a6-bd7c-91c2397637ee tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Acquiring lock "cb63f66c-b69e-42b0-805c-be6fe9b3aee3" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:11.532853 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-f5716233-3f0d-42a6-bd7c-91c2397637ee tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Lock "cb63f66c-b69e-42b0-805c-be6fe9b3aee3" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:11.532853 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-f5716233-3f0d-42a6-bd7c-91c2397637ee tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Acquiring lock "cb63f66c-b69e-42b0-805c-be6fe9b3aee3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:11.532853 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-f5716233-3f0d-42a6-bd7c-91c2397637ee tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Lock "cb63f66c-b69e-42b0-805c-be6fe9b3aee3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:11.532853 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-f5716233-3f0d-42a6-bd7c-91c2397637ee tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Lock "cb63f66c-b69e-42b0-805c-be6fe9b3aee3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:11.532853 np0000002687 nova-compute[98431]: WARNING nova.virt.libvirt.driver [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 11 23:13:11.532853 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='f30640f8-7aca-4300-a085-4706a5209a79', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-916877464', uuid='0d352738-c7bf-42a2-8260-bf5574a7200d'), owner=OwnerMeta(userid='72b6dac5eb744cfba6299636227aa59b', username='tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member', projectid='aaf744af828a4a5eba1e98da63373b2b', projectname='tempest-ServerBootFromVolumeStableRescueTest-539499192'), image=ImageMeta(id='f30640f8-7aca-4300-a085-4706a5209a79', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "3c37ff2c-78c4-4423-b4a2-219e94df57ca", "address": "fa:16:3e:8f:ae:21", "network": {"id": "2a770c99-2ec6-4fa2-945b-32830a59e7a7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-137493671-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-137493671-network", "vif_mac": "fa:16:3e:8f:ae:21"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aaf744af828a4a5eba1e98da63373b2b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c37ff2c-78", "ovs_interfaceid": "3c37ff2c-78c4-4423-b4a2-219e94df57ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1781219591.5303395) {{(pid=98431) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 11 23:13:11.533887 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-f5716233-3f0d-42a6-bd7c-91c2397637ee tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Terminating instance Jun 11 23:13:11.536471 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Searching host: 'np0000002687' for CPU controller through CGroups V1... {{(pid=98431) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 11 23:13:11.536897 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] CPU controller missing on host. {{(pid=98431) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 11 23:13:11.541270 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Searching host: 'np0000002687' for CPU controller through CGroups V2... {{(pid=98431) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 11 23:13:11.541466 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] CPU controller found on host. {{(pid=98431) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 11 23:13:11.542478 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98431) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 11 23:13:11.542815 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-11T23:08:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-11T23:08:20Z,direct_url=,disk_format='qcow2',id=f30640f8-7aca-4300-a085-4706a5209a79,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ce012f9fabdb4ee5a73e212437f59d97',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-11T23:08:23Z,virtual_size=,visibility=), allow threads: True {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 11 23:13:11.543205 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Flavor limits 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 11 23:13:11.543205 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Image limits 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 11 23:13:11.543205 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Flavor pref 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 11 23:13:11.543310 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Image pref 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 11 23:13:11.543338 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 11 23:13:11.543475 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 11 23:13:11.543571 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98431) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 11 23:13:11.543683 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Got 1 possible topologies {{(pid=98431) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 11 23:13:11.543771 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 11 23:13:11.549637 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 11 23:13:11.551034 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0d352738-c7bf-42a2-8260-bf5574a7200d {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:13:11.573219 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:11.578727 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Successfully updated port: 351eaad5-bf70-43b4-8f79-5bc0027de663 {{(pid=98431) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 11 23:13:11.780998 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-60a5c753-cef7-4ccd-9fdd-45bc4b83cd71 req-8739fc75-416f-485e-b20a-e7887762910e service nova] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] Updated VIF entry in instance network info cache for port 283962f2-faaf-4d85-8eda-9b77b55a5b0c. {{(pid=98431) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 11 23:13:11.780998 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-60a5c753-cef7-4ccd-9fdd-45bc4b83cd71 req-8739fc75-416f-485e-b20a-e7887762910e service nova] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] Updating instance_info_cache with network_info: [{"id": "283962f2-faaf-4d85-8eda-9b77b55a5b0c", "address": "fa:16:3e:4b:26:95", "network": {"id": "17593db3-c22d-4354-ab29-933b1c6a5c3a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1094286565-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "81fd45f475a04e5c8e9bd9deb7ad4c1e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap283962f2-fa", "ovs_interfaceid": "283962f2-faaf-4d85-8eda-9b77b55a5b0c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:13:11.829543 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-1bead5b8-f6b8-42f7-bee0-dd13dab84bfc req-bdb16d34-37fd-40d3-a9e9-1ab8ea95ade6 service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Instance cache missing network info. {{(pid=98431) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 11 23:13:11.971984 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] During sync_power_state the instance has a pending task (resize_finish). Skip. Jun 11 23:13:11.972213 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Emitting event Started> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:13:11.972318 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] VM Started (Lifecycle Event) Jun 11 23:13:12.043768 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-1bead5b8-f6b8-42f7-bee0-dd13dab84bfc req-bdb16d34-37fd-40d3-a9e9-1ab8ea95ade6 service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Updating instance_info_cache with network_info: [] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:13:12.052475 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-f5716233-3f0d-42a6-bd7c-91c2397637ee tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Start destroying the instance on the hypervisor. {{(pid=98431) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}} Jun 11 23:13:12.062238 np0000002687 nova-compute[98431]: DEBUG nova.objects.base [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Object Instance<0d352738-c7bf-42a2-8260-bf5574a7200d> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=98431) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 11 23:13:12.083479 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:12.096358 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d352738-c7bf-42a2-8260-bf5574a7200d/disk.config --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:13:12.143945 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:12.161023 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:12.165999 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:12.217248 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d352738-c7bf-42a2-8260-bf5574a7200d/disk.config --force-share --output=json" returned: 0 in 0.121s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:13:12.218834 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Acquiring lock "/opt/stack/data/nova/instances/0d352738-c7bf-42a2-8260-bf5574a7200d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:12.218834 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lock "/opt/stack/data/nova/instances/0d352738-c7bf-42a2-8260-bf5574a7200d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:12.219359 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lock "/opt/stack/data/nova/instances/0d352738-c7bf-42a2-8260-bf5574a7200d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:12.219959 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Calling os-brick to attach iSCSI Volume {{(pid=98431) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 11 23:13:12.220444 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859', 'iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '484c7594-8b2e-4f2d-81d7-bdda56999859', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}}" {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 11 23:13:12.220730 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 11 23:13:12.221201 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 11 23:13:12.221696 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859', 'iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '484c7594-8b2e-4f2d-81d7-bdda56999859', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'} {{(pid=98431) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 11 23:13:12.227023 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-74ce3945-e947-4bae-97d5-8f9b1119d6b5 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "64d7833a-82e8-43e9-83ed-2507197b69bf" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.518s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:12.239876 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 11 23:13:12.240428 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 11 23:13:12.240946 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 11 23:13:12.240946 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.iscsi [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 11 23:13:12.241843 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 11 23:13:12.241843 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.iscsi [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 11 23:13:12.256835 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 11 23:13:12.256835 np0000002687 nova-compute[98431]: node.name = iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 Jun 11 23:13:12.256835 np0000002687 nova-compute[98431]: node.tpgt = -1 Jun 11 23:13:12.256835 np0000002687 nova-compute[98431]: node.startup = automatic Jun 11 23:13:12.256835 np0000002687 nova-compute[98431]: node.leading_login = No Jun 11 23:13:12.256835 np0000002687 nova-compute[98431]: iface.iscsi_ifacename = default Jun 11 23:13:12.256835 np0000002687 nova-compute[98431]: iface.net_ifacename = Jun 11 23:13:12.256835 np0000002687 nova-compute[98431]: iface.ipaddress = Jun 11 23:13:12.256835 np0000002687 nova-compute[98431]: iface.prefix_len = 0 Jun 11 23:13:12.256835 np0000002687 nova-compute[98431]: iface.hwaddress = Jun 11 23:13:12.256835 np0000002687 nova-compute[98431]: iface.transport_name = tcp Jun 11 23:13:12.256835 np0000002687 nova-compute[98431]: iface.initiatorname = Jun 11 23:13:12.256835 np0000002687 nova-compute[98431]: iface.state = Jun 11 23:13:12.256835 np0000002687 nova-compute[98431]: iface.vlan_id = 0 Jun 11 23:13:12.256835 np0000002687 nova-compute[98431]: iface.vlan_priority = 0 Jun 11 23:13:12.256835 np0000002687 nova-compute[98431]: iface.vlan_state = Jun 11 23:13:12.256835 np0000002687 nova-compute[98431]: iface.iface_num = 0 Jun 11 23:13:12.256835 np0000002687 nova-compute[98431]: iface.mtu = 0 Jun 11 23:13:12.256835 np0000002687 nova-compute[98431]: iface.port = 0 Jun 11 23:13:12.256835 np0000002687 nova-compute[98431]: iface.bootproto = Jun 11 23:13:12.256835 np0000002687 nova-compute[98431]: iface.subnet_mask = Jun 11 23:13:12.256835 np0000002687 nova-compute[98431]: iface.gateway = Jun 11 23:13:12.256835 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id_state = Jun 11 23:13:12.256835 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id = Jun 11 23:13:12.256835 np0000002687 nova-compute[98431]: iface.dhcp_dns = Jun 11 23:13:12.256835 np0000002687 nova-compute[98431]: iface.dhcp_learn_iqn = Jun 11 23:13:12.256835 np0000002687 nova-compute[98431]: iface.dhcp_req_vendor_id_state = Jun 11 23:13:12.256835 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id_state = Jun 11 23:13:12.256835 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id = Jun 11 23:13:12.256835 np0000002687 nova-compute[98431]: iface.dhcp_slp_da = Jun 11 23:13:12.256835 np0000002687 nova-compute[98431]: iface.fragmentation = Jun 11 23:13:12.256835 np0000002687 nova-compute[98431]: iface.gratuitous_arp = Jun 11 23:13:12.256835 np0000002687 nova-compute[98431]: iface.incoming_forwarding = Jun 11 23:13:12.256835 np0000002687 nova-compute[98431]: iface.tos_state = Jun 11 23:13:12.256835 np0000002687 nova-compute[98431]: iface.tos = 0 Jun 11 23:13:12.256835 np0000002687 nova-compute[98431]: iface.ttl = 0 Jun 11 23:13:12.256835 np0000002687 nova-compute[98431]: iface.delayed_ack = Jun 11 23:13:12.256835 np0000002687 nova-compute[98431]: iface.tcp_nagle = Jun 11 23:13:12.256835 np0000002687 nova-compute[98431]: iface.tcp_wsf_state = Jun 11 23:13:12.256835 np0000002687 nova-compute[98431]: iface.tcp_wsf = 0 Jun 11 23:13:12.256835 np0000002687 nova-compute[98431]: iface.tcp_timer_scale = 0 Jun 11 23:13:12.256835 np0000002687 nova-compute[98431]: iface.tcp_timestamp = Jun 11 23:13:12.256835 np0000002687 nova-compute[98431]: iface.redirect = Jun 11 23:13:12.256835 np0000002687 nova-compute[98431]: iface.def_task_mgmt_timeout = 0 Jun 11 23:13:12.256835 np0000002687 nova-compute[98431]: iface.header_digest = Jun 11 23:13:12.256835 np0000002687 nova-compute[98431]: iface.data_digest = Jun 11 23:13:12.256835 np0000002687 nova-compute[98431]: iface.immediate_data = Jun 11 23:13:12.256835 np0000002687 nova-compute[98431]: iface.initial_r2t = Jun 11 23:13:12.256835 np0000002687 nova-compute[98431]: iface.data_seq_inorder = Jun 11 23:13:12.256835 np0000002687 nova-compute[98431]: iface.data_pdu_inorder = Jun 11 23:13:12.256835 np0000002687 nova-compute[98431]: iface.erl = 0 Jun 11 23:13:12.256835 np0000002687 nova-compute[98431]: iface.max_receive_data_len = 0 Jun 11 23:13:12.256835 np0000002687 nova-compute[98431]: iface.first_burst_len = 0 Jun 11 23:13:12.256835 np0000002687 nova-compute[98431]: iface.max_outstanding_r2t = 0 Jun 11 23:13:12.256835 np0000002687 nova-compute[98431]: iface.max_burst_len = 0 Jun 11 23:13:12.256835 np0000002687 nova-compute[98431]: iface.chap_auth = Jun 11 23:13:12.256835 np0000002687 nova-compute[98431]: iface.bidi_chap = Jun 11 23:13:12.256835 np0000002687 nova-compute[98431]: iface.strict_login_compliance = Jun 11 23:13:12.256835 np0000002687 nova-compute[98431]: iface.discovery_auth = Jun 11 23:13:12.256835 np0000002687 nova-compute[98431]: iface.discovery_logout = Jun 11 23:13:12.256835 np0000002687 nova-compute[98431]: node.discovery_address = Jun 11 23:13:12.256835 np0000002687 nova-compute[98431]: node.discovery_port = 0 Jun 11 23:13:12.256835 np0000002687 nova-compute[98431]: node.discovery_type = fw Jun 11 23:13:12.256835 np0000002687 nova-compute[98431]: node.session.initial_cmdsn = 0 Jun 11 23:13:12.256835 np0000002687 nova-compute[98431]: node.session.initial_login_retry_max = 8 Jun 11 23:13:12.256835 np0000002687 nova-compute[98431]: node.session.xmit_thread_priority = 0 Jun 11 23:13:12.256835 np0000002687 nova-compute[98431]: node.session.cmds_max = 128 Jun 11 23:13:12.256835 np0000002687 nova-compute[98431]: node.session.queue_depth = 32 Jun 11 23:13:12.256835 np0000002687 nova-compute[98431]: node.session.nr_sessions = 1 Jun 11 23:13:12.256835 np0000002687 nova-compute[98431]: node.session.auth.authmethod = None Jun 11 23:13:12.256835 np0000002687 nova-compute[98431]: node.session.auth.username = Jun 11 23:13:12.256835 np0000002687 nova-compute[98431]: node.session.auth.password = *** Jun 11 23:13:12.256835 np0000002687 nova-compute[98431]: node.session.auth.username_in = Jun 11 23:13:12.256835 np0000002687 nova-compute[98431]: node.session.auth.password_in = Jun 11 23:13:12.256835 np0000002687 nova-compute[98431]: node.session.auth.chap_algs = SHA256 Jun 11 23:13:12.256835 np0000002687 nova-compute[98431]: node.session.timeo.replacement_timeout = 120 Jun 11 23:13:12.256835 np0000002687 nova-compute[98431]: node.session.err_timeo.abort_timeout = 15 Jun 11 23:13:12.256835 np0000002687 nova-compute[98431]: node.session.err_timeo.lu_reset_timeout = 30 Jun 11 23:13:12.256835 np0000002687 nova-compute[98431]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 11 23:13:12.256835 np0000002687 nova-compute[98431]: node.session.err_timeo.host_reset_timeout = 60 Jun 11 23:13:12.256835 np0000002687 nova-compute[98431]: node.session.iscsi.FastAbort = Yes Jun 11 23:13:12.256835 np0000002687 nova-compute[98431]: node.session.iscsi.InitialR2T = No Jun 11 23:13:12.256835 np0000002687 nova-compute[98431]: node.session.iscsi.ImmediateData = Yes Jun 11 23:13:12.256835 np0000002687 nova-compute[98431]: node.session.iscsi.FirstBurstLength = 262144 Jun 11 23:13:12.256835 np0000002687 nova-compute[98431]: node.session.iscsi.MaxBurstLength = 16776192 Jun 11 23:13:12.256835 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Retain = 0 Jun 11 23:13:12.256835 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Wait = 2 Jun 11 23:13:12.256835 np0000002687 nova-compute[98431]: node.session.iscsi.MaxConnections = 1 Jun 11 23:13:12.256835 np0000002687 nova-compute[98431]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 11 23:13:12.256835 np0000002687 nova-compute[98431]: node.session.iscsi.ERL = 0 Jun 11 23:13:12.256835 np0000002687 nova-compute[98431]: node.session.scan = manual Jun 11 23:13:12.256835 np0000002687 nova-compute[98431]: node.session.reopen_max = 0 Jun 11 23:13:12.256835 np0000002687 nova-compute[98431]: node.conn[0].address = 192.168.40.100 Jun 11 23:13:12.256835 np0000002687 nova-compute[98431]: node.conn[0].port = 3260 Jun 11 23:13:12.256835 np0000002687 nova-compute[98431]: node.conn[0].startup = manual Jun 11 23:13:12.256835 np0000002687 nova-compute[98431]: node.conn[0].tcp.window_size = 524288 Jun 11 23:13:12.256835 np0000002687 nova-compute[98431]: node.conn[0].tcp.type_of_service = 0 Jun 11 23:13:12.256835 np0000002687 nova-compute[98431]: node.conn[0].timeo.logout_timeout = 15 Jun 11 23:13:12.256835 np0000002687 nova-compute[98431]: node.conn[0].timeo.login_timeout = 15 Jun 11 23:13:12.256835 np0000002687 nova-compute[98431]: node.conn[0].timeo.auth_timeout = 45 Jun 11 23:13:12.256835 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_interval = 5 Jun 11 23:13:12.256835 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_timeout = 5 Jun 11 23:13:12.256835 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 11 23:13:12.256835 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 11 23:13:12.256835 np0000002687 nova-compute[98431]: node.conn[0].iscsi.HeaderDigest = None Jun 11 23:13:12.256835 np0000002687 nova-compute[98431]: node.conn[0].iscsi.DataDigest = None Jun 11 23:13:12.256835 np0000002687 nova-compute[98431]: node.conn[0].iscsi.IFMarker = No Jun 11 23:13:12.256835 np0000002687 nova-compute[98431]: node.conn[0].iscsi.OFMarker = No Jun 11 23:13:12.256835 np0000002687 nova-compute[98431]: # END RECORD Jun 11 23:13:12.256835 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:13:12.266409 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 11 23:13:12.266409 np0000002687 nova-compute[98431]: node.name = iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 Jun 11 23:13:12.266409 np0000002687 nova-compute[98431]: node.tpgt = -1 Jun 11 23:13:12.266409 np0000002687 nova-compute[98431]: node.startup = automatic Jun 11 23:13:12.266409 np0000002687 nova-compute[98431]: node.leading_login = No Jun 11 23:13:12.266409 np0000002687 nova-compute[98431]: iface.iscsi_ifacename = default Jun 11 23:13:12.266409 np0000002687 nova-compute[98431]: iface.net_ifacename = Jun 11 23:13:12.266409 np0000002687 nova-compute[98431]: iface.ipaddress = Jun 11 23:13:12.266409 np0000002687 nova-compute[98431]: iface.prefix_len = 0 Jun 11 23:13:12.266409 np0000002687 nova-compute[98431]: iface.hwaddress = Jun 11 23:13:12.266409 np0000002687 nova-compute[98431]: iface.transport_name = tcp Jun 11 23:13:12.266409 np0000002687 nova-compute[98431]: iface.initiatorname = Jun 11 23:13:12.266409 np0000002687 nova-compute[98431]: iface.state = Jun 11 23:13:12.266409 np0000002687 nova-compute[98431]: iface.vlan_id = 0 Jun 11 23:13:12.266409 np0000002687 nova-compute[98431]: iface.vlan_priority = 0 Jun 11 23:13:12.266409 np0000002687 nova-compute[98431]: iface.vlan_state = Jun 11 23:13:12.266409 np0000002687 nova-compute[98431]: iface.iface_num = 0 Jun 11 23:13:12.266409 np0000002687 nova-compute[98431]: iface.mtu = 0 Jun 11 23:13:12.266409 np0000002687 nova-compute[98431]: iface.port = 0 Jun 11 23:13:12.266409 np0000002687 nova-compute[98431]: iface.bootproto = Jun 11 23:13:12.266409 np0000002687 nova-compute[98431]: iface.subnet_mask = Jun 11 23:13:12.266409 np0000002687 nova-compute[98431]: iface.gateway = Jun 11 23:13:12.266409 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id_state = Jun 11 23:13:12.266409 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id = Jun 11 23:13:12.266409 np0000002687 nova-compute[98431]: iface.dhcp_dns = Jun 11 23:13:12.266409 np0000002687 nova-compute[98431]: iface.dhcp_learn_iqn = Jun 11 23:13:12.266409 np0000002687 nova-compute[98431]: iface.dhcp_req_vendor_id_state = Jun 11 23:13:12.266409 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id_state = Jun 11 23:13:12.266409 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id = Jun 11 23:13:12.266409 np0000002687 nova-compute[98431]: iface.dhcp_slp_da = Jun 11 23:13:12.266409 np0000002687 nova-compute[98431]: iface.fragmentation = Jun 11 23:13:12.266409 np0000002687 nova-compute[98431]: iface.gratuitous_arp = Jun 11 23:13:12.266409 np0000002687 nova-compute[98431]: iface.incoming_forwarding = Jun 11 23:13:12.266409 np0000002687 nova-compute[98431]: iface.tos_state = Jun 11 23:13:12.266409 np0000002687 nova-compute[98431]: iface.tos = 0 Jun 11 23:13:12.266409 np0000002687 nova-compute[98431]: iface.ttl = 0 Jun 11 23:13:12.266409 np0000002687 nova-compute[98431]: iface.delayed_ack = Jun 11 23:13:12.266409 np0000002687 nova-compute[98431]: iface.tcp_nagle = Jun 11 23:13:12.266409 np0000002687 nova-compute[98431]: iface.tcp_wsf_state = Jun 11 23:13:12.266409 np0000002687 nova-compute[98431]: iface.tcp_wsf = 0 Jun 11 23:13:12.266409 np0000002687 nova-compute[98431]: iface.tcp_timer_scale = 0 Jun 11 23:13:12.266409 np0000002687 nova-compute[98431]: iface.tcp_timestamp = Jun 11 23:13:12.266409 np0000002687 nova-compute[98431]: iface.redirect = Jun 11 23:13:12.266409 np0000002687 nova-compute[98431]: iface.def_task_mgmt_timeout = 0 Jun 11 23:13:12.266409 np0000002687 nova-compute[98431]: iface.header_digest = Jun 11 23:13:12.266409 np0000002687 nova-compute[98431]: iface.data_digest = Jun 11 23:13:12.266409 np0000002687 nova-compute[98431]: iface.immediate_data = Jun 11 23:13:12.266409 np0000002687 nova-compute[98431]: iface.initial_r2t = Jun 11 23:13:12.266409 np0000002687 nova-compute[98431]: iface.data_seq_inorder = Jun 11 23:13:12.266409 np0000002687 nova-compute[98431]: iface.data_pdu_inorder = Jun 11 23:13:12.266409 np0000002687 nova-compute[98431]: iface.erl = 0 Jun 11 23:13:12.266409 np0000002687 nova-compute[98431]: iface.max_receive_data_len = 0 Jun 11 23:13:12.266409 np0000002687 nova-compute[98431]: iface.first_burst_len = 0 Jun 11 23:13:12.266409 np0000002687 nova-compute[98431]: iface.max_outstanding_r2t = 0 Jun 11 23:13:12.266409 np0000002687 nova-compute[98431]: iface.max_burst_len = 0 Jun 11 23:13:12.266409 np0000002687 nova-compute[98431]: iface.chap_auth = Jun 11 23:13:12.266409 np0000002687 nova-compute[98431]: iface.bidi_chap = Jun 11 23:13:12.266409 np0000002687 nova-compute[98431]: iface.strict_login_compliance = Jun 11 23:13:12.266409 np0000002687 nova-compute[98431]: iface.discovery_auth = Jun 11 23:13:12.266409 np0000002687 nova-compute[98431]: iface.discovery_logout = Jun 11 23:13:12.266409 np0000002687 nova-compute[98431]: node.discovery_address = Jun 11 23:13:12.266409 np0000002687 nova-compute[98431]: node.discovery_port = 0 Jun 11 23:13:12.266409 np0000002687 nova-compute[98431]: node.discovery_type = fw Jun 11 23:13:12.266409 np0000002687 nova-compute[98431]: node.session.initial_cmdsn = 0 Jun 11 23:13:12.266409 np0000002687 nova-compute[98431]: node.session.initial_login_retry_max = 8 Jun 11 23:13:12.266409 np0000002687 nova-compute[98431]: node.session.xmit_thread_priority = 0 Jun 11 23:13:12.266409 np0000002687 nova-compute[98431]: node.session.cmds_max = 128 Jun 11 23:13:12.266409 np0000002687 nova-compute[98431]: node.session.queue_depth = 32 Jun 11 23:13:12.266409 np0000002687 nova-compute[98431]: node.session.nr_sessions = 1 Jun 11 23:13:12.266409 np0000002687 nova-compute[98431]: node.session.auth.authmethod = None Jun 11 23:13:12.266409 np0000002687 nova-compute[98431]: node.session.auth.username = Jun 11 23:13:12.266409 np0000002687 nova-compute[98431]: node.session.auth.password = *** Jun 11 23:13:12.266409 np0000002687 nova-compute[98431]: node.session.auth.username_in = Jun 11 23:13:12.266409 np0000002687 nova-compute[98431]: node.session.auth.password_in = Jun 11 23:13:12.266409 np0000002687 nova-compute[98431]: node.session.auth.chap_algs = SHA256 Jun 11 23:13:12.266409 np0000002687 nova-compute[98431]: node.session.timeo.replacement_timeout = 120 Jun 11 23:13:12.266409 np0000002687 nova-compute[98431]: node.session.err_timeo.abort_timeout = 15 Jun 11 23:13:12.266409 np0000002687 nova-compute[98431]: node.session.err_timeo.lu_reset_timeout = 30 Jun 11 23:13:12.266409 np0000002687 nova-compute[98431]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 11 23:13:12.266409 np0000002687 nova-compute[98431]: node.session.err_timeo.host_reset_timeout = 60 Jun 11 23:13:12.266409 np0000002687 nova-compute[98431]: node.session.iscsi.FastAbort = Yes Jun 11 23:13:12.266409 np0000002687 nova-compute[98431]: node.session.iscsi.InitialR2T = No Jun 11 23:13:12.266409 np0000002687 nova-compute[98431]: node.session.iscsi.ImmediateData = Yes Jun 11 23:13:12.266409 np0000002687 nova-compute[98431]: node.session.iscsi.FirstBurstLength = 262144 Jun 11 23:13:12.266409 np0000002687 nova-compute[98431]: node.session.iscsi.MaxBurstLength = 16776192 Jun 11 23:13:12.266409 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Retain = 0 Jun 11 23:13:12.266409 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Wait = 2 Jun 11 23:13:12.266409 np0000002687 nova-compute[98431]: node.session.iscsi.MaxConnections = 1 Jun 11 23:13:12.266409 np0000002687 nova-compute[98431]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 11 23:13:12.266409 np0000002687 nova-compute[98431]: node.session.iscsi.ERL = 0 Jun 11 23:13:12.266409 np0000002687 nova-compute[98431]: node.session.scan = manual Jun 11 23:13:12.266409 np0000002687 nova-compute[98431]: node.session.reopen_max = 0 Jun 11 23:13:12.266409 np0000002687 nova-compute[98431]: node.conn[0].address = 192.168.50.100 Jun 11 23:13:12.266409 np0000002687 nova-compute[98431]: node.conn[0].port = 3260 Jun 11 23:13:12.266409 np0000002687 nova-compute[98431]: node.conn[0].startup = manual Jun 11 23:13:12.266409 np0000002687 nova-compute[98431]: node.conn[0].tcp.window_size = 524288 Jun 11 23:13:12.266409 np0000002687 nova-compute[98431]: node.conn[0].tcp.type_of_service = 0 Jun 11 23:13:12.266409 np0000002687 nova-compute[98431]: node.conn[0].timeo.logout_timeout = 15 Jun 11 23:13:12.266409 np0000002687 nova-compute[98431]: node.conn[0].timeo.login_timeout = 15 Jun 11 23:13:12.266409 np0000002687 nova-compute[98431]: node.conn[0].timeo.auth_timeout = 45 Jun 11 23:13:12.266409 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_interval = 5 Jun 11 23:13:12.266409 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_timeout = 5 Jun 11 23:13:12.266409 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 11 23:13:12.266409 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 11 23:13:12.266409 np0000002687 nova-compute[98431]: node.conn[0].iscsi.HeaderDigest = None Jun 11 23:13:12.266409 np0000002687 nova-compute[98431]: node.conn[0].iscsi.DataDigest = None Jun 11 23:13:12.266409 np0000002687 nova-compute[98431]: node.conn[0].iscsi.IFMarker = No Jun 11 23:13:12.266409 np0000002687 nova-compute[98431]: node.conn[0].iscsi.OFMarker = No Jun 11 23:13:12.266409 np0000002687 nova-compute[98431]: # END RECORD Jun 11 23:13:12.266409 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:13:12.275982 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:13:12.283305 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-60a5c753-cef7-4ccd-9fdd-45bc4b83cd71 req-8739fc75-416f-485e-b20a-e7887762910e service nova] Releasing lock "refresh_cache-64d7833a-82e8-43e9-83ed-2507197b69bf" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 11 23:13:12.283573 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-60a5c753-cef7-4ccd-9fdd-45bc4b83cd71 req-8739fc75-416f-485e-b20a-e7887762910e service nova] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] Received event network-changed-3c04202e-5ce6-4249-ba31-be06996ca75d {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:13:12.283726 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-60a5c753-cef7-4ccd-9fdd-45bc4b83cd71 req-8739fc75-416f-485e-b20a-e7887762910e service nova] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] Refreshing instance network info cache due to event network-changed-3c04202e-5ce6-4249-ba31-be06996ca75d. {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 11 23:13:12.283930 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-60a5c753-cef7-4ccd-9fdd-45bc4b83cd71 req-8739fc75-416f-485e-b20a-e7887762910e service nova] Acquiring lock "refresh_cache-8a45e04f-3516-4c39-bea1-820104411f17" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 11 23:13:12.284045 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-60a5c753-cef7-4ccd-9fdd-45bc4b83cd71 req-8739fc75-416f-485e-b20a-e7887762910e service nova] Acquired lock "refresh_cache-8a45e04f-3516-4c39-bea1-820104411f17" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 11 23:13:12.284309 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-60a5c753-cef7-4ccd-9fdd-45bc4b83cd71 req-8739fc75-416f-485e-b20a-e7887762910e service nova] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] Refreshing network info cache for port 3c04202e-5ce6-4249-ba31-be06996ca75d {{(pid=98431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 11 23:13:12.288086 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:13:12.296905 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:12.296905 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:12.296905 np0000002687 nova-compute[98431]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:13:12.296905 np0000002687 nova-compute[98431]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:13:12.296905 np0000002687 nova-compute[98431]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979 (non-flash) Jun 11 23:13:12.296905 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:12.296905 np0000002687 nova-compute[98431]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979 (non-flash) Jun 11 23:13:12.296905 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:12.296905 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:13:12.298715 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] iscsi session list stdout=tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:12.298715 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:12.298715 np0000002687 nova-compute[98431]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:13:12.298715 np0000002687 nova-compute[98431]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:13:12.298715 np0000002687 nova-compute[98431]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979 (non-flash) Jun 11 23:13:12.298715 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:12.298715 np0000002687 nova-compute[98431]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979 (non-flash) Jun 11 23:13:12.298715 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:12.298715 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:13:12.298715 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.057s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 11 23:13:12.298715 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Connected to 192.168.40.100:3260 {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 11 23:13:12.298715 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] HCTL ('12', '0', '0', 0) found on session 28 with lun 0 {{(pid=98431) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 11 23:13:12.298715 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Scanning host 12 c: 0, t: 0, l: 0) {{(pid=98431) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 11 23:13:12.312652 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:12.312652 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:12.312652 np0000002687 nova-compute[98431]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:13:12.312652 np0000002687 nova-compute[98431]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:13:12.312652 np0000002687 nova-compute[98431]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979 (non-flash) Jun 11 23:13:12.312652 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:12.312652 np0000002687 nova-compute[98431]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979 (non-flash) Jun 11 23:13:12.312652 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:12.312652 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:13:12.312652 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] iscsi session list stdout=tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:12.312652 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:12.312652 np0000002687 nova-compute[98431]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:13:12.312652 np0000002687 nova-compute[98431]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:13:12.312652 np0000002687 nova-compute[98431]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979 (non-flash) Jun 11 23:13:12.312652 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:12.312652 np0000002687 nova-compute[98431]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979 (non-flash) Jun 11 23:13:12.312652 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:12.312652 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:13:12.313213 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.071s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 11 23:13:12.313213 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Connected to 192.168.50.100:3260 {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 11 23:13:12.313705 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Searching for a device in session 28 and hctl ('12', '0', '0', 0) yield: sdg {{(pid=98431) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 11 23:13:12.313867 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '484c7594-8b2e-4f2d-81d7-bdda56999859', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'} {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 11 23:13:12.315146 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] HCTL ('11', '0', '0', 0) found on session 27 with lun 0 {{(pid=98431) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 11 23:13:12.315391 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Scanning host 11 c: 0, t: 0, l: 0) {{(pid=98431) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 11 23:13:12.332772 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Searching for a device in session 27 and hctl ('11', '0', '0', 0) yield: sdf {{(pid=98431) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 11 23:13:12.333014 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '484c7594-8b2e-4f2d-81d7-bdda56999859', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'} {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 11 23:13:12.409198 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [-] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Instance destroyed successfully. Jun 11 23:13:12.409881 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-f5716233-3f0d-42a6-bd7c-91c2397637ee tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Lazy-loading 'resources' on Instance uuid cb63f66c-b69e-42b0-805c-be6fe9b3aee3 {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:13:12.476235 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:13:12.478817 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98431) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 11 23:13:12.484310 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:12.550241 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-1bead5b8-f6b8-42f7-bee0-dd13dab84bfc req-bdb16d34-37fd-40d3-a9e9-1ab8ea95ade6 service nova] Releasing lock "refresh_cache-1d45c7ce-5760-4f59-9921-feb3e589da8a" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 11 23:13:12.794379 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [req-60a5c753-cef7-4ccd-9fdd-45bc4b83cd71 req-8739fc75-416f-485e-b20a-e7887762910e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:13:12.868495 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Successfully updated port: 004fd6c0-58df-4ceb-9733-267396cae60c {{(pid=98431) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 11 23:13:12.888898 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:12.915149 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-f5716233-3f0d-42a6-bd7c-91c2397637ee tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-11T23:10:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-2137494624',display_name='tempest-ServerStableDeviceRescueTest-server-2137494624',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='tempest-serverstabledevicerescuetest-server-2137494624',id=3,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN1NkCgK8LSIP5pEhMIIs/Dp4mkiYJTYFTODVcSUZZtZrJeHfa+y2LovFgjleMmNFgpcKBJrcGsKOrecwTGqJCOsVvMRx1B6Ulwud9J9N+Drb0c4n+JfyZ0C/b9T67XJKQ==',key_name='tempest-keypair-560362554',keypairs=,launch_index=0,launched_at=2026-06-11T23:12:24Z,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='2d62cddce233457caf7eb43be819e513',ramdisk_id='',reservation_id='r-5adcxr7m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-67974016',owner_user_name='tempest-ServerStableDeviceRescueTest-67974016-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-11T23:12:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='549767ad83a94efbb0bbd85d08fdc78a',uuid=cb63f66c-b69e-42b0-805c-be6fe9b3aee3,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2d6dd8b9-e3ff-462f-92cf-8c3a62bc27d1", "address": "fa:16:3e:b5:6f:fd", "network": {"id": "b1a1d33f-f9b6-48cf-86a1-0260d53f3bb0", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1779972098-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2d62cddce233457caf7eb43be819e513", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d6dd8b9-e3", "ovs_interfaceid": "2d6dd8b9-e3ff-462f-92cf-8c3a62bc27d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 11 23:13:12.915449 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-f5716233-3f0d-42a6-bd7c-91c2397637ee tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Converting VIF {"id": "2d6dd8b9-e3ff-462f-92cf-8c3a62bc27d1", "address": "fa:16:3e:b5:6f:fd", "network": {"id": "b1a1d33f-f9b6-48cf-86a1-0260d53f3bb0", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1779972098-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2d62cddce233457caf7eb43be819e513", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d6dd8b9-e3", "ovs_interfaceid": "2d6dd8b9-e3ff-462f-92cf-8c3a62bc27d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:13:12.916339 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-f5716233-3f0d-42a6-bd7c-91c2397637ee tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b5:6f:fd,bridge_name='br-int',has_traffic_filtering=True,id=2d6dd8b9-e3ff-462f-92cf-8c3a62bc27d1,network=Network(b1a1d33f-f9b6-48cf-86a1-0260d53f3bb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d6dd8b9-e3') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:13:12.916671 np0000002687 nova-compute[98431]: DEBUG os_vif [None req-f5716233-3f0d-42a6-bd7c-91c2397637ee tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:6f:fd,bridge_name='br-int',has_traffic_filtering=True,id=2d6dd8b9-e3ff-462f-92cf-8c3a62bc27d1,network=Network(b1a1d33f-f9b6-48cf-86a1-0260d53f3bb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d6dd8b9-e3') {{(pid=98431) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 11 23:13:12.921129 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:12.921321 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2d6dd8b9-e3, bridge=br-int, if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:13:12.922449 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:12.924018 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:13:12.930841 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:12.935036 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:12.935237 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=42439d33-14ee-4a49-a046-425f72686fbc) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:13:12.936133 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:12.936812 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:13:12.946457 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:12.950604 np0000002687 nova-compute[98431]: INFO os_vif [None req-f5716233-3f0d-42a6-bd7c-91c2397637ee tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:6f:fd,bridge_name='br-int',has_traffic_filtering=True,id=2d6dd8b9-e3ff-462f-92cf-8c3a62bc27d1,network=Network(b1a1d33f-f9b6-48cf-86a1-0260d53f3bb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d6dd8b9-e3') Jun 11 23:13:12.950938 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-f5716233-3f0d-42a6-bd7c-91c2397637ee tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Deleting instance files /opt/stack/data/nova/instances/cb63f66c-b69e-42b0-805c-be6fe9b3aee3_del Jun 11 23:13:12.952353 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-f5716233-3f0d-42a6-bd7c-91c2397637ee tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Deletion of /opt/stack/data/nova/instances/cb63f66c-b69e-42b0-805c-be6fe9b3aee3_del complete Jun 11 23:13:12.980523 np0000002687 nova-compute[98431]: DEBUG nova.utils [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Queued Task(fn=>, remaining_delay=14.999743849999959 future=) {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:13:13.137034 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-fc764337-eb53-469f-9989-312c3c6908b7 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] Acquiring lock "19beb2a4-b3fe-43e9-ac92-71446c2630ee" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:13.139102 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-fc764337-eb53-469f-9989-312c3c6908b7 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] Lock "19beb2a4-b3fe-43e9-ac92-71446c2630ee" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:13.139102 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-fc764337-eb53-469f-9989-312c3c6908b7 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] Acquiring lock "19beb2a4-b3fe-43e9-ac92-71446c2630ee-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:13.139102 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-fc764337-eb53-469f-9989-312c3c6908b7 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] Lock "19beb2a4-b3fe-43e9-ac92-71446c2630ee-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:13.139102 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-fc764337-eb53-469f-9989-312c3c6908b7 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] Lock "19beb2a4-b3fe-43e9-ac92-71446c2630ee-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:13.140715 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-4c180d2a-8bbc-429c-882c-d89cbbd433cf req-08148f5f-c0a8-4897-b18c-b0b188c1fb27 service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Received event network-changed-e3269961-a3f1-42c8-a49e-37f728b2f3d8 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:13:13.142166 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-4c180d2a-8bbc-429c-882c-d89cbbd433cf req-08148f5f-c0a8-4897-b18c-b0b188c1fb27 service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Refreshing instance network info cache due to event network-changed-e3269961-a3f1-42c8-a49e-37f728b2f3d8. {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 11 23:13:13.142912 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-4c180d2a-8bbc-429c-882c-d89cbbd433cf req-08148f5f-c0a8-4897-b18c-b0b188c1fb27 service nova] Acquiring lock "refresh_cache-1d45c7ce-5760-4f59-9921-feb3e589da8a" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 11 23:13:13.143172 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-4c180d2a-8bbc-429c-882c-d89cbbd433cf req-08148f5f-c0a8-4897-b18c-b0b188c1fb27 service nova] Acquired lock "refresh_cache-1d45c7ce-5760-4f59-9921-feb3e589da8a" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 11 23:13:13.143354 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-4c180d2a-8bbc-429c-882c-d89cbbd433cf req-08148f5f-c0a8-4897-b18c-b0b188c1fb27 service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Refreshing network info cache for port e3269961-a3f1-42c8-a49e-37f728b2f3d8 {{(pid=98431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 11 23:13:13.151006 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-fc764337-eb53-469f-9989-312c3c6908b7 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] [instance: 19beb2a4-b3fe-43e9-ac92-71446c2630ee] Terminating instance Jun 11 23:13:13.243454 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98431) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 11 23:13:13.366061 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:13:13.368527 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-74ce3945-e947-4bae-97d5-8f9b1119d6b5 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Acquiring lock "64d7833a-82e8-43e9-83ed-2507197b69bf" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:13.368758 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-74ce3945-e947-4bae-97d5-8f9b1119d6b5 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "64d7833a-82e8-43e9-83ed-2507197b69bf" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.002s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:13.369023 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-74ce3945-e947-4bae-97d5-8f9b1119d6b5 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] Attaching volume f535b91b-3bff-46ad-905e-644bd012b9ff to /dev/vdb Jun 11 23:13:13.372960 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Acquiring lock "refresh_cache-1d45c7ce-5760-4f59-9921-feb3e589da8a" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 11 23:13:13.382815 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [req-60a5c753-cef7-4ccd-9fdd-45bc4b83cd71 req-8739fc75-416f-485e-b20a-e7887762910e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:13:13.444309 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-74ce3945-e947-4bae-97d5-8f9b1119d6b5 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.209', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000002687', 'execute': None}" {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 11 23:13:13.466962 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.scaleio [None req-74ce3945-e947-4bae-97d5-8f9b1119d6b5 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98431) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 11 23:13:13.472859 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-f5716233-3f0d-42a6-bd7c-91c2397637ee tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Took 1.42 seconds to destroy the instance on the hypervisor. Jun 11 23:13:13.473389 np0000002687 nova-compute[98431]: DEBUG oslo.service.backend._common.loopingcall [None req-f5716233-3f0d-42a6-bd7c-91c2397637ee tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98431) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jun 11 23:13:13.474851 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [-] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Deallocating network for instance {{(pid=98431) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}} Jun 11 23:13:13.474851 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [-] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] deallocate_for_instance() {{(pid=98431) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jun 11 23:13:13.474851 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:13:13.503502 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-74ce3945-e947-4bae-97d5-8f9b1119d6b5 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Running cmd (subprocess): nvme version {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:13:13.507534 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-6034e07b-88d5-420d-8b80-4b0fe2c8b551 req-35d0987b-b748-4007-94a7-c87f62e3cae0 service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Received event network-changed-004fd6c0-58df-4ceb-9733-267396cae60c {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:13:13.508159 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-6034e07b-88d5-420d-8b80-4b0fe2c8b551 req-35d0987b-b748-4007-94a7-c87f62e3cae0 service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Refreshing instance network info cache due to event network-changed-004fd6c0-58df-4ceb-9733-267396cae60c. {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 11 23:13:13.530012 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-6034e07b-88d5-420d-8b80-4b0fe2c8b551 req-35d0987b-b748-4007-94a7-c87f62e3cae0 service nova] Acquiring lock "refresh_cache-1d45c7ce-5760-4f59-9921-feb3e589da8a" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 11 23:13:13.547674 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-74ce3945-e947-4bae-97d5-8f9b1119d6b5 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] 'nvme version' failed. Not Retrying. {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 11 23:13:13.549372 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.nvmeof [None req-74ce3945-e947-4bae-97d5-8f9b1119d6b5 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] nvme not present on system {{(pid=98431) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 11 23:13:13.560698 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:13:13.561339 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:13:13.561617 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:13:13.564325 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.lightos [None req-74ce3945-e947-4bae-97d5-8f9b1119d6b5 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98431) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 11 23:13:13.568693 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.lightos [None req-74ce3945-e947-4bae-97d5-8f9b1119d6b5 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Current host hostNQN and IP(s) are ['10.4.3.209', 'fe80::f816:3eff:fea3:3707', '192.168.40.6', 'fe80::f816:3eff:fe06:bdab', '192.168.50.6', 'fe80::f816:3eff:fe7a:46f2', '192.168.10.6', 'fe80::f816:3eff:fe13:793b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::38fa:21ff:fe6c:3746', 'fe80::fc16:3eff:fe6c:eb30', 'fe80::20a8:54ff:fe51:da0a', 'fe80::fc16:3eff:fe77:488d', 'fe80::9469:f2ff:feae:5824', 'fe80::fc16:3eff:fec7:336a', 'fe80::fc16:3eff:fe61:b7fd', 'fe80::fc16:3eff:fec6:c65b', 'fe80::fc16:3eff:fed6:e34f', 'fe80::fc16:3eff:fe4b:2695', 'fe80::fc16:3eff:fe6f:4242', 'fe80::fc16:3eff:feed:101f', 'fe80::8cf4:43ff:fe1e:1c0b', 'fe80::fc16:3eff:fe1d:f718', 'fe80::14a2:b8ff:feec:f607'] Jun 11 23:13:13.569046 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.lightos [None req-74ce3945-e947-4bae-97d5-8f9b1119d6b5 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98431) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 11 23:13:13.569171 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.lightos [None req-74ce3945-e947-4bae-97d5-8f9b1119d6b5 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] LIGHTOS: no hostnqn found. {{(pid=98431) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 11 23:13:13.570912 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-74ce3945-e947-4bae-97d5-8f9b1119d6b5 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.209', 'host': 'np0000002687', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:798b370f1cc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad465dfe-0ed1-4637-98c3-ddaebebd61a4', 'nvme_native_multipath': False} {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 11 23:13:13.570912 np0000002687 nova-compute[98431]: DEBUG nova.virt.block_device [None req-74ce3945-e947-4bae-97d5-8f9b1119d6b5 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] Updating existing volume attachment record: 7c684f3c-7f82-4d29-9a25-167fe2da9032 {{(pid=98431) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 11 23:13:13.640486 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:13:13.648065 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [req-4c180d2a-8bbc-429c-882c-d89cbbd433cf req-08148f5f-c0a8-4897-b18c-b0b188c1fb27 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:13:13.658610 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-fc764337-eb53-469f-9989-312c3c6908b7 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] [instance: 19beb2a4-b3fe-43e9-ac92-71446c2630ee] Start destroying the instance on the hypervisor. {{(pid=98431) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}} Jun 11 23:13:13.689560 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:13.700216 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:13.723525 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:13.733474 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-60a5c753-cef7-4ccd-9fdd-45bc4b83cd71 req-8739fc75-416f-485e-b20a-e7887762910e service nova] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] Updated VIF entry in instance network info cache for port 3c04202e-5ce6-4249-ba31-be06996ca75d. {{(pid=98431) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 11 23:13:13.735866 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-60a5c753-cef7-4ccd-9fdd-45bc4b83cd71 req-8739fc75-416f-485e-b20a-e7887762910e service nova] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] Updating instance_info_cache with network_info: [{"id": "3c04202e-5ce6-4249-ba31-be06996ca75d", "address": "fa:16:3e:6f:42:42", "network": {"id": "17593db3-c22d-4354-ab29-933b1c6a5c3a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1094286565-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "81fd45f475a04e5c8e9bd9deb7ad4c1e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c04202e-5c", "ovs_interfaceid": "3c04202e-5ce6-4249-ba31-be06996ca75d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:13:13.737865 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:13.758637 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:13.805244 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Port a1e7aeff-5992-43be-bb2c-d504e7019c64 binding to destination host np0000002687 is already ACTIVE {{(pid=98431) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3210}} Jun 11 23:13:13.805244 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Acquiring lock "refresh_cache-7609742e-a3a2-4be2-ba02-227efb2101e1" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 11 23:13:13.805244 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Acquired lock "refresh_cache-7609742e-a3a2-4be2-ba02-227efb2101e1" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 11 23:13:13.805244 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Building network info cache for instance {{(pid=98431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 11 23:13:13.948337 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-4c180d2a-8bbc-429c-882c-d89cbbd433cf req-08148f5f-c0a8-4897-b18c-b0b188c1fb27 service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Instance cache missing network info. {{(pid=98431) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 11 23:13:13.994560 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:14.015875 np0000002687 nova-compute[98431]: DEBUG nova.utils [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Queued Task(fn=>, remaining_delay=14.999670553999977 future=) {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:13:14.017583 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [-] [instance: 19beb2a4-b3fe-43e9-ac92-71446c2630ee] Instance destroyed successfully. Jun 11 23:13:14.020410 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-fc764337-eb53-469f-9989-312c3c6908b7 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] Lazy-loading 'resources' on Instance uuid 19beb2a4-b3fe-43e9-ac92-71446c2630ee {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:13:14.157191 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74ce3945-e947-4bae-97d5-8f9b1119d6b5 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] Calling os-brick to attach iSCSI Volume {{(pid=98431) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 11 23:13:14.157424 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ce3945-e947-4bae-97d5-8f9b1119d6b5 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff', 'iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f535b91b-3bff-46ad-905e-644bd012b9ff', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 11 23:13:14.157625 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-74ce3945-e947-4bae-97d5-8f9b1119d6b5 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 11 23:13:14.239582 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-60a5c753-cef7-4ccd-9fdd-45bc4b83cd71 req-8739fc75-416f-485e-b20a-e7887762910e service nova] Releasing lock "refresh_cache-8a45e04f-3516-4c39-bea1-820104411f17" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 11 23:13:14.265458 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Found WWN 330000000c1986051 for multipath device dm-4 {{(pid=98431) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 11 23:13:14.265458 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.044s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 11 23:13:14.265673 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] <== connect_volume: return (2044ms) {'type': 'block', 'scsi_wwn': '330000000c1986051', 'path': '/dev/dm-4', 'multipath_id': '330000000c1986051'} {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 11 23:13:14.265813 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000c1986051', 'path': '/dev/dm-4', 'multipath_id': '330000000c1986051'} {{(pid=98431) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 11 23:13:14.267153 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-74ce3945-e947-4bae-97d5-8f9b1119d6b5 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.109s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 11 23:13:14.267613 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-74ce3945-e947-4bae-97d5-8f9b1119d6b5 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff', 'iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f535b91b-3bff-46ad-905e-644bd012b9ff', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98431) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 11 23:13:14.286987 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-74ce3945-e947-4bae-97d5-8f9b1119d6b5 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 11 23:13:14.286987 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-74ce3945-e947-4bae-97d5-8f9b1119d6b5 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 11 23:13:14.286987 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.iscsi [None req-74ce3945-e947-4bae-97d5-8f9b1119d6b5 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 11 23:13:14.287512 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-74ce3945-e947-4bae-97d5-8f9b1119d6b5 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 11 23:13:14.287512 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-74ce3945-e947-4bae-97d5-8f9b1119d6b5 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 11 23:13:14.288235 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.iscsi [None req-74ce3945-e947-4bae-97d5-8f9b1119d6b5 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 11 23:13:14.302246 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ce3945-e947-4bae-97d5-8f9b1119d6b5 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 11 23:13:14.302246 np0000002687 nova-compute[98431]: {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:13:14.308267 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:13:14.315371 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ce3945-e947-4bae-97d5-8f9b1119d6b5 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 11 23:13:14.315371 np0000002687 nova-compute[98431]: {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:13:14.319310 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ce3945-e947-4bae-97d5-8f9b1119d6b5 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff] added Jun 11 23:13:14.319310 np0000002687 nova-compute[98431]: stderr=iscsiadm: Config file line 363 does not have value Jun 11 23:13:14.319310 np0000002687 nova-compute[98431]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 11 23:13:14.319310 np0000002687 nova-compute[98431]: iscsiadm: Config file line 363 does not have value Jun 11 23:13:14.319310 np0000002687 nova-compute[98431]: iscsiadm: Config file line 363 does not have value Jun 11 23:13:14.319310 np0000002687 nova-compute[98431]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 11 23:13:14.319310 np0000002687 nova-compute[98431]: {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:13:14.319441 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ce3945-e947-4bae-97d5-8f9b1119d6b5 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98431) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 11 23:13:14.319696 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-74ce3945-e947-4bae-97d5-8f9b1119d6b5 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0331(s), this was the 1st time calling it. {{(pid=98431) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 11 23:13:14.319890 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-74ce3945-e947-4bae-97d5-8f9b1119d6b5 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98431) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 11 23:13:14.330986 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ce3945-e947-4bae-97d5-8f9b1119d6b5 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff] added Jun 11 23:13:14.330986 np0000002687 nova-compute[98431]: stderr=iscsiadm: Config file line 363 does not have value Jun 11 23:13:14.330986 np0000002687 nova-compute[98431]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 11 23:13:14.330986 np0000002687 nova-compute[98431]: iscsiadm: Config file line 363 does not have value Jun 11 23:13:14.330986 np0000002687 nova-compute[98431]: iscsiadm: Config file line 363 does not have value Jun 11 23:13:14.330986 np0000002687 nova-compute[98431]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 11 23:13:14.330986 np0000002687 nova-compute[98431]: {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:13:14.331233 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ce3945-e947-4bae-97d5-8f9b1119d6b5 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98431) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 11 23:13:14.331440 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-74ce3945-e947-4bae-97d5-8f9b1119d6b5 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0437(s), this was the 1st time calling it. {{(pid=98431) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 11 23:13:14.331658 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-74ce3945-e947-4bae-97d5-8f9b1119d6b5 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98431) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 11 23:13:14.466287 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-4c180d2a-8bbc-429c-882c-d89cbbd433cf req-08148f5f-c0a8-4897-b18c-b0b188c1fb27 service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Updating instance_info_cache with network_info: [] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:13:14.504850 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Acquiring lock "dd1dd46c-2231-40b4-aa61-0121733a932d" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:14.504850 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Lock "dd1dd46c-2231-40b4-aa61-0121733a932d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:14.527726 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-fc764337-eb53-469f-9989-312c3c6908b7 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-11T23:12:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-314433121',display_name='tempest-VolumesAdminNegativeTest-server-314433121',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='tempest-volumesadminnegativetest-server-314433121',id=18,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-06-11T23:13:07Z,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='9c2c5af39c7b4fcc94f857ad4db5e636',ramdisk_id='',reservation_id='r-nubrf928',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-2097592246',owner_user_name='tempest-VolumesAdminNegativeTest-2097592246-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-11T23:13:08Z,user_data=None,user_id='e502d68a0c7841379aae120e3a687632',uuid=19beb2a4-b3fe-43e9-ac92-71446c2630ee,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4c1f7e6e-b361-4522-84d4-5bf89a5eb631", "address": "fa:16:3e:ed:10:1f", "network": {"id": "3af1cbf3-5c99-489d-885d-7f5f0475ce13", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1827810190-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9c2c5af39c7b4fcc94f857ad4db5e636", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c1f7e6e-b3", "ovs_interfaceid": "4c1f7e6e-b361-4522-84d4-5bf89a5eb631", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 11 23:13:14.527726 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-fc764337-eb53-469f-9989-312c3c6908b7 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] Converting VIF {"id": "4c1f7e6e-b361-4522-84d4-5bf89a5eb631", "address": "fa:16:3e:ed:10:1f", "network": {"id": "3af1cbf3-5c99-489d-885d-7f5f0475ce13", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1827810190-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9c2c5af39c7b4fcc94f857ad4db5e636", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c1f7e6e-b3", "ovs_interfaceid": "4c1f7e6e-b361-4522-84d4-5bf89a5eb631", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:13:14.527726 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-fc764337-eb53-469f-9989-312c3c6908b7 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:10:1f,bridge_name='br-int',has_traffic_filtering=True,id=4c1f7e6e-b361-4522-84d4-5bf89a5eb631,network=Network(3af1cbf3-5c99-489d-885d-7f5f0475ce13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c1f7e6e-b3') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:13:14.527726 np0000002687 nova-compute[98431]: DEBUG os_vif [None req-fc764337-eb53-469f-9989-312c3c6908b7 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:10:1f,bridge_name='br-int',has_traffic_filtering=True,id=4c1f7e6e-b361-4522-84d4-5bf89a5eb631,network=Network(3af1cbf3-5c99-489d-885d-7f5f0475ce13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c1f7e6e-b3') {{(pid=98431) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 11 23:13:14.529714 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:14.530018 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4c1f7e6e-b3, bridge=br-int, if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:13:14.531870 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:14.535023 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:13:14.541907 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:14.544773 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:14.544773 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=54609b8b-7f33-4fbe-bbac-ab532c22f994) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:13:14.547021 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:13:14.550002 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:14.553763 np0000002687 nova-compute[98431]: INFO os_vif [None req-fc764337-eb53-469f-9989-312c3c6908b7 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:10:1f,bridge_name='br-int',has_traffic_filtering=True,id=4c1f7e6e-b361-4522-84d4-5bf89a5eb631,network=Network(3af1cbf3-5c99-489d-885d-7f5f0475ce13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c1f7e6e-b3') Jun 11 23:13:14.554202 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-fc764337-eb53-469f-9989-312c3c6908b7 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] [instance: 19beb2a4-b3fe-43e9-ac92-71446c2630ee] Deleting instance files /opt/stack/data/nova/instances/19beb2a4-b3fe-43e9-ac92-71446c2630ee_del Jun 11 23:13:14.555070 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-fc764337-eb53-469f-9989-312c3c6908b7 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] [instance: 19beb2a4-b3fe-43e9-ac92-71446c2630ee] Deletion of /opt/stack/data/nova/instances/19beb2a4-b3fe-43e9-ac92-71446c2630ee_del complete Jun 11 23:13:14.776880 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-11T23:12:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-916877464',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='tempest-serverbootfromvolumestablerescuetest-server-916877464',id=16,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-06-11T23:12:59Z,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='aaf744af828a4a5eba1e98da63373b2b',ramdisk_id='',reservation_id='r-nua6jkmc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-539499192',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member'},tags=,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-06-11T23:13:00Z,user_data=None,user_id='72b6dac5eb744cfba6299636227aa59b',uuid=0d352738-c7bf-42a2-8260-bf5574a7200d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3c37ff2c-78c4-4423-b4a2-219e94df57ca", "address": "fa:16:3e:8f:ae:21", "network": {"id": "2a770c99-2ec6-4fa2-945b-32830a59e7a7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-137493671-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-137493671-network", "vif_mac": "fa:16:3e:8f:ae:21"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aaf744af828a4a5eba1e98da63373b2b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c37ff2c-78", "ovs_interfaceid": "3c37ff2c-78c4-4423-b4a2-219e94df57ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98431) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 11 23:13:14.776880 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Converting VIF {"id": "3c37ff2c-78c4-4423-b4a2-219e94df57ca", "address": "fa:16:3e:8f:ae:21", "network": {"id": "2a770c99-2ec6-4fa2-945b-32830a59e7a7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-137493671-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-137493671-network", "vif_mac": "fa:16:3e:8f:ae:21"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aaf744af828a4a5eba1e98da63373b2b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c37ff2c-78", "ovs_interfaceid": "3c37ff2c-78c4-4423-b4a2-219e94df57ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:13:14.776880 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8f:ae:21,bridge_name='br-int',has_traffic_filtering=True,id=3c37ff2c-78c4-4423-b4a2-219e94df57ca,network=Network(2a770c99-2ec6-4fa2-945b-32830a59e7a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c37ff2c-78') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:13:14.776880 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lazy-loading 'pci_devices' on Instance uuid 0d352738-c7bf-42a2-8260-bf5574a7200d {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:13:14.901394 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [-] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Updating instance_info_cache with network_info: [] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:13:14.969456 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-4c180d2a-8bbc-429c-882c-d89cbbd433cf req-08148f5f-c0a8-4897-b18c-b0b188c1fb27 service nova] Releasing lock "refresh_cache-1d45c7ce-5760-4f59-9921-feb3e589da8a" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 11 23:13:14.969586 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-4c180d2a-8bbc-429c-882c-d89cbbd433cf req-08148f5f-c0a8-4897-b18c-b0b188c1fb27 service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Received event network-changed-351eaad5-bf70-43b4-8f79-5bc0027de663 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:13:14.969864 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-4c180d2a-8bbc-429c-882c-d89cbbd433cf req-08148f5f-c0a8-4897-b18c-b0b188c1fb27 service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Refreshing instance network info cache due to event network-changed-351eaad5-bf70-43b4-8f79-5bc0027de663. {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 11 23:13:14.970208 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Acquired lock "refresh_cache-1d45c7ce-5760-4f59-9921-feb3e589da8a" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 11 23:13:14.970394 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-4c180d2a-8bbc-429c-882c-d89cbbd433cf req-08148f5f-c0a8-4897-b18c-b0b188c1fb27 service nova] Acquiring lock "refresh_cache-1d45c7ce-5760-4f59-9921-feb3e589da8a" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 11 23:13:14.970576 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Building network info cache for instance {{(pid=98431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 11 23:13:14.988625 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:13:15.007698 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: dd1dd46c-2231-40b4-aa61-0121733a932d] Starting instance... {{(pid=98431) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 11 23:13:15.067736 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-fc764337-eb53-469f-9989-312c3c6908b7 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] [instance: 19beb2a4-b3fe-43e9-ac92-71446c2630ee] Took 1.41 seconds to destroy the instance on the hypervisor. Jun 11 23:13:15.070851 np0000002687 nova-compute[98431]: DEBUG oslo.service.backend._common.loopingcall [None req-fc764337-eb53-469f-9989-312c3c6908b7 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98431) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jun 11 23:13:15.070851 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [-] [instance: 19beb2a4-b3fe-43e9-ac92-71446c2630ee] Deallocating network for instance {{(pid=98431) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}} Jun 11 23:13:15.070851 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [-] [instance: 19beb2a4-b3fe-43e9-ac92-71446c2630ee] deallocate_for_instance() {{(pid=98431) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jun 11 23:13:15.070851 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:13:15.253999 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-539800ef-4bf4-4995-945d-62397d08e908 req-b53c50ea-e4fd-495b-b6ce-0c219f59eca3 service nova] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Received event network-vif-unplugged-3c37ff2c-78c4-4423-b4a2-219e94df57ca {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:13:15.254447 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-539800ef-4bf4-4995-945d-62397d08e908 req-b53c50ea-e4fd-495b-b6ce-0c219f59eca3 service nova] Acquiring lock "0d352738-c7bf-42a2-8260-bf5574a7200d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:15.254671 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-539800ef-4bf4-4995-945d-62397d08e908 req-b53c50ea-e4fd-495b-b6ce-0c219f59eca3 service nova] Lock "0d352738-c7bf-42a2-8260-bf5574a7200d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:15.254838 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-539800ef-4bf4-4995-945d-62397d08e908 req-b53c50ea-e4fd-495b-b6ce-0c219f59eca3 service nova] Lock "0d352738-c7bf-42a2-8260-bf5574a7200d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:15.255001 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-539800ef-4bf4-4995-945d-62397d08e908 req-b53c50ea-e4fd-495b-b6ce-0c219f59eca3 service nova] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] No waiting events found dispatching network-vif-unplugged-3c37ff2c-78c4-4423-b4a2-219e94df57ca {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:13:15.255149 np0000002687 nova-compute[98431]: WARNING nova.compute.manager [req-539800ef-4bf4-4995-945d-62397d08e908 req-b53c50ea-e4fd-495b-b6ce-0c219f59eca3 service nova] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Received unexpected event network-vif-unplugged-3c37ff2c-78c4-4423-b4a2-219e94df57ca for instance with vm_state active and task_state rescuing. Jun 11 23:13:15.255302 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-539800ef-4bf4-4995-945d-62397d08e908 req-b53c50ea-e4fd-495b-b6ce-0c219f59eca3 service nova] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Received event network-vif-unplugged-3c37ff2c-78c4-4423-b4a2-219e94df57ca {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:13:15.255445 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-539800ef-4bf4-4995-945d-62397d08e908 req-b53c50ea-e4fd-495b-b6ce-0c219f59eca3 service nova] Acquiring lock "0d352738-c7bf-42a2-8260-bf5574a7200d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:15.255593 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-539800ef-4bf4-4995-945d-62397d08e908 req-b53c50ea-e4fd-495b-b6ce-0c219f59eca3 service nova] Lock "0d352738-c7bf-42a2-8260-bf5574a7200d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:15.255689 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-539800ef-4bf4-4995-945d-62397d08e908 req-b53c50ea-e4fd-495b-b6ce-0c219f59eca3 service nova] Lock "0d352738-c7bf-42a2-8260-bf5574a7200d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:15.255785 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-539800ef-4bf4-4995-945d-62397d08e908 req-b53c50ea-e4fd-495b-b6ce-0c219f59eca3 service nova] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] No waiting events found dispatching network-vif-unplugged-3c37ff2c-78c4-4423-b4a2-219e94df57ca {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:13:15.255928 np0000002687 nova-compute[98431]: WARNING nova.compute.manager [req-539800ef-4bf4-4995-945d-62397d08e908 req-b53c50ea-e4fd-495b-b6ce-0c219f59eca3 service nova] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Received unexpected event network-vif-unplugged-3c37ff2c-78c4-4423-b4a2-219e94df57ca for instance with vm_state active and task_state rescuing. Jun 11 23:13:15.278406 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:13:15.283200 np0000002687 nova-compute[98431]: DEBUG nova.objects.base [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Object Instance<0d352738-c7bf-42a2-8260-bf5574a7200d> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=98431) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 11 23:13:15.287528 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] End _get_guest_xml xml= Jun 11 23:13:15.287528 np0000002687 nova-compute[98431]: 0d352738-c7bf-42a2-8260-bf5574a7200d Jun 11 23:13:15.287528 np0000002687 nova-compute[98431]: instance-00000010 Jun 11 23:13:15.287528 np0000002687 nova-compute[98431]: 196608 Jun 11 23:13:15.287528 np0000002687 nova-compute[98431]: 1 Jun 11 23:13:15.287528 np0000002687 nova-compute[98431]: Jun 11 23:13:15.287528 np0000002687 nova-compute[98431]: Jun 11 23:13:15.287528 np0000002687 nova-compute[98431]: Jun 11 23:13:15.287528 np0000002687 nova-compute[98431]: tempest-ServerBootFromVolumeStableRescueTest-server-916877464 Jun 11 23:13:15.287528 np0000002687 nova-compute[98431]: 2026-06-11 23:13:11 Jun 11 23:13:15.287528 np0000002687 nova-compute[98431]: Jun 11 23:13:15.287528 np0000002687 nova-compute[98431]: 192 Jun 11 23:13:15.287528 np0000002687 nova-compute[98431]: 1 Jun 11 23:13:15.287528 np0000002687 nova-compute[98431]: 0 Jun 11 23:13:15.287528 np0000002687 nova-compute[98431]: 0 Jun 11 23:13:15.287528 np0000002687 nova-compute[98431]: 1 Jun 11 23:13:15.287528 np0000002687 nova-compute[98431]: Jun 11 23:13:15.287528 np0000002687 nova-compute[98431]: True Jun 11 23:13:15.287528 np0000002687 nova-compute[98431]: Jun 11 23:13:15.287528 np0000002687 nova-compute[98431]: Jun 11 23:13:15.287528 np0000002687 nova-compute[98431]: Jun 11 23:13:15.287528 np0000002687 nova-compute[98431]: bare Jun 11 23:13:15.287528 np0000002687 nova-compute[98431]: qcow2 Jun 11 23:13:15.287528 np0000002687 nova-compute[98431]: 1 Jun 11 23:13:15.287528 np0000002687 nova-compute[98431]: 0 Jun 11 23:13:15.287528 np0000002687 nova-compute[98431]: Jun 11 23:13:15.287528 np0000002687 nova-compute[98431]: ide Jun 11 23:13:15.287528 np0000002687 nova-compute[98431]: virtio Jun 11 23:13:15.287528 np0000002687 nova-compute[98431]: pc Jun 11 23:13:15.287528 np0000002687 nova-compute[98431]: virtio Jun 11 23:13:15.287528 np0000002687 nova-compute[98431]: virtio Jun 11 23:13:15.287528 np0000002687 nova-compute[98431]: virtio Jun 11 23:13:15.287528 np0000002687 nova-compute[98431]: Jun 11 23:13:15.287528 np0000002687 nova-compute[98431]: Jun 11 23:13:15.287528 np0000002687 nova-compute[98431]: Jun 11 23:13:15.287528 np0000002687 nova-compute[98431]: tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member Jun 11 23:13:15.287528 np0000002687 nova-compute[98431]: tempest-ServerBootFromVolumeStableRescueTest-539499192 Jun 11 23:13:15.287528 np0000002687 nova-compute[98431]: Jun 11 23:13:15.287528 np0000002687 nova-compute[98431]: Jun 11 23:13:15.287528 np0000002687 nova-compute[98431]: Jun 11 23:13:15.287528 np0000002687 nova-compute[98431]: Jun 11 23:13:15.287528 np0000002687 nova-compute[98431]: Jun 11 23:13:15.287528 np0000002687 nova-compute[98431]: Jun 11 23:13:15.287528 np0000002687 nova-compute[98431]: Jun 11 23:13:15.287528 np0000002687 nova-compute[98431]: Jun 11 23:13:15.287528 np0000002687 nova-compute[98431]: Jun 11 23:13:15.287528 np0000002687 nova-compute[98431]: Jun 11 23:13:15.287528 np0000002687 nova-compute[98431]: Jun 11 23:13:15.287528 np0000002687 nova-compute[98431]: OpenStack Foundation Jun 11 23:13:15.287528 np0000002687 nova-compute[98431]: OpenStack Nova Jun 11 23:13:15.287528 np0000002687 nova-compute[98431]: 33.1.0 Jun 11 23:13:15.287528 np0000002687 nova-compute[98431]: 0d352738-c7bf-42a2-8260-bf5574a7200d Jun 11 23:13:15.287528 np0000002687 nova-compute[98431]: 0d352738-c7bf-42a2-8260-bf5574a7200d Jun 11 23:13:15.287528 np0000002687 nova-compute[98431]: Virtual Machine Jun 11 23:13:15.287528 np0000002687 nova-compute[98431]: Jun 11 23:13:15.287528 np0000002687 nova-compute[98431]: Jun 11 23:13:15.287528 np0000002687 nova-compute[98431]: Jun 11 23:13:15.287528 np0000002687 nova-compute[98431]: hvm Jun 11 23:13:15.287528 np0000002687 nova-compute[98431]: Jun 11 23:13:15.287528 np0000002687 nova-compute[98431]: Jun 11 23:13:15.287528 np0000002687 nova-compute[98431]: Jun 11 23:13:15.287528 np0000002687 nova-compute[98431]: Jun 11 23:13:15.287528 np0000002687 nova-compute[98431]: Jun 11 23:13:15.287528 np0000002687 nova-compute[98431]: 128 Jun 11 23:13:15.287528 np0000002687 nova-compute[98431]: Jun 11 23:13:15.287528 np0000002687 nova-compute[98431]: Jun 11 23:13:15.287528 np0000002687 nova-compute[98431]: Jun 11 23:13:15.287528 np0000002687 nova-compute[98431]: 1 Jun 11 23:13:15.287528 np0000002687 nova-compute[98431]: Jun 11 23:13:15.287528 np0000002687 nova-compute[98431]: Jun 11 23:13:15.287528 np0000002687 nova-compute[98431]: Nehalem Jun 11 23:13:15.287528 np0000002687 nova-compute[98431]: Jun 11 23:13:15.287528 np0000002687 nova-compute[98431]: Jun 11 23:13:15.287528 np0000002687 nova-compute[98431]: Jun 11 23:13:15.287528 np0000002687 nova-compute[98431]: Jun 11 23:13:15.287528 np0000002687 nova-compute[98431]: Jun 11 23:13:15.287528 np0000002687 nova-compute[98431]: Jun 11 23:13:15.287528 np0000002687 nova-compute[98431]: Jun 11 23:13:15.287528 np0000002687 nova-compute[98431]: Jun 11 23:13:15.287528 np0000002687 nova-compute[98431]: Jun 11 23:13:15.287528 np0000002687 nova-compute[98431]: Jun 11 23:13:15.287528 np0000002687 nova-compute[98431]: Jun 11 23:13:15.287528 np0000002687 nova-compute[98431]: Jun 11 23:13:15.287528 np0000002687 nova-compute[98431]: Jun 11 23:13:15.287528 np0000002687 nova-compute[98431]: 484c7594-8b2e-4f2d-81d7-bdda56999859 Jun 11 23:13:15.287528 np0000002687 nova-compute[98431]: Jun 11 23:13:15.287528 np0000002687 nova-compute[98431]: Jun 11 23:13:15.287528 np0000002687 nova-compute[98431]: Jun 11 23:13:15.287528 np0000002687 nova-compute[98431]: Jun 11 23:13:15.287528 np0000002687 nova-compute[98431]: Jun 11 23:13:15.287528 np0000002687 nova-compute[98431]: Jun 11 23:13:15.287528 np0000002687 nova-compute[98431]: Jun 11 23:13:15.287528 np0000002687 nova-compute[98431]: Jun 11 23:13:15.287528 np0000002687 nova-compute[98431]: Jun 11 23:13:15.287528 np0000002687 nova-compute[98431]: Jun 11 23:13:15.287528 np0000002687 nova-compute[98431]: Jun 11 23:13:15.287528 np0000002687 nova-compute[98431]: Jun 11 23:13:15.287528 np0000002687 nova-compute[98431]: Jun 11 23:13:15.287528 np0000002687 nova-compute[98431]: Jun 11 23:13:15.287528 np0000002687 nova-compute[98431]: Jun 11 23:13:15.287528 np0000002687 nova-compute[98431]: Jun 11 23:13:15.287528 np0000002687 nova-compute[98431]: Jun 11 23:13:15.287528 np0000002687 nova-compute[98431]: Jun 11 23:13:15.287528 np0000002687 nova-compute[98431]: Jun 11 23:13:15.287528 np0000002687 nova-compute[98431]: Jun 11 23:13:15.287528 np0000002687 nova-compute[98431]: /dev/urandom Jun 11 23:13:15.287528 np0000002687 nova-compute[98431]: Jun 11 23:13:15.287528 np0000002687 nova-compute[98431]: Jun 11 23:13:15.287528 np0000002687 nova-compute[98431]: Jun 11 23:13:15.287528 np0000002687 nova-compute[98431]: Jun 11 23:13:15.287528 np0000002687 nova-compute[98431]: Jun 11 23:13:15.287528 np0000002687 nova-compute[98431]: Jun 11 23:13:15.287528 np0000002687 nova-compute[98431]: Jun 11 23:13:15.287528 np0000002687 nova-compute[98431]: {{(pid=98431) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 11 23:13:15.297787 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [-] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Instance destroyed successfully. Jun 11 23:13:15.323126 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.iscsi [None req-74ce3945-e947-4bae-97d5-8f9b1119d6b5 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 11 23:13:15.335439 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.iscsi [None req-74ce3945-e947-4bae-97d5-8f9b1119d6b5 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 11 23:13:15.337618 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Updating instance_info_cache with network_info: [{"id": "a1e7aeff-5992-43be-bb2c-d504e7019c64", "address": "fa:16:3e:1d:f7:18", "network": {"id": "710d3c5f-1a08-4a35-b3e1-e59f427989c2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2068802531-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62f47df2e0374879b837bc7431326e62", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1e7aeff-59", "ovs_interfaceid": "a1e7aeff-5992-43be-bb2c-d504e7019c64", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:13:15.343428 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ce3945-e947-4bae-97d5-8f9b1119d6b5 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 11 23:13:15.343428 np0000002687 nova-compute[98431]: node.name = iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff Jun 11 23:13:15.343428 np0000002687 nova-compute[98431]: node.tpgt = -1 Jun 11 23:13:15.343428 np0000002687 nova-compute[98431]: node.startup = manual Jun 11 23:13:15.343428 np0000002687 nova-compute[98431]: node.leading_login = No Jun 11 23:13:15.343428 np0000002687 nova-compute[98431]: iface.iscsi_ifacename = default Jun 11 23:13:15.343428 np0000002687 nova-compute[98431]: iface.net_ifacename = Jun 11 23:13:15.343428 np0000002687 nova-compute[98431]: iface.ipaddress = Jun 11 23:13:15.343428 np0000002687 nova-compute[98431]: iface.prefix_len = 0 Jun 11 23:13:15.343428 np0000002687 nova-compute[98431]: iface.hwaddress = Jun 11 23:13:15.343428 np0000002687 nova-compute[98431]: iface.transport_name = tcp Jun 11 23:13:15.343428 np0000002687 nova-compute[98431]: iface.initiatorname = Jun 11 23:13:15.343428 np0000002687 nova-compute[98431]: iface.state = Jun 11 23:13:15.343428 np0000002687 nova-compute[98431]: iface.vlan_id = 0 Jun 11 23:13:15.343428 np0000002687 nova-compute[98431]: iface.vlan_priority = 0 Jun 11 23:13:15.343428 np0000002687 nova-compute[98431]: iface.vlan_state = Jun 11 23:13:15.343428 np0000002687 nova-compute[98431]: iface.iface_num = 0 Jun 11 23:13:15.343428 np0000002687 nova-compute[98431]: iface.mtu = 0 Jun 11 23:13:15.343428 np0000002687 nova-compute[98431]: iface.port = 0 Jun 11 23:13:15.343428 np0000002687 nova-compute[98431]: iface.bootproto = Jun 11 23:13:15.343428 np0000002687 nova-compute[98431]: iface.subnet_mask = Jun 11 23:13:15.343428 np0000002687 nova-compute[98431]: iface.gateway = Jun 11 23:13:15.343428 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id_state = Jun 11 23:13:15.343428 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id = Jun 11 23:13:15.343428 np0000002687 nova-compute[98431]: iface.dhcp_dns = Jun 11 23:13:15.343428 np0000002687 nova-compute[98431]: iface.dhcp_learn_iqn = Jun 11 23:13:15.343428 np0000002687 nova-compute[98431]: iface.dhcp_req_vendor_id_state = Jun 11 23:13:15.343428 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id_state = Jun 11 23:13:15.343428 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id = Jun 11 23:13:15.343428 np0000002687 nova-compute[98431]: iface.dhcp_slp_da = Jun 11 23:13:15.343428 np0000002687 nova-compute[98431]: iface.fragmentation = Jun 11 23:13:15.343428 np0000002687 nova-compute[98431]: iface.gratuitous_arp = Jun 11 23:13:15.343428 np0000002687 nova-compute[98431]: iface.incoming_forwarding = Jun 11 23:13:15.343428 np0000002687 nova-compute[98431]: iface.tos_state = Jun 11 23:13:15.343428 np0000002687 nova-compute[98431]: iface.tos = 0 Jun 11 23:13:15.343428 np0000002687 nova-compute[98431]: iface.ttl = 0 Jun 11 23:13:15.343428 np0000002687 nova-compute[98431]: iface.delayed_ack = Jun 11 23:13:15.343428 np0000002687 nova-compute[98431]: iface.tcp_nagle = Jun 11 23:13:15.343428 np0000002687 nova-compute[98431]: iface.tcp_wsf_state = Jun 11 23:13:15.343428 np0000002687 nova-compute[98431]: iface.tcp_wsf = 0 Jun 11 23:13:15.343428 np0000002687 nova-compute[98431]: iface.tcp_timer_scale = 0 Jun 11 23:13:15.343428 np0000002687 nova-compute[98431]: iface.tcp_timestamp = Jun 11 23:13:15.343428 np0000002687 nova-compute[98431]: iface.redirect = Jun 11 23:13:15.343428 np0000002687 nova-compute[98431]: iface.def_task_mgmt_timeout = 0 Jun 11 23:13:15.343428 np0000002687 nova-compute[98431]: iface.header_digest = Jun 11 23:13:15.343428 np0000002687 nova-compute[98431]: iface.data_digest = Jun 11 23:13:15.343428 np0000002687 nova-compute[98431]: iface.immediate_data = Jun 11 23:13:15.343428 np0000002687 nova-compute[98431]: iface.initial_r2t = Jun 11 23:13:15.343428 np0000002687 nova-compute[98431]: iface.data_seq_inorder = Jun 11 23:13:15.343428 np0000002687 nova-compute[98431]: iface.data_pdu_inorder = Jun 11 23:13:15.343428 np0000002687 nova-compute[98431]: iface.erl = 0 Jun 11 23:13:15.343428 np0000002687 nova-compute[98431]: iface.max_receive_data_len = 0 Jun 11 23:13:15.343428 np0000002687 nova-compute[98431]: iface.first_burst_len = 0 Jun 11 23:13:15.343428 np0000002687 nova-compute[98431]: iface.max_outstanding_r2t = 0 Jun 11 23:13:15.343428 np0000002687 nova-compute[98431]: iface.max_burst_len = 0 Jun 11 23:13:15.343428 np0000002687 nova-compute[98431]: iface.chap_auth = Jun 11 23:13:15.343428 np0000002687 nova-compute[98431]: iface.bidi_chap = Jun 11 23:13:15.343428 np0000002687 nova-compute[98431]: iface.strict_login_compliance = Jun 11 23:13:15.343428 np0000002687 nova-compute[98431]: iface.discovery_auth = Jun 11 23:13:15.343428 np0000002687 nova-compute[98431]: iface.discovery_logout = Jun 11 23:13:15.343428 np0000002687 nova-compute[98431]: node.discovery_address = Jun 11 23:13:15.343428 np0000002687 nova-compute[98431]: node.discovery_port = 0 Jun 11 23:13:15.343428 np0000002687 nova-compute[98431]: node.discovery_type = fw Jun 11 23:13:15.343428 np0000002687 nova-compute[98431]: node.session.initial_cmdsn = 0 Jun 11 23:13:15.343428 np0000002687 nova-compute[98431]: node.session.initial_login_retry_max = 8 Jun 11 23:13:15.343428 np0000002687 nova-compute[98431]: node.session.xmit_thread_priority = 0 Jun 11 23:13:15.343428 np0000002687 nova-compute[98431]: node.session.cmds_max = 128 Jun 11 23:13:15.343428 np0000002687 nova-compute[98431]: node.session.queue_depth = 32 Jun 11 23:13:15.343428 np0000002687 nova-compute[98431]: node.session.nr_sessions = 1 Jun 11 23:13:15.343428 np0000002687 nova-compute[98431]: node.session.auth.authmethod = None Jun 11 23:13:15.343428 np0000002687 nova-compute[98431]: node.session.auth.username = Jun 11 23:13:15.343428 np0000002687 nova-compute[98431]: node.session.auth.password = *** Jun 11 23:13:15.343428 np0000002687 nova-compute[98431]: node.session.auth.username_in = Jun 11 23:13:15.343428 np0000002687 nova-compute[98431]: node.session.auth.password_in = Jun 11 23:13:15.343428 np0000002687 nova-compute[98431]: node.session.auth.chap_algs = SHA256 Jun 11 23:13:15.343428 np0000002687 nova-compute[98431]: node.session.timeo.replacement_timeout = 120 Jun 11 23:13:15.343428 np0000002687 nova-compute[98431]: node.session.err_timeo.abort_timeout = 15 Jun 11 23:13:15.343428 np0000002687 nova-compute[98431]: node.session.err_timeo.lu_reset_timeout = 30 Jun 11 23:13:15.343428 np0000002687 nova-compute[98431]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 11 23:13:15.343428 np0000002687 nova-compute[98431]: node.session.err_timeo.host_reset_timeout = 60 Jun 11 23:13:15.343428 np0000002687 nova-compute[98431]: node.session.iscsi.FastAbort = Yes Jun 11 23:13:15.343428 np0000002687 nova-compute[98431]: node.session.iscsi.InitialR2T = No Jun 11 23:13:15.343428 np0000002687 nova-compute[98431]: node.session.iscsi.ImmediateData = Yes Jun 11 23:13:15.343428 np0000002687 nova-compute[98431]: node.session.iscsi.FirstBurstLength = 262144 Jun 11 23:13:15.343428 np0000002687 nova-compute[98431]: node.session.iscsi.MaxBurstLength = 16776192 Jun 11 23:13:15.343428 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Retain = 0 Jun 11 23:13:15.343428 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Wait = 2 Jun 11 23:13:15.343428 np0000002687 nova-compute[98431]: node.session.iscsi.MaxConnections = 1 Jun 11 23:13:15.343428 np0000002687 nova-compute[98431]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 11 23:13:15.343428 np0000002687 nova-compute[98431]: node.session.iscsi.ERL = 0 Jun 11 23:13:15.343428 np0000002687 nova-compute[98431]: node.session.scan = auto Jun 11 23:13:15.343428 np0000002687 nova-compute[98431]: node.session.reopen_max = 0 Jun 11 23:13:15.343428 np0000002687 nova-compute[98431]: node.conn[0].address = 192.168.40.100 Jun 11 23:13:15.343428 np0000002687 nova-compute[98431]: node.conn[0].port = 3260 Jun 11 23:13:15.343428 np0000002687 nova-compute[98431]: node.conn[0].startup = manual Jun 11 23:13:15.343428 np0000002687 nova-compute[98431]: node.conn[0].tcp.window_size = 524288 Jun 11 23:13:15.343428 np0000002687 nova-compute[98431]: node.conn[0].tcp.type_of_service = 0 Jun 11 23:13:15.343428 np0000002687 nova-compute[98431]: node.conn[0].timeo.logout_timeout = 15 Jun 11 23:13:15.343428 np0000002687 nova-compute[98431]: node.conn[0].timeo.login_timeout = 15 Jun 11 23:13:15.343428 np0000002687 nova-compute[98431]: node.conn[0].timeo.auth_timeout = 45 Jun 11 23:13:15.343428 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_interval = 5 Jun 11 23:13:15.343428 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_timeout = 5 Jun 11 23:13:15.343428 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 11 23:13:15.343428 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 11 23:13:15.343428 np0000002687 nova-compute[98431]: node.conn[0].iscsi.HeaderDigest = None Jun 11 23:13:15.343428 np0000002687 nova-compute[98431]: node.conn[0].iscsi.DataDigest = None Jun 11 23:13:15.343428 np0000002687 nova-compute[98431]: node.conn[0].iscsi.IFMarker = No Jun 11 23:13:15.343428 np0000002687 nova-compute[98431]: node.conn[0].iscsi.OFMarker = No Jun 11 23:13:15.343428 np0000002687 nova-compute[98431]: # END RECORD Jun 11 23:13:15.343428 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:13:15.356872 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ce3945-e947-4bae-97d5-8f9b1119d6b5 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 11 23:13:15.356872 np0000002687 nova-compute[98431]: node.name = iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff Jun 11 23:13:15.356872 np0000002687 nova-compute[98431]: node.tpgt = -1 Jun 11 23:13:15.356872 np0000002687 nova-compute[98431]: node.startup = manual Jun 11 23:13:15.356872 np0000002687 nova-compute[98431]: node.leading_login = No Jun 11 23:13:15.356872 np0000002687 nova-compute[98431]: iface.iscsi_ifacename = default Jun 11 23:13:15.356872 np0000002687 nova-compute[98431]: iface.net_ifacename = Jun 11 23:13:15.356872 np0000002687 nova-compute[98431]: iface.ipaddress = Jun 11 23:13:15.356872 np0000002687 nova-compute[98431]: iface.prefix_len = 0 Jun 11 23:13:15.356872 np0000002687 nova-compute[98431]: iface.hwaddress = Jun 11 23:13:15.356872 np0000002687 nova-compute[98431]: iface.transport_name = tcp Jun 11 23:13:15.356872 np0000002687 nova-compute[98431]: iface.initiatorname = Jun 11 23:13:15.356872 np0000002687 nova-compute[98431]: iface.state = Jun 11 23:13:15.356872 np0000002687 nova-compute[98431]: iface.vlan_id = 0 Jun 11 23:13:15.356872 np0000002687 nova-compute[98431]: iface.vlan_priority = 0 Jun 11 23:13:15.356872 np0000002687 nova-compute[98431]: iface.vlan_state = Jun 11 23:13:15.356872 np0000002687 nova-compute[98431]: iface.iface_num = 0 Jun 11 23:13:15.356872 np0000002687 nova-compute[98431]: iface.mtu = 0 Jun 11 23:13:15.356872 np0000002687 nova-compute[98431]: iface.port = 0 Jun 11 23:13:15.356872 np0000002687 nova-compute[98431]: iface.bootproto = Jun 11 23:13:15.356872 np0000002687 nova-compute[98431]: iface.subnet_mask = Jun 11 23:13:15.356872 np0000002687 nova-compute[98431]: iface.gateway = Jun 11 23:13:15.356872 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id_state = Jun 11 23:13:15.356872 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id = Jun 11 23:13:15.356872 np0000002687 nova-compute[98431]: iface.dhcp_dns = Jun 11 23:13:15.356872 np0000002687 nova-compute[98431]: iface.dhcp_learn_iqn = Jun 11 23:13:15.356872 np0000002687 nova-compute[98431]: iface.dhcp_req_vendor_id_state = Jun 11 23:13:15.356872 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id_state = Jun 11 23:13:15.356872 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id = Jun 11 23:13:15.356872 np0000002687 nova-compute[98431]: iface.dhcp_slp_da = Jun 11 23:13:15.356872 np0000002687 nova-compute[98431]: iface.fragmentation = Jun 11 23:13:15.356872 np0000002687 nova-compute[98431]: iface.gratuitous_arp = Jun 11 23:13:15.356872 np0000002687 nova-compute[98431]: iface.incoming_forwarding = Jun 11 23:13:15.356872 np0000002687 nova-compute[98431]: iface.tos_state = Jun 11 23:13:15.356872 np0000002687 nova-compute[98431]: iface.tos = 0 Jun 11 23:13:15.356872 np0000002687 nova-compute[98431]: iface.ttl = 0 Jun 11 23:13:15.356872 np0000002687 nova-compute[98431]: iface.delayed_ack = Jun 11 23:13:15.356872 np0000002687 nova-compute[98431]: iface.tcp_nagle = Jun 11 23:13:15.356872 np0000002687 nova-compute[98431]: iface.tcp_wsf_state = Jun 11 23:13:15.356872 np0000002687 nova-compute[98431]: iface.tcp_wsf = 0 Jun 11 23:13:15.356872 np0000002687 nova-compute[98431]: iface.tcp_timer_scale = 0 Jun 11 23:13:15.356872 np0000002687 nova-compute[98431]: iface.tcp_timestamp = Jun 11 23:13:15.356872 np0000002687 nova-compute[98431]: iface.redirect = Jun 11 23:13:15.356872 np0000002687 nova-compute[98431]: iface.def_task_mgmt_timeout = 0 Jun 11 23:13:15.356872 np0000002687 nova-compute[98431]: iface.header_digest = Jun 11 23:13:15.356872 np0000002687 nova-compute[98431]: iface.data_digest = Jun 11 23:13:15.356872 np0000002687 nova-compute[98431]: iface.immediate_data = Jun 11 23:13:15.356872 np0000002687 nova-compute[98431]: iface.initial_r2t = Jun 11 23:13:15.356872 np0000002687 nova-compute[98431]: iface.data_seq_inorder = Jun 11 23:13:15.356872 np0000002687 nova-compute[98431]: iface.data_pdu_inorder = Jun 11 23:13:15.356872 np0000002687 nova-compute[98431]: iface.erl = 0 Jun 11 23:13:15.356872 np0000002687 nova-compute[98431]: iface.max_receive_data_len = 0 Jun 11 23:13:15.356872 np0000002687 nova-compute[98431]: iface.first_burst_len = 0 Jun 11 23:13:15.356872 np0000002687 nova-compute[98431]: iface.max_outstanding_r2t = 0 Jun 11 23:13:15.356872 np0000002687 nova-compute[98431]: iface.max_burst_len = 0 Jun 11 23:13:15.356872 np0000002687 nova-compute[98431]: iface.chap_auth = Jun 11 23:13:15.356872 np0000002687 nova-compute[98431]: iface.bidi_chap = Jun 11 23:13:15.356872 np0000002687 nova-compute[98431]: iface.strict_login_compliance = Jun 11 23:13:15.356872 np0000002687 nova-compute[98431]: iface.discovery_auth = Jun 11 23:13:15.356872 np0000002687 nova-compute[98431]: iface.discovery_logout = Jun 11 23:13:15.356872 np0000002687 nova-compute[98431]: node.discovery_address = Jun 11 23:13:15.356872 np0000002687 nova-compute[98431]: node.discovery_port = 0 Jun 11 23:13:15.356872 np0000002687 nova-compute[98431]: node.discovery_type = fw Jun 11 23:13:15.356872 np0000002687 nova-compute[98431]: node.session.initial_cmdsn = 0 Jun 11 23:13:15.356872 np0000002687 nova-compute[98431]: node.session.initial_login_retry_max = 8 Jun 11 23:13:15.356872 np0000002687 nova-compute[98431]: node.session.xmit_thread_priority = 0 Jun 11 23:13:15.356872 np0000002687 nova-compute[98431]: node.session.cmds_max = 128 Jun 11 23:13:15.356872 np0000002687 nova-compute[98431]: node.session.queue_depth = 32 Jun 11 23:13:15.356872 np0000002687 nova-compute[98431]: node.session.nr_sessions = 1 Jun 11 23:13:15.356872 np0000002687 nova-compute[98431]: node.session.auth.authmethod = None Jun 11 23:13:15.356872 np0000002687 nova-compute[98431]: node.session.auth.username = Jun 11 23:13:15.356872 np0000002687 nova-compute[98431]: node.session.auth.password = *** Jun 11 23:13:15.356872 np0000002687 nova-compute[98431]: node.session.auth.username_in = Jun 11 23:13:15.356872 np0000002687 nova-compute[98431]: node.session.auth.password_in = Jun 11 23:13:15.356872 np0000002687 nova-compute[98431]: node.session.auth.chap_algs = SHA256 Jun 11 23:13:15.356872 np0000002687 nova-compute[98431]: node.session.timeo.replacement_timeout = 120 Jun 11 23:13:15.356872 np0000002687 nova-compute[98431]: node.session.err_timeo.abort_timeout = 15 Jun 11 23:13:15.356872 np0000002687 nova-compute[98431]: node.session.err_timeo.lu_reset_timeout = 30 Jun 11 23:13:15.356872 np0000002687 nova-compute[98431]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 11 23:13:15.356872 np0000002687 nova-compute[98431]: node.session.err_timeo.host_reset_timeout = 60 Jun 11 23:13:15.356872 np0000002687 nova-compute[98431]: node.session.iscsi.FastAbort = Yes Jun 11 23:13:15.356872 np0000002687 nova-compute[98431]: node.session.iscsi.InitialR2T = No Jun 11 23:13:15.356872 np0000002687 nova-compute[98431]: node.session.iscsi.ImmediateData = Yes Jun 11 23:13:15.356872 np0000002687 nova-compute[98431]: node.session.iscsi.FirstBurstLength = 262144 Jun 11 23:13:15.356872 np0000002687 nova-compute[98431]: node.session.iscsi.MaxBurstLength = 16776192 Jun 11 23:13:15.356872 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Retain = 0 Jun 11 23:13:15.356872 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Wait = 2 Jun 11 23:13:15.356872 np0000002687 nova-compute[98431]: node.session.iscsi.MaxConnections = 1 Jun 11 23:13:15.356872 np0000002687 nova-compute[98431]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 11 23:13:15.356872 np0000002687 nova-compute[98431]: node.session.iscsi.ERL = 0 Jun 11 23:13:15.356872 np0000002687 nova-compute[98431]: node.session.scan = auto Jun 11 23:13:15.356872 np0000002687 nova-compute[98431]: node.session.reopen_max = 0 Jun 11 23:13:15.356872 np0000002687 nova-compute[98431]: node.conn[0].address = 192.168.50.100 Jun 11 23:13:15.356872 np0000002687 nova-compute[98431]: node.conn[0].port = 3260 Jun 11 23:13:15.356872 np0000002687 nova-compute[98431]: node.conn[0].startup = manual Jun 11 23:13:15.356872 np0000002687 nova-compute[98431]: node.conn[0].tcp.window_size = 524288 Jun 11 23:13:15.356872 np0000002687 nova-compute[98431]: node.conn[0].tcp.type_of_service = 0 Jun 11 23:13:15.356872 np0000002687 nova-compute[98431]: node.conn[0].timeo.logout_timeout = 15 Jun 11 23:13:15.356872 np0000002687 nova-compute[98431]: node.conn[0].timeo.login_timeout = 15 Jun 11 23:13:15.356872 np0000002687 nova-compute[98431]: node.conn[0].timeo.auth_timeout = 45 Jun 11 23:13:15.356872 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_interval = 5 Jun 11 23:13:15.356872 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_timeout = 5 Jun 11 23:13:15.356872 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 11 23:13:15.356872 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 11 23:13:15.356872 np0000002687 nova-compute[98431]: node.conn[0].iscsi.HeaderDigest = None Jun 11 23:13:15.356872 np0000002687 nova-compute[98431]: node.conn[0].iscsi.DataDigest = None Jun 11 23:13:15.356872 np0000002687 nova-compute[98431]: node.conn[0].iscsi.IFMarker = No Jun 11 23:13:15.356872 np0000002687 nova-compute[98431]: node.conn[0].iscsi.OFMarker = No Jun 11 23:13:15.356872 np0000002687 nova-compute[98431]: # END RECORD Jun 11 23:13:15.356872 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:13:15.364572 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ce3945-e947-4bae-97d5-8f9b1119d6b5 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:13:15.374218 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ce3945-e947-4bae-97d5-8f9b1119d6b5 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:13:15.390057 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ce3945-e947-4bae-97d5-8f9b1119d6b5 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:15.390057 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:15.390057 np0000002687 nova-compute[98431]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:13:15.390057 np0000002687 nova-compute[98431]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:13:15.390057 np0000002687 nova-compute[98431]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979 (non-flash) Jun 11 23:13:15.390057 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:15.390057 np0000002687 nova-compute[98431]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979 (non-flash) Jun 11 23:13:15.390057 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:15.390057 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:13:15.390057 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ce3945-e947-4bae-97d5-8f9b1119d6b5 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] iscsi session list stdout=tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:15.390057 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:15.390057 np0000002687 nova-compute[98431]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:13:15.390057 np0000002687 nova-compute[98431]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:13:15.390057 np0000002687 nova-compute[98431]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979 (non-flash) Jun 11 23:13:15.390057 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:15.390057 np0000002687 nova-compute[98431]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979 (non-flash) Jun 11 23:13:15.390057 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:15.390057 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:13:15.398769 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ce3945-e947-4bae-97d5-8f9b1119d6b5 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:15.398769 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:15.398769 np0000002687 nova-compute[98431]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:13:15.398769 np0000002687 nova-compute[98431]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:13:15.398769 np0000002687 nova-compute[98431]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979 (non-flash) Jun 11 23:13:15.398769 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:15.398769 np0000002687 nova-compute[98431]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979 (non-flash) Jun 11 23:13:15.398769 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:15.398769 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:13:15.399432 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ce3945-e947-4bae-97d5-8f9b1119d6b5 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] iscsi session list stdout=tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:15.399432 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:15.399432 np0000002687 nova-compute[98431]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:13:15.399432 np0000002687 nova-compute[98431]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:13:15.399432 np0000002687 nova-compute[98431]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979 (non-flash) Jun 11 23:13:15.399432 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:15.399432 np0000002687 nova-compute[98431]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979 (non-flash) Jun 11 23:13:15.399432 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:15.399432 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:13:15.405321 np0000002687 nova-compute[98431]: INFO nova.compute.manager [-] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Took 1.93 seconds to deallocate network for instance. Jun 11 23:13:15.438250 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ce3945-e947-4bae-97d5-8f9b1119d6b5 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff, portal: 192.168.40.100,3260] Jun 11 23:13:15.438250 np0000002687 nova-compute[98431]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff, portal: 192.168.40.100,3260] successful. Jun 11 23:13:15.438250 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:13:15.456117 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ce3945-e947-4bae-97d5-8f9b1119d6b5 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff, portal: 192.168.50.100,3260] Jun 11 23:13:15.456117 np0000002687 nova-compute[98431]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff, portal: 192.168.50.100,3260] successful. Jun 11 23:13:15.456117 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:13:15.456813 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ce3945-e947-4bae-97d5-8f9b1119d6b5 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:13:15.474877 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ce3945-e947-4bae-97d5-8f9b1119d6b5 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:13:15.482988 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ce3945-e947-4bae-97d5-8f9b1119d6b5 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:15.482988 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:15.482988 np0000002687 nova-compute[98431]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:13:15.482988 np0000002687 nova-compute[98431]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:13:15.482988 np0000002687 nova-compute[98431]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979 (non-flash) Jun 11 23:13:15.482988 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:15.482988 np0000002687 nova-compute[98431]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979 (non-flash) Jun 11 23:13:15.482988 np0000002687 nova-compute[98431]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:13:15.482988 np0000002687 nova-compute[98431]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:13:15.482988 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:15.482988 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:13:15.483418 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ce3945-e947-4bae-97d5-8f9b1119d6b5 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] iscsi session list stdout=tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:15.483418 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:15.483418 np0000002687 nova-compute[98431]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:13:15.483418 np0000002687 nova-compute[98431]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:13:15.483418 np0000002687 nova-compute[98431]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979 (non-flash) Jun 11 23:13:15.483418 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:15.483418 np0000002687 nova-compute[98431]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979 (non-flash) Jun 11 23:13:15.483418 np0000002687 nova-compute[98431]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:13:15.483418 np0000002687 nova-compute[98431]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:13:15.483418 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:15.483418 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:13:15.483418 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-74ce3945-e947-4bae-97d5-8f9b1119d6b5 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.197s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 11 23:13:15.483876 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ce3945-e947-4bae-97d5-8f9b1119d6b5 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Connected to 192.168.40.100:3260 {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 11 23:13:15.484893 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-74ce3945-e947-4bae-97d5-8f9b1119d6b5 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] HCTL ('13', '-', '-', 0) found on session 31 with lun 0 {{(pid=98431) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 11 23:13:15.484893 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-74ce3945-e947-4bae-97d5-8f9b1119d6b5 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98431) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 11 23:13:15.494184 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ce3945-e947-4bae-97d5-8f9b1119d6b5 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:15.494184 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:15.494184 np0000002687 nova-compute[98431]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:13:15.494184 np0000002687 nova-compute[98431]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:13:15.494184 np0000002687 nova-compute[98431]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979 (non-flash) Jun 11 23:13:15.494184 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:15.494184 np0000002687 nova-compute[98431]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979 (non-flash) Jun 11 23:13:15.494184 np0000002687 nova-compute[98431]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:13:15.494184 np0000002687 nova-compute[98431]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:13:15.494184 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:15.494184 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:13:15.494609 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ce3945-e947-4bae-97d5-8f9b1119d6b5 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] iscsi session list stdout=tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:15.494609 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:15.494609 np0000002687 nova-compute[98431]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:13:15.494609 np0000002687 nova-compute[98431]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:13:15.494609 np0000002687 nova-compute[98431]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979 (non-flash) Jun 11 23:13:15.494609 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:15.494609 np0000002687 nova-compute[98431]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979 (non-flash) Jun 11 23:13:15.494609 np0000002687 nova-compute[98431]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:13:15.494609 np0000002687 nova-compute[98431]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:13:15.494609 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:15.494609 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:13:15.494609 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-74ce3945-e947-4bae-97d5-8f9b1119d6b5 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.207s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 11 23:13:15.494954 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ce3945-e947-4bae-97d5-8f9b1119d6b5 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Connected to 192.168.50.100:3260 {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 11 23:13:15.495636 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-74ce3945-e947-4bae-97d5-8f9b1119d6b5 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] HCTL ('14', '-', '-', 0) found on session 32 with lun 0 {{(pid=98431) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 11 23:13:15.495720 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-74ce3945-e947-4bae-97d5-8f9b1119d6b5 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98431) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 11 23:13:15.510651 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-74ce3945-e947-4bae-97d5-8f9b1119d6b5 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Searching for a device in session 31 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98431) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 11 23:13:15.510651 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ce3945-e947-4bae-97d5-8f9b1119d6b5 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f535b91b-3bff-46ad-905e-644bd012b9ff', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 11 23:13:15.523279 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-74ce3945-e947-4bae-97d5-8f9b1119d6b5 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Searching for a device in session 32 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98431) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 11 23:13:15.523279 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ce3945-e947-4bae-97d5-8f9b1119d6b5 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'f535b91b-3bff-46ad-905e-644bd012b9ff', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 11 23:13:15.650751 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-ef82fd92-7363-459e-b49c-cf8cb4c97db5 req-d1342d68-2148-4163-bf6f-f6f86b9e1355 service nova] [instance: 19beb2a4-b3fe-43e9-ac92-71446c2630ee] Received event network-vif-unplugged-4c1f7e6e-b361-4522-84d4-5bf89a5eb631 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:13:15.650751 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-ef82fd92-7363-459e-b49c-cf8cb4c97db5 req-d1342d68-2148-4163-bf6f-f6f86b9e1355 service nova] Acquiring lock "19beb2a4-b3fe-43e9-ac92-71446c2630ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:15.650751 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-ef82fd92-7363-459e-b49c-cf8cb4c97db5 req-d1342d68-2148-4163-bf6f-f6f86b9e1355 service nova] Lock "19beb2a4-b3fe-43e9-ac92-71446c2630ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:15.650751 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-ef82fd92-7363-459e-b49c-cf8cb4c97db5 req-d1342d68-2148-4163-bf6f-f6f86b9e1355 service nova] Lock "19beb2a4-b3fe-43e9-ac92-71446c2630ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:15.650751 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-ef82fd92-7363-459e-b49c-cf8cb4c97db5 req-d1342d68-2148-4163-bf6f-f6f86b9e1355 service nova] [instance: 19beb2a4-b3fe-43e9-ac92-71446c2630ee] No waiting events found dispatching network-vif-unplugged-4c1f7e6e-b361-4522-84d4-5bf89a5eb631 {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:13:15.650751 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-ef82fd92-7363-459e-b49c-cf8cb4c97db5 req-d1342d68-2148-4163-bf6f-f6f86b9e1355 service nova] [instance: 19beb2a4-b3fe-43e9-ac92-71446c2630ee] Received event network-vif-unplugged-4c1f7e6e-b361-4522-84d4-5bf89a5eb631 for instance with task_state deleting. {{(pid=98431) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 11 23:13:15.650751 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-ef82fd92-7363-459e-b49c-cf8cb4c97db5 req-d1342d68-2148-4163-bf6f-f6f86b9e1355 service nova] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Received event network-vif-deleted-2d6dd8b9-e3ff-462f-92cf-8c3a62bc27d1 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:13:15.653663 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-ef82fd92-7363-459e-b49c-cf8cb4c97db5 req-d1342d68-2148-4163-bf6f-f6f86b9e1355 service nova] [instance: 19beb2a4-b3fe-43e9-ac92-71446c2630ee] Received event network-vif-unplugged-4c1f7e6e-b361-4522-84d4-5bf89a5eb631 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:13:15.653663 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-ef82fd92-7363-459e-b49c-cf8cb4c97db5 req-d1342d68-2148-4163-bf6f-f6f86b9e1355 service nova] Acquiring lock "19beb2a4-b3fe-43e9-ac92-71446c2630ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:15.653663 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-ef82fd92-7363-459e-b49c-cf8cb4c97db5 req-d1342d68-2148-4163-bf6f-f6f86b9e1355 service nova] Lock "19beb2a4-b3fe-43e9-ac92-71446c2630ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:15.653663 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-ef82fd92-7363-459e-b49c-cf8cb4c97db5 req-d1342d68-2148-4163-bf6f-f6f86b9e1355 service nova] Lock "19beb2a4-b3fe-43e9-ac92-71446c2630ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:15.653663 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-ef82fd92-7363-459e-b49c-cf8cb4c97db5 req-d1342d68-2148-4163-bf6f-f6f86b9e1355 service nova] [instance: 19beb2a4-b3fe-43e9-ac92-71446c2630ee] No waiting events found dispatching network-vif-unplugged-4c1f7e6e-b361-4522-84d4-5bf89a5eb631 {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:13:15.653915 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-ef82fd92-7363-459e-b49c-cf8cb4c97db5 req-d1342d68-2148-4163-bf6f-f6f86b9e1355 service nova] [instance: 19beb2a4-b3fe-43e9-ac92-71446c2630ee] Received event network-vif-unplugged-4c1f7e6e-b361-4522-84d4-5bf89a5eb631 for instance with task_state deleting. {{(pid=98431) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 11 23:13:15.759825 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Instance cache missing network info. {{(pid=98431) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 11 23:13:15.765658 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:15.766034 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:15.774652 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98431) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 11 23:13:15.774892 np0000002687 nova-compute[98431]: INFO nova.compute.claims [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: dd1dd46c-2231-40b4-aa61-0121733a932d] Claim successful on node np0000002687 Jun 11 23:13:15.816717 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Acquiring lock "67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:15.822118 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Lock "67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.005s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:15.830181 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-607e16d9-c1f7-46ec-b678-4b7f67d0bbce req-72192662-6d73-4509-9b33-88e03c5e1b0c service nova] [instance: 19beb2a4-b3fe-43e9-ac92-71446c2630ee] Received event network-vif-deleted-4c1f7e6e-b361-4522-84d4-5bf89a5eb631 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:13:15.832447 np0000002687 nova-compute[98431]: INFO nova.compute.manager [req-607e16d9-c1f7-46ec-b678-4b7f67d0bbce req-72192662-6d73-4509-9b33-88e03c5e1b0c service nova] [instance: 19beb2a4-b3fe-43e9-ac92-71446c2630ee] Neutron deleted interface 4c1f7e6e-b361-4522-84d4-5bf89a5eb631; detaching it from the instance and deleting it from the info cache Jun 11 23:13:15.839446 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-607e16d9-c1f7-46ec-b678-4b7f67d0bbce req-72192662-6d73-4509-9b33-88e03c5e1b0c service nova] [instance: 19beb2a4-b3fe-43e9-ac92-71446c2630ee] Detach interface failed, port_id=4c1f7e6e-b361-4522-84d4-5bf89a5eb631, reason: Instance 19beb2a4-b3fe-43e9-ac92-71446c2630ee could not be found. {{(pid=98431) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}} Jun 11 23:13:15.840345 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Releasing lock "refresh_cache-7609742e-a3a2-4be2-ba02-227efb2101e1" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 11 23:13:15.921173 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-f5716233-3f0d-42a6-bd7c-91c2397637ee tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:15.968831 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:13:16.223331 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [-] [instance: 19beb2a4-b3fe-43e9-ac92-71446c2630ee] Updating instance_info_cache with network_info: [] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:13:16.288963 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ce3945-e947-4bae-97d5-8f9b1119d6b5 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98431) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 11 23:13:16.302374 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:13:16.331843 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: 67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f] Starting instance... {{(pid=98431) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 11 23:13:16.348130 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Creating tmpfile /opt/stack/data/nova/instances/7609742e-a3a2-4be2-ba02-227efb2101e1/tmpvuai7psj to verify with other compute node that the instance is on the same shared storage. {{(pid=98431) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:10568}} Jun 11 23:13:16.348671 np0000002687 nova-compute[98431]: DEBUG nova.compute.rpcapi [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98431) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}} Jun 11 23:13:16.694043 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:13:16.726709 np0000002687 nova-compute[98431]: INFO nova.compute.manager [-] [instance: 19beb2a4-b3fe-43e9-ac92-71446c2630ee] Took 1.66 seconds to deallocate network for instance. Jun 11 23:13:16.836849 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] No BDM found with device name hda, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:13:16.837368 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] No BDM found with device name vda, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:13:16.837368 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:13:16.837368 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] No VIF found with MAC fa:16:3e:8f:ae:21, not building metadata {{(pid=98431) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13199}} Jun 11 23:13:16.839288 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Using config drive Jun 11 23:13:16.864010 np0000002687 nova-compute[98431]: DEBUG nova.scheduler.client.report [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Refreshing inventories for resource provider e3e65fe2-9de9-4821-8b4a-ccae37c66e25 {{(pid=98431) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:822}} Jun 11 23:13:16.880112 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:16.887998 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:16.915338 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:16.925348 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:16.935025 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:16.941996 np0000002687 nova-compute[98431]: DEBUG nova.scheduler.client.report [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Updating ProviderTree inventory for provider e3e65fe2-9de9-4821-8b4a-ccae37c66e25 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98431) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:786}} Jun 11 23:13:16.941996 np0000002687 nova-compute[98431]: DEBUG nova.compute.provider_tree [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Updating inventory in ProviderTree for provider e3e65fe2-9de9-4821-8b4a-ccae37c66e25 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98431) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}} Jun 11 23:13:16.947102 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:17.005929 np0000002687 nova-compute[98431]: DEBUG nova.scheduler.client.report [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Refreshing aggregate associations for resource provider e3e65fe2-9de9-4821-8b4a-ccae37c66e25, aggregates: None {{(pid=98431) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:831}} Jun 11 23:13:17.064884 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:17.083858 np0000002687 nova-compute[98431]: DEBUG nova.scheduler.client.report [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Refreshing trait associations for resource provider e3e65fe2-9de9-4821-8b4a-ccae37c66e25, traits: COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_VIRTIO,COMPUTE_ARCH_X86_64,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SECURITY_STATELESS_FIRMWARE,COMPUTE_SOUND_MODEL_PCSPK,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_RESCUE_BFV,COMPUTE_SOUND_MODEL_ES1370,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_SOUND_MODEL_ICH6,COMPUTE_SOUND_MODEL_ICH9,COMPUTE_ARCH_S390X,HW_ARCH_X86_64,COMPUTE_ARCH_MIPSEL,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_ADDRESS_SPACE_PASSTHROUGH,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_LAN9118,COMPUTE_SOUND_MODEL_USB,COMPUTE_SOUND_MODEL_SB16,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOUND_MODEL_AC97,COMPUTE_VIOMMU_MODEL_SMMUV3,HW_CPU_X86_MMX,HW_CPU_X86_SSSE3,COMPUTE_ARCH_RISCV64,COMPUTE_NET_VIF_MODEL_IGB,COMPUTE_STORAGE_VIRTIO_FS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SATA,COMPUTE_ARCH_PPC64LE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_ADDRESS_SPACE_EMULATED,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE2,HW_CPU_X86_SSE,COMPUTE_ARCH_AARCH64,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000E {{(pid=98431) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:843}} Jun 11 23:13:17.090740 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:17.208143 np0000002687 nova-compute[98431]: DEBUG nova.utils [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Queued Task(fn=>, remaining_delay=14.999729011999989 future=) {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:13:17.209914 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [-] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Instance destroyed successfully. Jun 11 23:13:17.210620 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Lazy-loading 'resources' on Instance uuid 7609742e-a3a2-4be2-ba02-227efb2101e1 {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:13:17.235394 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-fc764337-eb53-469f-9989-312c3c6908b7 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:17.253913 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:13:17.308885 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ce3945-e947-4bae-97d5-8f9b1119d6b5 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Found WWN 33000000000dc7ddd for multipath device dm-7 {{(pid=98431) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 11 23:13:17.309168 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-74ce3945-e947-4bae-97d5-8f9b1119d6b5 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.042s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 11 23:13:17.309344 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ce3945-e947-4bae-97d5-8f9b1119d6b5 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] <== connect_volume: return (3151ms) {'type': 'block', 'scsi_wwn': '33000000000dc7ddd', 'path': '/dev/dm-7', 'multipath_id': '33000000000dc7ddd'} {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 11 23:13:17.309485 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74ce3945-e947-4bae-97d5-8f9b1119d6b5 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000000dc7ddd', 'path': '/dev/dm-7', 'multipath_id': '33000000000dc7ddd'} {{(pid=98431) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 11 23:13:17.317769 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-74ce3945-e947-4bae-97d5-8f9b1119d6b5 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lazy-loading 'flavor' on Instance uuid 64d7833a-82e8-43e9-83ed-2507197b69bf {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:13:17.342660 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lazy-loading 'ec2_ids' on Instance uuid 0d352738-c7bf-42a2-8260-bf5574a7200d {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:13:17.667280 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:13:17.714607 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-11T23:11:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-872787611',display_name='tempest-ServerActionsTestOtherB-server-872787611',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(12),hidden=False,host='np0000002687',hostname='tempest-serveractionstestotherb-server-872787611',id=13,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE8GCNW5zoKlPJg2gDz6psGsk5eAwUwS5EcLVqi+Ws93aBM9mzyZ9OA4e5k8HR4bk5PDkKar3oCgqC2LYEZaaYcONGX+UXm8H5giZlXKo/6E9eZdQg2l6SXnZTdbPKM4Aw==',key_name='tempest-keypair-1789476090',keypairs=,launch_index=0,launched_at=2026-06-11T23:13:11Z,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=,new_flavor=Flavor(12),node='np0000002687',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='62f47df2e0374879b837bc7431326e62',ramdisk_id='',reservation_id='r-92sxxj92',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1260316994',owner_user_name='tempest-ServerActionsTestOtherB-1260316994-project-member'},tags=,task_state='resize_reverting',terminated_at=None,trusted_certs=,updated_at=2026-06-11T23:13:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2b37a00a21a249339e412bcde7a87f82',uuid=7609742e-a3a2-4be2-ba02-227efb2101e1,vcpu_model=,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "a1e7aeff-5992-43be-bb2c-d504e7019c64", "address": "fa:16:3e:1d:f7:18", "network": {"id": "710d3c5f-1a08-4a35-b3e1-e59f427989c2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2068802531-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62f47df2e0374879b837bc7431326e62", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1e7aeff-59", "ovs_interfaceid": "a1e7aeff-5992-43be-bb2c-d504e7019c64", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 11 23:13:17.714607 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Converting VIF {"id": "a1e7aeff-5992-43be-bb2c-d504e7019c64", "address": "fa:16:3e:1d:f7:18", "network": {"id": "710d3c5f-1a08-4a35-b3e1-e59f427989c2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2068802531-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62f47df2e0374879b837bc7431326e62", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1e7aeff-59", "ovs_interfaceid": "a1e7aeff-5992-43be-bb2c-d504e7019c64", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:13:17.714607 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1d:f7:18,bridge_name='br-int',has_traffic_filtering=True,id=a1e7aeff-5992-43be-bb2c-d504e7019c64,network=Network(710d3c5f-1a08-4a35-b3e1-e59f427989c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1e7aeff-59') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:13:17.714607 np0000002687 nova-compute[98431]: DEBUG os_vif [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1d:f7:18,bridge_name='br-int',has_traffic_filtering=True,id=a1e7aeff-5992-43be-bb2c-d504e7019c64,network=Network(710d3c5f-1a08-4a35-b3e1-e59f427989c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1e7aeff-59') {{(pid=98431) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 11 23:13:17.721344 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:17.721612 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa1e7aeff-59, bridge=br-int, if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:13:17.723852 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:13:17.731975 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-f0a99354-0efb-4a8d-970b-ac88361b005e req-8f498ce2-4aad-4ea0-88fc-dbcbe1099fb4 service nova] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Received event network-vif-unplugged-a1e7aeff-5992-43be-bb2c-d504e7019c64 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:13:17.731975 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-f0a99354-0efb-4a8d-970b-ac88361b005e req-8f498ce2-4aad-4ea0-88fc-dbcbe1099fb4 service nova] Acquiring lock "7609742e-a3a2-4be2-ba02-227efb2101e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:17.731975 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-f0a99354-0efb-4a8d-970b-ac88361b005e req-8f498ce2-4aad-4ea0-88fc-dbcbe1099fb4 service nova] Lock "7609742e-a3a2-4be2-ba02-227efb2101e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:17.731975 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-f0a99354-0efb-4a8d-970b-ac88361b005e req-8f498ce2-4aad-4ea0-88fc-dbcbe1099fb4 service nova] Lock "7609742e-a3a2-4be2-ba02-227efb2101e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:17.731975 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-f0a99354-0efb-4a8d-970b-ac88361b005e req-8f498ce2-4aad-4ea0-88fc-dbcbe1099fb4 service nova] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] No waiting events found dispatching network-vif-unplugged-a1e7aeff-5992-43be-bb2c-d504e7019c64 {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:13:17.732397 np0000002687 nova-compute[98431]: WARNING nova.compute.manager [req-f0a99354-0efb-4a8d-970b-ac88361b005e req-8f498ce2-4aad-4ea0-88fc-dbcbe1099fb4 service nova] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Received unexpected event network-vif-unplugged-a1e7aeff-5992-43be-bb2c-d504e7019c64 for instance with vm_state resized and task_state resize_reverting. Jun 11 23:13:17.732397 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-f0a99354-0efb-4a8d-970b-ac88361b005e req-8f498ce2-4aad-4ea0-88fc-dbcbe1099fb4 service nova] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Received event network-vif-unplugged-a1e7aeff-5992-43be-bb2c-d504e7019c64 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:13:17.732515 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-f0a99354-0efb-4a8d-970b-ac88361b005e req-8f498ce2-4aad-4ea0-88fc-dbcbe1099fb4 service nova] Acquiring lock "7609742e-a3a2-4be2-ba02-227efb2101e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:17.732866 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-f0a99354-0efb-4a8d-970b-ac88361b005e req-8f498ce2-4aad-4ea0-88fc-dbcbe1099fb4 service nova] Lock "7609742e-a3a2-4be2-ba02-227efb2101e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:17.733014 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-f0a99354-0efb-4a8d-970b-ac88361b005e req-8f498ce2-4aad-4ea0-88fc-dbcbe1099fb4 service nova] Lock "7609742e-a3a2-4be2-ba02-227efb2101e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:17.733486 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-f0a99354-0efb-4a8d-970b-ac88361b005e req-8f498ce2-4aad-4ea0-88fc-dbcbe1099fb4 service nova] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] No waiting events found dispatching network-vif-unplugged-a1e7aeff-5992-43be-bb2c-d504e7019c64 {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:13:17.733647 np0000002687 nova-compute[98431]: WARNING nova.compute.manager [req-f0a99354-0efb-4a8d-970b-ac88361b005e req-8f498ce2-4aad-4ea0-88fc-dbcbe1099fb4 service nova] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Received unexpected event network-vif-unplugged-a1e7aeff-5992-43be-bb2c-d504e7019c64 for instance with vm_state resized and task_state resize_reverting. Jun 11 23:13:17.735039 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:17.736925 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:17.736925 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2000b22a-44e2-43c5-9213-033e821b3d8c) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:13:17.738188 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:13:17.746871 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:17.748971 np0000002687 nova-compute[98431]: INFO os_vif [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1d:f7:18,bridge_name='br-int',has_traffic_filtering=True,id=a1e7aeff-5992-43be-bb2c-d504e7019c64,network=Network(710d3c5f-1a08-4a35-b3e1-e59f427989c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1e7aeff-59') Jun 11 23:13:17.756654 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] calling os-brick to detach iSCSI Volume {{(pid=98431) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jun 11 23:13:17.757041 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979', 'iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2f2d8ccb-5d26-4f0b-bc60-abf6355bf979', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': True}}" {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 11 23:13:17.757220 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 11 23:13:17.757507 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 11 23:13:17.757816 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979', 'iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2f2d8ccb-5d26-4f0b-bc60-abf6355bf979', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 11 23:13:17.757950 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979', 0)] {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 11 23:13:17.801012 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:17.801012 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:17.801012 np0000002687 nova-compute[98431]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:13:17.801012 np0000002687 nova-compute[98431]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:13:17.801012 np0000002687 nova-compute[98431]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979 (non-flash) Jun 11 23:13:17.801012 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:17.801012 np0000002687 nova-compute[98431]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979 (non-flash) Jun 11 23:13:17.801012 np0000002687 nova-compute[98431]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:13:17.801012 np0000002687 nova-compute[98431]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:13:17.801012 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:17.801012 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:13:17.801573 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] iscsi session list stdout=tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:17.801573 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:17.801573 np0000002687 nova-compute[98431]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:13:17.801573 np0000002687 nova-compute[98431]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:13:17.801573 np0000002687 nova-compute[98431]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979 (non-flash) Jun 11 23:13:17.801573 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:17.801573 np0000002687 nova-compute[98431]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979 (non-flash) Jun 11 23:13:17.801573 np0000002687 nova-compute[98431]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:13:17.801573 np0000002687 nova-compute[98431]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:13:17.801573 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:17.801573 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:13:17.801917 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea', '13'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea', '14'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859', '27'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859', '28'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979', '29'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9', '3'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979', '30'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff', '31'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff', '32'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9', '4')] {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 11 23:13:17.802293 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979', '30')] {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 11 23:13:17.803408 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979', '29')] {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 11 23:13:17.804625 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Resulting device map defaultdict(. at 0x7e1ea043f380>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979'): ({'sdd'}, set())}) {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 11 23:13:17.804873 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Removing multipathed devices sdd, sde {{(pid=98431) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 11 23:13:17.805127 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Flush multipath device 3300000009550c01f {{(pid=98431) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jun 11 23:13:17.824663 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-74ce3945-e947-4bae-97d5-8f9b1119d6b5 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] Attempting to attach volume f535b91b-3bff-46ad-905e-644bd012b9ff with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98431) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}} Jun 11 23:13:17.828322 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.guest [None req-74ce3945-e947-4bae-97d5-8f9b1119d6b5 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] attach device xml: Jun 11 23:13:17.828322 np0000002687 nova-compute[98431]: Jun 11 23:13:17.828322 np0000002687 nova-compute[98431]: Jun 11 23:13:17.828322 np0000002687 nova-compute[98431]: Jun 11 23:13:17.828322 np0000002687 nova-compute[98431]: Jun 11 23:13:17.828322 np0000002687 nova-compute[98431]: f535b91b-3bff-46ad-905e-644bd012b9ff Jun 11 23:13:17.828322 np0000002687 nova-compute[98431]: Jun 11 23:13:17.828322 np0000002687 nova-compute[98431]: Jun 11 23:13:17.828322 np0000002687 nova-compute[98431]: {{(pid=98431) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} Jun 11 23:13:17.839424 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98431) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 11 23:13:17.850490 np0000002687 nova-compute[98431]: DEBUG nova.objects.base [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Object Instance<0d352738-c7bf-42a2-8260-bf5574a7200d> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=98431) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 11 23:13:17.850607 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lazy-loading 'keypairs' on Instance uuid 0d352738-c7bf-42a2-8260-bf5574a7200d {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:13:17.885509 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98431) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 11 23:13:17.893039 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:17.942158 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Checking to see if SCSI volumes sdd, sde have been removed. {{(pid=98431) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 11 23:13:17.942158 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] SCSI volumes sdd, sde have been removed. {{(pid=98431) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 11 23:13:17.943166 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Checking to see if device paths {'sdd', 'sde'} are still under multipathd monitoring {{(pid=98431) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 11 23:13:17.957600 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Device paths {'sdd', 'sde'} have been removed from multipathd monitoring. {{(pid=98431) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 11 23:13:17.957808 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979')] {{(pid=98431) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 11 23:13:17.972289 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:13:18.016292 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979, portal: 192.168.40.100,3260] Jun 11 23:13:18.016292 np0000002687 nova-compute[98431]: Logout of [sid: 30, target: iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979, portal: 192.168.40.100,3260] successful. Jun 11 23:13:18.016292 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:13:18.038012 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:13:18.053034 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:13:18.084482 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979, portal: 192.168.50.100,3260] Jun 11 23:13:18.084482 np0000002687 nova-compute[98431]: Logout of [sid: 29, target: iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979, portal: 192.168.50.100,3260] successful. Jun 11 23:13:18.084482 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:13:18.102236 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:13:18.102509 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 11 23:13:18.102650 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] <== disconnect_volume: return (345ms) None {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 11 23:13:18.102812 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Disconnected iSCSI Volume {{(pid=98431) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jun 11 23:13:18.134940 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:13:18.143332 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98431) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 11 23:13:18.143609 np0000002687 nova-compute[98431]: DEBUG nova.compute.provider_tree [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Inventory has not changed in ProviderTree for provider: e3e65fe2-9de9-4821-8b4a-ccae37c66e25 {{(pid=98431) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 11 23:13:18.357187 np0000002687 nova-compute[98431]: DEBUG nova.objects.base [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Object Instance<0d352738-c7bf-42a2-8260-bf5574a7200d> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98431) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 11 23:13:18.359999 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:13:18.454383 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:13:18.519200 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Creating config drive at /opt/stack/data/nova/instances/0d352738-c7bf-42a2-8260-bf5574a7200d/disk.config.rescue Jun 11 23:13:18.522343 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/0d352738-c7bf-42a2-8260-bf5574a7200d/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmphsluvo49 {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:13:18.584067 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/0d352738-c7bf-42a2-8260-bf5574a7200d/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmphsluvo49" returned: 0 in 0.061s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:13:18.647511 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Updating instance_info_cache with network_info: [{"id": "5f9094e3-a3c6-48ea-bfbe-4fa25d19bcf2", "address": "fa:16:3e:b1:9e:6a", "network": {"id": "1cea4f00-aa2e-4d9d-8255-2e7ba484f3ec", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1566230580-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c1e407a42f24b34baf3ee44be9fb337", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f9094e3-a3", "ovs_interfaceid": "5f9094e3-a3c6-48ea-bfbe-4fa25d19bcf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fe1430ca-d60b-47c4-9ac9-96ba7d61f101", "address": "fa:16:3e:ca:17:0a", "network": {"id": "d84f8615-2bee-4c03-b721-d597e25acb42", "bridge": "br-int", "label": "tempest-device-tagging-net1-1869260730", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c1e407a42f24b34baf3ee44be9fb337", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe1430ca-d6", "ovs_interfaceid": "fe1430ca-d60b-47c4-9ac9-96ba7d61f101", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a39a55c7-874a-4a19-a069-8383a5f0bc5a", "address": "fa:16:3e:37:35:68", "network": {"id": "d84f8615-2bee-4c03-b721-d597e25acb42", "bridge": "br-int", "label": "tempest-device-tagging-net1-1869260730", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c1e407a42f24b34baf3ee44be9fb337", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa39a55c7-87", "ovs_interfaceid": "a39a55c7-874a-4a19-a069-8383a5f0bc5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "37aa7cee-88a0-4428-9b2d-45700f1dcab6", "address": "fa:16:3e:12:f4:f7", "network": {"id": "d84f8615-2bee-4c03-b721-d597e25acb42", "bridge": "br-int", "label": "tempest-device-tagging-net1-1869260730", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c1e407a42f24b34baf3ee44be9fb337", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap37aa7cee-88", "ovs_interfaceid": "37aa7cee-88a0-4428-9b2d-45700f1dcab6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e3269961-a3f1-42c8-a49e-37f728b2f3d8", "address": "fa:16:3e:7e:14:0b", "network": {"id": "d84f8615-2bee-4c03-b721-d597e25acb42", "bridge": "br-int", "label": "tempest-device-tagging-net1-1869260730", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c1e407a42f24b34baf3ee44be9fb337", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape3269961-a3", "ovs_interfaceid": "e3269961-a3f1-42c8-a49e-37f728b2f3d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "351eaad5-bf70-43b4-8f79-5bc0027de663", "address": "fa:16:3e:ee:d2:51", "network": {"id": "b0d7ffe8-2fba-456a-8969-949ee402ce5b", "bridge": "br-int", "label": "tempest-device-tagging-net2-84998986", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c1e407a42f24b34baf3ee44be9fb337", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap351eaad5-bf", "ovs_interfaceid": "351eaad5-bf70-43b4-8f79-5bc0027de663", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "004fd6c0-58df-4ceb-9733-267396cae60c", "address": "fa:16:3e:5d:12:c5", "network": {"id": "b0d7ffe8-2fba-456a-8969-949ee402ce5b", "bridge": "br-int", "label": "tempest-device-tagging-net2-84998986", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c1e407a42f24b34baf3ee44be9fb337", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap004fd6c0-58", "ovs_interfaceid": "004fd6c0-58df-4ceb-9733-267396cae60c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:13:18.654830 np0000002687 nova-compute[98431]: DEBUG nova.scheduler.client.report [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Inventory has not changed for provider e3e65fe2-9de9-4821-8b4a-ccae37c66e25 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98431) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 11 23:13:19.071863 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:19.109278 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:19.110378 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:19.159541 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Releasing lock "refresh_cache-1d45c7ce-5760-4f59-9921-feb3e589da8a" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 11 23:13:19.160125 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Instance network_info: |[{"id": "5f9094e3-a3c6-48ea-bfbe-4fa25d19bcf2", "address": "fa:16:3e:b1:9e:6a", "network": {"id": "1cea4f00-aa2e-4d9d-8255-2e7ba484f3ec", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1566230580-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c1e407a42f24b34baf3ee44be9fb337", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f9094e3-a3", "ovs_interfaceid": "5f9094e3-a3c6-48ea-bfbe-4fa25d19bcf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fe1430ca-d60b-47c4-9ac9-96ba7d61f101", "address": "fa:16:3e:ca:17:0a", "network": {"id": "d84f8615-2bee-4c03-b721-d597e25acb42", "bridge": "br-int", "label": "tempest-device-tagging-net1-1869260730", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c1e407a42f24b34baf3ee44be9fb337", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe1430ca-d6", "ovs_interfaceid": "fe1430ca-d60b-47c4-9ac9-96ba7d61f101", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a39a55c7-874a-4a19-a069-8383a5f0bc5a", "address": "fa:16:3e:37:35:68", "network": {"id": "d84f8615-2bee-4c03-b721-d597e25acb42", "bridge": "br-int", "label": "tempest-device-tagging-net1-1869260730", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c1e407a42f24b34baf3ee44be9fb337", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa39a55c7-87", "ovs_interfaceid": "a39a55c7-874a-4a19-a069-8383a5f0bc5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "37aa7cee-88a0-4428-9b2d-45700f1dcab6", "address": "fa:16:3e:12:f4:f7", "network": {"id": "d84f8615-2bee-4c03-b721-d597e25acb42", "bridge": "br-int", "label": "tempest-device-tagging-net1-1869260730", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c1e407a42f24b34baf3ee44be9fb337", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap37aa7cee-88", "ovs_interfaceid": "37aa7cee-88a0-4428-9b2d-45700f1dcab6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e3269961-a3f1-42c8-a49e-37f728b2f3d8", "address": "fa:16:3e:7e:14:0b", "network": {"id": "d84f8615-2bee-4c03-b721-d597e25acb42", "bridge": "br-int", "label": "tempest-device-tagging-net1-1869260730", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c1e407a42f24b34baf3ee44be9fb337", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape3269961-a3", "ovs_interfaceid": "e3269961-a3f1-42c8-a49e-37f728b2f3d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "351eaad5-bf70-43b4-8f79-5bc0027de663", "address": "fa:16:3e:ee:d2:51", "network": {"id": "b0d7ffe8-2fba-456a-8969-949ee402ce5b", "bridge": "br-int", "label": "tempest-device-tagging-net2-84998986", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c1e407a42f24b34baf3ee44be9fb337", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap351eaad5-bf", "ovs_interfaceid": "351eaad5-bf70-43b4-8f79-5bc0027de663", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "004fd6c0-58df-4ceb-9733-267396cae60c", "address": "fa:16:3e:5d:12:c5", "network": {"id": "b0d7ffe8-2fba-456a-8969-949ee402ce5b", "bridge": "br-int", "label": "tempest-device-tagging-net2-84998986", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c1e407a42f24b34baf3ee44be9fb337", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap004fd6c0-58", "ovs_interfaceid": "004fd6c0-58df-4ceb-9733-267396cae60c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98431) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 11 23:13:19.160814 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-6034e07b-88d5-420d-8b80-4b0fe2c8b551 req-35d0987b-b748-4007-94a7-c87f62e3cae0 service nova] Acquired lock "refresh_cache-1d45c7ce-5760-4f59-9921-feb3e589da8a" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 11 23:13:19.161023 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-6034e07b-88d5-420d-8b80-4b0fe2c8b551 req-35d0987b-b748-4007-94a7-c87f62e3cae0 service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Refreshing network info cache for port 004fd6c0-58df-4ceb-9733-267396cae60c {{(pid=98431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 11 23:13:19.165621 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.400s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:19.166242 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: dd1dd46c-2231-40b4-aa61-0121733a932d] Start building networks asynchronously for instance. {{(pid=98431) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 11 23:13:19.172740 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-f5716233-3f0d-42a6-bd7c-91c2397637ee tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 3.252s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:19.177686 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Start _get_guest_xml network_info=[{"id": "5f9094e3-a3c6-48ea-bfbe-4fa25d19bcf2", "address": "fa:16:3e:b1:9e:6a", "network": {"id": "1cea4f00-aa2e-4d9d-8255-2e7ba484f3ec", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1566230580-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c1e407a42f24b34baf3ee44be9fb337", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f9094e3-a3", "ovs_interfaceid": "5f9094e3-a3c6-48ea-bfbe-4fa25d19bcf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fe1430ca-d60b-47c4-9ac9-96ba7d61f101", "address": "fa:16:3e:ca:17:0a", "network": {"id": "d84f8615-2bee-4c03-b721-d597e25acb42", "bridge": "br-int", "label": "tempest-device-tagging-net1-1869260730", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c1e407a42f24b34baf3ee44be9fb337", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe1430ca-d6", "ovs_interfaceid": "fe1430ca-d60b-47c4-9ac9-96ba7d61f101", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a39a55c7-874a-4a19-a069-8383a5f0bc5a", "address": "fa:16:3e:37:35:68", "network": {"id": "d84f8615-2bee-4c03-b721-d597e25acb42", "bridge": "br-int", "label": "tempest-device-tagging-net1-1869260730", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c1e407a42f24b34baf3ee44be9fb337", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa39a55c7-87", "ovs_interfaceid": "a39a55c7-874a-4a19-a069-8383a5f0bc5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "37aa7cee-88a0-4428-9b2d-45700f1dcab6", "address": "fa:16:3e:12:f4:f7", "network": {"id": "d84f8615-2bee-4c03-b721-d597e25acb42", "bridge": "br-int", "label": "tempest-device-tagging-net1-1869260730", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c1e407a42f24b34baf3ee44be9fb337", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap37aa7cee-88", "ovs_interfaceid": "37aa7cee-88a0-4428-9b2d-45700f1dcab6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e3269961-a3f1-42c8-a49e-37f728b2f3d8", "address": "fa:16:3e:7e:14:0b", "network": {"id": "d84f8615-2bee-4c03-b721-d597e25acb42", "bridge": "br-int", "label": "tempest-device-tagging-net1-1869260730", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c1e407a42f24b34baf3ee44be9fb337", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape3269961-a3", "ovs_interfaceid": "e3269961-a3f1-42c8-a49e-37f728b2f3d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "351eaad5-bf70-43b4-8f79-5bc0027de663", "address": "fa:16:3e:ee:d2:51", "network": {"id": "b0d7ffe8-2fba-456a-8969-949ee402ce5b", "bridge": "br-int", "label": "tempest-device-tagging-net2-84998986", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c1e407a42f24b34baf3ee44be9fb337", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap351eaad5-bf", "ovs_interfaceid": "351eaad5-bf70-43b4-8f79-5bc0027de663", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "004fd6c0-58df-4ceb-9733-267396cae60c", "address": "fa:16:3e:5d:12:c5", "network": {"id": "b0d7ffe8-2fba-456a-8969-949ee402ce5b", "bridge": "br-int", "label": "tempest-device-tagging-net2-84998986", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c1e407a42f24b34baf3ee44be9fb337", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap004fd6c0-58", "ovs_interfaceid": "004fd6c0-58df-4ceb-9733-267396cae60c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-11T23:08:20Z,direct_url=,disk_format='qcow2',id=f30640f8-7aca-4300-a085-4706a5209a79,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ce012f9fabdb4ee5a73e212437f59d97',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-11T23:08:23Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'mount_device': '/dev/vda', 'attachment_id': '20fbe269-4aab-47d7-8973-d03dda5e90e8', 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc', 'iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1bc89aea-2378-4237-a440-71ea160649dc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '1d45c7ce-5760-4f59-9921-feb3e589da8a', 'attached_at': '', 'detached_at': '', 'volume_id': '1bc89aea-2378-4237-a440-71ea160649dc', 'serial': '1bc89aea-2378-4237-a440-71ea160649dc'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'volume_type': None}, {'boot_index': 1, 'mount_device': '/dev/vdb', 'attachment_id': '3f5701fe-b4ef-4c1d-90af-e131b7eff37e', 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8', 'iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0eeb4862-dd4f-442d-a749-c347a2ec29f8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '1d45c7ce-5760-4f59-9921-feb3e589da8a', 'attached_at': '', 'detached_at': '', 'volume_id': '0eeb4862-dd4f-442d-a749-c347a2ec29f8', 'serial': '0eeb4862-dd4f-442d-a749-c347a2ec29f8'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'volume_type': None}, {'boot_index': 2, 'mount_device': '/dev/vdc', 'attachment_id': '91ac0835-5052-4157-be4c-a077292d3f3d', 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13', 'iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'cf81e3db-e34d-4a99-b4f7-a47ab33a8f13', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '1d45c7ce-5760-4f59-9921-feb3e589da8a', 'attached_at': '', 'detached_at': '', 'volume_id': 'cf81e3db-e34d-4a99-b4f7-a47ab33a8f13', 'serial': 'cf81e3db-e34d-4a99-b4f7-a47ab33a8f13'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98431) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 11 23:13:19.188864 np0000002687 nova-compute[98431]: WARNING nova.virt.libvirt.driver [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 11 23:13:19.190756 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='f30640f8-7aca-4300-a085-4706a5209a79', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-1366771090', uuid='1d45c7ce-5760-4f59-9921-feb3e589da8a'), owner=OwnerMeta(userid='3dd7997e0762451ca159ee06bf3d9c44', username='tempest-TaggedBootDevicesTest_v242-37151554-project-member', projectid='6c1e407a42f24b34baf3ee44be9fb337', projectname='tempest-TaggedBootDevicesTest_v242-37151554'), image=ImageMeta(id='f30640f8-7aca-4300-a085-4706a5209a79', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "5f9094e3-a3c6-48ea-bfbe-4fa25d19bcf2", "address": "fa:16:3e:b1:9e:6a", "network": {"id": "1cea4f00-aa2e-4d9d-8255-2e7ba484f3ec", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1566230580-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c1e407a42f24b34baf3ee44be9fb337", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f9094e3-a3", "ovs_interfaceid": "5f9094e3-a3c6-48ea-bfbe-4fa25d19bcf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fe1430ca-d60b-47c4-9ac9-96ba7d61f101", "address": "fa:16:3e:ca:17:0a", "network": {"id": "d84f8615-2bee-4c03-b721-d597e25acb42", "bridge": "br-int", "label": "tempest-device-tagging-net1-1869260730", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c1e407a42f24b34baf3ee44be9fb337", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe1430ca-d6", "ovs_interfaceid": "fe1430ca-d60b-47c4-9ac9-96ba7d61f101", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a39a55c7-874a-4a19-a069-8383a5f0bc5a", "address": "fa:16:3e:37:35:68", "network": {"id": "d84f8615-2bee-4c03-b721-d597e25acb42", "bridge": "br-int", "label": "tempest-device-tagging-net1-1869260730", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c1e407a42f24b34baf3ee44be9fb337", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa39a55c7-87", "ovs_interfaceid": "a39a55c7-874a-4a19-a069-8383a5f0bc5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "37aa7cee-88a0-4428-9b2d-45700f1dcab6", "address": "fa:16:3e:12:f4:f7", "network": {"id": "d84f8615-2bee-4c03-b721-d597e25acb42", "bridge": "br-int", "label": "tempest-device-tagging-net1-1869260730", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c1e407a42f24b34baf3ee44be9fb337", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap37aa7cee-88", "ovs_interfaceid": "37aa7cee-88a0-4428-9b2d-45700f1dcab6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e3269961-a3f1-42c8-a49e-37f728b2f3d8", "address": "fa:16:3e:7e:14:0b", "network": {"id": "d84f8615-2bee-4c03-b721-d597e25acb42", "bridge": "br-int", "label": "tempest-device-tagging-net1-1869260730", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c1e407a42f24b34baf3ee44be9fb337", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape3269961-a3", "ovs_interfaceid": "e3269961-a3f1-42c8-a49e-37f728b2f3d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "351eaad5-bf70-43b4-8f79-5bc0027de663", "address": "fa:16:3e:ee:d2:51", "network": {"id": "b0d7ffe8-2fba-456a-8969-949ee402ce5b", "bridge": "br-int", "label": "tempest-device-tagging-net2-84998986", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c1e407a42f24b34baf3ee44be9fb337", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap351eaad5-bf", "ovs_interfaceid": "351eaad5-bf70-43b4-8f79-5bc0027de663", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "004fd6c0-58df-4ceb-9733-267396cae60c", "address": "fa:16:3e:5d:12:c5", "network": {"id": "b0d7ffe8-2fba-456a-8969-949ee402ce5b", "bridge": "br-int", "label": "tempest-device-tagging-net2-84998986", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c1e407a42f24b34baf3ee44be9fb337", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap004fd6c0-58", "ovs_interfaceid": "004fd6c0-58df-4ceb-9733-267396cae60c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1781219599.1901503) {{(pid=98431) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 11 23:13:19.195493 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Searching host: 'np0000002687' for CPU controller through CGroups V1... {{(pid=98431) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 11 23:13:19.195627 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] CPU controller missing on host. {{(pid=98431) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 11 23:13:19.201494 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Searching host: 'np0000002687' for CPU controller through CGroups V2... {{(pid=98431) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 11 23:13:19.201842 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] CPU controller found on host. {{(pid=98431) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 11 23:13:19.203189 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98431) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 11 23:13:19.204877 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-11T23:08:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-11T23:08:20Z,direct_url=,disk_format='qcow2',id=f30640f8-7aca-4300-a085-4706a5209a79,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ce012f9fabdb4ee5a73e212437f59d97',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-11T23:08:23Z,virtual_size=,visibility=), allow threads: True {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 11 23:13:19.204877 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Flavor limits 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 11 23:13:19.204877 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Image limits 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 11 23:13:19.204877 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Flavor pref 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 11 23:13:19.204877 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Image pref 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 11 23:13:19.206211 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 11 23:13:19.206505 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 11 23:13:19.207081 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98431) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 11 23:13:19.207336 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Got 1 possible topologies {{(pid=98431) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 11 23:13:19.207434 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 11 23:13:19.208516 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 11 23:13:19.217945 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:19.224793 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Calling os-brick to attach iSCSI Volume {{(pid=98431) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 11 23:13:19.225292 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc', 'iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1bc89aea-2378-4237-a440-71ea160649dc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 11 23:13:19.225529 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 11 23:13:19.226047 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 11 23:13:19.226564 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc', 'iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1bc89aea-2378-4237-a440-71ea160649dc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98431) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 11 23:13:19.250541 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 11 23:13:19.252958 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 11 23:13:19.252958 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 11 23:13:19.252958 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.iscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 11 23:13:19.253793 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 11 23:13:19.254616 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.iscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 11 23:13:19.269907 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:19.271040 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 11 23:13:19.271040 np0000002687 nova-compute[98431]: {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:13:19.277284 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 11 23:13:19.277284 np0000002687 nova-compute[98431]: {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:13:19.278295 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:19.282413 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:19.286328 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc] added Jun 11 23:13:19.286328 np0000002687 nova-compute[98431]: stderr=iscsiadm: Config file line 363 does not have value Jun 11 23:13:19.286328 np0000002687 nova-compute[98431]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 11 23:13:19.286328 np0000002687 nova-compute[98431]: iscsiadm: Config file line 363 does not have value Jun 11 23:13:19.286328 np0000002687 nova-compute[98431]: iscsiadm: Config file line 363 does not have value Jun 11 23:13:19.286328 np0000002687 nova-compute[98431]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 11 23:13:19.286328 np0000002687 nova-compute[98431]: {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:13:19.286567 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98431) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 11 23:13:19.286661 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0338(s), this was the 1st time calling it. {{(pid=98431) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 11 23:13:19.286864 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98431) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 11 23:13:19.291500 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc] added Jun 11 23:13:19.291500 np0000002687 nova-compute[98431]: stderr=iscsiadm: Config file line 363 does not have value Jun 11 23:13:19.291500 np0000002687 nova-compute[98431]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 11 23:13:19.291500 np0000002687 nova-compute[98431]: iscsiadm: Config file line 363 does not have value Jun 11 23:13:19.291500 np0000002687 nova-compute[98431]: iscsiadm: Config file line 363 does not have value Jun 11 23:13:19.291500 np0000002687 nova-compute[98431]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 11 23:13:19.291500 np0000002687 nova-compute[98431]: {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:13:19.293056 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98431) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 11 23:13:19.293056 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0374(s), this was the 1st time calling it. {{(pid=98431) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 11 23:13:19.293056 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98431) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 11 23:13:19.521959 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-74ce3945-e947-4bae-97d5-8f9b1119d6b5 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] No BDM found with device name vda, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:13:19.522107 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-74ce3945-e947-4bae-97d5-8f9b1119d6b5 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:13:19.522153 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-74ce3945-e947-4bae-97d5-8f9b1119d6b5 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] No BDM found with device name hda, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:13:19.522876 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-74ce3945-e947-4bae-97d5-8f9b1119d6b5 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] No VIF found with MAC fa:16:3e:4b:26:95, not building metadata {{(pid=98431) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13199}} Jun 11 23:13:19.674294 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [req-6034e07b-88d5-420d-8b80-4b0fe2c8b551 req-35d0987b-b748-4007-94a7-c87f62e3cae0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:13:19.688705 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: dd1dd46c-2231-40b4-aa61-0121733a932d] Allocating IP information in the background. {{(pid=98431) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 11 23:13:19.689978 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: dd1dd46c-2231-40b4-aa61-0121733a932d] allocate_for_instance() {{(pid=98431) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 11 23:13:19.690370 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:13:19.693149 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:13:19.811886 np0000002687 nova-compute[98431]: DEBUG nova.policy [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'eaecdd9c05b5485b9422171463cccf92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9f55b231c455ca1a4579d7ed54888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98431) authorize /opt/stack/nova/nova/policy.py:192}} Jun 11 23:13:19.954370 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:20.121981 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Removed pending STOPPED event for 0d352738-c7bf-42a2-8260-bf5574a7200d due to new event Resumed> {{(pid=98431) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:519}} Jun 11 23:13:20.122390 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Emitting event Resumed> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:13:20.122390 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] VM Resumed (Lifecycle Event) Jun 11 23:13:20.132984 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-79cf8edb-45c7-4d2d-a3eb-a7e0b240b3cf tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:13:20.155416 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [req-6034e07b-88d5-420d-8b80-4b0fe2c8b551 req-35d0987b-b748-4007-94a7-c87f62e3cae0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:13:20.193043 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: dd1dd46c-2231-40b4-aa61-0121733a932d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 11 23:13:20.278773 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-f5716233-3f0d-42a6-bd7c-91c2397637ee tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98431) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 11 23:13:20.279102 np0000002687 nova-compute[98431]: DEBUG nova.compute.provider_tree [None req-f5716233-3f0d-42a6-bd7c-91c2397637ee tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Inventory has not changed in ProviderTree for provider: e3e65fe2-9de9-4821-8b4a-ccae37c66e25 {{(pid=98431) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 11 23:13:20.287973 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.iscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 11 23:13:20.292741 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.iscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 11 23:13:20.307126 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 11 23:13:20.307126 np0000002687 nova-compute[98431]: node.name = iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc Jun 11 23:13:20.307126 np0000002687 nova-compute[98431]: node.tpgt = -1 Jun 11 23:13:20.307126 np0000002687 nova-compute[98431]: node.startup = manual Jun 11 23:13:20.307126 np0000002687 nova-compute[98431]: node.leading_login = No Jun 11 23:13:20.307126 np0000002687 nova-compute[98431]: iface.iscsi_ifacename = default Jun 11 23:13:20.307126 np0000002687 nova-compute[98431]: iface.net_ifacename = Jun 11 23:13:20.307126 np0000002687 nova-compute[98431]: iface.ipaddress = Jun 11 23:13:20.307126 np0000002687 nova-compute[98431]: iface.prefix_len = 0 Jun 11 23:13:20.307126 np0000002687 nova-compute[98431]: iface.hwaddress = Jun 11 23:13:20.307126 np0000002687 nova-compute[98431]: iface.transport_name = tcp Jun 11 23:13:20.307126 np0000002687 nova-compute[98431]: iface.initiatorname = Jun 11 23:13:20.307126 np0000002687 nova-compute[98431]: iface.state = Jun 11 23:13:20.307126 np0000002687 nova-compute[98431]: iface.vlan_id = 0 Jun 11 23:13:20.307126 np0000002687 nova-compute[98431]: iface.vlan_priority = 0 Jun 11 23:13:20.307126 np0000002687 nova-compute[98431]: iface.vlan_state = Jun 11 23:13:20.307126 np0000002687 nova-compute[98431]: iface.iface_num = 0 Jun 11 23:13:20.307126 np0000002687 nova-compute[98431]: iface.mtu = 0 Jun 11 23:13:20.307126 np0000002687 nova-compute[98431]: iface.port = 0 Jun 11 23:13:20.307126 np0000002687 nova-compute[98431]: iface.bootproto = Jun 11 23:13:20.307126 np0000002687 nova-compute[98431]: iface.subnet_mask = Jun 11 23:13:20.307126 np0000002687 nova-compute[98431]: iface.gateway = Jun 11 23:13:20.307126 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id_state = Jun 11 23:13:20.307126 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id = Jun 11 23:13:20.307126 np0000002687 nova-compute[98431]: iface.dhcp_dns = Jun 11 23:13:20.307126 np0000002687 nova-compute[98431]: iface.dhcp_learn_iqn = Jun 11 23:13:20.307126 np0000002687 nova-compute[98431]: iface.dhcp_req_vendor_id_state = Jun 11 23:13:20.307126 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id_state = Jun 11 23:13:20.307126 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id = Jun 11 23:13:20.307126 np0000002687 nova-compute[98431]: iface.dhcp_slp_da = Jun 11 23:13:20.307126 np0000002687 nova-compute[98431]: iface.fragmentation = Jun 11 23:13:20.307126 np0000002687 nova-compute[98431]: iface.gratuitous_arp = Jun 11 23:13:20.307126 np0000002687 nova-compute[98431]: iface.incoming_forwarding = Jun 11 23:13:20.307126 np0000002687 nova-compute[98431]: iface.tos_state = Jun 11 23:13:20.307126 np0000002687 nova-compute[98431]: iface.tos = 0 Jun 11 23:13:20.307126 np0000002687 nova-compute[98431]: iface.ttl = 0 Jun 11 23:13:20.307126 np0000002687 nova-compute[98431]: iface.delayed_ack = Jun 11 23:13:20.307126 np0000002687 nova-compute[98431]: iface.tcp_nagle = Jun 11 23:13:20.307126 np0000002687 nova-compute[98431]: iface.tcp_wsf_state = Jun 11 23:13:20.307126 np0000002687 nova-compute[98431]: iface.tcp_wsf = 0 Jun 11 23:13:20.307126 np0000002687 nova-compute[98431]: iface.tcp_timer_scale = 0 Jun 11 23:13:20.307126 np0000002687 nova-compute[98431]: iface.tcp_timestamp = Jun 11 23:13:20.307126 np0000002687 nova-compute[98431]: iface.redirect = Jun 11 23:13:20.307126 np0000002687 nova-compute[98431]: iface.def_task_mgmt_timeout = 0 Jun 11 23:13:20.307126 np0000002687 nova-compute[98431]: iface.header_digest = Jun 11 23:13:20.307126 np0000002687 nova-compute[98431]: iface.data_digest = Jun 11 23:13:20.307126 np0000002687 nova-compute[98431]: iface.immediate_data = Jun 11 23:13:20.307126 np0000002687 nova-compute[98431]: iface.initial_r2t = Jun 11 23:13:20.307126 np0000002687 nova-compute[98431]: iface.data_seq_inorder = Jun 11 23:13:20.307126 np0000002687 nova-compute[98431]: iface.data_pdu_inorder = Jun 11 23:13:20.307126 np0000002687 nova-compute[98431]: iface.erl = 0 Jun 11 23:13:20.307126 np0000002687 nova-compute[98431]: iface.max_receive_data_len = 0 Jun 11 23:13:20.307126 np0000002687 nova-compute[98431]: iface.first_burst_len = 0 Jun 11 23:13:20.307126 np0000002687 nova-compute[98431]: iface.max_outstanding_r2t = 0 Jun 11 23:13:20.307126 np0000002687 nova-compute[98431]: iface.max_burst_len = 0 Jun 11 23:13:20.307126 np0000002687 nova-compute[98431]: iface.chap_auth = Jun 11 23:13:20.307126 np0000002687 nova-compute[98431]: iface.bidi_chap = Jun 11 23:13:20.307126 np0000002687 nova-compute[98431]: iface.strict_login_compliance = Jun 11 23:13:20.307126 np0000002687 nova-compute[98431]: iface.discovery_auth = Jun 11 23:13:20.307126 np0000002687 nova-compute[98431]: iface.discovery_logout = Jun 11 23:13:20.307126 np0000002687 nova-compute[98431]: node.discovery_address = Jun 11 23:13:20.307126 np0000002687 nova-compute[98431]: node.discovery_port = 0 Jun 11 23:13:20.307126 np0000002687 nova-compute[98431]: node.discovery_type = fw Jun 11 23:13:20.307126 np0000002687 nova-compute[98431]: node.session.initial_cmdsn = 0 Jun 11 23:13:20.307126 np0000002687 nova-compute[98431]: node.session.initial_login_retry_max = 8 Jun 11 23:13:20.307126 np0000002687 nova-compute[98431]: node.session.xmit_thread_priority = 0 Jun 11 23:13:20.307126 np0000002687 nova-compute[98431]: node.session.cmds_max = 128 Jun 11 23:13:20.307126 np0000002687 nova-compute[98431]: node.session.queue_depth = 32 Jun 11 23:13:20.307126 np0000002687 nova-compute[98431]: node.session.nr_sessions = 1 Jun 11 23:13:20.307126 np0000002687 nova-compute[98431]: node.session.auth.authmethod = None Jun 11 23:13:20.307126 np0000002687 nova-compute[98431]: node.session.auth.username = Jun 11 23:13:20.307126 np0000002687 nova-compute[98431]: node.session.auth.password = *** Jun 11 23:13:20.307126 np0000002687 nova-compute[98431]: node.session.auth.username_in = Jun 11 23:13:20.307126 np0000002687 nova-compute[98431]: node.session.auth.password_in = Jun 11 23:13:20.307126 np0000002687 nova-compute[98431]: node.session.auth.chap_algs = SHA256 Jun 11 23:13:20.307126 np0000002687 nova-compute[98431]: node.session.timeo.replacement_timeout = 120 Jun 11 23:13:20.307126 np0000002687 nova-compute[98431]: node.session.err_timeo.abort_timeout = 15 Jun 11 23:13:20.307126 np0000002687 nova-compute[98431]: node.session.err_timeo.lu_reset_timeout = 30 Jun 11 23:13:20.307126 np0000002687 nova-compute[98431]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 11 23:13:20.307126 np0000002687 nova-compute[98431]: node.session.err_timeo.host_reset_timeout = 60 Jun 11 23:13:20.307126 np0000002687 nova-compute[98431]: node.session.iscsi.FastAbort = Yes Jun 11 23:13:20.307126 np0000002687 nova-compute[98431]: node.session.iscsi.InitialR2T = No Jun 11 23:13:20.307126 np0000002687 nova-compute[98431]: node.session.iscsi.ImmediateData = Yes Jun 11 23:13:20.307126 np0000002687 nova-compute[98431]: node.session.iscsi.FirstBurstLength = 262144 Jun 11 23:13:20.307126 np0000002687 nova-compute[98431]: node.session.iscsi.MaxBurstLength = 16776192 Jun 11 23:13:20.307126 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Retain = 0 Jun 11 23:13:20.307126 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Wait = 2 Jun 11 23:13:20.307126 np0000002687 nova-compute[98431]: node.session.iscsi.MaxConnections = 1 Jun 11 23:13:20.307126 np0000002687 nova-compute[98431]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 11 23:13:20.307126 np0000002687 nova-compute[98431]: node.session.iscsi.ERL = 0 Jun 11 23:13:20.307126 np0000002687 nova-compute[98431]: node.session.scan = auto Jun 11 23:13:20.307126 np0000002687 nova-compute[98431]: node.session.reopen_max = 0 Jun 11 23:13:20.307126 np0000002687 nova-compute[98431]: node.conn[0].address = 192.168.50.100 Jun 11 23:13:20.307126 np0000002687 nova-compute[98431]: node.conn[0].port = 3260 Jun 11 23:13:20.307126 np0000002687 nova-compute[98431]: node.conn[0].startup = manual Jun 11 23:13:20.307126 np0000002687 nova-compute[98431]: node.conn[0].tcp.window_size = 524288 Jun 11 23:13:20.307126 np0000002687 nova-compute[98431]: node.conn[0].tcp.type_of_service = 0 Jun 11 23:13:20.307126 np0000002687 nova-compute[98431]: node.conn[0].timeo.logout_timeout = 15 Jun 11 23:13:20.307126 np0000002687 nova-compute[98431]: node.conn[0].timeo.login_timeout = 15 Jun 11 23:13:20.307126 np0000002687 nova-compute[98431]: node.conn[0].timeo.auth_timeout = 45 Jun 11 23:13:20.307126 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_interval = 5 Jun 11 23:13:20.307126 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_timeout = 5 Jun 11 23:13:20.307126 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 11 23:13:20.307126 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 11 23:13:20.307126 np0000002687 nova-compute[98431]: node.conn[0].iscsi.HeaderDigest = None Jun 11 23:13:20.307126 np0000002687 nova-compute[98431]: node.conn[0].iscsi.DataDigest = None Jun 11 23:13:20.307126 np0000002687 nova-compute[98431]: node.conn[0].iscsi.IFMarker = No Jun 11 23:13:20.307126 np0000002687 nova-compute[98431]: node.conn[0].iscsi.OFMarker = No Jun 11 23:13:20.307126 np0000002687 nova-compute[98431]: # END RECORD Jun 11 23:13:20.307126 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:13:20.315985 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 11 23:13:20.315985 np0000002687 nova-compute[98431]: node.name = iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc Jun 11 23:13:20.315985 np0000002687 nova-compute[98431]: node.tpgt = -1 Jun 11 23:13:20.315985 np0000002687 nova-compute[98431]: node.startup = manual Jun 11 23:13:20.315985 np0000002687 nova-compute[98431]: node.leading_login = No Jun 11 23:13:20.315985 np0000002687 nova-compute[98431]: iface.iscsi_ifacename = default Jun 11 23:13:20.315985 np0000002687 nova-compute[98431]: iface.net_ifacename = Jun 11 23:13:20.315985 np0000002687 nova-compute[98431]: iface.ipaddress = Jun 11 23:13:20.315985 np0000002687 nova-compute[98431]: iface.prefix_len = 0 Jun 11 23:13:20.315985 np0000002687 nova-compute[98431]: iface.hwaddress = Jun 11 23:13:20.315985 np0000002687 nova-compute[98431]: iface.transport_name = tcp Jun 11 23:13:20.315985 np0000002687 nova-compute[98431]: iface.initiatorname = Jun 11 23:13:20.315985 np0000002687 nova-compute[98431]: iface.state = Jun 11 23:13:20.315985 np0000002687 nova-compute[98431]: iface.vlan_id = 0 Jun 11 23:13:20.315985 np0000002687 nova-compute[98431]: iface.vlan_priority = 0 Jun 11 23:13:20.315985 np0000002687 nova-compute[98431]: iface.vlan_state = Jun 11 23:13:20.315985 np0000002687 nova-compute[98431]: iface.iface_num = 0 Jun 11 23:13:20.315985 np0000002687 nova-compute[98431]: iface.mtu = 0 Jun 11 23:13:20.315985 np0000002687 nova-compute[98431]: iface.port = 0 Jun 11 23:13:20.315985 np0000002687 nova-compute[98431]: iface.bootproto = Jun 11 23:13:20.315985 np0000002687 nova-compute[98431]: iface.subnet_mask = Jun 11 23:13:20.315985 np0000002687 nova-compute[98431]: iface.gateway = Jun 11 23:13:20.315985 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id_state = Jun 11 23:13:20.315985 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id = Jun 11 23:13:20.315985 np0000002687 nova-compute[98431]: iface.dhcp_dns = Jun 11 23:13:20.315985 np0000002687 nova-compute[98431]: iface.dhcp_learn_iqn = Jun 11 23:13:20.315985 np0000002687 nova-compute[98431]: iface.dhcp_req_vendor_id_state = Jun 11 23:13:20.315985 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id_state = Jun 11 23:13:20.315985 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id = Jun 11 23:13:20.315985 np0000002687 nova-compute[98431]: iface.dhcp_slp_da = Jun 11 23:13:20.315985 np0000002687 nova-compute[98431]: iface.fragmentation = Jun 11 23:13:20.315985 np0000002687 nova-compute[98431]: iface.gratuitous_arp = Jun 11 23:13:20.315985 np0000002687 nova-compute[98431]: iface.incoming_forwarding = Jun 11 23:13:20.315985 np0000002687 nova-compute[98431]: iface.tos_state = Jun 11 23:13:20.315985 np0000002687 nova-compute[98431]: iface.tos = 0 Jun 11 23:13:20.315985 np0000002687 nova-compute[98431]: iface.ttl = 0 Jun 11 23:13:20.315985 np0000002687 nova-compute[98431]: iface.delayed_ack = Jun 11 23:13:20.315985 np0000002687 nova-compute[98431]: iface.tcp_nagle = Jun 11 23:13:20.315985 np0000002687 nova-compute[98431]: iface.tcp_wsf_state = Jun 11 23:13:20.315985 np0000002687 nova-compute[98431]: iface.tcp_wsf = 0 Jun 11 23:13:20.315985 np0000002687 nova-compute[98431]: iface.tcp_timer_scale = 0 Jun 11 23:13:20.315985 np0000002687 nova-compute[98431]: iface.tcp_timestamp = Jun 11 23:13:20.315985 np0000002687 nova-compute[98431]: iface.redirect = Jun 11 23:13:20.315985 np0000002687 nova-compute[98431]: iface.def_task_mgmt_timeout = 0 Jun 11 23:13:20.315985 np0000002687 nova-compute[98431]: iface.header_digest = Jun 11 23:13:20.315985 np0000002687 nova-compute[98431]: iface.data_digest = Jun 11 23:13:20.315985 np0000002687 nova-compute[98431]: iface.immediate_data = Jun 11 23:13:20.315985 np0000002687 nova-compute[98431]: iface.initial_r2t = Jun 11 23:13:20.315985 np0000002687 nova-compute[98431]: iface.data_seq_inorder = Jun 11 23:13:20.315985 np0000002687 nova-compute[98431]: iface.data_pdu_inorder = Jun 11 23:13:20.315985 np0000002687 nova-compute[98431]: iface.erl = 0 Jun 11 23:13:20.315985 np0000002687 nova-compute[98431]: iface.max_receive_data_len = 0 Jun 11 23:13:20.315985 np0000002687 nova-compute[98431]: iface.first_burst_len = 0 Jun 11 23:13:20.315985 np0000002687 nova-compute[98431]: iface.max_outstanding_r2t = 0 Jun 11 23:13:20.315985 np0000002687 nova-compute[98431]: iface.max_burst_len = 0 Jun 11 23:13:20.315985 np0000002687 nova-compute[98431]: iface.chap_auth = Jun 11 23:13:20.315985 np0000002687 nova-compute[98431]: iface.bidi_chap = Jun 11 23:13:20.315985 np0000002687 nova-compute[98431]: iface.strict_login_compliance = Jun 11 23:13:20.315985 np0000002687 nova-compute[98431]: iface.discovery_auth = Jun 11 23:13:20.315985 np0000002687 nova-compute[98431]: iface.discovery_logout = Jun 11 23:13:20.315985 np0000002687 nova-compute[98431]: node.discovery_address = Jun 11 23:13:20.315985 np0000002687 nova-compute[98431]: node.discovery_port = 0 Jun 11 23:13:20.315985 np0000002687 nova-compute[98431]: node.discovery_type = fw Jun 11 23:13:20.315985 np0000002687 nova-compute[98431]: node.session.initial_cmdsn = 0 Jun 11 23:13:20.315985 np0000002687 nova-compute[98431]: node.session.initial_login_retry_max = 8 Jun 11 23:13:20.315985 np0000002687 nova-compute[98431]: node.session.xmit_thread_priority = 0 Jun 11 23:13:20.315985 np0000002687 nova-compute[98431]: node.session.cmds_max = 128 Jun 11 23:13:20.315985 np0000002687 nova-compute[98431]: node.session.queue_depth = 32 Jun 11 23:13:20.315985 np0000002687 nova-compute[98431]: node.session.nr_sessions = 1 Jun 11 23:13:20.315985 np0000002687 nova-compute[98431]: node.session.auth.authmethod = None Jun 11 23:13:20.315985 np0000002687 nova-compute[98431]: node.session.auth.username = Jun 11 23:13:20.315985 np0000002687 nova-compute[98431]: node.session.auth.password = *** Jun 11 23:13:20.315985 np0000002687 nova-compute[98431]: node.session.auth.username_in = Jun 11 23:13:20.315985 np0000002687 nova-compute[98431]: node.session.auth.password_in = Jun 11 23:13:20.315985 np0000002687 nova-compute[98431]: node.session.auth.chap_algs = SHA256 Jun 11 23:13:20.315985 np0000002687 nova-compute[98431]: node.session.timeo.replacement_timeout = 120 Jun 11 23:13:20.315985 np0000002687 nova-compute[98431]: node.session.err_timeo.abort_timeout = 15 Jun 11 23:13:20.315985 np0000002687 nova-compute[98431]: node.session.err_timeo.lu_reset_timeout = 30 Jun 11 23:13:20.315985 np0000002687 nova-compute[98431]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 11 23:13:20.315985 np0000002687 nova-compute[98431]: node.session.err_timeo.host_reset_timeout = 60 Jun 11 23:13:20.315985 np0000002687 nova-compute[98431]: node.session.iscsi.FastAbort = Yes Jun 11 23:13:20.315985 np0000002687 nova-compute[98431]: node.session.iscsi.InitialR2T = No Jun 11 23:13:20.315985 np0000002687 nova-compute[98431]: node.session.iscsi.ImmediateData = Yes Jun 11 23:13:20.315985 np0000002687 nova-compute[98431]: node.session.iscsi.FirstBurstLength = 262144 Jun 11 23:13:20.315985 np0000002687 nova-compute[98431]: node.session.iscsi.MaxBurstLength = 16776192 Jun 11 23:13:20.315985 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Retain = 0 Jun 11 23:13:20.315985 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Wait = 2 Jun 11 23:13:20.315985 np0000002687 nova-compute[98431]: node.session.iscsi.MaxConnections = 1 Jun 11 23:13:20.315985 np0000002687 nova-compute[98431]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 11 23:13:20.315985 np0000002687 nova-compute[98431]: node.session.iscsi.ERL = 0 Jun 11 23:13:20.315985 np0000002687 nova-compute[98431]: node.session.scan = auto Jun 11 23:13:20.315985 np0000002687 nova-compute[98431]: node.session.reopen_max = 0 Jun 11 23:13:20.315985 np0000002687 nova-compute[98431]: node.conn[0].address = 192.168.40.100 Jun 11 23:13:20.315985 np0000002687 nova-compute[98431]: node.conn[0].port = 3260 Jun 11 23:13:20.315985 np0000002687 nova-compute[98431]: node.conn[0].startup = manual Jun 11 23:13:20.315985 np0000002687 nova-compute[98431]: node.conn[0].tcp.window_size = 524288 Jun 11 23:13:20.315985 np0000002687 nova-compute[98431]: node.conn[0].tcp.type_of_service = 0 Jun 11 23:13:20.315985 np0000002687 nova-compute[98431]: node.conn[0].timeo.logout_timeout = 15 Jun 11 23:13:20.315985 np0000002687 nova-compute[98431]: node.conn[0].timeo.login_timeout = 15 Jun 11 23:13:20.315985 np0000002687 nova-compute[98431]: node.conn[0].timeo.auth_timeout = 45 Jun 11 23:13:20.315985 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_interval = 5 Jun 11 23:13:20.315985 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_timeout = 5 Jun 11 23:13:20.315985 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 11 23:13:20.315985 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 11 23:13:20.315985 np0000002687 nova-compute[98431]: node.conn[0].iscsi.HeaderDigest = None Jun 11 23:13:20.315985 np0000002687 nova-compute[98431]: node.conn[0].iscsi.DataDigest = None Jun 11 23:13:20.315985 np0000002687 nova-compute[98431]: node.conn[0].iscsi.IFMarker = No Jun 11 23:13:20.315985 np0000002687 nova-compute[98431]: node.conn[0].iscsi.OFMarker = No Jun 11 23:13:20.315985 np0000002687 nova-compute[98431]: # END RECORD Jun 11 23:13:20.315985 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:13:20.326507 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:13:20.336934 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:13:20.357763 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:20.357763 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:20.357763 np0000002687 nova-compute[98431]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:13:20.357763 np0000002687 nova-compute[98431]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:13:20.357763 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:20.357763 np0000002687 nova-compute[98431]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:13:20.357763 np0000002687 nova-compute[98431]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:13:20.357763 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:20.357763 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:13:20.360412 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] iscsi session list stdout=tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:20.360412 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:20.360412 np0000002687 nova-compute[98431]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:13:20.360412 np0000002687 nova-compute[98431]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:13:20.360412 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:20.360412 np0000002687 nova-compute[98431]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:13:20.360412 np0000002687 nova-compute[98431]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:13:20.360412 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:20.360412 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:13:20.364819 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-6034e07b-88d5-420d-8b80-4b0fe2c8b551 req-35d0987b-b748-4007-94a7-c87f62e3cae0 service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Updated VIF entry in instance network info cache for port 004fd6c0-58df-4ceb-9733-267396cae60c. {{(pid=98431) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 11 23:13:20.365577 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-6034e07b-88d5-420d-8b80-4b0fe2c8b551 req-35d0987b-b748-4007-94a7-c87f62e3cae0 service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Updating instance_info_cache with network_info: [{"id": "5f9094e3-a3c6-48ea-bfbe-4fa25d19bcf2", "address": "fa:16:3e:b1:9e:6a", "network": {"id": "1cea4f00-aa2e-4d9d-8255-2e7ba484f3ec", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1566230580-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c1e407a42f24b34baf3ee44be9fb337", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f9094e3-a3", "ovs_interfaceid": "5f9094e3-a3c6-48ea-bfbe-4fa25d19bcf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fe1430ca-d60b-47c4-9ac9-96ba7d61f101", "address": "fa:16:3e:ca:17:0a", "network": {"id": "d84f8615-2bee-4c03-b721-d597e25acb42", "bridge": "br-int", "label": "tempest-device-tagging-net1-1869260730", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c1e407a42f24b34baf3ee44be9fb337", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe1430ca-d6", "ovs_interfaceid": "fe1430ca-d60b-47c4-9ac9-96ba7d61f101", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a39a55c7-874a-4a19-a069-8383a5f0bc5a", "address": "fa:16:3e:37:35:68", "network": {"id": "d84f8615-2bee-4c03-b721-d597e25acb42", "bridge": "br-int", "label": "tempest-device-tagging-net1-1869260730", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c1e407a42f24b34baf3ee44be9fb337", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa39a55c7-87", "ovs_interfaceid": "a39a55c7-874a-4a19-a069-8383a5f0bc5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "37aa7cee-88a0-4428-9b2d-45700f1dcab6", "address": "fa:16:3e:12:f4:f7", "network": {"id": "d84f8615-2bee-4c03-b721-d597e25acb42", "bridge": "br-int", "label": "tempest-device-tagging-net1-1869260730", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c1e407a42f24b34baf3ee44be9fb337", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap37aa7cee-88", "ovs_interfaceid": "37aa7cee-88a0-4428-9b2d-45700f1dcab6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e3269961-a3f1-42c8-a49e-37f728b2f3d8", "address": "fa:16:3e:7e:14:0b", "network": {"id": "d84f8615-2bee-4c03-b721-d597e25acb42", "bridge": "br-int", "label": "tempest-device-tagging-net1-1869260730", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c1e407a42f24b34baf3ee44be9fb337", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape3269961-a3", "ovs_interfaceid": "e3269961-a3f1-42c8-a49e-37f728b2f3d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "351eaad5-bf70-43b4-8f79-5bc0027de663", "address": "fa:16:3e:ee:d2:51", "network": {"id": "b0d7ffe8-2fba-456a-8969-949ee402ce5b", "bridge": "br-int", "label": "tempest-device-tagging-net2-84998986", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c1e407a42f24b34baf3ee44be9fb337", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap351eaad5-bf", "ovs_interfaceid": "351eaad5-bf70-43b4-8f79-5bc0027de663", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "004fd6c0-58df-4ceb-9733-267396cae60c", "address": "fa:16:3e:5d:12:c5", "network": {"id": "b0d7ffe8-2fba-456a-8969-949ee402ce5b", "bridge": "br-int", "label": "tempest-device-tagging-net2-84998986", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c1e407a42f24b34baf3ee44be9fb337", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap004fd6c0-58", "ovs_interfaceid": "004fd6c0-58df-4ceb-9733-267396cae60c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:13:20.368684 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:20.368684 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:20.368684 np0000002687 nova-compute[98431]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:13:20.368684 np0000002687 nova-compute[98431]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:13:20.368684 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:20.368684 np0000002687 nova-compute[98431]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:13:20.368684 np0000002687 nova-compute[98431]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:13:20.368684 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:20.368684 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:13:20.369086 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] iscsi session list stdout=tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:20.369086 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:20.369086 np0000002687 nova-compute[98431]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:13:20.369086 np0000002687 nova-compute[98431]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:13:20.369086 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:20.369086 np0000002687 nova-compute[98431]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:13:20.369086 np0000002687 nova-compute[98431]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:13:20.369086 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:20.369086 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:13:20.409234 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: dd1dd46c-2231-40b4-aa61-0121733a932d] Successfully created port: 98c628a8-e152-4189-94f1-e166c406cf10 {{(pid=98431) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 11 23:13:20.419163 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc, portal: 192.168.50.100,3260] Jun 11 23:13:20.419163 np0000002687 nova-compute[98431]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc, portal: 192.168.50.100,3260] successful. Jun 11 23:13:20.419163 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:13:20.425870 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc, portal: 192.168.40.100,3260] Jun 11 23:13:20.425870 np0000002687 nova-compute[98431]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc, portal: 192.168.40.100,3260] successful. Jun 11 23:13:20.425870 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:13:20.436816 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:13:20.440552 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:13:20.458539 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:20.458539 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:20.458539 np0000002687 nova-compute[98431]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:13:20.458539 np0000002687 nova-compute[98431]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:13:20.458539 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:20.458539 np0000002687 nova-compute[98431]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:13:20.458539 np0000002687 nova-compute[98431]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:13:20.458539 np0000002687 nova-compute[98431]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:13:20.458539 np0000002687 nova-compute[98431]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:13:20.458539 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:20.458539 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:13:20.458878 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] iscsi session list stdout=tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:20.458878 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:20.458878 np0000002687 nova-compute[98431]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:13:20.458878 np0000002687 nova-compute[98431]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:13:20.458878 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:20.458878 np0000002687 nova-compute[98431]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:13:20.458878 np0000002687 nova-compute[98431]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:13:20.458878 np0000002687 nova-compute[98431]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:13:20.458878 np0000002687 nova-compute[98431]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:13:20.458878 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:20.458878 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:13:20.459090 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.207s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 11 23:13:20.459090 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Connected to 192.168.50.100:3260 {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 11 23:13:20.460692 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] HCTL ('9', '-', '-', 0) found on session 33 with lun 0 {{(pid=98431) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 11 23:13:20.460831 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98431) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 11 23:13:20.461692 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:20.461692 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:20.461692 np0000002687 nova-compute[98431]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:13:20.461692 np0000002687 nova-compute[98431]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:13:20.461692 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:20.461692 np0000002687 nova-compute[98431]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:13:20.461692 np0000002687 nova-compute[98431]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:13:20.461692 np0000002687 nova-compute[98431]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:13:20.461692 np0000002687 nova-compute[98431]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:13:20.461692 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:20.461692 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:13:20.462571 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] iscsi session list stdout=tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:20.462571 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:20.462571 np0000002687 nova-compute[98431]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:13:20.462571 np0000002687 nova-compute[98431]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:13:20.462571 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:20.462571 np0000002687 nova-compute[98431]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:13:20.462571 np0000002687 nova-compute[98431]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:13:20.462571 np0000002687 nova-compute[98431]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:13:20.462571 np0000002687 nova-compute[98431]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:13:20.462571 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:20.462571 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:13:20.463837 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.210s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 11 23:13:20.463837 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Connected to 192.168.40.100:3260 {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 11 23:13:20.464950 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] HCTL ('10', '-', '-', 0) found on session 34 with lun 0 {{(pid=98431) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 11 23:13:20.465083 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98431) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 11 23:13:20.488593 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Searching for a device in session 33 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98431) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 11 23:13:20.488593 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '1bc89aea-2378-4237-a440-71ea160649dc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 11 23:13:20.488593 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Searching for a device in session 34 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98431) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 11 23:13:20.488593 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1bc89aea-2378-4237-a440-71ea160649dc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 11 23:13:20.631820 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:13:20.634647 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98431) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 11 23:13:20.698484 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: dd1dd46c-2231-40b4-aa61-0121733a932d] Start building block device mappings for instance. {{(pid=98431) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 11 23:13:20.782201 np0000002687 nova-compute[98431]: DEBUG nova.scheduler.client.report [None req-f5716233-3f0d-42a6-bd7c-91c2397637ee tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Inventory has not changed for provider e3e65fe2-9de9-4821-8b4a-ccae37c66e25 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98431) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 11 23:13:20.869961 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-6034e07b-88d5-420d-8b80-4b0fe2c8b551 req-35d0987b-b748-4007-94a7-c87f62e3cae0 service nova] Releasing lock "refresh_cache-1d45c7ce-5760-4f59-9921-feb3e589da8a" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 11 23:13:20.870357 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-4c180d2a-8bbc-429c-882c-d89cbbd433cf req-08148f5f-c0a8-4897-b18c-b0b188c1fb27 service nova] Acquired lock "refresh_cache-1d45c7ce-5760-4f59-9921-feb3e589da8a" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 11 23:13:20.871539 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-4c180d2a-8bbc-429c-882c-d89cbbd433cf req-08148f5f-c0a8-4897-b18c-b0b188c1fb27 service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Refreshing network info cache for port 351eaad5-bf70-43b4-8f79-5bc0027de663 {{(pid=98431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 11 23:13:21.100094 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-74ce3945-e947-4bae-97d5-8f9b1119d6b5 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "64d7833a-82e8-43e9-83ed-2507197b69bf" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 7.731s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:21.123103 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: dd1dd46c-2231-40b4-aa61-0121733a932d] Successfully updated port: 98c628a8-e152-4189-94f1-e166c406cf10 {{(pid=98431) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 11 23:13:21.139057 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Emitting event Started> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:13:21.139273 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] VM Started (Lifecycle Event) Jun 11 23:13:21.200584 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-c50a7c8a-7e4b-4636-a0c4-ea027781e286 req-cec26564-9277-4f54-bcd2-d67cbc619947 service nova] [instance: dd1dd46c-2231-40b4-aa61-0121733a932d] Received event network-changed-98c628a8-e152-4189-94f1-e166c406cf10 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:13:21.200584 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-c50a7c8a-7e4b-4636-a0c4-ea027781e286 req-cec26564-9277-4f54-bcd2-d67cbc619947 service nova] [instance: dd1dd46c-2231-40b4-aa61-0121733a932d] Refreshing instance network info cache due to event network-changed-98c628a8-e152-4189-94f1-e166c406cf10. {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 11 23:13:21.200584 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-c50a7c8a-7e4b-4636-a0c4-ea027781e286 req-cec26564-9277-4f54-bcd2-d67cbc619947 service nova] Acquiring lock "refresh_cache-dd1dd46c-2231-40b4-aa61-0121733a932d" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 11 23:13:21.200584 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-c50a7c8a-7e4b-4636-a0c4-ea027781e286 req-cec26564-9277-4f54-bcd2-d67cbc619947 service nova] Acquired lock "refresh_cache-dd1dd46c-2231-40b4-aa61-0121733a932d" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 11 23:13:21.200584 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-c50a7c8a-7e4b-4636-a0c4-ea027781e286 req-cec26564-9277-4f54-bcd2-d67cbc619947 service nova] [instance: dd1dd46c-2231-40b4-aa61-0121733a932d] Refreshing network info cache for port 98c628a8-e152-4189-94f1-e166c406cf10 {{(pid=98431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 11 23:13:21.254267 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98431) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 11 23:13:21.290784 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-f5716233-3f0d-42a6-bd7c-91c2397637ee tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 2.118s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:21.292769 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 4.367s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:21.296826 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98431) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 11 23:13:21.296826 np0000002687 nova-compute[98431]: INFO nova.compute.claims [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: 67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f] Claim successful on node np0000002687 Jun 11 23:13:21.355689 np0000002687 nova-compute[98431]: INFO nova.scheduler.client.report [None req-f5716233-3f0d-42a6-bd7c-91c2397637ee tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Deleted allocations for instance cb63f66c-b69e-42b0-805c-be6fe9b3aee3 Jun 11 23:13:21.373557 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [req-4c180d2a-8bbc-429c-882c-d89cbbd433cf req-08148f5f-c0a8-4897-b18c-b0b188c1fb27 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:13:21.586022 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-f2cbe4b9-a6dd-4fa2-852e-e726439312f0 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Unrescuing Jun 11 23:13:21.586251 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-f2cbe4b9-a6dd-4fa2-852e-e726439312f0 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Acquiring lock "refresh_cache-0d352738-c7bf-42a2-8260-bf5574a7200d" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 11 23:13:21.586413 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-f2cbe4b9-a6dd-4fa2-852e-e726439312f0 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Acquired lock "refresh_cache-0d352738-c7bf-42a2-8260-bf5574a7200d" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 11 23:13:21.586572 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-f2cbe4b9-a6dd-4fa2-852e-e726439312f0 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Building network info cache for instance {{(pid=98431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 11 23:13:21.627578 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Acquiring lock "refresh_cache-dd1dd46c-2231-40b4-aa61-0121733a932d" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 11 23:13:21.645046 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:13:21.647836 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98431) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 11 23:13:21.704902 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [req-c50a7c8a-7e4b-4636-a0c4-ea027781e286 req-cec26564-9277-4f54-bcd2-d67cbc619947 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:13:21.711353 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: dd1dd46c-2231-40b4-aa61-0121733a932d] Start spawning the instance on the hypervisor. {{(pid=98431) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 11 23:13:21.712792 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: dd1dd46c-2231-40b4-aa61-0121733a932d] Creating instance directory {{(pid=98431) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}} Jun 11 23:13:21.712792 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: dd1dd46c-2231-40b4-aa61-0121733a932d] Creating image(s) Jun 11 23:13:21.712792 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Acquiring lock "/opt/stack/data/nova/instances/dd1dd46c-2231-40b4-aa61-0121733a932d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:21.714963 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Lock "/opt/stack/data/nova/instances/dd1dd46c-2231-40b4-aa61-0121733a932d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:21.716036 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Lock "/opt/stack/data/nova/instances/dd1dd46c-2231-40b4-aa61-0121733a932d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.003s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:21.719841 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:13:21.722307 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:13:21.724855 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:13:21.762306 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [req-4c180d2a-8bbc-429c-882c-d89cbbd433cf req-08148f5f-c0a8-4897-b18c-b0b188c1fb27 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:13:21.777852 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-0fdfb306-5511-483c-9bee-ececad48eaa4 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Acquiring lock "8a45e04f-3516-4c39-bea1-820104411f17" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:21.779819 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-0fdfb306-5511-483c-9bee-ececad48eaa4 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "8a45e04f-3516-4c39-bea1-820104411f17" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.002s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:21.818020 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-5f00f380-07de-47c8-944d-8b7f67e39ddf req-dec37d1b-0759-4b3b-96bb-de433d72da33 service nova] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Received event network-vif-plugged-3c37ff2c-78c4-4423-b4a2-219e94df57ca {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:13:21.818020 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-5f00f380-07de-47c8-944d-8b7f67e39ddf req-dec37d1b-0759-4b3b-96bb-de433d72da33 service nova] Acquiring lock "0d352738-c7bf-42a2-8260-bf5574a7200d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:21.818229 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-5f00f380-07de-47c8-944d-8b7f67e39ddf req-dec37d1b-0759-4b3b-96bb-de433d72da33 service nova] Lock "0d352738-c7bf-42a2-8260-bf5574a7200d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:21.818749 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-5f00f380-07de-47c8-944d-8b7f67e39ddf req-dec37d1b-0759-4b3b-96bb-de433d72da33 service nova] Lock "0d352738-c7bf-42a2-8260-bf5574a7200d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:21.819068 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-5f00f380-07de-47c8-944d-8b7f67e39ddf req-dec37d1b-0759-4b3b-96bb-de433d72da33 service nova] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] No waiting events found dispatching network-vif-plugged-3c37ff2c-78c4-4423-b4a2-219e94df57ca {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:13:21.819776 np0000002687 nova-compute[98431]: WARNING nova.compute.manager [req-5f00f380-07de-47c8-944d-8b7f67e39ddf req-dec37d1b-0759-4b3b-96bb-de433d72da33 service nova] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Received unexpected event network-vif-plugged-3c37ff2c-78c4-4423-b4a2-219e94df57ca for instance with vm_state rescued and task_state unrescuing. Jun 11 23:13:21.836027 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json" returned: 0 in 0.111s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:13:21.836762 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Acquiring lock "d2c441059b2992961b5de03c05b32d04aff77cb1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:21.836918 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Lock "d2c441059b2992961b5de03c05b32d04aff77cb1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:21.837351 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:13:21.846727 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:13:21.849992 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:13:21.896574 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-c50a7c8a-7e4b-4636-a0c4-ea027781e286 req-cec26564-9277-4f54-bcd2-d67cbc619947 service nova] [instance: dd1dd46c-2231-40b4-aa61-0121733a932d] Instance cache missing network info. {{(pid=98431) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 11 23:13:21.959316 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json" returned: 0 in 0.110s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:13:21.959710 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1,backing_fmt=raw /opt/stack/data/nova/instances/dd1dd46c-2231-40b4-aa61-0121733a932d/disk 1073741824 {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:13:22.039390 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1,backing_fmt=raw /opt/stack/data/nova/instances/dd1dd46c-2231-40b4-aa61-0121733a932d/disk 1073741824" returned: 0 in 0.079s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:13:22.042941 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Lock "d2c441059b2992961b5de03c05b32d04aff77cb1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.203s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:22.042941 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:13:22.078662 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-4c180d2a-8bbc-429c-882c-d89cbbd433cf req-08148f5f-c0a8-4897-b18c-b0b188c1fb27 service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Updated VIF entry in instance network info cache for port 351eaad5-bf70-43b4-8f79-5bc0027de663. {{(pid=98431) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 11 23:13:22.079821 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-4c180d2a-8bbc-429c-882c-d89cbbd433cf req-08148f5f-c0a8-4897-b18c-b0b188c1fb27 service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Updating instance_info_cache with network_info: [{"id": "5f9094e3-a3c6-48ea-bfbe-4fa25d19bcf2", "address": "fa:16:3e:b1:9e:6a", "network": {"id": "1cea4f00-aa2e-4d9d-8255-2e7ba484f3ec", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1566230580-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c1e407a42f24b34baf3ee44be9fb337", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f9094e3-a3", "ovs_interfaceid": "5f9094e3-a3c6-48ea-bfbe-4fa25d19bcf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fe1430ca-d60b-47c4-9ac9-96ba7d61f101", "address": "fa:16:3e:ca:17:0a", "network": {"id": "d84f8615-2bee-4c03-b721-d597e25acb42", "bridge": "br-int", "label": "tempest-device-tagging-net1-1869260730", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c1e407a42f24b34baf3ee44be9fb337", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe1430ca-d6", "ovs_interfaceid": "fe1430ca-d60b-47c4-9ac9-96ba7d61f101", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a39a55c7-874a-4a19-a069-8383a5f0bc5a", "address": "fa:16:3e:37:35:68", "network": {"id": "d84f8615-2bee-4c03-b721-d597e25acb42", "bridge": "br-int", "label": "tempest-device-tagging-net1-1869260730", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c1e407a42f24b34baf3ee44be9fb337", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa39a55c7-87", "ovs_interfaceid": "a39a55c7-874a-4a19-a069-8383a5f0bc5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "37aa7cee-88a0-4428-9b2d-45700f1dcab6", "address": "fa:16:3e:12:f4:f7", "network": {"id": "d84f8615-2bee-4c03-b721-d597e25acb42", "bridge": "br-int", "label": "tempest-device-tagging-net1-1869260730", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c1e407a42f24b34baf3ee44be9fb337", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap37aa7cee-88", "ovs_interfaceid": "37aa7cee-88a0-4428-9b2d-45700f1dcab6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e3269961-a3f1-42c8-a49e-37f728b2f3d8", "address": "fa:16:3e:7e:14:0b", "network": {"id": "d84f8615-2bee-4c03-b721-d597e25acb42", "bridge": "br-int", "label": "tempest-device-tagging-net1-1869260730", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c1e407a42f24b34baf3ee44be9fb337", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape3269961-a3", "ovs_interfaceid": "e3269961-a3f1-42c8-a49e-37f728b2f3d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "351eaad5-bf70-43b4-8f79-5bc0027de663", "address": "fa:16:3e:ee:d2:51", "network": {"id": "b0d7ffe8-2fba-456a-8969-949ee402ce5b", "bridge": "br-int", "label": "tempest-device-tagging-net2-84998986", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c1e407a42f24b34baf3ee44be9fb337", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap351eaad5-bf", "ovs_interfaceid": "351eaad5-bf70-43b4-8f79-5bc0027de663", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "004fd6c0-58df-4ceb-9733-267396cae60c", "address": "fa:16:3e:5d:12:c5", "network": {"id": "b0d7ffe8-2fba-456a-8969-949ee402ce5b", "bridge": "br-int", "label": "tempest-device-tagging-net2-84998986", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c1e407a42f24b34baf3ee44be9fb337", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap004fd6c0-58", "ovs_interfaceid": "004fd6c0-58df-4ceb-9733-267396cae60c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:13:22.088898 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-f2cbe4b9-a6dd-4fa2-852e-e726439312f0 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:13:22.133391 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json" returned: 0 in 0.093s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:13:22.136972 np0000002687 nova-compute[98431]: DEBUG nova.virt.disk.api [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dd1dd46c-2231-40b4-aa61-0121733a932d/disk. size=1073741824 {{(pid=98431) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 11 23:13:22.136972 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd1dd46c-2231-40b4-aa61-0121733a932d/disk --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:13:22.157026 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] During sync_power_state the instance has a pending task (unrescuing). Skip. Jun 11 23:13:22.175257 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-c50a7c8a-7e4b-4636-a0c4-ea027781e286 req-cec26564-9277-4f54-bcd2-d67cbc619947 service nova] [instance: dd1dd46c-2231-40b4-aa61-0121733a932d] Updating instance_info_cache with network_info: [] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:13:22.248509 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd1dd46c-2231-40b4-aa61-0121733a932d/disk --force-share --output=json" returned: 0 in 0.114s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:13:22.250626 np0000002687 nova-compute[98431]: DEBUG nova.virt.disk.api [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Cannot resize image /opt/stack/data/nova/instances/dd1dd46c-2231-40b4-aa61-0121733a932d/disk to a smaller size. {{(pid=98431) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 11 23:13:22.250626 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: dd1dd46c-2231-40b4-aa61-0121733a932d] Created local disks {{(pid=98431) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}} Jun 11 23:13:22.250626 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: dd1dd46c-2231-40b4-aa61-0121733a932d] Ensure instance console log exists: /opt/stack/data/nova/instances/dd1dd46c-2231-40b4-aa61-0121733a932d/console.log {{(pid=98431) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}} Jun 11 23:13:22.250626 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:22.250626 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:22.250626 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:22.271122 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Found WWN 33000000072808ee7 for multipath device dm-3 {{(pid=98431) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 11 23:13:22.271521 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.046s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 11 23:13:22.271724 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] <== connect_volume: return (3046ms) {'type': 'block', 'scsi_wwn': '33000000072808ee7', 'path': '/dev/dm-3', 'multipath_id': '33000000072808ee7'} {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 11 23:13:22.272174 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000072808ee7', 'path': '/dev/dm-3', 'multipath_id': '33000000072808ee7'} {{(pid=98431) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 11 23:13:22.290970 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-0fdfb306-5511-483c-9bee-ececad48eaa4 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lazy-loading 'flavor' on Instance uuid 8a45e04f-3516-4c39-bea1-820104411f17 {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:13:22.384823 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-f5716233-3f0d-42a6-bd7c-91c2397637ee tempest-ServerStableDeviceRescueTest-67974016 tempest-ServerStableDeviceRescueTest-67974016-project-member] Lock "cb63f66c-b69e-42b0-805c-be6fe9b3aee3" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 10.857s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:22.421182 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:22.561722 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-f2cbe4b9-a6dd-4fa2-852e-e726439312f0 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:13:22.589721 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-4c180d2a-8bbc-429c-882c-d89cbbd433cf req-08148f5f-c0a8-4897-b18c-b0b188c1fb27 service nova] Releasing lock "refresh_cache-1d45c7ce-5760-4f59-9921-feb3e589da8a" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 11 23:13:22.683281 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-c50a7c8a-7e4b-4636-a0c4-ea027781e286 req-cec26564-9277-4f54-bcd2-d67cbc619947 service nova] Releasing lock "refresh_cache-dd1dd46c-2231-40b4-aa61-0121733a932d" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 11 23:13:22.684539 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Acquired lock "refresh_cache-dd1dd46c-2231-40b4-aa61-0121733a932d" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 11 23:13:22.684837 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: dd1dd46c-2231-40b4-aa61-0121733a932d] Building network info cache for instance {{(pid=98431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 11 23:13:22.737158 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:22.785248 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-f2cbe4b9-a6dd-4fa2-852e-e726439312f0 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Updating instance_info_cache with network_info: [{"id": "3c37ff2c-78c4-4423-b4a2-219e94df57ca", "address": "fa:16:3e:8f:ae:21", "network": {"id": "2a770c99-2ec6-4fa2-945b-32830a59e7a7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-137493671-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aaf744af828a4a5eba1e98da63373b2b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c37ff2c-78", "ovs_interfaceid": "3c37ff2c-78c4-4423-b4a2-219e94df57ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:13:22.793588 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Calling os-brick to attach iSCSI Volume {{(pid=98431) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 11 23:13:22.800864 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8', 'iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0eeb4862-dd4f-442d-a749-c347a2ec29f8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 11 23:13:22.801532 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 11 23:13:22.802117 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 11 23:13:22.802447 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8', 'iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0eeb4862-dd4f-442d-a749-c347a2ec29f8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98431) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 11 23:13:22.817205 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 11 23:13:22.818400 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 11 23:13:22.819043 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 11 23:13:22.819301 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.iscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 11 23:13:22.820199 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 11 23:13:22.821361 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.iscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 11 23:13:22.837252 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 11 23:13:22.837252 np0000002687 nova-compute[98431]: {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:13:22.839419 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 11 23:13:22.839419 np0000002687 nova-compute[98431]: {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:13:22.853221 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8] added Jun 11 23:13:22.853221 np0000002687 nova-compute[98431]: stderr=iscsiadm: Config file line 363 does not have value Jun 11 23:13:22.853221 np0000002687 nova-compute[98431]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 11 23:13:22.853221 np0000002687 nova-compute[98431]: iscsiadm: Config file line 363 does not have value Jun 11 23:13:22.853221 np0000002687 nova-compute[98431]: iscsiadm: Config file line 363 does not have value Jun 11 23:13:22.853221 np0000002687 nova-compute[98431]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 11 23:13:22.853221 np0000002687 nova-compute[98431]: {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:13:22.853470 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98431) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 11 23:13:22.853713 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0344(s), this was the 1st time calling it. {{(pid=98431) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 11 23:13:22.853914 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98431) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 11 23:13:22.856824 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8] added Jun 11 23:13:22.856824 np0000002687 nova-compute[98431]: stderr=iscsiadm: Config file line 363 does not have value Jun 11 23:13:22.856824 np0000002687 nova-compute[98431]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 11 23:13:22.856824 np0000002687 nova-compute[98431]: iscsiadm: Config file line 363 does not have value Jun 11 23:13:22.856824 np0000002687 nova-compute[98431]: iscsiadm: Config file line 363 does not have value Jun 11 23:13:22.856824 np0000002687 nova-compute[98431]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 11 23:13:22.856824 np0000002687 nova-compute[98431]: {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:13:22.856824 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98431) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 11 23:13:22.857050 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0364(s), this was the 1st time calling it. {{(pid=98431) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 11 23:13:22.857949 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98431) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 11 23:13:22.896119 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:23.288779 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-f2cbe4b9-a6dd-4fa2-852e-e726439312f0 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Releasing lock "refresh_cache-0d352738-c7bf-42a2-8260-bf5574a7200d" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 11 23:13:23.289441 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-f2cbe4b9-a6dd-4fa2-852e-e726439312f0 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lazy-loading 'flavor' on Instance uuid 0d352738-c7bf-42a2-8260-bf5574a7200d {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:13:23.292631 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98431) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 11 23:13:23.292900 np0000002687 nova-compute[98431]: DEBUG nova.compute.provider_tree [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Inventory has not changed in ProviderTree for provider: e3e65fe2-9de9-4821-8b4a-ccae37c66e25 {{(pid=98431) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 11 23:13:23.298731 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: dd1dd46c-2231-40b4-aa61-0121733a932d] Instance cache missing network info. {{(pid=98431) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 11 23:13:23.311721 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-0fdfb306-5511-483c-9bee-ececad48eaa4 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "8a45e04f-3516-4c39-bea1-820104411f17" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.533s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:23.486208 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:13:23.662005 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: dd1dd46c-2231-40b4-aa61-0121733a932d] Updating instance_info_cache with network_info: [{"id": "98c628a8-e152-4189-94f1-e166c406cf10", "address": "fa:16:3e:2b:91:a7", "network": {"id": "77fc4e10-1fed-4963-86b4-1fbb3a9c6f7f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1105404274-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b2b9f55b231c455ca1a4579d7ed54888", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap98c628a8-e1", "ovs_interfaceid": "98c628a8-e152-4189-94f1-e166c406cf10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:13:23.732459 np0000002687 nova-compute[98431]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0022451209999871935 future=) was cancelled during its delay period, skipping {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:13:23.732607 np0000002687 nova-compute[98431]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:13:23.732791 np0000002687 nova-compute[98431]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=4.247419218999994 future=) {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:13:23.732915 np0000002687 nova-compute[98431]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=4.247267449999981 future=) {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:13:23.806238 np0000002687 nova-compute[98431]: DEBUG nova.scheduler.client.report [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Inventory has not changed for provider e3e65fe2-9de9-4821-8b4a-ccae37c66e25 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98431) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 11 23:13:23.822429 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:23.826438 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:23.851217 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:23.854461 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.iscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 11 23:13:23.858535 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.iscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 11 23:13:23.869690 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 11 23:13:23.869690 np0000002687 nova-compute[98431]: node.name = iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8 Jun 11 23:13:23.869690 np0000002687 nova-compute[98431]: node.tpgt = -1 Jun 11 23:13:23.869690 np0000002687 nova-compute[98431]: node.startup = manual Jun 11 23:13:23.869690 np0000002687 nova-compute[98431]: node.leading_login = No Jun 11 23:13:23.869690 np0000002687 nova-compute[98431]: iface.iscsi_ifacename = default Jun 11 23:13:23.869690 np0000002687 nova-compute[98431]: iface.net_ifacename = Jun 11 23:13:23.869690 np0000002687 nova-compute[98431]: iface.ipaddress = Jun 11 23:13:23.869690 np0000002687 nova-compute[98431]: iface.prefix_len = 0 Jun 11 23:13:23.869690 np0000002687 nova-compute[98431]: iface.hwaddress = Jun 11 23:13:23.869690 np0000002687 nova-compute[98431]: iface.transport_name = tcp Jun 11 23:13:23.869690 np0000002687 nova-compute[98431]: iface.initiatorname = Jun 11 23:13:23.869690 np0000002687 nova-compute[98431]: iface.state = Jun 11 23:13:23.869690 np0000002687 nova-compute[98431]: iface.vlan_id = 0 Jun 11 23:13:23.869690 np0000002687 nova-compute[98431]: iface.vlan_priority = 0 Jun 11 23:13:23.869690 np0000002687 nova-compute[98431]: iface.vlan_state = Jun 11 23:13:23.869690 np0000002687 nova-compute[98431]: iface.iface_num = 0 Jun 11 23:13:23.869690 np0000002687 nova-compute[98431]: iface.mtu = 0 Jun 11 23:13:23.869690 np0000002687 nova-compute[98431]: iface.port = 0 Jun 11 23:13:23.869690 np0000002687 nova-compute[98431]: iface.bootproto = Jun 11 23:13:23.869690 np0000002687 nova-compute[98431]: iface.subnet_mask = Jun 11 23:13:23.869690 np0000002687 nova-compute[98431]: iface.gateway = Jun 11 23:13:23.869690 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id_state = Jun 11 23:13:23.869690 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id = Jun 11 23:13:23.869690 np0000002687 nova-compute[98431]: iface.dhcp_dns = Jun 11 23:13:23.869690 np0000002687 nova-compute[98431]: iface.dhcp_learn_iqn = Jun 11 23:13:23.869690 np0000002687 nova-compute[98431]: iface.dhcp_req_vendor_id_state = Jun 11 23:13:23.869690 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id_state = Jun 11 23:13:23.869690 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id = Jun 11 23:13:23.869690 np0000002687 nova-compute[98431]: iface.dhcp_slp_da = Jun 11 23:13:23.869690 np0000002687 nova-compute[98431]: iface.fragmentation = Jun 11 23:13:23.869690 np0000002687 nova-compute[98431]: iface.gratuitous_arp = Jun 11 23:13:23.869690 np0000002687 nova-compute[98431]: iface.incoming_forwarding = Jun 11 23:13:23.869690 np0000002687 nova-compute[98431]: iface.tos_state = Jun 11 23:13:23.869690 np0000002687 nova-compute[98431]: iface.tos = 0 Jun 11 23:13:23.869690 np0000002687 nova-compute[98431]: iface.ttl = 0 Jun 11 23:13:23.869690 np0000002687 nova-compute[98431]: iface.delayed_ack = Jun 11 23:13:23.869690 np0000002687 nova-compute[98431]: iface.tcp_nagle = Jun 11 23:13:23.869690 np0000002687 nova-compute[98431]: iface.tcp_wsf_state = Jun 11 23:13:23.869690 np0000002687 nova-compute[98431]: iface.tcp_wsf = 0 Jun 11 23:13:23.869690 np0000002687 nova-compute[98431]: iface.tcp_timer_scale = 0 Jun 11 23:13:23.869690 np0000002687 nova-compute[98431]: iface.tcp_timestamp = Jun 11 23:13:23.869690 np0000002687 nova-compute[98431]: iface.redirect = Jun 11 23:13:23.869690 np0000002687 nova-compute[98431]: iface.def_task_mgmt_timeout = 0 Jun 11 23:13:23.869690 np0000002687 nova-compute[98431]: iface.header_digest = Jun 11 23:13:23.869690 np0000002687 nova-compute[98431]: iface.data_digest = Jun 11 23:13:23.869690 np0000002687 nova-compute[98431]: iface.immediate_data = Jun 11 23:13:23.869690 np0000002687 nova-compute[98431]: iface.initial_r2t = Jun 11 23:13:23.869690 np0000002687 nova-compute[98431]: iface.data_seq_inorder = Jun 11 23:13:23.869690 np0000002687 nova-compute[98431]: iface.data_pdu_inorder = Jun 11 23:13:23.869690 np0000002687 nova-compute[98431]: iface.erl = 0 Jun 11 23:13:23.869690 np0000002687 nova-compute[98431]: iface.max_receive_data_len = 0 Jun 11 23:13:23.869690 np0000002687 nova-compute[98431]: iface.first_burst_len = 0 Jun 11 23:13:23.869690 np0000002687 nova-compute[98431]: iface.max_outstanding_r2t = 0 Jun 11 23:13:23.869690 np0000002687 nova-compute[98431]: iface.max_burst_len = 0 Jun 11 23:13:23.869690 np0000002687 nova-compute[98431]: iface.chap_auth = Jun 11 23:13:23.869690 np0000002687 nova-compute[98431]: iface.bidi_chap = Jun 11 23:13:23.869690 np0000002687 nova-compute[98431]: iface.strict_login_compliance = Jun 11 23:13:23.869690 np0000002687 nova-compute[98431]: iface.discovery_auth = Jun 11 23:13:23.869690 np0000002687 nova-compute[98431]: iface.discovery_logout = Jun 11 23:13:23.869690 np0000002687 nova-compute[98431]: node.discovery_address = Jun 11 23:13:23.869690 np0000002687 nova-compute[98431]: node.discovery_port = 0 Jun 11 23:13:23.869690 np0000002687 nova-compute[98431]: node.discovery_type = fw Jun 11 23:13:23.869690 np0000002687 nova-compute[98431]: node.session.initial_cmdsn = 0 Jun 11 23:13:23.869690 np0000002687 nova-compute[98431]: node.session.initial_login_retry_max = 8 Jun 11 23:13:23.869690 np0000002687 nova-compute[98431]: node.session.xmit_thread_priority = 0 Jun 11 23:13:23.869690 np0000002687 nova-compute[98431]: node.session.cmds_max = 128 Jun 11 23:13:23.869690 np0000002687 nova-compute[98431]: node.session.queue_depth = 32 Jun 11 23:13:23.869690 np0000002687 nova-compute[98431]: node.session.nr_sessions = 1 Jun 11 23:13:23.869690 np0000002687 nova-compute[98431]: node.session.auth.authmethod = None Jun 11 23:13:23.869690 np0000002687 nova-compute[98431]: node.session.auth.username = Jun 11 23:13:23.869690 np0000002687 nova-compute[98431]: node.session.auth.password = *** Jun 11 23:13:23.869690 np0000002687 nova-compute[98431]: node.session.auth.username_in = Jun 11 23:13:23.869690 np0000002687 nova-compute[98431]: node.session.auth.password_in = Jun 11 23:13:23.869690 np0000002687 nova-compute[98431]: node.session.auth.chap_algs = SHA256 Jun 11 23:13:23.869690 np0000002687 nova-compute[98431]: node.session.timeo.replacement_timeout = 120 Jun 11 23:13:23.869690 np0000002687 nova-compute[98431]: node.session.err_timeo.abort_timeout = 15 Jun 11 23:13:23.869690 np0000002687 nova-compute[98431]: node.session.err_timeo.lu_reset_timeout = 30 Jun 11 23:13:23.869690 np0000002687 nova-compute[98431]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 11 23:13:23.869690 np0000002687 nova-compute[98431]: node.session.err_timeo.host_reset_timeout = 60 Jun 11 23:13:23.869690 np0000002687 nova-compute[98431]: node.session.iscsi.FastAbort = Yes Jun 11 23:13:23.869690 np0000002687 nova-compute[98431]: node.session.iscsi.InitialR2T = No Jun 11 23:13:23.869690 np0000002687 nova-compute[98431]: node.session.iscsi.ImmediateData = Yes Jun 11 23:13:23.869690 np0000002687 nova-compute[98431]: node.session.iscsi.FirstBurstLength = 262144 Jun 11 23:13:23.869690 np0000002687 nova-compute[98431]: node.session.iscsi.MaxBurstLength = 16776192 Jun 11 23:13:23.869690 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Retain = 0 Jun 11 23:13:23.869690 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Wait = 2 Jun 11 23:13:23.869690 np0000002687 nova-compute[98431]: node.session.iscsi.MaxConnections = 1 Jun 11 23:13:23.869690 np0000002687 nova-compute[98431]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 11 23:13:23.869690 np0000002687 nova-compute[98431]: node.session.iscsi.ERL = 0 Jun 11 23:13:23.869690 np0000002687 nova-compute[98431]: node.session.scan = auto Jun 11 23:13:23.869690 np0000002687 nova-compute[98431]: node.session.reopen_max = 0 Jun 11 23:13:23.869690 np0000002687 nova-compute[98431]: node.conn[0].address = 192.168.40.100 Jun 11 23:13:23.869690 np0000002687 nova-compute[98431]: node.conn[0].port = 3260 Jun 11 23:13:23.869690 np0000002687 nova-compute[98431]: node.conn[0].startup = manual Jun 11 23:13:23.869690 np0000002687 nova-compute[98431]: node.conn[0].tcp.window_size = 524288 Jun 11 23:13:23.869690 np0000002687 nova-compute[98431]: node.conn[0].tcp.type_of_service = 0 Jun 11 23:13:23.869690 np0000002687 nova-compute[98431]: node.conn[0].timeo.logout_timeout = 15 Jun 11 23:13:23.869690 np0000002687 nova-compute[98431]: node.conn[0].timeo.login_timeout = 15 Jun 11 23:13:23.869690 np0000002687 nova-compute[98431]: node.conn[0].timeo.auth_timeout = 45 Jun 11 23:13:23.869690 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_interval = 5 Jun 11 23:13:23.869690 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_timeout = 5 Jun 11 23:13:23.869690 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 11 23:13:23.869690 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 11 23:13:23.869690 np0000002687 nova-compute[98431]: node.conn[0].iscsi.HeaderDigest = None Jun 11 23:13:23.869690 np0000002687 nova-compute[98431]: node.conn[0].iscsi.DataDigest = None Jun 11 23:13:23.869690 np0000002687 nova-compute[98431]: node.conn[0].iscsi.IFMarker = No Jun 11 23:13:23.869690 np0000002687 nova-compute[98431]: node.conn[0].iscsi.OFMarker = No Jun 11 23:13:23.869690 np0000002687 nova-compute[98431]: # END RECORD Jun 11 23:13:23.869690 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:13:23.875584 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 11 23:13:23.875584 np0000002687 nova-compute[98431]: node.name = iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8 Jun 11 23:13:23.875584 np0000002687 nova-compute[98431]: node.tpgt = -1 Jun 11 23:13:23.875584 np0000002687 nova-compute[98431]: node.startup = manual Jun 11 23:13:23.875584 np0000002687 nova-compute[98431]: node.leading_login = No Jun 11 23:13:23.875584 np0000002687 nova-compute[98431]: iface.iscsi_ifacename = default Jun 11 23:13:23.875584 np0000002687 nova-compute[98431]: iface.net_ifacename = Jun 11 23:13:23.875584 np0000002687 nova-compute[98431]: iface.ipaddress = Jun 11 23:13:23.875584 np0000002687 nova-compute[98431]: iface.prefix_len = 0 Jun 11 23:13:23.875584 np0000002687 nova-compute[98431]: iface.hwaddress = Jun 11 23:13:23.875584 np0000002687 nova-compute[98431]: iface.transport_name = tcp Jun 11 23:13:23.875584 np0000002687 nova-compute[98431]: iface.initiatorname = Jun 11 23:13:23.875584 np0000002687 nova-compute[98431]: iface.state = Jun 11 23:13:23.875584 np0000002687 nova-compute[98431]: iface.vlan_id = 0 Jun 11 23:13:23.875584 np0000002687 nova-compute[98431]: iface.vlan_priority = 0 Jun 11 23:13:23.875584 np0000002687 nova-compute[98431]: iface.vlan_state = Jun 11 23:13:23.875584 np0000002687 nova-compute[98431]: iface.iface_num = 0 Jun 11 23:13:23.875584 np0000002687 nova-compute[98431]: iface.mtu = 0 Jun 11 23:13:23.875584 np0000002687 nova-compute[98431]: iface.port = 0 Jun 11 23:13:23.875584 np0000002687 nova-compute[98431]: iface.bootproto = Jun 11 23:13:23.875584 np0000002687 nova-compute[98431]: iface.subnet_mask = Jun 11 23:13:23.875584 np0000002687 nova-compute[98431]: iface.gateway = Jun 11 23:13:23.875584 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id_state = Jun 11 23:13:23.875584 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id = Jun 11 23:13:23.875584 np0000002687 nova-compute[98431]: iface.dhcp_dns = Jun 11 23:13:23.875584 np0000002687 nova-compute[98431]: iface.dhcp_learn_iqn = Jun 11 23:13:23.875584 np0000002687 nova-compute[98431]: iface.dhcp_req_vendor_id_state = Jun 11 23:13:23.875584 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id_state = Jun 11 23:13:23.875584 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id = Jun 11 23:13:23.875584 np0000002687 nova-compute[98431]: iface.dhcp_slp_da = Jun 11 23:13:23.875584 np0000002687 nova-compute[98431]: iface.fragmentation = Jun 11 23:13:23.875584 np0000002687 nova-compute[98431]: iface.gratuitous_arp = Jun 11 23:13:23.875584 np0000002687 nova-compute[98431]: iface.incoming_forwarding = Jun 11 23:13:23.875584 np0000002687 nova-compute[98431]: iface.tos_state = Jun 11 23:13:23.875584 np0000002687 nova-compute[98431]: iface.tos = 0 Jun 11 23:13:23.875584 np0000002687 nova-compute[98431]: iface.ttl = 0 Jun 11 23:13:23.875584 np0000002687 nova-compute[98431]: iface.delayed_ack = Jun 11 23:13:23.875584 np0000002687 nova-compute[98431]: iface.tcp_nagle = Jun 11 23:13:23.875584 np0000002687 nova-compute[98431]: iface.tcp_wsf_state = Jun 11 23:13:23.875584 np0000002687 nova-compute[98431]: iface.tcp_wsf = 0 Jun 11 23:13:23.875584 np0000002687 nova-compute[98431]: iface.tcp_timer_scale = 0 Jun 11 23:13:23.875584 np0000002687 nova-compute[98431]: iface.tcp_timestamp = Jun 11 23:13:23.875584 np0000002687 nova-compute[98431]: iface.redirect = Jun 11 23:13:23.875584 np0000002687 nova-compute[98431]: iface.def_task_mgmt_timeout = 0 Jun 11 23:13:23.875584 np0000002687 nova-compute[98431]: iface.header_digest = Jun 11 23:13:23.875584 np0000002687 nova-compute[98431]: iface.data_digest = Jun 11 23:13:23.875584 np0000002687 nova-compute[98431]: iface.immediate_data = Jun 11 23:13:23.875584 np0000002687 nova-compute[98431]: iface.initial_r2t = Jun 11 23:13:23.875584 np0000002687 nova-compute[98431]: iface.data_seq_inorder = Jun 11 23:13:23.875584 np0000002687 nova-compute[98431]: iface.data_pdu_inorder = Jun 11 23:13:23.875584 np0000002687 nova-compute[98431]: iface.erl = 0 Jun 11 23:13:23.875584 np0000002687 nova-compute[98431]: iface.max_receive_data_len = 0 Jun 11 23:13:23.875584 np0000002687 nova-compute[98431]: iface.first_burst_len = 0 Jun 11 23:13:23.875584 np0000002687 nova-compute[98431]: iface.max_outstanding_r2t = 0 Jun 11 23:13:23.875584 np0000002687 nova-compute[98431]: iface.max_burst_len = 0 Jun 11 23:13:23.875584 np0000002687 nova-compute[98431]: iface.chap_auth = Jun 11 23:13:23.875584 np0000002687 nova-compute[98431]: iface.bidi_chap = Jun 11 23:13:23.875584 np0000002687 nova-compute[98431]: iface.strict_login_compliance = Jun 11 23:13:23.875584 np0000002687 nova-compute[98431]: iface.discovery_auth = Jun 11 23:13:23.875584 np0000002687 nova-compute[98431]: iface.discovery_logout = Jun 11 23:13:23.875584 np0000002687 nova-compute[98431]: node.discovery_address = Jun 11 23:13:23.875584 np0000002687 nova-compute[98431]: node.discovery_port = 0 Jun 11 23:13:23.875584 np0000002687 nova-compute[98431]: node.discovery_type = fw Jun 11 23:13:23.875584 np0000002687 nova-compute[98431]: node.session.initial_cmdsn = 0 Jun 11 23:13:23.875584 np0000002687 nova-compute[98431]: node.session.initial_login_retry_max = 8 Jun 11 23:13:23.875584 np0000002687 nova-compute[98431]: node.session.xmit_thread_priority = 0 Jun 11 23:13:23.875584 np0000002687 nova-compute[98431]: node.session.cmds_max = 128 Jun 11 23:13:23.875584 np0000002687 nova-compute[98431]: node.session.queue_depth = 32 Jun 11 23:13:23.875584 np0000002687 nova-compute[98431]: node.session.nr_sessions = 1 Jun 11 23:13:23.875584 np0000002687 nova-compute[98431]: node.session.auth.authmethod = None Jun 11 23:13:23.875584 np0000002687 nova-compute[98431]: node.session.auth.username = Jun 11 23:13:23.875584 np0000002687 nova-compute[98431]: node.session.auth.password = *** Jun 11 23:13:23.875584 np0000002687 nova-compute[98431]: node.session.auth.username_in = Jun 11 23:13:23.875584 np0000002687 nova-compute[98431]: node.session.auth.password_in = Jun 11 23:13:23.875584 np0000002687 nova-compute[98431]: node.session.auth.chap_algs = SHA256 Jun 11 23:13:23.875584 np0000002687 nova-compute[98431]: node.session.timeo.replacement_timeout = 120 Jun 11 23:13:23.875584 np0000002687 nova-compute[98431]: node.session.err_timeo.abort_timeout = 15 Jun 11 23:13:23.875584 np0000002687 nova-compute[98431]: node.session.err_timeo.lu_reset_timeout = 30 Jun 11 23:13:23.875584 np0000002687 nova-compute[98431]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 11 23:13:23.875584 np0000002687 nova-compute[98431]: node.session.err_timeo.host_reset_timeout = 60 Jun 11 23:13:23.875584 np0000002687 nova-compute[98431]: node.session.iscsi.FastAbort = Yes Jun 11 23:13:23.875584 np0000002687 nova-compute[98431]: node.session.iscsi.InitialR2T = No Jun 11 23:13:23.875584 np0000002687 nova-compute[98431]: node.session.iscsi.ImmediateData = Yes Jun 11 23:13:23.875584 np0000002687 nova-compute[98431]: node.session.iscsi.FirstBurstLength = 262144 Jun 11 23:13:23.875584 np0000002687 nova-compute[98431]: node.session.iscsi.MaxBurstLength = 16776192 Jun 11 23:13:23.875584 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Retain = 0 Jun 11 23:13:23.875584 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Wait = 2 Jun 11 23:13:23.875584 np0000002687 nova-compute[98431]: node.session.iscsi.MaxConnections = 1 Jun 11 23:13:23.875584 np0000002687 nova-compute[98431]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 11 23:13:23.875584 np0000002687 nova-compute[98431]: node.session.iscsi.ERL = 0 Jun 11 23:13:23.875584 np0000002687 nova-compute[98431]: node.session.scan = auto Jun 11 23:13:23.875584 np0000002687 nova-compute[98431]: node.session.reopen_max = 0 Jun 11 23:13:23.875584 np0000002687 nova-compute[98431]: node.conn[0].address = 192.168.50.100 Jun 11 23:13:23.875584 np0000002687 nova-compute[98431]: node.conn[0].port = 3260 Jun 11 23:13:23.875584 np0000002687 nova-compute[98431]: node.conn[0].startup = manual Jun 11 23:13:23.875584 np0000002687 nova-compute[98431]: node.conn[0].tcp.window_size = 524288 Jun 11 23:13:23.875584 np0000002687 nova-compute[98431]: node.conn[0].tcp.type_of_service = 0 Jun 11 23:13:23.875584 np0000002687 nova-compute[98431]: node.conn[0].timeo.logout_timeout = 15 Jun 11 23:13:23.875584 np0000002687 nova-compute[98431]: node.conn[0].timeo.login_timeout = 15 Jun 11 23:13:23.875584 np0000002687 nova-compute[98431]: node.conn[0].timeo.auth_timeout = 45 Jun 11 23:13:23.875584 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_interval = 5 Jun 11 23:13:23.875584 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_timeout = 5 Jun 11 23:13:23.875584 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 11 23:13:23.875584 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 11 23:13:23.875584 np0000002687 nova-compute[98431]: node.conn[0].iscsi.HeaderDigest = None Jun 11 23:13:23.875584 np0000002687 nova-compute[98431]: node.conn[0].iscsi.DataDigest = None Jun 11 23:13:23.875584 np0000002687 nova-compute[98431]: node.conn[0].iscsi.IFMarker = No Jun 11 23:13:23.875584 np0000002687 nova-compute[98431]: node.conn[0].iscsi.OFMarker = No Jun 11 23:13:23.875584 np0000002687 nova-compute[98431]: # END RECORD Jun 11 23:13:23.875584 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:13:23.884169 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:13:23.897929 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:13:23.911245 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:23.911245 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:23.911245 np0000002687 nova-compute[98431]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:13:23.911245 np0000002687 nova-compute[98431]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:13:23.911245 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:23.911245 np0000002687 nova-compute[98431]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:13:23.911245 np0000002687 nova-compute[98431]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:13:23.911245 np0000002687 nova-compute[98431]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:13:23.911245 np0000002687 nova-compute[98431]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:13:23.911245 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:23.911245 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:13:23.911684 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] iscsi session list stdout=tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:23.911684 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:23.911684 np0000002687 nova-compute[98431]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:13:23.911684 np0000002687 nova-compute[98431]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:13:23.911684 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:23.911684 np0000002687 nova-compute[98431]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:13:23.911684 np0000002687 nova-compute[98431]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:13:23.911684 np0000002687 nova-compute[98431]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:13:23.911684 np0000002687 nova-compute[98431]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:13:23.911684 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:23.911684 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:13:23.922859 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:23.922859 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:23.922859 np0000002687 nova-compute[98431]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:13:23.922859 np0000002687 nova-compute[98431]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:13:23.922859 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:23.922859 np0000002687 nova-compute[98431]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:13:23.922859 np0000002687 nova-compute[98431]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:13:23.922859 np0000002687 nova-compute[98431]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:13:23.922859 np0000002687 nova-compute[98431]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:13:23.922859 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:23.922859 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:13:23.922859 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] iscsi session list stdout=tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:23.922859 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:23.922859 np0000002687 nova-compute[98431]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:13:23.922859 np0000002687 nova-compute[98431]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:13:23.922859 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:23.922859 np0000002687 nova-compute[98431]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:13:23.922859 np0000002687 nova-compute[98431]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:13:23.922859 np0000002687 nova-compute[98431]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:13:23.922859 np0000002687 nova-compute[98431]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:13:23.922859 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:23.922859 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:13:23.946840 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-40c96ba5-941a-442c-9c2d-e7998c335902 req-a1d43f7b-bc54-4a1f-8b4e-b516088a1954 service nova] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Received event network-vif-plugged-3c37ff2c-78c4-4423-b4a2-219e94df57ca {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:13:23.951438 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-40c96ba5-941a-442c-9c2d-e7998c335902 req-a1d43f7b-bc54-4a1f-8b4e-b516088a1954 service nova] Acquiring lock "0d352738-c7bf-42a2-8260-bf5574a7200d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:23.951438 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-40c96ba5-941a-442c-9c2d-e7998c335902 req-a1d43f7b-bc54-4a1f-8b4e-b516088a1954 service nova] Lock "0d352738-c7bf-42a2-8260-bf5574a7200d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:23.951438 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-40c96ba5-941a-442c-9c2d-e7998c335902 req-a1d43f7b-bc54-4a1f-8b4e-b516088a1954 service nova] Lock "0d352738-c7bf-42a2-8260-bf5574a7200d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:23.951598 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-40c96ba5-941a-442c-9c2d-e7998c335902 req-a1d43f7b-bc54-4a1f-8b4e-b516088a1954 service nova] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] No waiting events found dispatching network-vif-plugged-3c37ff2c-78c4-4423-b4a2-219e94df57ca {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:13:23.951675 np0000002687 nova-compute[98431]: WARNING nova.compute.manager [req-40c96ba5-941a-442c-9c2d-e7998c335902 req-a1d43f7b-bc54-4a1f-8b4e-b516088a1954 service nova] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Received unexpected event network-vif-plugged-3c37ff2c-78c4-4423-b4a2-219e94df57ca for instance with vm_state rescued and task_state unrescuing. Jun 11 23:13:23.968849 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8, portal: 192.168.40.100,3260] Jun 11 23:13:23.968849 np0000002687 nova-compute[98431]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8, portal: 192.168.40.100,3260] successful. Jun 11 23:13:23.968849 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:13:23.981946 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:13:23.996131 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8, portal: 192.168.50.100,3260] Jun 11 23:13:23.996131 np0000002687 nova-compute[98431]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8, portal: 192.168.50.100,3260] successful. Jun 11 23:13:23.996131 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:13:24.005688 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:24.005688 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:24.005688 np0000002687 nova-compute[98431]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:13:24.005688 np0000002687 nova-compute[98431]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:13:24.005688 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:24.005688 np0000002687 nova-compute[98431]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:13:24.005688 np0000002687 nova-compute[98431]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:13:24.005688 np0000002687 nova-compute[98431]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:13:24.005688 np0000002687 nova-compute[98431]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:13:24.005688 np0000002687 nova-compute[98431]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8 (non-flash) Jun 11 23:13:24.005688 np0000002687 nova-compute[98431]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8 (non-flash) Jun 11 23:13:24.005688 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:24.005688 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:13:24.006193 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] iscsi session list stdout=tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:24.006193 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:24.006193 np0000002687 nova-compute[98431]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:13:24.006193 np0000002687 nova-compute[98431]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:13:24.006193 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:24.006193 np0000002687 nova-compute[98431]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:13:24.006193 np0000002687 nova-compute[98431]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:13:24.006193 np0000002687 nova-compute[98431]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:13:24.006193 np0000002687 nova-compute[98431]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:13:24.006193 np0000002687 nova-compute[98431]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8 (non-flash) Jun 11 23:13:24.006193 np0000002687 nova-compute[98431]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8 (non-flash) Jun 11 23:13:24.006193 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:24.006193 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:13:24.006451 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.187s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 11 23:13:24.006519 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Connected to 192.168.40.100:3260 {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 11 23:13:24.008037 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] HCTL ('17', '-', '-', 0) found on session 35 with lun 0 {{(pid=98431) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 11 23:13:24.008167 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Scanning host 17 c: -, t: -, l: 0) {{(pid=98431) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 11 23:13:24.013194 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:13:24.014839 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:24.035152 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:24.035152 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Searching for a device in session 35 and hctl ['17', '*', '*', 0] yield: sdl {{(pid=98431) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 11 23:13:24.035152 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0eeb4862-dd4f-442d-a749-c347a2ec29f8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 11 23:13:24.046189 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:24.046189 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:24.046189 np0000002687 nova-compute[98431]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:13:24.046189 np0000002687 nova-compute[98431]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:13:24.046189 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:24.046189 np0000002687 nova-compute[98431]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:13:24.046189 np0000002687 nova-compute[98431]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:13:24.046189 np0000002687 nova-compute[98431]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:13:24.046189 np0000002687 nova-compute[98431]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:13:24.046189 np0000002687 nova-compute[98431]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8 (non-flash) Jun 11 23:13:24.046189 np0000002687 nova-compute[98431]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8 (non-flash) Jun 11 23:13:24.046189 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:24.046189 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:13:24.046591 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] iscsi session list stdout=tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:24.046591 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:24.046591 np0000002687 nova-compute[98431]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:13:24.046591 np0000002687 nova-compute[98431]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:13:24.046591 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:24.046591 np0000002687 nova-compute[98431]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:13:24.046591 np0000002687 nova-compute[98431]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:13:24.046591 np0000002687 nova-compute[98431]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:13:24.046591 np0000002687 nova-compute[98431]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:13:24.046591 np0000002687 nova-compute[98431]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8 (non-flash) Jun 11 23:13:24.046591 np0000002687 nova-compute[98431]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8 (non-flash) Jun 11 23:13:24.046591 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:24.046591 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:13:24.046954 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.227s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 11 23:13:24.046954 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Connected to 192.168.50.100:3260 {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 11 23:13:24.048245 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] HCTL ('18', '-', '-', 0) found on session 36 with lun 0 {{(pid=98431) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 11 23:13:24.048245 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Scanning host 18 c: -, t: -, l: 0) {{(pid=98431) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 11 23:13:24.068820 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Searching for a device in session 36 and hctl ['18', '*', '*', 0] yield: sdm {{(pid=98431) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 11 23:13:24.069021 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '0eeb4862-dd4f-442d-a749-c347a2ec29f8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 11 23:13:24.122126 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:24.131424 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:24.153499 np0000002687 nova-compute[98431]: DEBUG nova.utils [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Queued Task(fn=>, remaining_delay=14.999184799999966 future=) {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:13:24.154675 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [-] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Instance destroyed successfully. Jun 11 23:13:24.154776 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-f2cbe4b9-a6dd-4fa2-852e-e726439312f0 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lazy-loading 'numa_topology' on Instance uuid 0d352738-c7bf-42a2-8260-bf5574a7200d {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:13:24.166106 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Releasing lock "refresh_cache-dd1dd46c-2231-40b4-aa61-0121733a932d" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 11 23:13:24.166106 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: dd1dd46c-2231-40b4-aa61-0121733a932d] Instance network_info: |[{"id": "98c628a8-e152-4189-94f1-e166c406cf10", "address": "fa:16:3e:2b:91:a7", "network": {"id": "77fc4e10-1fed-4963-86b4-1fbb3a9c6f7f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1105404274-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b2b9f55b231c455ca1a4579d7ed54888", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap98c628a8-e1", "ovs_interfaceid": "98c628a8-e152-4189-94f1-e166c406cf10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98431) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 11 23:13:24.168253 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: dd1dd46c-2231-40b4-aa61-0121733a932d] Start _get_guest_xml network_info=[{"id": "98c628a8-e152-4189-94f1-e166c406cf10", "address": "fa:16:3e:2b:91:a7", "network": {"id": "77fc4e10-1fed-4963-86b4-1fbb3a9c6f7f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1105404274-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b2b9f55b231c455ca1a4579d7ed54888", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap98c628a8-e1", "ovs_interfaceid": "98c628a8-e152-4189-94f1-e166c406cf10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-11T23:08:20Z,direct_url=,disk_format='qcow2',id=f30640f8-7aca-4300-a085-4706a5209a79,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ce012f9fabdb4ee5a73e212437f59d97',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-11T23:08:23Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'image_id': 'f30640f8-7aca-4300-a085-4706a5209a79'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98431) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 11 23:13:24.175288 np0000002687 nova-compute[98431]: WARNING nova.virt.libvirt.driver [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 11 23:13:24.176701 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='f30640f8-7aca-4300-a085-4706a5209a79', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-2077015389', uuid='dd1dd46c-2231-40b4-aa61-0121733a932d'), owner=OwnerMeta(userid='eaecdd9c05b5485b9422171463cccf92', username='tempest-ServerRescueNegativeTestJSON-2027875711-project-member', projectid='b2b9f55b231c455ca1a4579d7ed54888', projectname='tempest-ServerRescueNegativeTestJSON-2027875711'), image=ImageMeta(id='f30640f8-7aca-4300-a085-4706a5209a79', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "98c628a8-e152-4189-94f1-e166c406cf10", "address": "fa:16:3e:2b:91:a7", "network": {"id": "77fc4e10-1fed-4963-86b4-1fbb3a9c6f7f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1105404274-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b2b9f55b231c455ca1a4579d7ed54888", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap98c628a8-e1", "ovs_interfaceid": "98c628a8-e152-4189-94f1-e166c406cf10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1781219604.1762886) {{(pid=98431) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 11 23:13:24.179878 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Searching host: 'np0000002687' for CPU controller through CGroups V1... {{(pid=98431) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 11 23:13:24.180721 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] CPU controller missing on host. {{(pid=98431) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 11 23:13:24.184462 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Searching host: 'np0000002687' for CPU controller through CGroups V2... {{(pid=98431) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 11 23:13:24.184915 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] CPU controller found on host. {{(pid=98431) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 11 23:13:24.186998 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98431) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 11 23:13:24.188266 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-11T23:08:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-11T23:08:20Z,direct_url=,disk_format='qcow2',id=f30640f8-7aca-4300-a085-4706a5209a79,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ce012f9fabdb4ee5a73e212437f59d97',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-11T23:08:23Z,virtual_size=,visibility=), allow threads: True {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 11 23:13:24.188266 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Flavor limits 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 11 23:13:24.188266 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Image limits 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 11 23:13:24.188634 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Flavor pref 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 11 23:13:24.188634 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Image pref 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 11 23:13:24.188764 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 11 23:13:24.189078 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 11 23:13:24.189256 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98431) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 11 23:13:24.190434 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Got 1 possible topologies {{(pid=98431) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 11 23:13:24.190677 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 11 23:13:24.190856 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 11 23:13:24.211358 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-11T23:13:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2077015389',display_name='tempest-ServerRescueNegativeTestJSON-server-2077015389',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='tempest-serverrescuenegativetestjson-server-2077015389',id=20,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b2b9f55b231c455ca1a4579d7ed54888',ramdisk_id='',reservation_id='r-a0ty5rvr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2027875711',owner_user_name='tempest-ServerRescueNegativeTestJSON-2027875711-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-11T23:13:21Z,user_data=None,user_id='eaecdd9c05b5485b9422171463cccf92',uuid=dd1dd46c-2231-40b4-aa61-0121733a932d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "98c628a8-e152-4189-94f1-e166c406cf10", "address": "fa:16:3e:2b:91:a7", "network": {"id": "77fc4e10-1fed-4963-86b4-1fbb3a9c6f7f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1105404274-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b2b9f55b231c455ca1a4579d7ed54888", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap98c628a8-e1", "ovs_interfaceid": "98c628a8-e152-4189-94f1-e166c406cf10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98431) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 11 23:13:24.211552 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Converting VIF {"id": "98c628a8-e152-4189-94f1-e166c406cf10", "address": "fa:16:3e:2b:91:a7", "network": {"id": "77fc4e10-1fed-4963-86b4-1fbb3a9c6f7f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1105404274-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b2b9f55b231c455ca1a4579d7ed54888", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap98c628a8-e1", "ovs_interfaceid": "98c628a8-e152-4189-94f1-e166c406cf10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:13:24.212206 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:91:a7,bridge_name='br-int',has_traffic_filtering=True,id=98c628a8-e152-4189-94f1-e166c406cf10,network=Network(77fc4e10-1fed-4963-86b4-1fbb3a9c6f7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98c628a8-e1') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:13:24.212876 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Lazy-loading 'pci_devices' on Instance uuid dd1dd46c-2231-40b4-aa61-0121733a932d {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:13:24.317198 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.026s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:24.318051 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: 67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f] Start building networks asynchronously for instance. {{(pid=98431) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 11 23:13:24.320537 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-fc764337-eb53-469f-9989-312c3c6908b7 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 7.085s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:24.423143 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-0fdfb306-5511-483c-9bee-ececad48eaa4 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Acquiring lock "8a45e04f-3516-4c39-bea1-820104411f17" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:24.423323 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-0fdfb306-5511-483c-9bee-ececad48eaa4 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "8a45e04f-3516-4c39-bea1-820104411f17" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:24.423514 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-0fdfb306-5511-483c-9bee-ececad48eaa4 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] Attaching volume f535b91b-3bff-46ad-905e-644bd012b9ff to /dev/vdb Jun 11 23:13:24.480167 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-0fdfb306-5511-483c-9bee-ececad48eaa4 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.209', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000002687', 'execute': None}" {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 11 23:13:24.496657 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.scaleio [None req-0fdfb306-5511-483c-9bee-ececad48eaa4 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98431) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 11 23:13:24.526905 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-0fdfb306-5511-483c-9bee-ececad48eaa4 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Running cmd (subprocess): nvme version {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:13:24.566072 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-0fdfb306-5511-483c-9bee-ececad48eaa4 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] 'nvme version' failed. Not Retrying. {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 11 23:13:24.569841 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0fdfb306-5511-483c-9bee-ececad48eaa4 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] nvme not present on system {{(pid=98431) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 11 23:13:24.586335 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.lightos [None req-0fdfb306-5511-483c-9bee-ececad48eaa4 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98431) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 11 23:13:24.588140 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.lightos [None req-0fdfb306-5511-483c-9bee-ececad48eaa4 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Current host hostNQN and IP(s) are ['10.4.3.209', 'fe80::f816:3eff:fea3:3707', '192.168.40.6', 'fe80::f816:3eff:fe06:bdab', '192.168.50.6', 'fe80::f816:3eff:fe7a:46f2', '192.168.10.6', 'fe80::f816:3eff:fe13:793b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::38fa:21ff:fe6c:3746', 'fe80::fc16:3eff:fe6c:eb30', 'fe80::20a8:54ff:fe51:da0a', 'fe80::fc16:3eff:fe77:488d', 'fe80::9469:f2ff:feae:5824', 'fe80::fc16:3eff:fec7:336a', 'fe80::fc16:3eff:fe61:b7fd', 'fe80::fc16:3eff:fec6:c65b', 'fe80::fc16:3eff:fed6:e34f', 'fe80::fc16:3eff:fe4b:2695', 'fe80::fc16:3eff:fe6f:4242'] Jun 11 23:13:24.588334 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.lightos [None req-0fdfb306-5511-483c-9bee-ececad48eaa4 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98431) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 11 23:13:24.588503 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.lightos [None req-0fdfb306-5511-483c-9bee-ececad48eaa4 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] LIGHTOS: no hostnqn found. {{(pid=98431) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 11 23:13:24.588923 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-0fdfb306-5511-483c-9bee-ececad48eaa4 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] <== get_connector_properties: return (108ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.209', 'host': 'np0000002687', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:798b370f1cc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad465dfe-0ed1-4637-98c3-ddaebebd61a4', 'nvme_native_multipath': False} {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 11 23:13:24.589665 np0000002687 nova-compute[98431]: DEBUG nova.virt.block_device [None req-0fdfb306-5511-483c-9bee-ececad48eaa4 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] Updating existing volume attachment record: 1fb9b428-c9d2-475e-8b42-675ec77798e8 {{(pid=98431) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 11 23:13:24.657559 np0000002687 nova-compute[98431]: DEBUG nova.objects.base [None req-f2cbe4b9-a6dd-4fa2-852e-e726439312f0 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Object Instance<0d352738-c7bf-42a2-8260-bf5574a7200d> lazy-loaded attributes: flavor,numa_topology {{(pid=98431) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 11 23:13:24.717962 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: dd1dd46c-2231-40b4-aa61-0121733a932d] End _get_guest_xml xml= Jun 11 23:13:24.717962 np0000002687 nova-compute[98431]: dd1dd46c-2231-40b4-aa61-0121733a932d Jun 11 23:13:24.717962 np0000002687 nova-compute[98431]: instance-00000014 Jun 11 23:13:24.717962 np0000002687 nova-compute[98431]: 196608 Jun 11 23:13:24.717962 np0000002687 nova-compute[98431]: 1 Jun 11 23:13:24.717962 np0000002687 nova-compute[98431]: Jun 11 23:13:24.717962 np0000002687 nova-compute[98431]: Jun 11 23:13:24.717962 np0000002687 nova-compute[98431]: Jun 11 23:13:24.717962 np0000002687 nova-compute[98431]: tempest-ServerRescueNegativeTestJSON-server-2077015389 Jun 11 23:13:24.717962 np0000002687 nova-compute[98431]: 2026-06-11 23:13:24 Jun 11 23:13:24.717962 np0000002687 nova-compute[98431]: Jun 11 23:13:24.717962 np0000002687 nova-compute[98431]: 192 Jun 11 23:13:24.717962 np0000002687 nova-compute[98431]: 1 Jun 11 23:13:24.717962 np0000002687 nova-compute[98431]: 0 Jun 11 23:13:24.717962 np0000002687 nova-compute[98431]: 0 Jun 11 23:13:24.717962 np0000002687 nova-compute[98431]: 1 Jun 11 23:13:24.717962 np0000002687 nova-compute[98431]: Jun 11 23:13:24.717962 np0000002687 nova-compute[98431]: True Jun 11 23:13:24.717962 np0000002687 nova-compute[98431]: Jun 11 23:13:24.717962 np0000002687 nova-compute[98431]: Jun 11 23:13:24.717962 np0000002687 nova-compute[98431]: Jun 11 23:13:24.717962 np0000002687 nova-compute[98431]: bare Jun 11 23:13:24.717962 np0000002687 nova-compute[98431]: qcow2 Jun 11 23:13:24.717962 np0000002687 nova-compute[98431]: 1 Jun 11 23:13:24.717962 np0000002687 nova-compute[98431]: 0 Jun 11 23:13:24.717962 np0000002687 nova-compute[98431]: Jun 11 23:13:24.717962 np0000002687 nova-compute[98431]: virtio Jun 11 23:13:24.717962 np0000002687 nova-compute[98431]: Jun 11 23:13:24.717962 np0000002687 nova-compute[98431]: Jun 11 23:13:24.717962 np0000002687 nova-compute[98431]: Jun 11 23:13:24.717962 np0000002687 nova-compute[98431]: tempest-ServerRescueNegativeTestJSON-2027875711-project-member Jun 11 23:13:24.717962 np0000002687 nova-compute[98431]: tempest-ServerRescueNegativeTestJSON-2027875711 Jun 11 23:13:24.717962 np0000002687 nova-compute[98431]: Jun 11 23:13:24.717962 np0000002687 nova-compute[98431]: Jun 11 23:13:24.717962 np0000002687 nova-compute[98431]: Jun 11 23:13:24.717962 np0000002687 nova-compute[98431]: Jun 11 23:13:24.717962 np0000002687 nova-compute[98431]: Jun 11 23:13:24.717962 np0000002687 nova-compute[98431]: Jun 11 23:13:24.717962 np0000002687 nova-compute[98431]: Jun 11 23:13:24.717962 np0000002687 nova-compute[98431]: Jun 11 23:13:24.717962 np0000002687 nova-compute[98431]: Jun 11 23:13:24.717962 np0000002687 nova-compute[98431]: Jun 11 23:13:24.717962 np0000002687 nova-compute[98431]: Jun 11 23:13:24.717962 np0000002687 nova-compute[98431]: OpenStack Foundation Jun 11 23:13:24.717962 np0000002687 nova-compute[98431]: OpenStack Nova Jun 11 23:13:24.717962 np0000002687 nova-compute[98431]: 33.1.0 Jun 11 23:13:24.717962 np0000002687 nova-compute[98431]: dd1dd46c-2231-40b4-aa61-0121733a932d Jun 11 23:13:24.717962 np0000002687 nova-compute[98431]: dd1dd46c-2231-40b4-aa61-0121733a932d Jun 11 23:13:24.717962 np0000002687 nova-compute[98431]: Virtual Machine Jun 11 23:13:24.717962 np0000002687 nova-compute[98431]: Jun 11 23:13:24.717962 np0000002687 nova-compute[98431]: Jun 11 23:13:24.717962 np0000002687 nova-compute[98431]: Jun 11 23:13:24.717962 np0000002687 nova-compute[98431]: hvm Jun 11 23:13:24.717962 np0000002687 nova-compute[98431]: Jun 11 23:13:24.717962 np0000002687 nova-compute[98431]: Jun 11 23:13:24.717962 np0000002687 nova-compute[98431]: Jun 11 23:13:24.717962 np0000002687 nova-compute[98431]: Jun 11 23:13:24.717962 np0000002687 nova-compute[98431]: Jun 11 23:13:24.717962 np0000002687 nova-compute[98431]: Jun 11 23:13:24.717962 np0000002687 nova-compute[98431]: 128 Jun 11 23:13:24.717962 np0000002687 nova-compute[98431]: Jun 11 23:13:24.717962 np0000002687 nova-compute[98431]: Jun 11 23:13:24.717962 np0000002687 nova-compute[98431]: Jun 11 23:13:24.717962 np0000002687 nova-compute[98431]: 1 Jun 11 23:13:24.717962 np0000002687 nova-compute[98431]: Jun 11 23:13:24.717962 np0000002687 nova-compute[98431]: Jun 11 23:13:24.717962 np0000002687 nova-compute[98431]: Nehalem Jun 11 23:13:24.717962 np0000002687 nova-compute[98431]: Jun 11 23:13:24.717962 np0000002687 nova-compute[98431]: Jun 11 23:13:24.717962 np0000002687 nova-compute[98431]: Jun 11 23:13:24.717962 np0000002687 nova-compute[98431]: Jun 11 23:13:24.717962 np0000002687 nova-compute[98431]: Jun 11 23:13:24.717962 np0000002687 nova-compute[98431]: Jun 11 23:13:24.717962 np0000002687 nova-compute[98431]: Jun 11 23:13:24.717962 np0000002687 nova-compute[98431]: Jun 11 23:13:24.717962 np0000002687 nova-compute[98431]: Jun 11 23:13:24.717962 np0000002687 nova-compute[98431]: Jun 11 23:13:24.717962 np0000002687 nova-compute[98431]: Jun 11 23:13:24.717962 np0000002687 nova-compute[98431]: Jun 11 23:13:24.717962 np0000002687 nova-compute[98431]: Jun 11 23:13:24.717962 np0000002687 nova-compute[98431]: Jun 11 23:13:24.717962 np0000002687 nova-compute[98431]: Jun 11 23:13:24.717962 np0000002687 nova-compute[98431]: Jun 11 23:13:24.717962 np0000002687 nova-compute[98431]: Jun 11 23:13:24.717962 np0000002687 nova-compute[98431]: Jun 11 23:13:24.717962 np0000002687 nova-compute[98431]: Jun 11 23:13:24.717962 np0000002687 nova-compute[98431]: Jun 11 23:13:24.717962 np0000002687 nova-compute[98431]: Jun 11 23:13:24.717962 np0000002687 nova-compute[98431]: Jun 11 23:13:24.717962 np0000002687 nova-compute[98431]: Jun 11 23:13:24.717962 np0000002687 nova-compute[98431]: Jun 11 23:13:24.717962 np0000002687 nova-compute[98431]: Jun 11 23:13:24.717962 np0000002687 nova-compute[98431]: Jun 11 23:13:24.717962 np0000002687 nova-compute[98431]: /dev/urandom Jun 11 23:13:24.717962 np0000002687 nova-compute[98431]: Jun 11 23:13:24.717962 np0000002687 nova-compute[98431]: Jun 11 23:13:24.717962 np0000002687 nova-compute[98431]: Jun 11 23:13:24.717962 np0000002687 nova-compute[98431]: Jun 11 23:13:24.717962 np0000002687 nova-compute[98431]: Jun 11 23:13:24.717962 np0000002687 nova-compute[98431]: Jun 11 23:13:24.717962 np0000002687 nova-compute[98431]: Jun 11 23:13:24.717962 np0000002687 nova-compute[98431]: {{(pid=98431) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 11 23:13:24.717962 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: dd1dd46c-2231-40b4-aa61-0121733a932d] Preparing to wait for external event network-vif-plugged-98c628a8-e152-4189-94f1-e166c406cf10 {{(pid=98431) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 11 23:13:24.721426 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Acquiring lock "dd1dd46c-2231-40b4-aa61-0121733a932d-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:24.721426 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Lock "dd1dd46c-2231-40b4-aa61-0121733a932d-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:24.721426 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Lock "dd1dd46c-2231-40b4-aa61-0121733a932d-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:24.721426 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-11T23:13:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2077015389',display_name='tempest-ServerRescueNegativeTestJSON-server-2077015389',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='tempest-serverrescuenegativetestjson-server-2077015389',id=20,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b2b9f55b231c455ca1a4579d7ed54888',ramdisk_id='',reservation_id='r-a0ty5rvr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2027875711',owner_user_name='tempest-ServerRescueNegativeTestJSON-2027875711-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-11T23:13:21Z,user_data=None,user_id='eaecdd9c05b5485b9422171463cccf92',uuid=dd1dd46c-2231-40b4-aa61-0121733a932d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "98c628a8-e152-4189-94f1-e166c406cf10", "address": "fa:16:3e:2b:91:a7", "network": {"id": "77fc4e10-1fed-4963-86b4-1fbb3a9c6f7f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1105404274-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b2b9f55b231c455ca1a4579d7ed54888", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap98c628a8-e1", "ovs_interfaceid": "98c628a8-e152-4189-94f1-e166c406cf10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 11 23:13:24.721426 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Converting VIF {"id": "98c628a8-e152-4189-94f1-e166c406cf10", "address": "fa:16:3e:2b:91:a7", "network": {"id": "77fc4e10-1fed-4963-86b4-1fbb3a9c6f7f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1105404274-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b2b9f55b231c455ca1a4579d7ed54888", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap98c628a8-e1", "ovs_interfaceid": "98c628a8-e152-4189-94f1-e166c406cf10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:13:24.721426 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:91:a7,bridge_name='br-int',has_traffic_filtering=True,id=98c628a8-e152-4189-94f1-e166c406cf10,network=Network(77fc4e10-1fed-4963-86b4-1fbb3a9c6f7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98c628a8-e1') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:13:24.721426 np0000002687 nova-compute[98431]: DEBUG os_vif [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:91:a7,bridge_name='br-int',has_traffic_filtering=True,id=98c628a8-e152-4189-94f1-e166c406cf10,network=Network(77fc4e10-1fed-4963-86b4-1fbb3a9c6f7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98c628a8-e1') {{(pid=98431) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 11 23:13:24.722866 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:24.722866 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:13:24.723392 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 11 23:13:24.725704 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:24.725955 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f3f777e4-1e34-5f2b-a50f-875b01dc70ce', '_type': 'linux-noop'}}, row=False) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:13:24.726904 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:24.728520 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:13:24.733478 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:24.737011 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:24.737011 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap98c628a8-e1, may_exist=True, interface_attrs={}) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:13:24.737631 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap98c628a8-e1, col_values=(('qos', UUID('739d4a11-d467-4e23-9c28-04df22a092b5')),), if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:13:24.737631 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap98c628a8-e1, col_values=(('external_ids', {'iface-id': '98c628a8-e152-4189-94f1-e166c406cf10', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2b:91:a7', 'vm-uuid': 'dd1dd46c-2231-40b4-aa61-0121733a932d'}),), if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:13:24.738543 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:24.739986 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:13:24.756923 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:24.757597 np0000002687 nova-compute[98431]: INFO os_vif [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:91:a7,bridge_name='br-int',has_traffic_filtering=True,id=98c628a8-e152-4189-94f1-e166c406cf10,network=Network(77fc4e10-1fed-4963-86b4-1fbb3a9c6f7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98c628a8-e1') Jun 11 23:13:24.821126 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98431) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 11 23:13:24.835357 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: 67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f] Allocating IP information in the background. {{(pid=98431) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 11 23:13:24.835779 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: 67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f] allocate_for_instance() {{(pid=98431) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 11 23:13:24.836378 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:13:24.836759 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:13:24.955734 np0000002687 nova-compute[98431]: DEBUG nova.policy [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'eaecdd9c05b5485b9422171463cccf92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9f55b231c455ca1a4579d7ed54888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98431) authorize /opt/stack/nova/nova/policy.py:192}} Jun 11 23:13:25.159957 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0fdfb306-5511-483c-9bee-ececad48eaa4 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] Calling os-brick to attach iSCSI Volume {{(pid=98431) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 11 23:13:25.160573 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fdfb306-5511-483c-9bee-ececad48eaa4 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff', 'iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f535b91b-3bff-46ad-905e-644bd012b9ff', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 11 23:13:25.160573 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-0fdfb306-5511-483c-9bee-ececad48eaa4 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 11 23:13:25.182723 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:25.224536 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:25.318481 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-fc764337-eb53-469f-9989-312c3c6908b7 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98431) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 11 23:13:25.319094 np0000002687 nova-compute[98431]: DEBUG nova.compute.provider_tree [None req-fc764337-eb53-469f-9989-312c3c6908b7 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] Inventory has not changed in ProviderTree for provider: e3e65fe2-9de9-4821-8b4a-ccae37c66e25 {{(pid=98431) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 11 23:13:25.326209 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:25.347456 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: 67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 11 23:13:25.393263 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:25.402130 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:25.480335 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: 67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f] Successfully created port: 59f62261-8a42-4e76-9609-68343996250d {{(pid=98431) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 11 23:13:25.822891 np0000002687 nova-compute[98431]: DEBUG nova.scheduler.client.report [None req-fc764337-eb53-469f-9989-312c3c6908b7 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] Inventory has not changed for provider e3e65fe2-9de9-4821-8b4a-ccae37c66e25 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98431) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 11 23:13:25.850005 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Found WWN 330000000d835ecb1 for multipath device dm-11 {{(pid=98431) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 11 23:13:25.850005 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.048s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 11 23:13:25.850163 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] <== connect_volume: return (3049ms) {'type': 'block', 'scsi_wwn': '330000000d835ecb1', 'path': '/dev/dm-11', 'multipath_id': '330000000d835ecb1'} {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 11 23:13:25.850777 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000d835ecb1', 'path': '/dev/dm-11', 'multipath_id': '330000000d835ecb1'} {{(pid=98431) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 11 23:13:25.851108 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-0fdfb306-5511-483c-9bee-ececad48eaa4 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.691s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 11 23:13:25.851331 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-0fdfb306-5511-483c-9bee-ececad48eaa4 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff', 'iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f535b91b-3bff-46ad-905e-644bd012b9ff', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98431) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 11 23:13:25.851946 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: 67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f] Start building block device mappings for instance. {{(pid=98431) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 11 23:13:25.868252 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-0fdfb306-5511-483c-9bee-ececad48eaa4 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 11 23:13:25.868757 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-0fdfb306-5511-483c-9bee-ececad48eaa4 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 11 23:13:25.868976 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.iscsi [None req-0fdfb306-5511-483c-9bee-ececad48eaa4 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 11 23:13:25.869603 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-0fdfb306-5511-483c-9bee-ececad48eaa4 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 11 23:13:25.871114 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-0fdfb306-5511-483c-9bee-ececad48eaa4 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 11 23:13:25.871376 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.iscsi [None req-0fdfb306-5511-483c-9bee-ececad48eaa4 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 11 23:13:25.882702 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fdfb306-5511-483c-9bee-ececad48eaa4 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 11 23:13:25.882702 np0000002687 nova-compute[98431]: node.name = iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff Jun 11 23:13:25.882702 np0000002687 nova-compute[98431]: node.tpgt = -1 Jun 11 23:13:25.882702 np0000002687 nova-compute[98431]: node.startup = automatic Jun 11 23:13:25.882702 np0000002687 nova-compute[98431]: node.leading_login = No Jun 11 23:13:25.882702 np0000002687 nova-compute[98431]: iface.iscsi_ifacename = default Jun 11 23:13:25.882702 np0000002687 nova-compute[98431]: iface.net_ifacename = Jun 11 23:13:25.882702 np0000002687 nova-compute[98431]: iface.ipaddress = Jun 11 23:13:25.882702 np0000002687 nova-compute[98431]: iface.prefix_len = 0 Jun 11 23:13:25.882702 np0000002687 nova-compute[98431]: iface.hwaddress = Jun 11 23:13:25.882702 np0000002687 nova-compute[98431]: iface.transport_name = tcp Jun 11 23:13:25.882702 np0000002687 nova-compute[98431]: iface.initiatorname = Jun 11 23:13:25.882702 np0000002687 nova-compute[98431]: iface.state = Jun 11 23:13:25.882702 np0000002687 nova-compute[98431]: iface.vlan_id = 0 Jun 11 23:13:25.882702 np0000002687 nova-compute[98431]: iface.vlan_priority = 0 Jun 11 23:13:25.882702 np0000002687 nova-compute[98431]: iface.vlan_state = Jun 11 23:13:25.882702 np0000002687 nova-compute[98431]: iface.iface_num = 0 Jun 11 23:13:25.882702 np0000002687 nova-compute[98431]: iface.mtu = 0 Jun 11 23:13:25.882702 np0000002687 nova-compute[98431]: iface.port = 0 Jun 11 23:13:25.882702 np0000002687 nova-compute[98431]: iface.bootproto = Jun 11 23:13:25.882702 np0000002687 nova-compute[98431]: iface.subnet_mask = Jun 11 23:13:25.882702 np0000002687 nova-compute[98431]: iface.gateway = Jun 11 23:13:25.882702 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id_state = Jun 11 23:13:25.882702 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id = Jun 11 23:13:25.882702 np0000002687 nova-compute[98431]: iface.dhcp_dns = Jun 11 23:13:25.882702 np0000002687 nova-compute[98431]: iface.dhcp_learn_iqn = Jun 11 23:13:25.882702 np0000002687 nova-compute[98431]: iface.dhcp_req_vendor_id_state = Jun 11 23:13:25.882702 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id_state = Jun 11 23:13:25.882702 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id = Jun 11 23:13:25.882702 np0000002687 nova-compute[98431]: iface.dhcp_slp_da = Jun 11 23:13:25.882702 np0000002687 nova-compute[98431]: iface.fragmentation = Jun 11 23:13:25.882702 np0000002687 nova-compute[98431]: iface.gratuitous_arp = Jun 11 23:13:25.882702 np0000002687 nova-compute[98431]: iface.incoming_forwarding = Jun 11 23:13:25.882702 np0000002687 nova-compute[98431]: iface.tos_state = Jun 11 23:13:25.882702 np0000002687 nova-compute[98431]: iface.tos = 0 Jun 11 23:13:25.882702 np0000002687 nova-compute[98431]: iface.ttl = 0 Jun 11 23:13:25.882702 np0000002687 nova-compute[98431]: iface.delayed_ack = Jun 11 23:13:25.882702 np0000002687 nova-compute[98431]: iface.tcp_nagle = Jun 11 23:13:25.882702 np0000002687 nova-compute[98431]: iface.tcp_wsf_state = Jun 11 23:13:25.882702 np0000002687 nova-compute[98431]: iface.tcp_wsf = 0 Jun 11 23:13:25.882702 np0000002687 nova-compute[98431]: iface.tcp_timer_scale = 0 Jun 11 23:13:25.882702 np0000002687 nova-compute[98431]: iface.tcp_timestamp = Jun 11 23:13:25.882702 np0000002687 nova-compute[98431]: iface.redirect = Jun 11 23:13:25.882702 np0000002687 nova-compute[98431]: iface.def_task_mgmt_timeout = 0 Jun 11 23:13:25.882702 np0000002687 nova-compute[98431]: iface.header_digest = Jun 11 23:13:25.882702 np0000002687 nova-compute[98431]: iface.data_digest = Jun 11 23:13:25.882702 np0000002687 nova-compute[98431]: iface.immediate_data = Jun 11 23:13:25.882702 np0000002687 nova-compute[98431]: iface.initial_r2t = Jun 11 23:13:25.882702 np0000002687 nova-compute[98431]: iface.data_seq_inorder = Jun 11 23:13:25.882702 np0000002687 nova-compute[98431]: iface.data_pdu_inorder = Jun 11 23:13:25.882702 np0000002687 nova-compute[98431]: iface.erl = 0 Jun 11 23:13:25.882702 np0000002687 nova-compute[98431]: iface.max_receive_data_len = 0 Jun 11 23:13:25.882702 np0000002687 nova-compute[98431]: iface.first_burst_len = 0 Jun 11 23:13:25.882702 np0000002687 nova-compute[98431]: iface.max_outstanding_r2t = 0 Jun 11 23:13:25.882702 np0000002687 nova-compute[98431]: iface.max_burst_len = 0 Jun 11 23:13:25.882702 np0000002687 nova-compute[98431]: iface.chap_auth = Jun 11 23:13:25.882702 np0000002687 nova-compute[98431]: iface.bidi_chap = Jun 11 23:13:25.882702 np0000002687 nova-compute[98431]: iface.strict_login_compliance = Jun 11 23:13:25.882702 np0000002687 nova-compute[98431]: iface.discovery_auth = Jun 11 23:13:25.882702 np0000002687 nova-compute[98431]: iface.discovery_logout = Jun 11 23:13:25.882702 np0000002687 nova-compute[98431]: node.discovery_address = Jun 11 23:13:25.882702 np0000002687 nova-compute[98431]: node.discovery_port = 0 Jun 11 23:13:25.882702 np0000002687 nova-compute[98431]: node.discovery_type = fw Jun 11 23:13:25.882702 np0000002687 nova-compute[98431]: node.session.initial_cmdsn = 0 Jun 11 23:13:25.882702 np0000002687 nova-compute[98431]: node.session.initial_login_retry_max = 8 Jun 11 23:13:25.882702 np0000002687 nova-compute[98431]: node.session.xmit_thread_priority = 0 Jun 11 23:13:25.882702 np0000002687 nova-compute[98431]: node.session.cmds_max = 128 Jun 11 23:13:25.882702 np0000002687 nova-compute[98431]: node.session.queue_depth = 32 Jun 11 23:13:25.882702 np0000002687 nova-compute[98431]: node.session.nr_sessions = 1 Jun 11 23:13:25.882702 np0000002687 nova-compute[98431]: node.session.auth.authmethod = None Jun 11 23:13:25.882702 np0000002687 nova-compute[98431]: node.session.auth.username = Jun 11 23:13:25.882702 np0000002687 nova-compute[98431]: node.session.auth.password = *** Jun 11 23:13:25.882702 np0000002687 nova-compute[98431]: node.session.auth.username_in = Jun 11 23:13:25.882702 np0000002687 nova-compute[98431]: node.session.auth.password_in = Jun 11 23:13:25.882702 np0000002687 nova-compute[98431]: node.session.auth.chap_algs = SHA256 Jun 11 23:13:25.882702 np0000002687 nova-compute[98431]: node.session.timeo.replacement_timeout = 120 Jun 11 23:13:25.882702 np0000002687 nova-compute[98431]: node.session.err_timeo.abort_timeout = 15 Jun 11 23:13:25.882702 np0000002687 nova-compute[98431]: node.session.err_timeo.lu_reset_timeout = 30 Jun 11 23:13:25.882702 np0000002687 nova-compute[98431]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 11 23:13:25.882702 np0000002687 nova-compute[98431]: node.session.err_timeo.host_reset_timeout = 60 Jun 11 23:13:25.882702 np0000002687 nova-compute[98431]: node.session.iscsi.FastAbort = Yes Jun 11 23:13:25.882702 np0000002687 nova-compute[98431]: node.session.iscsi.InitialR2T = No Jun 11 23:13:25.882702 np0000002687 nova-compute[98431]: node.session.iscsi.ImmediateData = Yes Jun 11 23:13:25.882702 np0000002687 nova-compute[98431]: node.session.iscsi.FirstBurstLength = 262144 Jun 11 23:13:25.882702 np0000002687 nova-compute[98431]: node.session.iscsi.MaxBurstLength = 16776192 Jun 11 23:13:25.882702 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Retain = 0 Jun 11 23:13:25.882702 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Wait = 2 Jun 11 23:13:25.882702 np0000002687 nova-compute[98431]: node.session.iscsi.MaxConnections = 1 Jun 11 23:13:25.882702 np0000002687 nova-compute[98431]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 11 23:13:25.882702 np0000002687 nova-compute[98431]: node.session.iscsi.ERL = 0 Jun 11 23:13:25.882702 np0000002687 nova-compute[98431]: node.session.scan = manual Jun 11 23:13:25.882702 np0000002687 nova-compute[98431]: node.session.reopen_max = 0 Jun 11 23:13:25.882702 np0000002687 nova-compute[98431]: node.conn[0].address = 192.168.40.100 Jun 11 23:13:25.882702 np0000002687 nova-compute[98431]: node.conn[0].port = 3260 Jun 11 23:13:25.882702 np0000002687 nova-compute[98431]: node.conn[0].startup = manual Jun 11 23:13:25.882702 np0000002687 nova-compute[98431]: node.conn[0].tcp.window_size = 524288 Jun 11 23:13:25.882702 np0000002687 nova-compute[98431]: node.conn[0].tcp.type_of_service = 0 Jun 11 23:13:25.882702 np0000002687 nova-compute[98431]: node.conn[0].timeo.logout_timeout = 15 Jun 11 23:13:25.882702 np0000002687 nova-compute[98431]: node.conn[0].timeo.login_timeout = 15 Jun 11 23:13:25.882702 np0000002687 nova-compute[98431]: node.conn[0].timeo.auth_timeout = 45 Jun 11 23:13:25.882702 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_interval = 5 Jun 11 23:13:25.882702 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_timeout = 5 Jun 11 23:13:25.882702 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 11 23:13:25.882702 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 11 23:13:25.882702 np0000002687 nova-compute[98431]: node.conn[0].iscsi.HeaderDigest = None Jun 11 23:13:25.882702 np0000002687 nova-compute[98431]: node.conn[0].iscsi.DataDigest = None Jun 11 23:13:25.882702 np0000002687 nova-compute[98431]: node.conn[0].iscsi.IFMarker = No Jun 11 23:13:25.882702 np0000002687 nova-compute[98431]: node.conn[0].iscsi.OFMarker = No Jun 11 23:13:25.882702 np0000002687 nova-compute[98431]: # END RECORD Jun 11 23:13:25.882702 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:13:25.893564 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fdfb306-5511-483c-9bee-ececad48eaa4 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 11 23:13:25.893564 np0000002687 nova-compute[98431]: node.name = iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff Jun 11 23:13:25.893564 np0000002687 nova-compute[98431]: node.tpgt = -1 Jun 11 23:13:25.893564 np0000002687 nova-compute[98431]: node.startup = automatic Jun 11 23:13:25.893564 np0000002687 nova-compute[98431]: node.leading_login = No Jun 11 23:13:25.893564 np0000002687 nova-compute[98431]: iface.iscsi_ifacename = default Jun 11 23:13:25.893564 np0000002687 nova-compute[98431]: iface.net_ifacename = Jun 11 23:13:25.893564 np0000002687 nova-compute[98431]: iface.ipaddress = Jun 11 23:13:25.893564 np0000002687 nova-compute[98431]: iface.prefix_len = 0 Jun 11 23:13:25.893564 np0000002687 nova-compute[98431]: iface.hwaddress = Jun 11 23:13:25.893564 np0000002687 nova-compute[98431]: iface.transport_name = tcp Jun 11 23:13:25.893564 np0000002687 nova-compute[98431]: iface.initiatorname = Jun 11 23:13:25.893564 np0000002687 nova-compute[98431]: iface.state = Jun 11 23:13:25.893564 np0000002687 nova-compute[98431]: iface.vlan_id = 0 Jun 11 23:13:25.893564 np0000002687 nova-compute[98431]: iface.vlan_priority = 0 Jun 11 23:13:25.893564 np0000002687 nova-compute[98431]: iface.vlan_state = Jun 11 23:13:25.893564 np0000002687 nova-compute[98431]: iface.iface_num = 0 Jun 11 23:13:25.893564 np0000002687 nova-compute[98431]: iface.mtu = 0 Jun 11 23:13:25.893564 np0000002687 nova-compute[98431]: iface.port = 0 Jun 11 23:13:25.893564 np0000002687 nova-compute[98431]: iface.bootproto = Jun 11 23:13:25.893564 np0000002687 nova-compute[98431]: iface.subnet_mask = Jun 11 23:13:25.893564 np0000002687 nova-compute[98431]: iface.gateway = Jun 11 23:13:25.893564 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id_state = Jun 11 23:13:25.893564 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id = Jun 11 23:13:25.893564 np0000002687 nova-compute[98431]: iface.dhcp_dns = Jun 11 23:13:25.893564 np0000002687 nova-compute[98431]: iface.dhcp_learn_iqn = Jun 11 23:13:25.893564 np0000002687 nova-compute[98431]: iface.dhcp_req_vendor_id_state = Jun 11 23:13:25.893564 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id_state = Jun 11 23:13:25.893564 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id = Jun 11 23:13:25.893564 np0000002687 nova-compute[98431]: iface.dhcp_slp_da = Jun 11 23:13:25.893564 np0000002687 nova-compute[98431]: iface.fragmentation = Jun 11 23:13:25.893564 np0000002687 nova-compute[98431]: iface.gratuitous_arp = Jun 11 23:13:25.893564 np0000002687 nova-compute[98431]: iface.incoming_forwarding = Jun 11 23:13:25.893564 np0000002687 nova-compute[98431]: iface.tos_state = Jun 11 23:13:25.893564 np0000002687 nova-compute[98431]: iface.tos = 0 Jun 11 23:13:25.893564 np0000002687 nova-compute[98431]: iface.ttl = 0 Jun 11 23:13:25.893564 np0000002687 nova-compute[98431]: iface.delayed_ack = Jun 11 23:13:25.893564 np0000002687 nova-compute[98431]: iface.tcp_nagle = Jun 11 23:13:25.893564 np0000002687 nova-compute[98431]: iface.tcp_wsf_state = Jun 11 23:13:25.893564 np0000002687 nova-compute[98431]: iface.tcp_wsf = 0 Jun 11 23:13:25.893564 np0000002687 nova-compute[98431]: iface.tcp_timer_scale = 0 Jun 11 23:13:25.893564 np0000002687 nova-compute[98431]: iface.tcp_timestamp = Jun 11 23:13:25.893564 np0000002687 nova-compute[98431]: iface.redirect = Jun 11 23:13:25.893564 np0000002687 nova-compute[98431]: iface.def_task_mgmt_timeout = 0 Jun 11 23:13:25.893564 np0000002687 nova-compute[98431]: iface.header_digest = Jun 11 23:13:25.893564 np0000002687 nova-compute[98431]: iface.data_digest = Jun 11 23:13:25.893564 np0000002687 nova-compute[98431]: iface.immediate_data = Jun 11 23:13:25.893564 np0000002687 nova-compute[98431]: iface.initial_r2t = Jun 11 23:13:25.893564 np0000002687 nova-compute[98431]: iface.data_seq_inorder = Jun 11 23:13:25.893564 np0000002687 nova-compute[98431]: iface.data_pdu_inorder = Jun 11 23:13:25.893564 np0000002687 nova-compute[98431]: iface.erl = 0 Jun 11 23:13:25.893564 np0000002687 nova-compute[98431]: iface.max_receive_data_len = 0 Jun 11 23:13:25.893564 np0000002687 nova-compute[98431]: iface.first_burst_len = 0 Jun 11 23:13:25.893564 np0000002687 nova-compute[98431]: iface.max_outstanding_r2t = 0 Jun 11 23:13:25.893564 np0000002687 nova-compute[98431]: iface.max_burst_len = 0 Jun 11 23:13:25.893564 np0000002687 nova-compute[98431]: iface.chap_auth = Jun 11 23:13:25.893564 np0000002687 nova-compute[98431]: iface.bidi_chap = Jun 11 23:13:25.893564 np0000002687 nova-compute[98431]: iface.strict_login_compliance = Jun 11 23:13:25.893564 np0000002687 nova-compute[98431]: iface.discovery_auth = Jun 11 23:13:25.893564 np0000002687 nova-compute[98431]: iface.discovery_logout = Jun 11 23:13:25.893564 np0000002687 nova-compute[98431]: node.discovery_address = Jun 11 23:13:25.893564 np0000002687 nova-compute[98431]: node.discovery_port = 0 Jun 11 23:13:25.893564 np0000002687 nova-compute[98431]: node.discovery_type = fw Jun 11 23:13:25.893564 np0000002687 nova-compute[98431]: node.session.initial_cmdsn = 0 Jun 11 23:13:25.893564 np0000002687 nova-compute[98431]: node.session.initial_login_retry_max = 8 Jun 11 23:13:25.893564 np0000002687 nova-compute[98431]: node.session.xmit_thread_priority = 0 Jun 11 23:13:25.893564 np0000002687 nova-compute[98431]: node.session.cmds_max = 128 Jun 11 23:13:25.893564 np0000002687 nova-compute[98431]: node.session.queue_depth = 32 Jun 11 23:13:25.893564 np0000002687 nova-compute[98431]: node.session.nr_sessions = 1 Jun 11 23:13:25.893564 np0000002687 nova-compute[98431]: node.session.auth.authmethod = None Jun 11 23:13:25.893564 np0000002687 nova-compute[98431]: node.session.auth.username = Jun 11 23:13:25.893564 np0000002687 nova-compute[98431]: node.session.auth.password = *** Jun 11 23:13:25.893564 np0000002687 nova-compute[98431]: node.session.auth.username_in = Jun 11 23:13:25.893564 np0000002687 nova-compute[98431]: node.session.auth.password_in = Jun 11 23:13:25.893564 np0000002687 nova-compute[98431]: node.session.auth.chap_algs = SHA256 Jun 11 23:13:25.893564 np0000002687 nova-compute[98431]: node.session.timeo.replacement_timeout = 120 Jun 11 23:13:25.893564 np0000002687 nova-compute[98431]: node.session.err_timeo.abort_timeout = 15 Jun 11 23:13:25.893564 np0000002687 nova-compute[98431]: node.session.err_timeo.lu_reset_timeout = 30 Jun 11 23:13:25.893564 np0000002687 nova-compute[98431]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 11 23:13:25.893564 np0000002687 nova-compute[98431]: node.session.err_timeo.host_reset_timeout = 60 Jun 11 23:13:25.893564 np0000002687 nova-compute[98431]: node.session.iscsi.FastAbort = Yes Jun 11 23:13:25.893564 np0000002687 nova-compute[98431]: node.session.iscsi.InitialR2T = No Jun 11 23:13:25.893564 np0000002687 nova-compute[98431]: node.session.iscsi.ImmediateData = Yes Jun 11 23:13:25.893564 np0000002687 nova-compute[98431]: node.session.iscsi.FirstBurstLength = 262144 Jun 11 23:13:25.893564 np0000002687 nova-compute[98431]: node.session.iscsi.MaxBurstLength = 16776192 Jun 11 23:13:25.893564 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Retain = 0 Jun 11 23:13:25.893564 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Wait = 2 Jun 11 23:13:25.893564 np0000002687 nova-compute[98431]: node.session.iscsi.MaxConnections = 1 Jun 11 23:13:25.893564 np0000002687 nova-compute[98431]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 11 23:13:25.893564 np0000002687 nova-compute[98431]: node.session.iscsi.ERL = 0 Jun 11 23:13:25.893564 np0000002687 nova-compute[98431]: node.session.scan = manual Jun 11 23:13:25.893564 np0000002687 nova-compute[98431]: node.session.reopen_max = 0 Jun 11 23:13:25.893564 np0000002687 nova-compute[98431]: node.conn[0].address = 192.168.50.100 Jun 11 23:13:25.893564 np0000002687 nova-compute[98431]: node.conn[0].port = 3260 Jun 11 23:13:25.893564 np0000002687 nova-compute[98431]: node.conn[0].startup = manual Jun 11 23:13:25.893564 np0000002687 nova-compute[98431]: node.conn[0].tcp.window_size = 524288 Jun 11 23:13:25.893564 np0000002687 nova-compute[98431]: node.conn[0].tcp.type_of_service = 0 Jun 11 23:13:25.893564 np0000002687 nova-compute[98431]: node.conn[0].timeo.logout_timeout = 15 Jun 11 23:13:25.893564 np0000002687 nova-compute[98431]: node.conn[0].timeo.login_timeout = 15 Jun 11 23:13:25.893564 np0000002687 nova-compute[98431]: node.conn[0].timeo.auth_timeout = 45 Jun 11 23:13:25.893564 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_interval = 5 Jun 11 23:13:25.893564 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_timeout = 5 Jun 11 23:13:25.893564 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 11 23:13:25.893564 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 11 23:13:25.893564 np0000002687 nova-compute[98431]: node.conn[0].iscsi.HeaderDigest = None Jun 11 23:13:25.893564 np0000002687 nova-compute[98431]: node.conn[0].iscsi.DataDigest = None Jun 11 23:13:25.893564 np0000002687 nova-compute[98431]: node.conn[0].iscsi.IFMarker = No Jun 11 23:13:25.893564 np0000002687 nova-compute[98431]: node.conn[0].iscsi.OFMarker = No Jun 11 23:13:25.893564 np0000002687 nova-compute[98431]: # END RECORD Jun 11 23:13:25.893564 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:13:25.898710 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fdfb306-5511-483c-9bee-ececad48eaa4 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:13:25.908379 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fdfb306-5511-483c-9bee-ececad48eaa4 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:13:25.923112 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fdfb306-5511-483c-9bee-ececad48eaa4 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:25.923112 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:25.923112 np0000002687 nova-compute[98431]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:13:25.923112 np0000002687 nova-compute[98431]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:13:25.923112 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:25.923112 np0000002687 nova-compute[98431]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:13:25.923112 np0000002687 nova-compute[98431]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:13:25.923112 np0000002687 nova-compute[98431]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:13:25.923112 np0000002687 nova-compute[98431]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:13:25.923112 np0000002687 nova-compute[98431]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8 (non-flash) Jun 11 23:13:25.923112 np0000002687 nova-compute[98431]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8 (non-flash) Jun 11 23:13:25.923112 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:25.923112 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:13:25.923424 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fdfb306-5511-483c-9bee-ececad48eaa4 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] iscsi session list stdout=tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:25.923424 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:25.923424 np0000002687 nova-compute[98431]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:13:25.923424 np0000002687 nova-compute[98431]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:13:25.923424 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:25.923424 np0000002687 nova-compute[98431]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:13:25.923424 np0000002687 nova-compute[98431]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:13:25.923424 np0000002687 nova-compute[98431]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:13:25.923424 np0000002687 nova-compute[98431]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:13:25.923424 np0000002687 nova-compute[98431]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8 (non-flash) Jun 11 23:13:25.923424 np0000002687 nova-compute[98431]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8 (non-flash) Jun 11 23:13:25.923424 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:25.923424 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:13:25.923646 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-0fdfb306-5511-483c-9bee-ececad48eaa4 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.055s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 11 23:13:25.923758 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fdfb306-5511-483c-9bee-ececad48eaa4 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Connected to 192.168.40.100:3260 {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 11 23:13:25.924591 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-0fdfb306-5511-483c-9bee-ececad48eaa4 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] HCTL ('13', '0', '0', 0) found on session 31 with lun 0 {{(pid=98431) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 11 23:13:25.924725 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-0fdfb306-5511-483c-9bee-ececad48eaa4 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Scanning host 13 c: 0, t: 0, l: 0) {{(pid=98431) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 11 23:13:25.929196 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fdfb306-5511-483c-9bee-ececad48eaa4 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:25.929196 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:25.929196 np0000002687 nova-compute[98431]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:13:25.929196 np0000002687 nova-compute[98431]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:13:25.929196 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:25.929196 np0000002687 nova-compute[98431]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:13:25.929196 np0000002687 nova-compute[98431]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:13:25.929196 np0000002687 nova-compute[98431]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:13:25.929196 np0000002687 nova-compute[98431]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:13:25.929196 np0000002687 nova-compute[98431]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8 (non-flash) Jun 11 23:13:25.929196 np0000002687 nova-compute[98431]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8 (non-flash) Jun 11 23:13:25.929196 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:25.929196 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:13:25.929512 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fdfb306-5511-483c-9bee-ececad48eaa4 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] iscsi session list stdout=tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:25.929512 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:25.929512 np0000002687 nova-compute[98431]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:13:25.929512 np0000002687 nova-compute[98431]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:13:25.929512 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:25.929512 np0000002687 nova-compute[98431]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:13:25.929512 np0000002687 nova-compute[98431]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:13:25.929512 np0000002687 nova-compute[98431]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:13:25.929512 np0000002687 nova-compute[98431]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:13:25.929512 np0000002687 nova-compute[98431]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8 (non-flash) Jun 11 23:13:25.929512 np0000002687 nova-compute[98431]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8 (non-flash) Jun 11 23:13:25.929512 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:25.929512 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:13:25.929787 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-0fdfb306-5511-483c-9bee-ececad48eaa4 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.059s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 11 23:13:25.929908 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fdfb306-5511-483c-9bee-ececad48eaa4 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Connected to 192.168.50.100:3260 {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 11 23:13:25.930838 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-0fdfb306-5511-483c-9bee-ececad48eaa4 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] HCTL ('14', '0', '0', 0) found on session 32 with lun 0 {{(pid=98431) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 11 23:13:25.930989 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-0fdfb306-5511-483c-9bee-ececad48eaa4 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Scanning host 14 c: 0, t: 0, l: 0) {{(pid=98431) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 11 23:13:25.935590 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-0fdfb306-5511-483c-9bee-ececad48eaa4 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Searching for a device in session 31 and hctl ('13', '0', '0', 0) yield: sdh {{(pid=98431) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 11 23:13:25.935792 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fdfb306-5511-483c-9bee-ececad48eaa4 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f535b91b-3bff-46ad-905e-644bd012b9ff', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 11 23:13:25.941671 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-0fdfb306-5511-483c-9bee-ececad48eaa4 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Searching for a device in session 32 and hctl ('14', '0', '0', 0) yield: sdi {{(pid=98431) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 11 23:13:25.941671 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fdfb306-5511-483c-9bee-ececad48eaa4 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'f535b91b-3bff-46ad-905e-644bd012b9ff', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 11 23:13:26.099254 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Removed pending STOPPED event for 0d352738-c7bf-42a2-8260-bf5574a7200d due to new event Resumed> {{(pid=98431) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:519}} Jun 11 23:13:26.099415 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Emitting event Resumed> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:13:26.099590 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] VM Resumed (Lifecycle Event) Jun 11 23:13:26.102284 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-f2cbe4b9-a6dd-4fa2-852e-e726439312f0 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:13:26.162748 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: 67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f] Successfully updated port: 59f62261-8a42-4e76-9609-68343996250d {{(pid=98431) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 11 23:13:26.228447 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:26.283410 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] No BDM found with device name vda, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:13:26.283586 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] No BDM found with device name hda, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:13:26.283703 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] No VIF found with MAC fa:16:3e:2b:91:a7, not building metadata {{(pid=98431) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13199}} Jun 11 23:13:26.284529 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: dd1dd46c-2231-40b4-aa61-0121733a932d] Using config drive Jun 11 23:13:26.334731 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-fc764337-eb53-469f-9989-312c3c6908b7 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 2.014s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:26.337053 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 7.065s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:26.364148 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Calling os-brick to attach iSCSI Volume {{(pid=98431) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 11 23:13:26.364148 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13', 'iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'cf81e3db-e34d-4a99-b4f7-a47ab33a8f13', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 11 23:13:26.364148 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 11 23:13:26.418999 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-e93c71dd-0460-43fe-8de5-f27f01955ed8 req-cb5be349-494f-49d2-9dfc-faea2feb3831 service nova] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Received event network-vif-unplugged-3c37ff2c-78c4-4423-b4a2-219e94df57ca {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:13:26.420505 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-e93c71dd-0460-43fe-8de5-f27f01955ed8 req-cb5be349-494f-49d2-9dfc-faea2feb3831 service nova] Acquiring lock "0d352738-c7bf-42a2-8260-bf5574a7200d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:26.421055 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-e93c71dd-0460-43fe-8de5-f27f01955ed8 req-cb5be349-494f-49d2-9dfc-faea2feb3831 service nova] Lock "0d352738-c7bf-42a2-8260-bf5574a7200d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:26.421055 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-e93c71dd-0460-43fe-8de5-f27f01955ed8 req-cb5be349-494f-49d2-9dfc-faea2feb3831 service nova] Lock "0d352738-c7bf-42a2-8260-bf5574a7200d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:26.421354 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-e93c71dd-0460-43fe-8de5-f27f01955ed8 req-cb5be349-494f-49d2-9dfc-faea2feb3831 service nova] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] No waiting events found dispatching network-vif-unplugged-3c37ff2c-78c4-4423-b4a2-219e94df57ca {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:13:26.421471 np0000002687 nova-compute[98431]: WARNING nova.compute.manager [req-e93c71dd-0460-43fe-8de5-f27f01955ed8 req-cb5be349-494f-49d2-9dfc-faea2feb3831 service nova] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Received unexpected event network-vif-unplugged-3c37ff2c-78c4-4423-b4a2-219e94df57ca for instance with vm_state active and task_state None. Jun 11 23:13:26.421540 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-e93c71dd-0460-43fe-8de5-f27f01955ed8 req-cb5be349-494f-49d2-9dfc-faea2feb3831 service nova] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Received event network-vif-unplugged-3c37ff2c-78c4-4423-b4a2-219e94df57ca {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:13:26.421938 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-e93c71dd-0460-43fe-8de5-f27f01955ed8 req-cb5be349-494f-49d2-9dfc-faea2feb3831 service nova] Acquiring lock "0d352738-c7bf-42a2-8260-bf5574a7200d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:26.423024 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-e93c71dd-0460-43fe-8de5-f27f01955ed8 req-cb5be349-494f-49d2-9dfc-faea2feb3831 service nova] Lock "0d352738-c7bf-42a2-8260-bf5574a7200d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:26.423298 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-e93c71dd-0460-43fe-8de5-f27f01955ed8 req-cb5be349-494f-49d2-9dfc-faea2feb3831 service nova] Lock "0d352738-c7bf-42a2-8260-bf5574a7200d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:26.423460 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-e93c71dd-0460-43fe-8de5-f27f01955ed8 req-cb5be349-494f-49d2-9dfc-faea2feb3831 service nova] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] No waiting events found dispatching network-vif-unplugged-3c37ff2c-78c4-4423-b4a2-219e94df57ca {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:13:26.423639 np0000002687 nova-compute[98431]: WARNING nova.compute.manager [req-e93c71dd-0460-43fe-8de5-f27f01955ed8 req-cb5be349-494f-49d2-9dfc-faea2feb3831 service nova] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Received unexpected event network-vif-unplugged-3c37ff2c-78c4-4423-b4a2-219e94df57ca for instance with vm_state active and task_state None. Jun 11 23:13:26.423780 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-e93c71dd-0460-43fe-8de5-f27f01955ed8 req-cb5be349-494f-49d2-9dfc-faea2feb3831 service nova] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Received event network-vif-plugged-3c37ff2c-78c4-4423-b4a2-219e94df57ca {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:13:26.424111 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-e93c71dd-0460-43fe-8de5-f27f01955ed8 req-cb5be349-494f-49d2-9dfc-faea2feb3831 service nova] Acquiring lock "0d352738-c7bf-42a2-8260-bf5574a7200d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:26.424111 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-e93c71dd-0460-43fe-8de5-f27f01955ed8 req-cb5be349-494f-49d2-9dfc-faea2feb3831 service nova] Lock "0d352738-c7bf-42a2-8260-bf5574a7200d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:26.424111 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-e93c71dd-0460-43fe-8de5-f27f01955ed8 req-cb5be349-494f-49d2-9dfc-faea2feb3831 service nova] Lock "0d352738-c7bf-42a2-8260-bf5574a7200d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:26.424231 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-e93c71dd-0460-43fe-8de5-f27f01955ed8 req-cb5be349-494f-49d2-9dfc-faea2feb3831 service nova] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] No waiting events found dispatching network-vif-plugged-3c37ff2c-78c4-4423-b4a2-219e94df57ca {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:13:26.424282 np0000002687 nova-compute[98431]: WARNING nova.compute.manager [req-e93c71dd-0460-43fe-8de5-f27f01955ed8 req-cb5be349-494f-49d2-9dfc-faea2feb3831 service nova] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Received unexpected event network-vif-plugged-3c37ff2c-78c4-4423-b4a2-219e94df57ca for instance with vm_state active and task_state None. Jun 11 23:13:26.430362 np0000002687 nova-compute[98431]: INFO nova.scheduler.client.report [None req-fc764337-eb53-469f-9989-312c3c6908b7 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] Deleted allocations for instance 19beb2a4-b3fe-43e9-ac92-71446c2630ee Jun 11 23:13:26.521970 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-a5068389-1b6f-4b91-b2db-f42d84d5caf0 req-84c6ea44-eb3f-43a1-9467-b29aeb2d34b3 service nova] [instance: 67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f] Received event network-changed-59f62261-8a42-4e76-9609-68343996250d {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:13:26.522369 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-a5068389-1b6f-4b91-b2db-f42d84d5caf0 req-84c6ea44-eb3f-43a1-9467-b29aeb2d34b3 service nova] [instance: 67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f] Refreshing instance network info cache due to event network-changed-59f62261-8a42-4e76-9609-68343996250d. {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 11 23:13:26.522586 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-a5068389-1b6f-4b91-b2db-f42d84d5caf0 req-84c6ea44-eb3f-43a1-9467-b29aeb2d34b3 service nova] Acquiring lock "refresh_cache-67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 11 23:13:26.522687 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-a5068389-1b6f-4b91-b2db-f42d84d5caf0 req-84c6ea44-eb3f-43a1-9467-b29aeb2d34b3 service nova] Acquired lock "refresh_cache-67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 11 23:13:26.522916 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-a5068389-1b6f-4b91-b2db-f42d84d5caf0 req-84c6ea44-eb3f-43a1-9467-b29aeb2d34b3 service nova] [instance: 67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f] Refreshing network info cache for port 59f62261-8a42-4e76-9609-68343996250d {{(pid=98431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 11 23:13:26.602238 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:13:26.604349 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98431) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 11 23:13:26.665857 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Acquiring lock "refresh_cache-67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 11 23:13:26.791242 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:13:26.840440 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Lazy-loading 'migration_context' on Instance uuid 7609742e-a3a2-4be2-ba02-227efb2101e1 {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:13:26.862132 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: 67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f] Start spawning the instance on the hypervisor. {{(pid=98431) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 11 23:13:26.863191 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: 67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f] Creating instance directory {{(pid=98431) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}} Jun 11 23:13:26.863439 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: 67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f] Creating image(s) Jun 11 23:13:26.863917 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Acquiring lock "/opt/stack/data/nova/instances/67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:26.864095 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Lock "/opt/stack/data/nova/instances/67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:26.865070 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Lock "/opt/stack/data/nova/instances/67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:26.865786 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:13:26.870052 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:13:26.871235 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:13:26.907553 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fdfb306-5511-483c-9bee-ececad48eaa4 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98431) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 11 23:13:26.979837 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: dd1dd46c-2231-40b4-aa61-0121733a932d] Creating config drive at /opt/stack/data/nova/instances/dd1dd46c-2231-40b4-aa61-0121733a932d/disk.config Jun 11 23:13:26.984961 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json" returned: 0 in 0.113s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:13:26.985771 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Acquiring lock "d2c441059b2992961b5de03c05b32d04aff77cb1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:26.986602 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/dd1dd46c-2231-40b4-aa61-0121733a932d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpdlmaa2ek {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:13:26.987094 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Lock "d2c441059b2992961b5de03c05b32d04aff77cb1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:27.000849 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:13:27.015990 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:13:27.016761 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:13:27.035450 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [req-a5068389-1b6f-4b91-b2db-f42d84d5caf0 req-84c6ea44-eb3f-43a1-9467-b29aeb2d34b3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:13:27.049141 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/dd1dd46c-2231-40b4-aa61-0121733a932d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpdlmaa2ek" returned: 0 in 0.062s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:13:27.110409 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Emitting event Started> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:13:27.110610 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] VM Started (Lifecycle Event) Jun 11 23:13:27.114506 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json" returned: 0 in 0.098s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:13:27.116313 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1,backing_fmt=raw /opt/stack/data/nova/instances/67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f/disk 1073741824 {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:13:27.136825 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-a5068389-1b6f-4b91-b2db-f42d84d5caf0 req-84c6ea44-eb3f-43a1-9467-b29aeb2d34b3 service nova] [instance: 67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f] Instance cache missing network info. {{(pid=98431) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 11 23:13:27.174646 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1,backing_fmt=raw /opt/stack/data/nova/instances/67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f/disk 1073741824" returned: 0 in 0.059s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:13:27.175678 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Lock "d2c441059b2992961b5de03c05b32d04aff77cb1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.189s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:27.176654 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:13:27.260445 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-4ed7a9fd-47f6-4b91-be24-b696520bc0cd tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Acquiring lock "0d352738-c7bf-42a2-8260-bf5574a7200d" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:27.260755 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-4ed7a9fd-47f6-4b91-be24-b696520bc0cd tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lock "0d352738-c7bf-42a2-8260-bf5574a7200d" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:27.261069 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-4ed7a9fd-47f6-4b91-be24-b696520bc0cd tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Acquiring lock "0d352738-c7bf-42a2-8260-bf5574a7200d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:27.261290 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-4ed7a9fd-47f6-4b91-be24-b696520bc0cd tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lock "0d352738-c7bf-42a2-8260-bf5574a7200d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:27.261431 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-4ed7a9fd-47f6-4b91-be24-b696520bc0cd tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lock "0d352738-c7bf-42a2-8260-bf5574a7200d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:27.267593 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-4ed7a9fd-47f6-4b91-be24-b696520bc0cd tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Terminating instance Jun 11 23:13:27.269920 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json" returned: 0 in 0.093s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:13:27.269920 np0000002687 nova-compute[98431]: DEBUG nova.virt.disk.api [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Checking if we can resize image /opt/stack/data/nova/instances/67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f/disk. size=1073741824 {{(pid=98431) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 11 23:13:27.269920 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f/disk --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:13:27.346185 np0000002687 nova-compute[98431]: DEBUG nova.objects.base [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Object Instance<7609742e-a3a2-4be2-ba02-227efb2101e1> lazy-loaded attributes: resources,migration_context {{(pid=98431) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 11 23:13:27.372837 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f/disk --force-share --output=json" returned: 0 in 0.102s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:13:27.372837 np0000002687 nova-compute[98431]: DEBUG nova.virt.disk.api [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Cannot resize image /opt/stack/data/nova/instances/67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f/disk to a smaller size. {{(pid=98431) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 11 23:13:27.373177 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: 67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f] Created local disks {{(pid=98431) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}} Jun 11 23:13:27.373425 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: 67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f] Ensure instance console log exists: /opt/stack/data/nova/instances/67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f/console.log {{(pid=98431) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}} Jun 11 23:13:27.373713 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:27.375496 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:27.375496 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:27.393900 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-a5068389-1b6f-4b91-b2db-f42d84d5caf0 req-84c6ea44-eb3f-43a1-9467-b29aeb2d34b3 service nova] [instance: 67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f] Updating instance_info_cache with network_info: [] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:13:27.447115 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-fc764337-eb53-469f-9989-312c3c6908b7 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] Lock "19beb2a4-b3fe-43e9-ac92-71446c2630ee" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 14.309s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:27.568259 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:27.608657 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:27.633373 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:13:27.640259 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: deleting, current DB power_state: 1, VM power_state: 1 {{(pid=98431) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 11 23:13:27.732062 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:27.797520 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-4ed7a9fd-47f6-4b91-be24-b696520bc0cd tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Start destroying the instance on the hypervisor. {{(pid=98431) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}} Jun 11 23:13:27.825843 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:27.831404 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:27.855654 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:27.899186 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-a5068389-1b6f-4b91-b2db-f42d84d5caf0 req-84c6ea44-eb3f-43a1-9467-b29aeb2d34b3 service nova] Releasing lock "refresh_cache-67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 11 23:13:27.901055 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:27.903452 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Acquired lock "refresh_cache-67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 11 23:13:27.903452 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: 67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f] Building network info cache for instance {{(pid=98431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 11 23:13:27.928458 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fdfb306-5511-483c-9bee-ececad48eaa4 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Found WWN 33000000000dc7ddd for multipath device dm-7 {{(pid=98431) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 11 23:13:27.928990 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-0fdfb306-5511-483c-9bee-ececad48eaa4 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.078s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 11 23:13:27.929359 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fdfb306-5511-483c-9bee-ececad48eaa4 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] <== connect_volume: return (2768ms) {'type': 'block', 'scsi_wwn': '33000000000dc7ddd', 'path': '/dev/dm-7', 'multipath_id': '33000000000dc7ddd'} {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 11 23:13:27.929462 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0fdfb306-5511-483c-9bee-ececad48eaa4 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000000dc7ddd', 'path': '/dev/dm-7', 'multipath_id': '33000000000dc7ddd'} {{(pid=98431) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 11 23:13:27.931869 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.568s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 11 23:13:27.932245 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13', 'iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'cf81e3db-e34d-4a99-b4f7-a47ab33a8f13', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98431) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 11 23:13:27.933774 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-0fdfb306-5511-483c-9bee-ececad48eaa4 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lazy-loading 'flavor' on Instance uuid 8a45e04f-3516-4c39-bea1-820104411f17 {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:13:27.954132 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 11 23:13:27.954666 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 11 23:13:27.954936 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.iscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 11 23:13:27.958531 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 11 23:13:27.958531 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 11 23:13:27.958531 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.iscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 11 23:13:27.969956 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-a1bf5a51-9fae-46e1-9323-f92c5c1dbc85 req-ebd407b8-2d7b-438a-b728-53eb4053fe85 service nova] [instance: dd1dd46c-2231-40b4-aa61-0121733a932d] Received event network-vif-plugged-98c628a8-e152-4189-94f1-e166c406cf10 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:13:27.970472 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-a1bf5a51-9fae-46e1-9323-f92c5c1dbc85 req-ebd407b8-2d7b-438a-b728-53eb4053fe85 service nova] Acquiring lock "dd1dd46c-2231-40b4-aa61-0121733a932d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:27.971898 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-a1bf5a51-9fae-46e1-9323-f92c5c1dbc85 req-ebd407b8-2d7b-438a-b728-53eb4053fe85 service nova] Lock "dd1dd46c-2231-40b4-aa61-0121733a932d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:27.972816 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-a1bf5a51-9fae-46e1-9323-f92c5c1dbc85 req-ebd407b8-2d7b-438a-b728-53eb4053fe85 service nova] Lock "dd1dd46c-2231-40b4-aa61-0121733a932d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:27.972816 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-a1bf5a51-9fae-46e1-9323-f92c5c1dbc85 req-ebd407b8-2d7b-438a-b728-53eb4053fe85 service nova] [instance: dd1dd46c-2231-40b4-aa61-0121733a932d] Processing event network-vif-plugged-98c628a8-e152-4189-94f1-e166c406cf10 {{(pid=98431) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 11 23:13:27.973926 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 11 23:13:27.973926 np0000002687 nova-compute[98431]: {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:13:27.982369 np0000002687 nova-compute[98431]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0020567269998537085 future=) submitted to {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:13:27.982453 np0000002687 nova-compute[98431]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:13:27.982606 np0000002687 nova-compute[98431]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=1.0328869520001263 future=) {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:13:27.989072 np0000002687 nova-compute[98431]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=1.0327585560000898 future=) {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:13:27.993164 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Emitting event Stopped> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:13:27.994795 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] VM Stopped (Lifecycle Event) Jun 11 23:13:27.995201 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 11 23:13:27.995201 np0000002687 nova-compute[98431]: {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:13:28.003225 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13] added Jun 11 23:13:28.003225 np0000002687 nova-compute[98431]: stderr=iscsiadm: Config file line 363 does not have value Jun 11 23:13:28.003225 np0000002687 nova-compute[98431]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 11 23:13:28.003225 np0000002687 nova-compute[98431]: iscsiadm: Config file line 363 does not have value Jun 11 23:13:28.003225 np0000002687 nova-compute[98431]: iscsiadm: Config file line 363 does not have value Jun 11 23:13:28.003225 np0000002687 nova-compute[98431]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 11 23:13:28.003225 np0000002687 nova-compute[98431]: {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:13:28.003465 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98431) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 11 23:13:28.006161 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0487(s), this was the 1st time calling it. {{(pid=98431) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 11 23:13:28.006161 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98431) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 11 23:13:28.012371 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13] added Jun 11 23:13:28.012371 np0000002687 nova-compute[98431]: stderr=iscsiadm: Config file line 363 does not have value Jun 11 23:13:28.012371 np0000002687 nova-compute[98431]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 11 23:13:28.012371 np0000002687 nova-compute[98431]: iscsiadm: Config file line 363 does not have value Jun 11 23:13:28.012371 np0000002687 nova-compute[98431]: iscsiadm: Config file line 363 does not have value Jun 11 23:13:28.012371 np0000002687 nova-compute[98431]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 11 23:13:28.012371 np0000002687 nova-compute[98431]: {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:13:28.013063 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98431) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 11 23:13:28.013462 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.055(s), this was the 1st time calling it. {{(pid=98431) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 11 23:13:28.013781 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98431) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 11 23:13:28.040025 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:28.050713 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:28.057497 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:28.084305 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:28.092498 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:28.145855 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [-] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Instance destroyed successfully. Jun 11 23:13:28.147997 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-4ed7a9fd-47f6-4b91-be24-b696520bc0cd tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lazy-loading 'resources' on Instance uuid 0d352738-c7bf-42a2-8260-bf5574a7200d {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:13:28.150585 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] During sync_power_state the instance has a pending task (deleting). Skip. Jun 11 23:13:28.150585 np0000002687 nova-compute[98431]: DEBUG nova.utils [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Queued Task(fn=>, remaining_delay=14.99987884799998 future=) {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:13:28.324370 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98431) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 11 23:13:28.324370 np0000002687 nova-compute[98431]: DEBUG nova.compute.provider_tree [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Inventory has not changed in ProviderTree for provider: e3e65fe2-9de9-4821-8b4a-ccae37c66e25 {{(pid=98431) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 11 23:13:28.373254 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:28.379488 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:28.439882 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-0fdfb306-5511-483c-9bee-ececad48eaa4 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] Attempting to attach volume f535b91b-3bff-46ad-905e-644bd012b9ff with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98431) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}} Jun 11 23:13:28.444279 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.guest [None req-0fdfb306-5511-483c-9bee-ececad48eaa4 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] attach device xml: Jun 11 23:13:28.444279 np0000002687 nova-compute[98431]: Jun 11 23:13:28.444279 np0000002687 nova-compute[98431]: Jun 11 23:13:28.444279 np0000002687 nova-compute[98431]: Jun 11 23:13:28.444279 np0000002687 nova-compute[98431]: Jun 11 23:13:28.444279 np0000002687 nova-compute[98431]: f535b91b-3bff-46ad-905e-644bd012b9ff Jun 11 23:13:28.444279 np0000002687 nova-compute[98431]: Jun 11 23:13:28.444279 np0000002687 nova-compute[98431]: Jun 11 23:13:28.444279 np0000002687 nova-compute[98431]: {{(pid=98431) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} Jun 11 23:13:28.503987 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: cb63f66c-b69e-42b0-805c-be6fe9b3aee3] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:13:28.523273 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: 67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f] Instance cache missing network info. {{(pid=98431) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 11 23:13:28.536501 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-55ffa0e1-09c0-49a9-b9ec-dcef4b331ce6 req-ed0d68fe-5b9a-4c39-80df-f403f25a8add service nova] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Received event network-vif-plugged-3c37ff2c-78c4-4423-b4a2-219e94df57ca {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:13:28.536599 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-55ffa0e1-09c0-49a9-b9ec-dcef4b331ce6 req-ed0d68fe-5b9a-4c39-80df-f403f25a8add service nova] Acquiring lock "0d352738-c7bf-42a2-8260-bf5574a7200d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:28.544517 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-55ffa0e1-09c0-49a9-b9ec-dcef4b331ce6 req-ed0d68fe-5b9a-4c39-80df-f403f25a8add service nova] Lock "0d352738-c7bf-42a2-8260-bf5574a7200d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.008s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:28.544680 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-55ffa0e1-09c0-49a9-b9ec-dcef4b331ce6 req-ed0d68fe-5b9a-4c39-80df-f403f25a8add service nova] Lock "0d352738-c7bf-42a2-8260-bf5574a7200d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:28.544986 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-55ffa0e1-09c0-49a9-b9ec-dcef4b331ce6 req-ed0d68fe-5b9a-4c39-80df-f403f25a8add service nova] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] No waiting events found dispatching network-vif-plugged-3c37ff2c-78c4-4423-b4a2-219e94df57ca {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:13:28.545073 np0000002687 nova-compute[98431]: WARNING nova.compute.manager [req-55ffa0e1-09c0-49a9-b9ec-dcef4b331ce6 req-ed0d68fe-5b9a-4c39-80df-f403f25a8add service nova] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Received unexpected event network-vif-plugged-3c37ff2c-78c4-4423-b4a2-219e94df57ca for instance with vm_state active and task_state deleting. Jun 11 23:13:28.545160 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-55ffa0e1-09c0-49a9-b9ec-dcef4b331ce6 req-ed0d68fe-5b9a-4c39-80df-f403f25a8add service nova] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Received event network-vif-unplugged-3c37ff2c-78c4-4423-b4a2-219e94df57ca {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:13:28.545328 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-55ffa0e1-09c0-49a9-b9ec-dcef4b331ce6 req-ed0d68fe-5b9a-4c39-80df-f403f25a8add service nova] Acquiring lock "0d352738-c7bf-42a2-8260-bf5574a7200d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:28.545456 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-55ffa0e1-09c0-49a9-b9ec-dcef4b331ce6 req-ed0d68fe-5b9a-4c39-80df-f403f25a8add service nova] Lock "0d352738-c7bf-42a2-8260-bf5574a7200d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:28.545635 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-55ffa0e1-09c0-49a9-b9ec-dcef4b331ce6 req-ed0d68fe-5b9a-4c39-80df-f403f25a8add service nova] Lock "0d352738-c7bf-42a2-8260-bf5574a7200d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:28.545733 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-55ffa0e1-09c0-49a9-b9ec-dcef4b331ce6 req-ed0d68fe-5b9a-4c39-80df-f403f25a8add service nova] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] No waiting events found dispatching network-vif-unplugged-3c37ff2c-78c4-4423-b4a2-219e94df57ca {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:13:28.545774 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-55ffa0e1-09c0-49a9-b9ec-dcef4b331ce6 req-ed0d68fe-5b9a-4c39-80df-f403f25a8add service nova] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Received event network-vif-unplugged-3c37ff2c-78c4-4423-b4a2-219e94df57ca for instance with task_state deleting. {{(pid=98431) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 11 23:13:28.567677 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:28.650323 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-4ed7a9fd-47f6-4b91-be24-b696520bc0cd tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-11T23:12:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-916877464',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='tempest-serverbootfromvolumestablerescuetest-server-916877464',id=16,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-06-11T23:13:20Z,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='aaf744af828a4a5eba1e98da63373b2b',ramdisk_id='',reservation_id='r-nua6jkmc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-539499192',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-11T23:13:26Z,user_data=None,user_id='72b6dac5eb744cfba6299636227aa59b',uuid=0d352738-c7bf-42a2-8260-bf5574a7200d,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3c37ff2c-78c4-4423-b4a2-219e94df57ca", "address": "fa:16:3e:8f:ae:21", "network": {"id": "2a770c99-2ec6-4fa2-945b-32830a59e7a7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-137493671-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aaf744af828a4a5eba1e98da63373b2b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c37ff2c-78", "ovs_interfaceid": "3c37ff2c-78c4-4423-b4a2-219e94df57ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 11 23:13:28.650323 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-4ed7a9fd-47f6-4b91-be24-b696520bc0cd tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Converting VIF {"id": "3c37ff2c-78c4-4423-b4a2-219e94df57ca", "address": "fa:16:3e:8f:ae:21", "network": {"id": "2a770c99-2ec6-4fa2-945b-32830a59e7a7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-137493671-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aaf744af828a4a5eba1e98da63373b2b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c37ff2c-78", "ovs_interfaceid": "3c37ff2c-78c4-4423-b4a2-219e94df57ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:13:28.650975 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-4ed7a9fd-47f6-4b91-be24-b696520bc0cd tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8f:ae:21,bridge_name='br-int',has_traffic_filtering=True,id=3c37ff2c-78c4-4423-b4a2-219e94df57ca,network=Network(2a770c99-2ec6-4fa2-945b-32830a59e7a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c37ff2c-78') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:13:28.651337 np0000002687 nova-compute[98431]: DEBUG os_vif [None req-4ed7a9fd-47f6-4b91-be24-b696520bc0cd tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:ae:21,bridge_name='br-int',has_traffic_filtering=True,id=3c37ff2c-78c4-4423-b4a2-219e94df57ca,network=Network(2a770c99-2ec6-4fa2-945b-32830a59e7a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c37ff2c-78') {{(pid=98431) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 11 23:13:28.652972 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:28.653891 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3c37ff2c-78, bridge=br-int, if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:13:28.655120 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:28.656261 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:13:28.657628 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:28.658934 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:28.659156 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0b9ea769-332a-49aa-88b1-bba0c2f705f9) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:13:28.661306 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:28.663262 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:13:28.667417 np0000002687 nova-compute[98431]: INFO os_vif [None req-4ed7a9fd-47f6-4b91-be24-b696520bc0cd tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:ae:21,bridge_name='br-int',has_traffic_filtering=True,id=3c37ff2c-78c4-4423-b4a2-219e94df57ca,network=Network(2a770c99-2ec6-4fa2-945b-32830a59e7a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c37ff2c-78') Jun 11 23:13:28.669788 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ed7a9fd-47f6-4b91-be24-b696520bc0cd tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] calling os-brick to detach iSCSI Volume {{(pid=98431) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jun 11 23:13:28.670259 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ed7a9fd-47f6-4b91-be24-b696520bc0cd tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859', 'iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '484c7594-8b2e-4f2d-81d7-bdda56999859', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': True}}" {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 11 23:13:28.670529 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-4ed7a9fd-47f6-4b91-be24-b696520bc0cd tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 11 23:13:28.712133 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: dd1dd46c-2231-40b4-aa61-0121733a932d] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98431) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 11 23:13:28.718548 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: dd1dd46c-2231-40b4-aa61-0121733a932d] Guest created on hypervisor {{(pid=98431) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}} Jun 11 23:13:28.719252 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Emitting event Started> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:13:28.720683 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: dd1dd46c-2231-40b4-aa61-0121733a932d] VM Started (Lifecycle Event) Jun 11 23:13:28.732825 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [-] [instance: dd1dd46c-2231-40b4-aa61-0121733a932d] Instance spawned successfully. Jun 11 23:13:28.733265 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: dd1dd46c-2231-40b4-aa61-0121733a932d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 11 23:13:28.778503 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:13:28.827210 np0000002687 nova-compute[98431]: DEBUG nova.scheduler.client.report [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Inventory has not changed for provider e3e65fe2-9de9-4821-8b4a-ccae37c66e25 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98431) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 11 23:13:28.986581 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: 67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f] Updating instance_info_cache with network_info: [{"id": "59f62261-8a42-4e76-9609-68343996250d", "address": "fa:16:3e:c2:8d:a4", "network": {"id": "77fc4e10-1fed-4963-86b4-1fbb3a9c6f7f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1105404274-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b2b9f55b231c455ca1a4579d7ed54888", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap59f62261-8a", "ovs_interfaceid": "59f62261-8a42-4e76-9609-68343996250d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:13:29.004967 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.iscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 11 23:13:29.015607 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.iscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 11 23:13:29.016125 np0000002687 nova-compute[98431]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.000553799000044819 future=) submitted to {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:13:29.016125 np0000002687 nova-compute[98431]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:13:29.016952 np0000002687 nova-compute[98431]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=3.1916085029999977 future=) {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:13:29.016952 np0000002687 nova-compute[98431]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=3.1915284260001044 future=) {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:13:29.017273 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Emitting event Stopped> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:13:29.017443 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] [instance: 19beb2a4-b3fe-43e9-ac92-71446c2630ee] VM Stopped (Lifecycle Event) Jun 11 23:13:29.025886 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 11 23:13:29.025886 np0000002687 nova-compute[98431]: node.name = iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13 Jun 11 23:13:29.025886 np0000002687 nova-compute[98431]: node.tpgt = -1 Jun 11 23:13:29.025886 np0000002687 nova-compute[98431]: node.startup = manual Jun 11 23:13:29.025886 np0000002687 nova-compute[98431]: node.leading_login = No Jun 11 23:13:29.025886 np0000002687 nova-compute[98431]: iface.iscsi_ifacename = default Jun 11 23:13:29.025886 np0000002687 nova-compute[98431]: iface.net_ifacename = Jun 11 23:13:29.025886 np0000002687 nova-compute[98431]: iface.ipaddress = Jun 11 23:13:29.025886 np0000002687 nova-compute[98431]: iface.prefix_len = 0 Jun 11 23:13:29.025886 np0000002687 nova-compute[98431]: iface.hwaddress = Jun 11 23:13:29.025886 np0000002687 nova-compute[98431]: iface.transport_name = tcp Jun 11 23:13:29.025886 np0000002687 nova-compute[98431]: iface.initiatorname = Jun 11 23:13:29.025886 np0000002687 nova-compute[98431]: iface.state = Jun 11 23:13:29.025886 np0000002687 nova-compute[98431]: iface.vlan_id = 0 Jun 11 23:13:29.025886 np0000002687 nova-compute[98431]: iface.vlan_priority = 0 Jun 11 23:13:29.025886 np0000002687 nova-compute[98431]: iface.vlan_state = Jun 11 23:13:29.025886 np0000002687 nova-compute[98431]: iface.iface_num = 0 Jun 11 23:13:29.025886 np0000002687 nova-compute[98431]: iface.mtu = 0 Jun 11 23:13:29.025886 np0000002687 nova-compute[98431]: iface.port = 0 Jun 11 23:13:29.025886 np0000002687 nova-compute[98431]: iface.bootproto = Jun 11 23:13:29.025886 np0000002687 nova-compute[98431]: iface.subnet_mask = Jun 11 23:13:29.025886 np0000002687 nova-compute[98431]: iface.gateway = Jun 11 23:13:29.025886 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id_state = Jun 11 23:13:29.025886 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id = Jun 11 23:13:29.025886 np0000002687 nova-compute[98431]: iface.dhcp_dns = Jun 11 23:13:29.025886 np0000002687 nova-compute[98431]: iface.dhcp_learn_iqn = Jun 11 23:13:29.025886 np0000002687 nova-compute[98431]: iface.dhcp_req_vendor_id_state = Jun 11 23:13:29.025886 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id_state = Jun 11 23:13:29.025886 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id = Jun 11 23:13:29.025886 np0000002687 nova-compute[98431]: iface.dhcp_slp_da = Jun 11 23:13:29.025886 np0000002687 nova-compute[98431]: iface.fragmentation = Jun 11 23:13:29.025886 np0000002687 nova-compute[98431]: iface.gratuitous_arp = Jun 11 23:13:29.025886 np0000002687 nova-compute[98431]: iface.incoming_forwarding = Jun 11 23:13:29.025886 np0000002687 nova-compute[98431]: iface.tos_state = Jun 11 23:13:29.025886 np0000002687 nova-compute[98431]: iface.tos = 0 Jun 11 23:13:29.025886 np0000002687 nova-compute[98431]: iface.ttl = 0 Jun 11 23:13:29.025886 np0000002687 nova-compute[98431]: iface.delayed_ack = Jun 11 23:13:29.025886 np0000002687 nova-compute[98431]: iface.tcp_nagle = Jun 11 23:13:29.025886 np0000002687 nova-compute[98431]: iface.tcp_wsf_state = Jun 11 23:13:29.025886 np0000002687 nova-compute[98431]: iface.tcp_wsf = 0 Jun 11 23:13:29.025886 np0000002687 nova-compute[98431]: iface.tcp_timer_scale = 0 Jun 11 23:13:29.025886 np0000002687 nova-compute[98431]: iface.tcp_timestamp = Jun 11 23:13:29.025886 np0000002687 nova-compute[98431]: iface.redirect = Jun 11 23:13:29.025886 np0000002687 nova-compute[98431]: iface.def_task_mgmt_timeout = 0 Jun 11 23:13:29.025886 np0000002687 nova-compute[98431]: iface.header_digest = Jun 11 23:13:29.025886 np0000002687 nova-compute[98431]: iface.data_digest = Jun 11 23:13:29.025886 np0000002687 nova-compute[98431]: iface.immediate_data = Jun 11 23:13:29.025886 np0000002687 nova-compute[98431]: iface.initial_r2t = Jun 11 23:13:29.025886 np0000002687 nova-compute[98431]: iface.data_seq_inorder = Jun 11 23:13:29.025886 np0000002687 nova-compute[98431]: iface.data_pdu_inorder = Jun 11 23:13:29.025886 np0000002687 nova-compute[98431]: iface.erl = 0 Jun 11 23:13:29.025886 np0000002687 nova-compute[98431]: iface.max_receive_data_len = 0 Jun 11 23:13:29.025886 np0000002687 nova-compute[98431]: iface.first_burst_len = 0 Jun 11 23:13:29.025886 np0000002687 nova-compute[98431]: iface.max_outstanding_r2t = 0 Jun 11 23:13:29.025886 np0000002687 nova-compute[98431]: iface.max_burst_len = 0 Jun 11 23:13:29.025886 np0000002687 nova-compute[98431]: iface.chap_auth = Jun 11 23:13:29.025886 np0000002687 nova-compute[98431]: iface.bidi_chap = Jun 11 23:13:29.025886 np0000002687 nova-compute[98431]: iface.strict_login_compliance = Jun 11 23:13:29.025886 np0000002687 nova-compute[98431]: iface.discovery_auth = Jun 11 23:13:29.025886 np0000002687 nova-compute[98431]: iface.discovery_logout = Jun 11 23:13:29.025886 np0000002687 nova-compute[98431]: node.discovery_address = Jun 11 23:13:29.025886 np0000002687 nova-compute[98431]: node.discovery_port = 0 Jun 11 23:13:29.025886 np0000002687 nova-compute[98431]: node.discovery_type = fw Jun 11 23:13:29.025886 np0000002687 nova-compute[98431]: node.session.initial_cmdsn = 0 Jun 11 23:13:29.025886 np0000002687 nova-compute[98431]: node.session.initial_login_retry_max = 8 Jun 11 23:13:29.025886 np0000002687 nova-compute[98431]: node.session.xmit_thread_priority = 0 Jun 11 23:13:29.025886 np0000002687 nova-compute[98431]: node.session.cmds_max = 128 Jun 11 23:13:29.025886 np0000002687 nova-compute[98431]: node.session.queue_depth = 32 Jun 11 23:13:29.025886 np0000002687 nova-compute[98431]: node.session.nr_sessions = 1 Jun 11 23:13:29.025886 np0000002687 nova-compute[98431]: node.session.auth.authmethod = None Jun 11 23:13:29.025886 np0000002687 nova-compute[98431]: node.session.auth.username = Jun 11 23:13:29.025886 np0000002687 nova-compute[98431]: node.session.auth.password = *** Jun 11 23:13:29.025886 np0000002687 nova-compute[98431]: node.session.auth.username_in = Jun 11 23:13:29.025886 np0000002687 nova-compute[98431]: node.session.auth.password_in = Jun 11 23:13:29.025886 np0000002687 nova-compute[98431]: node.session.auth.chap_algs = SHA256 Jun 11 23:13:29.025886 np0000002687 nova-compute[98431]: node.session.timeo.replacement_timeout = 120 Jun 11 23:13:29.025886 np0000002687 nova-compute[98431]: node.session.err_timeo.abort_timeout = 15 Jun 11 23:13:29.025886 np0000002687 nova-compute[98431]: node.session.err_timeo.lu_reset_timeout = 30 Jun 11 23:13:29.025886 np0000002687 nova-compute[98431]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 11 23:13:29.025886 np0000002687 nova-compute[98431]: node.session.err_timeo.host_reset_timeout = 60 Jun 11 23:13:29.025886 np0000002687 nova-compute[98431]: node.session.iscsi.FastAbort = Yes Jun 11 23:13:29.025886 np0000002687 nova-compute[98431]: node.session.iscsi.InitialR2T = No Jun 11 23:13:29.025886 np0000002687 nova-compute[98431]: node.session.iscsi.ImmediateData = Yes Jun 11 23:13:29.025886 np0000002687 nova-compute[98431]: node.session.iscsi.FirstBurstLength = 262144 Jun 11 23:13:29.025886 np0000002687 nova-compute[98431]: node.session.iscsi.MaxBurstLength = 16776192 Jun 11 23:13:29.025886 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Retain = 0 Jun 11 23:13:29.025886 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Wait = 2 Jun 11 23:13:29.025886 np0000002687 nova-compute[98431]: node.session.iscsi.MaxConnections = 1 Jun 11 23:13:29.025886 np0000002687 nova-compute[98431]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 11 23:13:29.025886 np0000002687 nova-compute[98431]: node.session.iscsi.ERL = 0 Jun 11 23:13:29.025886 np0000002687 nova-compute[98431]: node.session.scan = auto Jun 11 23:13:29.025886 np0000002687 nova-compute[98431]: node.session.reopen_max = 0 Jun 11 23:13:29.025886 np0000002687 nova-compute[98431]: node.conn[0].address = 192.168.40.100 Jun 11 23:13:29.025886 np0000002687 nova-compute[98431]: node.conn[0].port = 3260 Jun 11 23:13:29.025886 np0000002687 nova-compute[98431]: node.conn[0].startup = manual Jun 11 23:13:29.025886 np0000002687 nova-compute[98431]: node.conn[0].tcp.window_size = 524288 Jun 11 23:13:29.025886 np0000002687 nova-compute[98431]: node.conn[0].tcp.type_of_service = 0 Jun 11 23:13:29.025886 np0000002687 nova-compute[98431]: node.conn[0].timeo.logout_timeout = 15 Jun 11 23:13:29.025886 np0000002687 nova-compute[98431]: node.conn[0].timeo.login_timeout = 15 Jun 11 23:13:29.025886 np0000002687 nova-compute[98431]: node.conn[0].timeo.auth_timeout = 45 Jun 11 23:13:29.025886 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_interval = 5 Jun 11 23:13:29.025886 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_timeout = 5 Jun 11 23:13:29.025886 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 11 23:13:29.025886 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 11 23:13:29.025886 np0000002687 nova-compute[98431]: node.conn[0].iscsi.HeaderDigest = None Jun 11 23:13:29.025886 np0000002687 nova-compute[98431]: node.conn[0].iscsi.DataDigest = None Jun 11 23:13:29.025886 np0000002687 nova-compute[98431]: node.conn[0].iscsi.IFMarker = No Jun 11 23:13:29.025886 np0000002687 nova-compute[98431]: node.conn[0].iscsi.OFMarker = No Jun 11 23:13:29.025886 np0000002687 nova-compute[98431]: # END RECORD Jun 11 23:13:29.025886 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:13:29.040068 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 11 23:13:29.040068 np0000002687 nova-compute[98431]: node.name = iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13 Jun 11 23:13:29.040068 np0000002687 nova-compute[98431]: node.tpgt = -1 Jun 11 23:13:29.040068 np0000002687 nova-compute[98431]: node.startup = manual Jun 11 23:13:29.040068 np0000002687 nova-compute[98431]: node.leading_login = No Jun 11 23:13:29.040068 np0000002687 nova-compute[98431]: iface.iscsi_ifacename = default Jun 11 23:13:29.040068 np0000002687 nova-compute[98431]: iface.net_ifacename = Jun 11 23:13:29.040068 np0000002687 nova-compute[98431]: iface.ipaddress = Jun 11 23:13:29.040068 np0000002687 nova-compute[98431]: iface.prefix_len = 0 Jun 11 23:13:29.040068 np0000002687 nova-compute[98431]: iface.hwaddress = Jun 11 23:13:29.040068 np0000002687 nova-compute[98431]: iface.transport_name = tcp Jun 11 23:13:29.040068 np0000002687 nova-compute[98431]: iface.initiatorname = Jun 11 23:13:29.040068 np0000002687 nova-compute[98431]: iface.state = Jun 11 23:13:29.040068 np0000002687 nova-compute[98431]: iface.vlan_id = 0 Jun 11 23:13:29.040068 np0000002687 nova-compute[98431]: iface.vlan_priority = 0 Jun 11 23:13:29.040068 np0000002687 nova-compute[98431]: iface.vlan_state = Jun 11 23:13:29.040068 np0000002687 nova-compute[98431]: iface.iface_num = 0 Jun 11 23:13:29.040068 np0000002687 nova-compute[98431]: iface.mtu = 0 Jun 11 23:13:29.040068 np0000002687 nova-compute[98431]: iface.port = 0 Jun 11 23:13:29.040068 np0000002687 nova-compute[98431]: iface.bootproto = Jun 11 23:13:29.040068 np0000002687 nova-compute[98431]: iface.subnet_mask = Jun 11 23:13:29.040068 np0000002687 nova-compute[98431]: iface.gateway = Jun 11 23:13:29.040068 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id_state = Jun 11 23:13:29.040068 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id = Jun 11 23:13:29.040068 np0000002687 nova-compute[98431]: iface.dhcp_dns = Jun 11 23:13:29.040068 np0000002687 nova-compute[98431]: iface.dhcp_learn_iqn = Jun 11 23:13:29.040068 np0000002687 nova-compute[98431]: iface.dhcp_req_vendor_id_state = Jun 11 23:13:29.040068 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id_state = Jun 11 23:13:29.040068 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id = Jun 11 23:13:29.040068 np0000002687 nova-compute[98431]: iface.dhcp_slp_da = Jun 11 23:13:29.040068 np0000002687 nova-compute[98431]: iface.fragmentation = Jun 11 23:13:29.040068 np0000002687 nova-compute[98431]: iface.gratuitous_arp = Jun 11 23:13:29.040068 np0000002687 nova-compute[98431]: iface.incoming_forwarding = Jun 11 23:13:29.040068 np0000002687 nova-compute[98431]: iface.tos_state = Jun 11 23:13:29.040068 np0000002687 nova-compute[98431]: iface.tos = 0 Jun 11 23:13:29.040068 np0000002687 nova-compute[98431]: iface.ttl = 0 Jun 11 23:13:29.040068 np0000002687 nova-compute[98431]: iface.delayed_ack = Jun 11 23:13:29.040068 np0000002687 nova-compute[98431]: iface.tcp_nagle = Jun 11 23:13:29.040068 np0000002687 nova-compute[98431]: iface.tcp_wsf_state = Jun 11 23:13:29.040068 np0000002687 nova-compute[98431]: iface.tcp_wsf = 0 Jun 11 23:13:29.040068 np0000002687 nova-compute[98431]: iface.tcp_timer_scale = 0 Jun 11 23:13:29.040068 np0000002687 nova-compute[98431]: iface.tcp_timestamp = Jun 11 23:13:29.040068 np0000002687 nova-compute[98431]: iface.redirect = Jun 11 23:13:29.040068 np0000002687 nova-compute[98431]: iface.def_task_mgmt_timeout = 0 Jun 11 23:13:29.040068 np0000002687 nova-compute[98431]: iface.header_digest = Jun 11 23:13:29.040068 np0000002687 nova-compute[98431]: iface.data_digest = Jun 11 23:13:29.040068 np0000002687 nova-compute[98431]: iface.immediate_data = Jun 11 23:13:29.040068 np0000002687 nova-compute[98431]: iface.initial_r2t = Jun 11 23:13:29.040068 np0000002687 nova-compute[98431]: iface.data_seq_inorder = Jun 11 23:13:29.040068 np0000002687 nova-compute[98431]: iface.data_pdu_inorder = Jun 11 23:13:29.040068 np0000002687 nova-compute[98431]: iface.erl = 0 Jun 11 23:13:29.040068 np0000002687 nova-compute[98431]: iface.max_receive_data_len = 0 Jun 11 23:13:29.040068 np0000002687 nova-compute[98431]: iface.first_burst_len = 0 Jun 11 23:13:29.040068 np0000002687 nova-compute[98431]: iface.max_outstanding_r2t = 0 Jun 11 23:13:29.040068 np0000002687 nova-compute[98431]: iface.max_burst_len = 0 Jun 11 23:13:29.040068 np0000002687 nova-compute[98431]: iface.chap_auth = Jun 11 23:13:29.040068 np0000002687 nova-compute[98431]: iface.bidi_chap = Jun 11 23:13:29.040068 np0000002687 nova-compute[98431]: iface.strict_login_compliance = Jun 11 23:13:29.040068 np0000002687 nova-compute[98431]: iface.discovery_auth = Jun 11 23:13:29.040068 np0000002687 nova-compute[98431]: iface.discovery_logout = Jun 11 23:13:29.040068 np0000002687 nova-compute[98431]: node.discovery_address = Jun 11 23:13:29.040068 np0000002687 nova-compute[98431]: node.discovery_port = 0 Jun 11 23:13:29.040068 np0000002687 nova-compute[98431]: node.discovery_type = fw Jun 11 23:13:29.040068 np0000002687 nova-compute[98431]: node.session.initial_cmdsn = 0 Jun 11 23:13:29.040068 np0000002687 nova-compute[98431]: node.session.initial_login_retry_max = 8 Jun 11 23:13:29.040068 np0000002687 nova-compute[98431]: node.session.xmit_thread_priority = 0 Jun 11 23:13:29.040068 np0000002687 nova-compute[98431]: node.session.cmds_max = 128 Jun 11 23:13:29.040068 np0000002687 nova-compute[98431]: node.session.queue_depth = 32 Jun 11 23:13:29.040068 np0000002687 nova-compute[98431]: node.session.nr_sessions = 1 Jun 11 23:13:29.040068 np0000002687 nova-compute[98431]: node.session.auth.authmethod = None Jun 11 23:13:29.040068 np0000002687 nova-compute[98431]: node.session.auth.username = Jun 11 23:13:29.040068 np0000002687 nova-compute[98431]: node.session.auth.password = *** Jun 11 23:13:29.040068 np0000002687 nova-compute[98431]: node.session.auth.username_in = Jun 11 23:13:29.040068 np0000002687 nova-compute[98431]: node.session.auth.password_in = Jun 11 23:13:29.040068 np0000002687 nova-compute[98431]: node.session.auth.chap_algs = SHA256 Jun 11 23:13:29.040068 np0000002687 nova-compute[98431]: node.session.timeo.replacement_timeout = 120 Jun 11 23:13:29.040068 np0000002687 nova-compute[98431]: node.session.err_timeo.abort_timeout = 15 Jun 11 23:13:29.040068 np0000002687 nova-compute[98431]: node.session.err_timeo.lu_reset_timeout = 30 Jun 11 23:13:29.040068 np0000002687 nova-compute[98431]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 11 23:13:29.040068 np0000002687 nova-compute[98431]: node.session.err_timeo.host_reset_timeout = 60 Jun 11 23:13:29.040068 np0000002687 nova-compute[98431]: node.session.iscsi.FastAbort = Yes Jun 11 23:13:29.040068 np0000002687 nova-compute[98431]: node.session.iscsi.InitialR2T = No Jun 11 23:13:29.040068 np0000002687 nova-compute[98431]: node.session.iscsi.ImmediateData = Yes Jun 11 23:13:29.040068 np0000002687 nova-compute[98431]: node.session.iscsi.FirstBurstLength = 262144 Jun 11 23:13:29.040068 np0000002687 nova-compute[98431]: node.session.iscsi.MaxBurstLength = 16776192 Jun 11 23:13:29.040068 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Retain = 0 Jun 11 23:13:29.040068 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Wait = 2 Jun 11 23:13:29.040068 np0000002687 nova-compute[98431]: node.session.iscsi.MaxConnections = 1 Jun 11 23:13:29.040068 np0000002687 nova-compute[98431]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 11 23:13:29.040068 np0000002687 nova-compute[98431]: node.session.iscsi.ERL = 0 Jun 11 23:13:29.040068 np0000002687 nova-compute[98431]: node.session.scan = auto Jun 11 23:13:29.040068 np0000002687 nova-compute[98431]: node.session.reopen_max = 0 Jun 11 23:13:29.040068 np0000002687 nova-compute[98431]: node.conn[0].address = 192.168.50.100 Jun 11 23:13:29.040068 np0000002687 nova-compute[98431]: node.conn[0].port = 3260 Jun 11 23:13:29.040068 np0000002687 nova-compute[98431]: node.conn[0].startup = manual Jun 11 23:13:29.040068 np0000002687 nova-compute[98431]: node.conn[0].tcp.window_size = 524288 Jun 11 23:13:29.040068 np0000002687 nova-compute[98431]: node.conn[0].tcp.type_of_service = 0 Jun 11 23:13:29.040068 np0000002687 nova-compute[98431]: node.conn[0].timeo.logout_timeout = 15 Jun 11 23:13:29.040068 np0000002687 nova-compute[98431]: node.conn[0].timeo.login_timeout = 15 Jun 11 23:13:29.040068 np0000002687 nova-compute[98431]: node.conn[0].timeo.auth_timeout = 45 Jun 11 23:13:29.040068 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_interval = 5 Jun 11 23:13:29.040068 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_timeout = 5 Jun 11 23:13:29.040068 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 11 23:13:29.040068 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 11 23:13:29.040068 np0000002687 nova-compute[98431]: node.conn[0].iscsi.HeaderDigest = None Jun 11 23:13:29.040068 np0000002687 nova-compute[98431]: node.conn[0].iscsi.DataDigest = None Jun 11 23:13:29.040068 np0000002687 nova-compute[98431]: node.conn[0].iscsi.IFMarker = No Jun 11 23:13:29.040068 np0000002687 nova-compute[98431]: node.conn[0].iscsi.OFMarker = No Jun 11 23:13:29.040068 np0000002687 nova-compute[98431]: # END RECORD Jun 11 23:13:29.040068 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:13:29.050883 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:13:29.059164 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:13:29.073113 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:29.073113 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:29.073113 np0000002687 nova-compute[98431]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:13:29.073113 np0000002687 nova-compute[98431]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:13:29.073113 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:29.073113 np0000002687 nova-compute[98431]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:13:29.073113 np0000002687 nova-compute[98431]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:13:29.073113 np0000002687 nova-compute[98431]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:13:29.073113 np0000002687 nova-compute[98431]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:13:29.073113 np0000002687 nova-compute[98431]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8 (non-flash) Jun 11 23:13:29.073113 np0000002687 nova-compute[98431]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8 (non-flash) Jun 11 23:13:29.073113 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:29.073113 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:13:29.073700 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] iscsi session list stdout=tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:29.073700 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:29.073700 np0000002687 nova-compute[98431]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:13:29.073700 np0000002687 nova-compute[98431]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:13:29.073700 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:29.073700 np0000002687 nova-compute[98431]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:13:29.073700 np0000002687 nova-compute[98431]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:13:29.073700 np0000002687 nova-compute[98431]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:13:29.073700 np0000002687 nova-compute[98431]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:13:29.073700 np0000002687 nova-compute[98431]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8 (non-flash) Jun 11 23:13:29.073700 np0000002687 nova-compute[98431]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8 (non-flash) Jun 11 23:13:29.073700 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:29.073700 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:13:29.090150 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:29.090150 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:29.090150 np0000002687 nova-compute[98431]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:13:29.090150 np0000002687 nova-compute[98431]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:13:29.090150 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:29.090150 np0000002687 nova-compute[98431]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:13:29.090150 np0000002687 nova-compute[98431]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:13:29.090150 np0000002687 nova-compute[98431]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:13:29.090150 np0000002687 nova-compute[98431]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:13:29.090150 np0000002687 nova-compute[98431]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8 (non-flash) Jun 11 23:13:29.090150 np0000002687 nova-compute[98431]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8 (non-flash) Jun 11 23:13:29.090150 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:29.090150 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:13:29.090598 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] iscsi session list stdout=tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:29.090598 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:29.090598 np0000002687 nova-compute[98431]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:13:29.090598 np0000002687 nova-compute[98431]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:13:29.090598 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:29.090598 np0000002687 nova-compute[98431]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:13:29.090598 np0000002687 nova-compute[98431]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:13:29.090598 np0000002687 nova-compute[98431]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:13:29.090598 np0000002687 nova-compute[98431]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:13:29.090598 np0000002687 nova-compute[98431]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8 (non-flash) Jun 11 23:13:29.090598 np0000002687 nova-compute[98431]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8 (non-flash) Jun 11 23:13:29.090598 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:29.090598 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:13:29.165504 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13, portal: 192.168.50.100,3260] Jun 11 23:13:29.165504 np0000002687 nova-compute[98431]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13, portal: 192.168.50.100,3260] successful. Jun 11 23:13:29.165504 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:13:29.166084 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13, portal: 192.168.40.100,3260] Jun 11 23:13:29.166084 np0000002687 nova-compute[98431]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13, portal: 192.168.40.100,3260] successful. Jun 11 23:13:29.166084 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:13:29.179189 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:13:29.186010 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:13:29.202372 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:29.202372 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:29.202372 np0000002687 nova-compute[98431]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:13:29.202372 np0000002687 nova-compute[98431]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:13:29.202372 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:29.202372 np0000002687 nova-compute[98431]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:13:29.202372 np0000002687 nova-compute[98431]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:13:29.202372 np0000002687 nova-compute[98431]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:13:29.202372 np0000002687 nova-compute[98431]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:13:29.202372 np0000002687 nova-compute[98431]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8 (non-flash) Jun 11 23:13:29.202372 np0000002687 nova-compute[98431]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8 (non-flash) Jun 11 23:13:29.202372 np0000002687 nova-compute[98431]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13 (non-flash) Jun 11 23:13:29.202372 np0000002687 nova-compute[98431]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13 (non-flash) Jun 11 23:13:29.202372 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:29.202372 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:13:29.202867 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] iscsi session list stdout=tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:29.202867 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:29.202867 np0000002687 nova-compute[98431]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:13:29.202867 np0000002687 nova-compute[98431]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:13:29.202867 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:29.202867 np0000002687 nova-compute[98431]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:13:29.202867 np0000002687 nova-compute[98431]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:13:29.202867 np0000002687 nova-compute[98431]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:13:29.202867 np0000002687 nova-compute[98431]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:13:29.202867 np0000002687 nova-compute[98431]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8 (non-flash) Jun 11 23:13:29.202867 np0000002687 nova-compute[98431]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8 (non-flash) Jun 11 23:13:29.202867 np0000002687 nova-compute[98431]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13 (non-flash) Jun 11 23:13:29.202867 np0000002687 nova-compute[98431]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13 (non-flash) Jun 11 23:13:29.202867 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:29.202867 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:13:29.202867 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.245s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 11 23:13:29.203424 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Connected to 192.168.50.100:3260 {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 11 23:13:29.204788 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] HCTL ('20', '-', '-', 0) found on session 38 with lun 0 {{(pid=98431) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 11 23:13:29.204930 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Scanning host 20 c: -, t: -, l: 0) {{(pid=98431) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 11 23:13:29.214021 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:29.214021 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:29.214021 np0000002687 nova-compute[98431]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:13:29.214021 np0000002687 nova-compute[98431]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:13:29.214021 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:29.214021 np0000002687 nova-compute[98431]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:13:29.214021 np0000002687 nova-compute[98431]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:13:29.214021 np0000002687 nova-compute[98431]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:13:29.214021 np0000002687 nova-compute[98431]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:13:29.214021 np0000002687 nova-compute[98431]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8 (non-flash) Jun 11 23:13:29.214021 np0000002687 nova-compute[98431]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8 (non-flash) Jun 11 23:13:29.214021 np0000002687 nova-compute[98431]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13 (non-flash) Jun 11 23:13:29.214021 np0000002687 nova-compute[98431]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13 (non-flash) Jun 11 23:13:29.214021 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:29.214021 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:13:29.214021 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] iscsi session list stdout=tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:29.214021 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:29.214021 np0000002687 nova-compute[98431]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:13:29.214021 np0000002687 nova-compute[98431]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:13:29.214021 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:29.214021 np0000002687 nova-compute[98431]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:13:29.214021 np0000002687 nova-compute[98431]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:13:29.214021 np0000002687 nova-compute[98431]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:13:29.214021 np0000002687 nova-compute[98431]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:13:29.214021 np0000002687 nova-compute[98431]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8 (non-flash) Jun 11 23:13:29.214021 np0000002687 nova-compute[98431]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8 (non-flash) Jun 11 23:13:29.214021 np0000002687 nova-compute[98431]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13 (non-flash) Jun 11 23:13:29.214021 np0000002687 nova-compute[98431]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13 (non-flash) Jun 11 23:13:29.214021 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:29.214021 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:13:29.214021 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.259s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 11 23:13:29.214021 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Connected to 192.168.40.100:3260 {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 11 23:13:29.215153 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] HCTL ('19', '-', '-', 0) found on session 37 with lun 0 {{(pid=98431) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 11 23:13:29.215316 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Scanning host 19 c: -, t: -, l: 0) {{(pid=98431) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 11 23:13:29.227733 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: dd1dd46c-2231-40b4-aa61-0121733a932d] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:13:29.229609 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Searching for a device in session 38 and hctl ['20', '*', '*', 0] yield: sdn {{(pid=98431) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 11 23:13:29.229774 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Connected to sdn using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'cf81e3db-e34d-4a99-b4f7-a47ab33a8f13', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 11 23:13:29.235920 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: dd1dd46c-2231-40b4-aa61-0121733a932d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98431) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 11 23:13:29.245037 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Searching for a device in session 37 and hctl ['19', '*', '*', 0] yield: sdo {{(pid=98431) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 11 23:13:29.245037 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Connected to sdo using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'cf81e3db-e34d-4a99-b4f7-a47ab33a8f13', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 11 23:13:29.249999 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: dd1dd46c-2231-40b4-aa61-0121733a932d] Found default for hw_cdrom_bus of ide {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:13:29.249999 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: dd1dd46c-2231-40b4-aa61-0121733a932d] Found default for hw_disk_bus of virtio {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:13:29.250230 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: dd1dd46c-2231-40b4-aa61-0121733a932d] Found default for hw_input_bus of None {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:13:29.250599 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: dd1dd46c-2231-40b4-aa61-0121733a932d] Found default for hw_pointer_model of None {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:13:29.251733 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: dd1dd46c-2231-40b4-aa61-0121733a932d] Found default for hw_video_model of virtio {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:13:29.251733 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: dd1dd46c-2231-40b4-aa61-0121733a932d] Found default for hw_vif_model of virtio {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:13:29.490487 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Releasing lock "refresh_cache-67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 11 23:13:29.491056 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: 67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f] Instance network_info: |[{"id": "59f62261-8a42-4e76-9609-68343996250d", "address": "fa:16:3e:c2:8d:a4", "network": {"id": "77fc4e10-1fed-4963-86b4-1fbb3a9c6f7f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1105404274-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b2b9f55b231c455ca1a4579d7ed54888", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap59f62261-8a", "ovs_interfaceid": "59f62261-8a42-4e76-9609-68343996250d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98431) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 11 23:13:29.494069 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: 67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f] Start _get_guest_xml network_info=[{"id": "59f62261-8a42-4e76-9609-68343996250d", "address": "fa:16:3e:c2:8d:a4", "network": {"id": "77fc4e10-1fed-4963-86b4-1fbb3a9c6f7f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1105404274-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b2b9f55b231c455ca1a4579d7ed54888", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap59f62261-8a", "ovs_interfaceid": "59f62261-8a42-4e76-9609-68343996250d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-11T23:08:20Z,direct_url=,disk_format='qcow2',id=f30640f8-7aca-4300-a085-4706a5209a79,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ce012f9fabdb4ee5a73e212437f59d97',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-11T23:08:23Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'image_id': 'f30640f8-7aca-4300-a085-4706a5209a79'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98431) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 11 23:13:29.497595 np0000002687 nova-compute[98431]: WARNING nova.virt.libvirt.driver [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 11 23:13:29.499003 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='f30640f8-7aca-4300-a085-4706a5209a79', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-1084057464', uuid='67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f'), owner=OwnerMeta(userid='eaecdd9c05b5485b9422171463cccf92', username='tempest-ServerRescueNegativeTestJSON-2027875711-project-member', projectid='b2b9f55b231c455ca1a4579d7ed54888', projectname='tempest-ServerRescueNegativeTestJSON-2027875711'), image=ImageMeta(id='f30640f8-7aca-4300-a085-4706a5209a79', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "59f62261-8a42-4e76-9609-68343996250d", "address": "fa:16:3e:c2:8d:a4", "network": {"id": "77fc4e10-1fed-4963-86b4-1fbb3a9c6f7f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1105404274-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b2b9f55b231c455ca1a4579d7ed54888", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap59f62261-8a", "ovs_interfaceid": "59f62261-8a42-4e76-9609-68343996250d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1781219609.498542) {{(pid=98431) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 11 23:13:29.500327 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Searching host: 'np0000002687' for CPU controller through CGroups V1... {{(pid=98431) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 11 23:13:29.501394 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] CPU controller missing on host. {{(pid=98431) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 11 23:13:29.501944 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Searching host: 'np0000002687' for CPU controller through CGroups V2... {{(pid=98431) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 11 23:13:29.502172 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] CPU controller found on host. {{(pid=98431) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 11 23:13:29.503243 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98431) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 11 23:13:29.504319 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-11T23:08:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-11T23:08:20Z,direct_url=,disk_format='qcow2',id=f30640f8-7aca-4300-a085-4706a5209a79,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ce012f9fabdb4ee5a73e212437f59d97',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-11T23:08:23Z,virtual_size=,visibility=), allow threads: True {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 11 23:13:29.504594 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Flavor limits 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 11 23:13:29.506144 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Image limits 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 11 23:13:29.506144 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Flavor pref 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 11 23:13:29.506144 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Image pref 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 11 23:13:29.506144 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 11 23:13:29.506144 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 11 23:13:29.506144 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98431) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 11 23:13:29.506144 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Got 1 possible topologies {{(pid=98431) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 11 23:13:29.506144 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 11 23:13:29.506144 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 11 23:13:29.527168 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] [instance: 19beb2a4-b3fe-43e9-ac92-71446c2630ee] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:13:29.529831 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-11T23:13:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1084057464',display_name='tempest-ServerRescueNegativeTestJSON-server-1084057464',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='tempest-serverrescuenegativetestjson-server-1084057464',id=21,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b2b9f55b231c455ca1a4579d7ed54888',ramdisk_id='',reservation_id='r-gp5qd3p1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2027875711',owner_user_name='tempest-ServerRescueNegativeTestJSON-2027875711-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-11T23:13:26Z,user_data=None,user_id='eaecdd9c05b5485b9422171463cccf92',uuid=67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "59f62261-8a42-4e76-9609-68343996250d", "address": "fa:16:3e:c2:8d:a4", "network": {"id": "77fc4e10-1fed-4963-86b4-1fbb3a9c6f7f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1105404274-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b2b9f55b231c455ca1a4579d7ed54888", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap59f62261-8a", "ovs_interfaceid": "59f62261-8a42-4e76-9609-68343996250d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98431) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 11 23:13:29.530132 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Converting VIF {"id": "59f62261-8a42-4e76-9609-68343996250d", "address": "fa:16:3e:c2:8d:a4", "network": {"id": "77fc4e10-1fed-4963-86b4-1fbb3a9c6f7f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1105404274-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b2b9f55b231c455ca1a4579d7ed54888", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap59f62261-8a", "ovs_interfaceid": "59f62261-8a42-4e76-9609-68343996250d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:13:29.531334 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:8d:a4,bridge_name='br-int',has_traffic_filtering=True,id=59f62261-8a42-4e76-9609-68343996250d,network=Network(77fc4e10-1fed-4963-86b4-1fbb3a9c6f7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59f62261-8a') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:13:29.531845 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Lazy-loading 'pci_devices' on Instance uuid 67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:13:29.741280 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: dd1dd46c-2231-40b4-aa61-0121733a932d] During sync_power_state the instance has a pending task (spawning). Skip. Jun 11 23:13:29.741608 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Emitting event Paused> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:13:29.741765 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: dd1dd46c-2231-40b4-aa61-0121733a932d] VM Paused (Lifecycle Event) Jun 11 23:13:29.760899 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: dd1dd46c-2231-40b4-aa61-0121733a932d] Took 8.05 seconds to spawn the instance on the hypervisor. Jun 11 23:13:29.761094 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: dd1dd46c-2231-40b4-aa61-0121733a932d] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:13:29.850268 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 3.515s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:29.851315 np0000002687 nova-compute[98431]: DEBUG nova.compute.rpcapi [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98431) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}} Jun 11 23:13:29.960927 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98431) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 11 23:13:30.041295 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: 67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f] End _get_guest_xml xml= Jun 11 23:13:30.041295 np0000002687 nova-compute[98431]: 67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f Jun 11 23:13:30.041295 np0000002687 nova-compute[98431]: instance-00000015 Jun 11 23:13:30.041295 np0000002687 nova-compute[98431]: 196608 Jun 11 23:13:30.041295 np0000002687 nova-compute[98431]: 1 Jun 11 23:13:30.041295 np0000002687 nova-compute[98431]: Jun 11 23:13:30.041295 np0000002687 nova-compute[98431]: Jun 11 23:13:30.041295 np0000002687 nova-compute[98431]: Jun 11 23:13:30.041295 np0000002687 nova-compute[98431]: tempest-ServerRescueNegativeTestJSON-server-1084057464 Jun 11 23:13:30.041295 np0000002687 nova-compute[98431]: 2026-06-11 23:13:29 Jun 11 23:13:30.041295 np0000002687 nova-compute[98431]: Jun 11 23:13:30.041295 np0000002687 nova-compute[98431]: 192 Jun 11 23:13:30.041295 np0000002687 nova-compute[98431]: 1 Jun 11 23:13:30.041295 np0000002687 nova-compute[98431]: 0 Jun 11 23:13:30.041295 np0000002687 nova-compute[98431]: 0 Jun 11 23:13:30.041295 np0000002687 nova-compute[98431]: 1 Jun 11 23:13:30.041295 np0000002687 nova-compute[98431]: Jun 11 23:13:30.041295 np0000002687 nova-compute[98431]: True Jun 11 23:13:30.041295 np0000002687 nova-compute[98431]: Jun 11 23:13:30.041295 np0000002687 nova-compute[98431]: Jun 11 23:13:30.041295 np0000002687 nova-compute[98431]: Jun 11 23:13:30.041295 np0000002687 nova-compute[98431]: bare Jun 11 23:13:30.041295 np0000002687 nova-compute[98431]: qcow2 Jun 11 23:13:30.041295 np0000002687 nova-compute[98431]: 1 Jun 11 23:13:30.041295 np0000002687 nova-compute[98431]: 0 Jun 11 23:13:30.041295 np0000002687 nova-compute[98431]: Jun 11 23:13:30.041295 np0000002687 nova-compute[98431]: virtio Jun 11 23:13:30.041295 np0000002687 nova-compute[98431]: Jun 11 23:13:30.041295 np0000002687 nova-compute[98431]: Jun 11 23:13:30.041295 np0000002687 nova-compute[98431]: Jun 11 23:13:30.041295 np0000002687 nova-compute[98431]: tempest-ServerRescueNegativeTestJSON-2027875711-project-member Jun 11 23:13:30.041295 np0000002687 nova-compute[98431]: tempest-ServerRescueNegativeTestJSON-2027875711 Jun 11 23:13:30.041295 np0000002687 nova-compute[98431]: Jun 11 23:13:30.041295 np0000002687 nova-compute[98431]: Jun 11 23:13:30.041295 np0000002687 nova-compute[98431]: Jun 11 23:13:30.041295 np0000002687 nova-compute[98431]: Jun 11 23:13:30.041295 np0000002687 nova-compute[98431]: Jun 11 23:13:30.041295 np0000002687 nova-compute[98431]: Jun 11 23:13:30.041295 np0000002687 nova-compute[98431]: Jun 11 23:13:30.041295 np0000002687 nova-compute[98431]: Jun 11 23:13:30.041295 np0000002687 nova-compute[98431]: Jun 11 23:13:30.041295 np0000002687 nova-compute[98431]: Jun 11 23:13:30.041295 np0000002687 nova-compute[98431]: Jun 11 23:13:30.041295 np0000002687 nova-compute[98431]: OpenStack Foundation Jun 11 23:13:30.041295 np0000002687 nova-compute[98431]: OpenStack Nova Jun 11 23:13:30.041295 np0000002687 nova-compute[98431]: 33.1.0 Jun 11 23:13:30.041295 np0000002687 nova-compute[98431]: 67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f Jun 11 23:13:30.041295 np0000002687 nova-compute[98431]: 67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f Jun 11 23:13:30.041295 np0000002687 nova-compute[98431]: Virtual Machine Jun 11 23:13:30.041295 np0000002687 nova-compute[98431]: Jun 11 23:13:30.041295 np0000002687 nova-compute[98431]: Jun 11 23:13:30.041295 np0000002687 nova-compute[98431]: Jun 11 23:13:30.041295 np0000002687 nova-compute[98431]: hvm Jun 11 23:13:30.041295 np0000002687 nova-compute[98431]: Jun 11 23:13:30.041295 np0000002687 nova-compute[98431]: Jun 11 23:13:30.041295 np0000002687 nova-compute[98431]: Jun 11 23:13:30.041295 np0000002687 nova-compute[98431]: Jun 11 23:13:30.041295 np0000002687 nova-compute[98431]: Jun 11 23:13:30.041295 np0000002687 nova-compute[98431]: Jun 11 23:13:30.041295 np0000002687 nova-compute[98431]: 128 Jun 11 23:13:30.041295 np0000002687 nova-compute[98431]: Jun 11 23:13:30.041295 np0000002687 nova-compute[98431]: Jun 11 23:13:30.041295 np0000002687 nova-compute[98431]: Jun 11 23:13:30.041295 np0000002687 nova-compute[98431]: 1 Jun 11 23:13:30.041295 np0000002687 nova-compute[98431]: Jun 11 23:13:30.041295 np0000002687 nova-compute[98431]: Jun 11 23:13:30.041295 np0000002687 nova-compute[98431]: Nehalem Jun 11 23:13:30.041295 np0000002687 nova-compute[98431]: Jun 11 23:13:30.041295 np0000002687 nova-compute[98431]: Jun 11 23:13:30.041295 np0000002687 nova-compute[98431]: Jun 11 23:13:30.041295 np0000002687 nova-compute[98431]: Jun 11 23:13:30.041295 np0000002687 nova-compute[98431]: Jun 11 23:13:30.041295 np0000002687 nova-compute[98431]: Jun 11 23:13:30.041295 np0000002687 nova-compute[98431]: Jun 11 23:13:30.041295 np0000002687 nova-compute[98431]: Jun 11 23:13:30.041295 np0000002687 nova-compute[98431]: Jun 11 23:13:30.041295 np0000002687 nova-compute[98431]: Jun 11 23:13:30.041295 np0000002687 nova-compute[98431]: Jun 11 23:13:30.041295 np0000002687 nova-compute[98431]: Jun 11 23:13:30.041295 np0000002687 nova-compute[98431]: Jun 11 23:13:30.041295 np0000002687 nova-compute[98431]: Jun 11 23:13:30.041295 np0000002687 nova-compute[98431]: Jun 11 23:13:30.041295 np0000002687 nova-compute[98431]: Jun 11 23:13:30.041295 np0000002687 nova-compute[98431]: Jun 11 23:13:30.041295 np0000002687 nova-compute[98431]: Jun 11 23:13:30.041295 np0000002687 nova-compute[98431]: Jun 11 23:13:30.041295 np0000002687 nova-compute[98431]: Jun 11 23:13:30.041295 np0000002687 nova-compute[98431]: Jun 11 23:13:30.041295 np0000002687 nova-compute[98431]: Jun 11 23:13:30.041295 np0000002687 nova-compute[98431]: Jun 11 23:13:30.041295 np0000002687 nova-compute[98431]: Jun 11 23:13:30.041295 np0000002687 nova-compute[98431]: Jun 11 23:13:30.041295 np0000002687 nova-compute[98431]: Jun 11 23:13:30.041295 np0000002687 nova-compute[98431]: /dev/urandom Jun 11 23:13:30.041295 np0000002687 nova-compute[98431]: Jun 11 23:13:30.041295 np0000002687 nova-compute[98431]: Jun 11 23:13:30.041295 np0000002687 nova-compute[98431]: Jun 11 23:13:30.041295 np0000002687 nova-compute[98431]: Jun 11 23:13:30.041295 np0000002687 nova-compute[98431]: Jun 11 23:13:30.041295 np0000002687 nova-compute[98431]: Jun 11 23:13:30.041295 np0000002687 nova-compute[98431]: Jun 11 23:13:30.041295 np0000002687 nova-compute[98431]: {{(pid=98431) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 11 23:13:30.041295 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: 67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f] Preparing to wait for external event network-vif-plugged-59f62261-8a42-4e76-9609-68343996250d {{(pid=98431) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 11 23:13:30.041295 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Acquiring lock "67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:30.041295 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Lock "67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:30.041295 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Lock "67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:30.047728 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-11T23:13:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1084057464',display_name='tempest-ServerRescueNegativeTestJSON-server-1084057464',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='tempest-serverrescuenegativetestjson-server-1084057464',id=21,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b2b9f55b231c455ca1a4579d7ed54888',ramdisk_id='',reservation_id='r-gp5qd3p1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2027875711',owner_user_name='tempest-ServerRescueNegativeTestJSON-2027875711-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-11T23:13:26Z,user_data=None,user_id='eaecdd9c05b5485b9422171463cccf92',uuid=67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "59f62261-8a42-4e76-9609-68343996250d", "address": "fa:16:3e:c2:8d:a4", "network": {"id": "77fc4e10-1fed-4963-86b4-1fbb3a9c6f7f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1105404274-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b2b9f55b231c455ca1a4579d7ed54888", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap59f62261-8a", "ovs_interfaceid": "59f62261-8a42-4e76-9609-68343996250d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 11 23:13:30.047728 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Converting VIF {"id": "59f62261-8a42-4e76-9609-68343996250d", "address": "fa:16:3e:c2:8d:a4", "network": {"id": "77fc4e10-1fed-4963-86b4-1fbb3a9c6f7f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1105404274-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b2b9f55b231c455ca1a4579d7ed54888", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap59f62261-8a", "ovs_interfaceid": "59f62261-8a42-4e76-9609-68343996250d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:13:30.047728 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:8d:a4,bridge_name='br-int',has_traffic_filtering=True,id=59f62261-8a42-4e76-9609-68343996250d,network=Network(77fc4e10-1fed-4963-86b4-1fbb3a9c6f7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59f62261-8a') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:13:30.047728 np0000002687 nova-compute[98431]: DEBUG os_vif [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:8d:a4,bridge_name='br-int',has_traffic_filtering=True,id=59f62261-8a42-4e76-9609-68343996250d,network=Network(77fc4e10-1fed-4963-86b4-1fbb3a9c6f7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59f62261-8a') {{(pid=98431) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 11 23:13:30.048124 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:30.048312 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:13:30.048514 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 11 23:13:30.049598 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:30.049838 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '40bad675-acd4-5320-9572-d2c0889718ba', '_type': 'linux-noop'}}, row=False) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:13:30.051227 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:30.052108 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:13:30.052108 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:30.055086 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:30.056283 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap59f62261-8a, may_exist=True, interface_attrs={}) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:13:30.056283 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap59f62261-8a, col_values=(('qos', UUID('511ea5e2-76c4-48ed-a497-0d4580888494')),), if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:13:30.056283 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap59f62261-8a, col_values=(('external_ids', {'iface-id': '59f62261-8a42-4e76-9609-68343996250d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c2:8d:a4', 'vm-uuid': '67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f'}),), if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:13:30.057429 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:30.059558 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:13:30.066075 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-64f8f183-665c-461c-bf71-f628cb073635 req-bd8e9c02-7fd9-4f1d-ac23-04157df63591 service nova] [instance: dd1dd46c-2231-40b4-aa61-0121733a932d] Received event network-vif-plugged-98c628a8-e152-4189-94f1-e166c406cf10 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:13:30.066250 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-64f8f183-665c-461c-bf71-f628cb073635 req-bd8e9c02-7fd9-4f1d-ac23-04157df63591 service nova] Acquiring lock "dd1dd46c-2231-40b4-aa61-0121733a932d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:30.066443 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-64f8f183-665c-461c-bf71-f628cb073635 req-bd8e9c02-7fd9-4f1d-ac23-04157df63591 service nova] Lock "dd1dd46c-2231-40b4-aa61-0121733a932d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:30.067410 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-64f8f183-665c-461c-bf71-f628cb073635 req-bd8e9c02-7fd9-4f1d-ac23-04157df63591 service nova] Lock "dd1dd46c-2231-40b4-aa61-0121733a932d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:30.067410 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-64f8f183-665c-461c-bf71-f628cb073635 req-bd8e9c02-7fd9-4f1d-ac23-04157df63591 service nova] [instance: dd1dd46c-2231-40b4-aa61-0121733a932d] No waiting events found dispatching network-vif-plugged-98c628a8-e152-4189-94f1-e166c406cf10 {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:13:30.067410 np0000002687 nova-compute[98431]: WARNING nova.compute.manager [req-64f8f183-665c-461c-bf71-f628cb073635 req-bd8e9c02-7fd9-4f1d-ac23-04157df63591 service nova] [instance: dd1dd46c-2231-40b4-aa61-0121733a932d] Received unexpected event network-vif-plugged-98c628a8-e152-4189-94f1-e166c406cf10 for instance with vm_state active and task_state None. Jun 11 23:13:30.067695 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:30.069287 np0000002687 nova-compute[98431]: INFO os_vif [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:8d:a4,bridge_name='br-int',has_traffic_filtering=True,id=59f62261-8a42-4e76-9609-68343996250d,network=Network(77fc4e10-1fed-4963-86b4-1fbb3a9c6f7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59f62261-8a') Jun 11 23:13:30.155124 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-0fdfb306-5511-483c-9bee-ececad48eaa4 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] No BDM found with device name vda, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:13:30.155329 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-0fdfb306-5511-483c-9bee-ececad48eaa4 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:13:30.155682 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-0fdfb306-5511-483c-9bee-ececad48eaa4 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] No BDM found with device name hda, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:13:30.155845 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-0fdfb306-5511-483c-9bee-ececad48eaa4 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] No VIF found with MAC fa:16:3e:6f:42:42, not building metadata {{(pid=98431) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13199}} Jun 11 23:13:30.244538 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: dd1dd46c-2231-40b4-aa61-0121733a932d] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:13:30.247608 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Emitting event Resumed> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:13:30.247930 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: dd1dd46c-2231-40b4-aa61-0121733a932d] VM Resumed (Lifecycle Event) Jun 11 23:13:30.276157 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: dd1dd46c-2231-40b4-aa61-0121733a932d] Took 14.76 seconds to build instance. Jun 11 23:13:30.366443 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:30.630020 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-fae3311d-60ad-436e-9324-fd41cefddd8f req-ce58c2a5-b4e2-444d-afef-121f8103d50c service nova] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Received event network-vif-unplugged-3c37ff2c-78c4-4423-b4a2-219e94df57ca {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:13:30.630579 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-fae3311d-60ad-436e-9324-fd41cefddd8f req-ce58c2a5-b4e2-444d-afef-121f8103d50c service nova] Acquiring lock "0d352738-c7bf-42a2-8260-bf5574a7200d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:30.630579 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-fae3311d-60ad-436e-9324-fd41cefddd8f req-ce58c2a5-b4e2-444d-afef-121f8103d50c service nova] Lock "0d352738-c7bf-42a2-8260-bf5574a7200d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:30.630579 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-fae3311d-60ad-436e-9324-fd41cefddd8f req-ce58c2a5-b4e2-444d-afef-121f8103d50c service nova] Lock "0d352738-c7bf-42a2-8260-bf5574a7200d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:30.630739 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-fae3311d-60ad-436e-9324-fd41cefddd8f req-ce58c2a5-b4e2-444d-afef-121f8103d50c service nova] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] No waiting events found dispatching network-vif-unplugged-3c37ff2c-78c4-4423-b4a2-219e94df57ca {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:13:30.630819 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-fae3311d-60ad-436e-9324-fd41cefddd8f req-ce58c2a5-b4e2-444d-afef-121f8103d50c service nova] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Received event network-vif-unplugged-3c37ff2c-78c4-4423-b4a2-219e94df57ca for instance with task_state deleting. {{(pid=98431) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 11 23:13:30.752545 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: dd1dd46c-2231-40b4-aa61-0121733a932d] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:13:30.756475 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: dd1dd46c-2231-40b4-aa61-0121733a932d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98431) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 11 23:13:30.784757 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Lock "dd1dd46c-2231-40b4-aa61-0121733a932d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 16.280s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:30.976370 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Found WWN 330000000531b62bf for multipath device dm-12 {{(pid=98431) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 11 23:13:30.976728 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.045s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 11 23:13:30.976879 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] <== connect_volume: return (4613ms) {'type': 'block', 'scsi_wwn': '330000000531b62bf', 'path': '/dev/dm-12', 'multipath_id': '330000000531b62bf'} {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 11 23:13:30.976999 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000531b62bf', 'path': '/dev/dm-12', 'multipath_id': '330000000531b62bf'} {{(pid=98431) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 11 23:13:30.978879 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-4ed7a9fd-47f6-4b91-be24-b696520bc0cd tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.307s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 11 23:13:30.978879 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ed7a9fd-47f6-4b91-be24-b696520bc0cd tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859', 'iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '484c7594-8b2e-4f2d-81d7-bdda56999859', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 11 23:13:30.979177 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ed7a9fd-47f6-4b91-be24-b696520bc0cd tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859', 0)] {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 11 23:13:31.019674 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ed7a9fd-47f6-4b91-be24-b696520bc0cd tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:31.019674 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:31.019674 np0000002687 nova-compute[98431]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:13:31.019674 np0000002687 nova-compute[98431]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:13:31.019674 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:31.019674 np0000002687 nova-compute[98431]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:13:31.019674 np0000002687 nova-compute[98431]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:13:31.019674 np0000002687 nova-compute[98431]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:13:31.019674 np0000002687 nova-compute[98431]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:13:31.019674 np0000002687 nova-compute[98431]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8 (non-flash) Jun 11 23:13:31.019674 np0000002687 nova-compute[98431]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8 (non-flash) Jun 11 23:13:31.019674 np0000002687 nova-compute[98431]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13 (non-flash) Jun 11 23:13:31.019674 np0000002687 nova-compute[98431]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13 (non-flash) Jun 11 23:13:31.019674 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:31.019674 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:13:31.019674 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ed7a9fd-47f6-4b91-be24-b696520bc0cd tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] iscsi session list stdout=tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:31.019674 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:31.019674 np0000002687 nova-compute[98431]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:13:31.019674 np0000002687 nova-compute[98431]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859 (non-flash) Jun 11 23:13:31.019674 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:31.019674 np0000002687 nova-compute[98431]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:13:31.019674 np0000002687 nova-compute[98431]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:13:31.019674 np0000002687 nova-compute[98431]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:13:31.019674 np0000002687 nova-compute[98431]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:13:31.019674 np0000002687 nova-compute[98431]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8 (non-flash) Jun 11 23:13:31.019674 np0000002687 nova-compute[98431]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8 (non-flash) Jun 11 23:13:31.019674 np0000002687 nova-compute[98431]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13 (non-flash) Jun 11 23:13:31.019674 np0000002687 nova-compute[98431]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13 (non-flash) Jun 11 23:13:31.019674 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:31.019674 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:13:31.019674 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ed7a9fd-47f6-4b91-be24-b696520bc0cd tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea', '13'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea', '14'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859', '27'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859', '28'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9', '3'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff', '31'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff', '32'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc', '33'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc', '34'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8', '35'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8', '36'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13', '37'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13', '38'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9', '4')] {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 11 23:13:31.019674 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ed7a9fd-47f6-4b91-be24-b696520bc0cd tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859', '28')] {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 11 23:13:31.019674 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ed7a9fd-47f6-4b91-be24-b696520bc0cd tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859', '27')] {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 11 23:13:31.021865 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ed7a9fd-47f6-4b91-be24-b696520bc0cd tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Resulting device map defaultdict(. at 0x7e1ea01a9ee0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859'): ({'sdf'}, set())}) {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 11 23:13:31.021865 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-4ed7a9fd-47f6-4b91-be24-b696520bc0cd tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Removing multipathed devices sdf, sdg {{(pid=98431) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 11 23:13:31.021865 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-4ed7a9fd-47f6-4b91-be24-b696520bc0cd tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Flush multipath device 330000000c1986051 {{(pid=98431) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jun 11 23:13:31.088727 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-4ed7a9fd-47f6-4b91-be24-b696520bc0cd tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98431) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 11 23:13:31.151491 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-4ed7a9fd-47f6-4b91-be24-b696520bc0cd tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98431) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 11 23:13:31.194109 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-4ed7a9fd-47f6-4b91-be24-b696520bc0cd tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98431) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 11 23:13:31.195479 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-4ed7a9fd-47f6-4b91-be24-b696520bc0cd tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98431) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 11 23:13:31.198154 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-4ed7a9fd-47f6-4b91-be24-b696520bc0cd tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98431) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 11 23:13:31.213835 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-4ed7a9fd-47f6-4b91-be24-b696520bc0cd tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98431) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 11 23:13:31.213835 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ed7a9fd-47f6-4b91-be24-b696520bc0cd tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859')] {{(pid=98431) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 11 23:13:31.225223 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ed7a9fd-47f6-4b91-be24-b696520bc0cd tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:13:31.280875 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ed7a9fd-47f6-4b91-be24-b696520bc0cd tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859, portal: 192.168.40.100,3260] Jun 11 23:13:31.280875 np0000002687 nova-compute[98431]: Logout of [sid: 28, target: iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859, portal: 192.168.40.100,3260] successful. Jun 11 23:13:31.280875 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:13:31.312563 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ed7a9fd-47f6-4b91-be24-b696520bc0cd tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:13:31.332206 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ed7a9fd-47f6-4b91-be24-b696520bc0cd tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:13:31.381872 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ed7a9fd-47f6-4b91-be24-b696520bc0cd tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859, portal: 192.168.50.100,3260] Jun 11 23:13:31.381872 np0000002687 nova-compute[98431]: Logout of [sid: 27, target: iqn.2023-03.storpool.com:os--volume-484c7594-8b2e-4f2d-81d7-bdda56999859, portal: 192.168.50.100,3260] successful. Jun 11 23:13:31.381872 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:13:31.413907 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ed7a9fd-47f6-4b91-be24-b696520bc0cd tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:13:31.414037 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-4ed7a9fd-47f6-4b91-be24-b696520bc0cd tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.436s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 11 23:13:31.414887 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ed7a9fd-47f6-4b91-be24-b696520bc0cd tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] <== disconnect_volume: return (2743ms) None {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 11 23:13:31.414887 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ed7a9fd-47f6-4b91-be24-b696520bc0cd tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Disconnected iSCSI Volume {{(pid=98431) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jun 11 23:13:31.415605 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-4ed7a9fd-47f6-4b91-be24-b696520bc0cd tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Deleting instance files /opt/stack/data/nova/instances/0d352738-c7bf-42a2-8260-bf5574a7200d_del Jun 11 23:13:31.416476 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-4ed7a9fd-47f6-4b91-be24-b696520bc0cd tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Deletion of /opt/stack/data/nova/instances/0d352738-c7bf-42a2-8260-bf5574a7200d_del complete Jun 11 23:13:31.454596 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Swapping old allocation on dict_keys(['e3e65fe2-9de9-4821-8b4a-ccae37c66e25']) held by migration 859c9e92-9a57-4932-9703-f13835841422 for instance Jun 11 23:13:31.486973 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-11T23:12:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1366771090',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='tempest-device-tagging-server-1366771090',id=19,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC5UXUrCEEA/0gxvD1NavMz6RwD8U++JuZnAB48UjQLmwHKU2knd70tRMd/ODZENnwRMpvr28/C2g9VTy2gQO0/t/l3FqY9lxY/3+5+G6z+bb25kWd7QXQRH7lbyZDsb8w==',key_name='tempest-keypair-965487513',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6c1e407a42f24b34baf3ee44be9fb337',ramdisk_id='',reservation_id='r-dqc2uc2r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-37151554',owner_user_name='tempest-TaggedBootDevicesTest_v242-37151554-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-11T23:12:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3dd7997e0762451ca159ee06bf3d9c44',uuid=1d45c7ce-5760-4f59-9921-feb3e589da8a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5f9094e3-a3c6-48ea-bfbe-4fa25d19bcf2", "address": "fa:16:3e:b1:9e:6a", "network": {"id": "1cea4f00-aa2e-4d9d-8255-2e7ba484f3ec", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1566230580-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c1e407a42f24b34baf3ee44be9fb337", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f9094e3-a3", "ovs_interfaceid": "5f9094e3-a3c6-48ea-bfbe-4fa25d19bcf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98431) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 11 23:13:31.487411 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Converting VIF {"id": "5f9094e3-a3c6-48ea-bfbe-4fa25d19bcf2", "address": "fa:16:3e:b1:9e:6a", "network": {"id": "1cea4f00-aa2e-4d9d-8255-2e7ba484f3ec", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1566230580-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c1e407a42f24b34baf3ee44be9fb337", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f9094e3-a3", "ovs_interfaceid": "5f9094e3-a3c6-48ea-bfbe-4fa25d19bcf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:13:31.490586 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:9e:6a,bridge_name='br-int',has_traffic_filtering=True,id=5f9094e3-a3c6-48ea-bfbe-4fa25d19bcf2,network=Network(1cea4f00-aa2e-4d9d-8255-2e7ba484f3ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f9094e3-a3') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:13:31.493446 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-11T23:12:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1366771090',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='tempest-device-tagging-server-1366771090',id=19,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC5UXUrCEEA/0gxvD1NavMz6RwD8U++JuZnAB48UjQLmwHKU2knd70tRMd/ODZENnwRMpvr28/C2g9VTy2gQO0/t/l3FqY9lxY/3+5+G6z+bb25kWd7QXQRH7lbyZDsb8w==',key_name='tempest-keypair-965487513',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6c1e407a42f24b34baf3ee44be9fb337',ramdisk_id='',reservation_id='r-dqc2uc2r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-37151554',owner_user_name='tempest-TaggedBootDevicesTest_v242-37151554-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-11T23:12:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3dd7997e0762451ca159ee06bf3d9c44',uuid=1d45c7ce-5760-4f59-9921-feb3e589da8a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe1430ca-d60b-47c4-9ac9-96ba7d61f101", "address": "fa:16:3e:ca:17:0a", "network": {"id": "d84f8615-2bee-4c03-b721-d597e25acb42", "bridge": "br-int", "label": "tempest-device-tagging-net1-1869260730", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c1e407a42f24b34baf3ee44be9fb337", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe1430ca-d6", "ovs_interfaceid": "fe1430ca-d60b-47c4-9ac9-96ba7d61f101", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98431) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 11 23:13:31.493708 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Converting VIF {"id": "fe1430ca-d60b-47c4-9ac9-96ba7d61f101", "address": "fa:16:3e:ca:17:0a", "network": {"id": "d84f8615-2bee-4c03-b721-d597e25acb42", "bridge": "br-int", "label": "tempest-device-tagging-net1-1869260730", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c1e407a42f24b34baf3ee44be9fb337", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe1430ca-d6", "ovs_interfaceid": "fe1430ca-d60b-47c4-9ac9-96ba7d61f101", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:13:31.496205 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:17:0a,bridge_name='br-int',has_traffic_filtering=True,id=fe1430ca-d60b-47c4-9ac9-96ba7d61f101,network=Network(d84f8615-2bee-4c03-b721-d597e25acb42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfe1430ca-d6') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:13:31.498717 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-11T23:12:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1366771090',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='tempest-device-tagging-server-1366771090',id=19,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC5UXUrCEEA/0gxvD1NavMz6RwD8U++JuZnAB48UjQLmwHKU2knd70tRMd/ODZENnwRMpvr28/C2g9VTy2gQO0/t/l3FqY9lxY/3+5+G6z+bb25kWd7QXQRH7lbyZDsb8w==',key_name='tempest-keypair-965487513',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6c1e407a42f24b34baf3ee44be9fb337',ramdisk_id='',reservation_id='r-dqc2uc2r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-37151554',owner_user_name='tempest-TaggedBootDevicesTest_v242-37151554-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-11T23:12:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3dd7997e0762451ca159ee06bf3d9c44',uuid=1d45c7ce-5760-4f59-9921-feb3e589da8a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a39a55c7-874a-4a19-a069-8383a5f0bc5a", "address": "fa:16:3e:37:35:68", "network": {"id": "d84f8615-2bee-4c03-b721-d597e25acb42", "bridge": "br-int", "label": "tempest-device-tagging-net1-1869260730", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c1e407a42f24b34baf3ee44be9fb337", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa39a55c7-87", "ovs_interfaceid": "a39a55c7-874a-4a19-a069-8383a5f0bc5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98431) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 11 23:13:31.498717 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Converting VIF {"id": "a39a55c7-874a-4a19-a069-8383a5f0bc5a", "address": "fa:16:3e:37:35:68", "network": {"id": "d84f8615-2bee-4c03-b721-d597e25acb42", "bridge": "br-int", "label": "tempest-device-tagging-net1-1869260730", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c1e407a42f24b34baf3ee44be9fb337", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa39a55c7-87", "ovs_interfaceid": "a39a55c7-874a-4a19-a069-8383a5f0bc5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:13:31.498717 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:35:68,bridge_name='br-int',has_traffic_filtering=True,id=a39a55c7-874a-4a19-a069-8383a5f0bc5a,network=Network(d84f8615-2bee-4c03-b721-d597e25acb42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa39a55c7-87') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:13:31.499488 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-11T23:12:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1366771090',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='tempest-device-tagging-server-1366771090',id=19,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC5UXUrCEEA/0gxvD1NavMz6RwD8U++JuZnAB48UjQLmwHKU2knd70tRMd/ODZENnwRMpvr28/C2g9VTy2gQO0/t/l3FqY9lxY/3+5+G6z+bb25kWd7QXQRH7lbyZDsb8w==',key_name='tempest-keypair-965487513',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6c1e407a42f24b34baf3ee44be9fb337',ramdisk_id='',reservation_id='r-dqc2uc2r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-37151554',owner_user_name='tempest-TaggedBootDevicesTest_v242-37151554-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-11T23:12:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3dd7997e0762451ca159ee06bf3d9c44',uuid=1d45c7ce-5760-4f59-9921-feb3e589da8a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "37aa7cee-88a0-4428-9b2d-45700f1dcab6", "address": "fa:16:3e:12:f4:f7", "network": {"id": "d84f8615-2bee-4c03-b721-d597e25acb42", "bridge": "br-int", "label": "tempest-device-tagging-net1-1869260730", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c1e407a42f24b34baf3ee44be9fb337", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap37aa7cee-88", "ovs_interfaceid": "37aa7cee-88a0-4428-9b2d-45700f1dcab6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98431) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 11 23:13:31.499710 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Converting VIF {"id": "37aa7cee-88a0-4428-9b2d-45700f1dcab6", "address": "fa:16:3e:12:f4:f7", "network": {"id": "d84f8615-2bee-4c03-b721-d597e25acb42", "bridge": "br-int", "label": "tempest-device-tagging-net1-1869260730", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c1e407a42f24b34baf3ee44be9fb337", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap37aa7cee-88", "ovs_interfaceid": "37aa7cee-88a0-4428-9b2d-45700f1dcab6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:13:31.500555 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:f4:f7,bridge_name='br-int',has_traffic_filtering=True,id=37aa7cee-88a0-4428-9b2d-45700f1dcab6,network=Network(d84f8615-2bee-4c03-b721-d597e25acb42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37aa7cee-88') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:13:31.501568 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-11T23:12:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1366771090',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='tempest-device-tagging-server-1366771090',id=19,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC5UXUrCEEA/0gxvD1NavMz6RwD8U++JuZnAB48UjQLmwHKU2knd70tRMd/ODZENnwRMpvr28/C2g9VTy2gQO0/t/l3FqY9lxY/3+5+G6z+bb25kWd7QXQRH7lbyZDsb8w==',key_name='tempest-keypair-965487513',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6c1e407a42f24b34baf3ee44be9fb337',ramdisk_id='',reservation_id='r-dqc2uc2r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-37151554',owner_user_name='tempest-TaggedBootDevicesTest_v242-37151554-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-11T23:12:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3dd7997e0762451ca159ee06bf3d9c44',uuid=1d45c7ce-5760-4f59-9921-feb3e589da8a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e3269961-a3f1-42c8-a49e-37f728b2f3d8", "address": "fa:16:3e:7e:14:0b", "network": {"id": "d84f8615-2bee-4c03-b721-d597e25acb42", "bridge": "br-int", "label": "tempest-device-tagging-net1-1869260730", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c1e407a42f24b34baf3ee44be9fb337", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape3269961-a3", "ovs_interfaceid": "e3269961-a3f1-42c8-a49e-37f728b2f3d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98431) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 11 23:13:31.501847 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Converting VIF {"id": "e3269961-a3f1-42c8-a49e-37f728b2f3d8", "address": "fa:16:3e:7e:14:0b", "network": {"id": "d84f8615-2bee-4c03-b721-d597e25acb42", "bridge": "br-int", "label": "tempest-device-tagging-net1-1869260730", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c1e407a42f24b34baf3ee44be9fb337", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape3269961-a3", "ovs_interfaceid": "e3269961-a3f1-42c8-a49e-37f728b2f3d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:13:31.502664 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:14:0b,bridge_name='br-int',has_traffic_filtering=True,id=e3269961-a3f1-42c8-a49e-37f728b2f3d8,network=Network(d84f8615-2bee-4c03-b721-d597e25acb42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3269961-a3') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:13:31.504088 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-11T23:12:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1366771090',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='tempest-device-tagging-server-1366771090',id=19,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC5UXUrCEEA/0gxvD1NavMz6RwD8U++JuZnAB48UjQLmwHKU2knd70tRMd/ODZENnwRMpvr28/C2g9VTy2gQO0/t/l3FqY9lxY/3+5+G6z+bb25kWd7QXQRH7lbyZDsb8w==',key_name='tempest-keypair-965487513',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6c1e407a42f24b34baf3ee44be9fb337',ramdisk_id='',reservation_id='r-dqc2uc2r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-37151554',owner_user_name='tempest-TaggedBootDevicesTest_v242-37151554-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-11T23:12:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3dd7997e0762451ca159ee06bf3d9c44',uuid=1d45c7ce-5760-4f59-9921-feb3e589da8a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "351eaad5-bf70-43b4-8f79-5bc0027de663", "address": "fa:16:3e:ee:d2:51", "network": {"id": "b0d7ffe8-2fba-456a-8969-949ee402ce5b", "bridge": "br-int", "label": "tempest-device-tagging-net2-84998986", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c1e407a42f24b34baf3ee44be9fb337", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap351eaad5-bf", "ovs_interfaceid": "351eaad5-bf70-43b4-8f79-5bc0027de663", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98431) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 11 23:13:31.506514 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Converting VIF {"id": "351eaad5-bf70-43b4-8f79-5bc0027de663", "address": "fa:16:3e:ee:d2:51", "network": {"id": "b0d7ffe8-2fba-456a-8969-949ee402ce5b", "bridge": "br-int", "label": "tempest-device-tagging-net2-84998986", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c1e407a42f24b34baf3ee44be9fb337", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap351eaad5-bf", "ovs_interfaceid": "351eaad5-bf70-43b4-8f79-5bc0027de663", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:13:31.512716 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:d2:51,bridge_name='br-int',has_traffic_filtering=True,id=351eaad5-bf70-43b4-8f79-5bc0027de663,network=Network(b0d7ffe8-2fba-456a-8969-949ee402ce5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap351eaad5-bf') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:13:31.513332 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-11T23:12:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1366771090',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='tempest-device-tagging-server-1366771090',id=19,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC5UXUrCEEA/0gxvD1NavMz6RwD8U++JuZnAB48UjQLmwHKU2knd70tRMd/ODZENnwRMpvr28/C2g9VTy2gQO0/t/l3FqY9lxY/3+5+G6z+bb25kWd7QXQRH7lbyZDsb8w==',key_name='tempest-keypair-965487513',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6c1e407a42f24b34baf3ee44be9fb337',ramdisk_id='',reservation_id='r-dqc2uc2r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-37151554',owner_user_name='tempest-TaggedBootDevicesTest_v242-37151554-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-11T23:12:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3dd7997e0762451ca159ee06bf3d9c44',uuid=1d45c7ce-5760-4f59-9921-feb3e589da8a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "004fd6c0-58df-4ceb-9733-267396cae60c", "address": "fa:16:3e:5d:12:c5", "network": {"id": "b0d7ffe8-2fba-456a-8969-949ee402ce5b", "bridge": "br-int", "label": "tempest-device-tagging-net2-84998986", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c1e407a42f24b34baf3ee44be9fb337", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap004fd6c0-58", "ovs_interfaceid": "004fd6c0-58df-4ceb-9733-267396cae60c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98431) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 11 23:13:31.513536 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Converting VIF {"id": "004fd6c0-58df-4ceb-9733-267396cae60c", "address": "fa:16:3e:5d:12:c5", "network": {"id": "b0d7ffe8-2fba-456a-8969-949ee402ce5b", "bridge": "br-int", "label": "tempest-device-tagging-net2-84998986", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c1e407a42f24b34baf3ee44be9fb337", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap004fd6c0-58", "ovs_interfaceid": "004fd6c0-58df-4ceb-9733-267396cae60c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:13:31.517510 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:12:c5,bridge_name='br-int',has_traffic_filtering=True,id=004fd6c0-58df-4ceb-9733-267396cae60c,network=Network(b0d7ffe8-2fba-456a-8969-949ee402ce5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap004fd6c0-58') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:13:31.522103 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Lazy-loading 'pci_devices' on Instance uuid 1d45c7ce-5760-4f59-9921-feb3e589da8a {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:13:31.594882 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] No BDM found with device name vda, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:13:31.594954 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] No BDM found with device name hda, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:13:31.595057 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] No VIF found with MAC fa:16:3e:c2:8d:a4, not building metadata {{(pid=98431) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13199}} Jun 11 23:13:31.595496 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: 67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f] Using config drive Jun 11 23:13:31.616370 np0000002687 nova-compute[98431]: DEBUG nova.scheduler.client.report [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Overwriting current allocation {'allocations': {'e3e65fe2-9de9-4821-8b4a-ccae37c66e25': {'resources': {'VCPU': 1, 'MEMORY_MB': 256, 'DISK_GB': 1}, 'generation': 25}}, 'project_id': '62f47df2e0374879b837bc7431326e62', 'user_id': '2b37a00a21a249339e412bcde7a87f82', 'consumer_generation': 1} on consumer 7609742e-a3a2-4be2-ba02-227efb2101e1 {{(pid=98431) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2036}} Jun 11 23:13:31.747580 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-0fdfb306-5511-483c-9bee-ececad48eaa4 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "8a45e04f-3516-4c39-bea1-820104411f17" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 7.324s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:31.763273 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:13:31.844601 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Acquiring lock "refresh_cache-7609742e-a3a2-4be2-ba02-227efb2101e1" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 11 23:13:31.844796 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Acquired lock "refresh_cache-7609742e-a3a2-4be2-ba02-227efb2101e1" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 11 23:13:31.845019 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Building network info cache for instance {{(pid=98431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 11 23:13:31.931524 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-4ed7a9fd-47f6-4b91-be24-b696520bc0cd tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Took 4.13 seconds to destroy the instance on the hypervisor. Jun 11 23:13:31.932223 np0000002687 nova-compute[98431]: DEBUG oslo.service.backend._common.loopingcall [None req-4ed7a9fd-47f6-4b91-be24-b696520bc0cd tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98431) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jun 11 23:13:31.932411 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [-] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Deallocating network for instance {{(pid=98431) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}} Jun 11 23:13:31.932581 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [-] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] deallocate_for_instance() {{(pid=98431) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jun 11 23:13:31.932731 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] End _get_guest_xml xml= Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: 1d45c7ce-5760-4f59-9921-feb3e589da8a Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: instance-00000013 Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: 196608 Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: 1 Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: tempest-device-tagging-server-1366771090 Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: 2026-06-11 23:13:19 Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: 192 Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: 1 Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: 0 Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: 0 Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: 1 Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: True Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: bare Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: qcow2 Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: 1 Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: 0 Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: virtio Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: tempest-TaggedBootDevicesTest_v242-37151554-project-member Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: tempest-TaggedBootDevicesTest_v242-37151554 Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: OpenStack Foundation Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: OpenStack Nova Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: 33.1.0 Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: 1d45c7ce-5760-4f59-9921-feb3e589da8a Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: 1d45c7ce-5760-4f59-9921-feb3e589da8a Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Virtual Machine Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: hvm Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: 128 Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: 1 Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Nehalem Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: 1bc89aea-2378-4237-a440-71ea160649dc Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: 0eeb4862-dd4f-442d-a749-c347a2ec29f8 Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: cf81e3db-e34d-4a99-b4f7-a47ab33a8f13 Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: /dev/urandom Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: Jun 11 23:13:32.027812 np0000002687 nova-compute[98431]: {{(pid=98431) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 11 23:13:32.035757 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Preparing to wait for external event network-vif-plugged-5f9094e3-a3c6-48ea-bfbe-4fa25d19bcf2 {{(pid=98431) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 11 23:13:32.035757 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Acquiring lock "1d45c7ce-5760-4f59-9921-feb3e589da8a-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:32.035757 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Lock "1d45c7ce-5760-4f59-9921-feb3e589da8a-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:32.035757 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Lock "1d45c7ce-5760-4f59-9921-feb3e589da8a-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:32.035757 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Preparing to wait for external event network-vif-plugged-fe1430ca-d60b-47c4-9ac9-96ba7d61f101 {{(pid=98431) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 11 23:13:32.035757 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Acquiring lock "1d45c7ce-5760-4f59-9921-feb3e589da8a-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:32.035757 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Lock "1d45c7ce-5760-4f59-9921-feb3e589da8a-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:32.035757 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Lock "1d45c7ce-5760-4f59-9921-feb3e589da8a-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:32.035757 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Preparing to wait for external event network-vif-plugged-a39a55c7-874a-4a19-a069-8383a5f0bc5a {{(pid=98431) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 11 23:13:32.035757 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Acquiring lock "1d45c7ce-5760-4f59-9921-feb3e589da8a-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:32.035757 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Lock "1d45c7ce-5760-4f59-9921-feb3e589da8a-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:32.035757 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Lock "1d45c7ce-5760-4f59-9921-feb3e589da8a-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:32.035757 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Preparing to wait for external event network-vif-plugged-37aa7cee-88a0-4428-9b2d-45700f1dcab6 {{(pid=98431) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 11 23:13:32.035757 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Acquiring lock "1d45c7ce-5760-4f59-9921-feb3e589da8a-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:32.035757 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Lock "1d45c7ce-5760-4f59-9921-feb3e589da8a-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:32.035757 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Lock "1d45c7ce-5760-4f59-9921-feb3e589da8a-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:32.035757 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Preparing to wait for external event network-vif-plugged-e3269961-a3f1-42c8-a49e-37f728b2f3d8 {{(pid=98431) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 11 23:13:32.035757 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Acquiring lock "1d45c7ce-5760-4f59-9921-feb3e589da8a-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:32.035757 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Lock "1d45c7ce-5760-4f59-9921-feb3e589da8a-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:32.035757 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Lock "1d45c7ce-5760-4f59-9921-feb3e589da8a-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:32.035757 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Preparing to wait for external event network-vif-plugged-351eaad5-bf70-43b4-8f79-5bc0027de663 {{(pid=98431) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 11 23:13:32.035757 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Acquiring lock "1d45c7ce-5760-4f59-9921-feb3e589da8a-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:32.035757 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Lock "1d45c7ce-5760-4f59-9921-feb3e589da8a-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:32.035757 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Lock "1d45c7ce-5760-4f59-9921-feb3e589da8a-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:32.035757 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Preparing to wait for external event network-vif-plugged-004fd6c0-58df-4ceb-9733-267396cae60c {{(pid=98431) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 11 23:13:32.035757 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Acquiring lock "1d45c7ce-5760-4f59-9921-feb3e589da8a-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:32.035757 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Lock "1d45c7ce-5760-4f59-9921-feb3e589da8a-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:32.035757 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Lock "1d45c7ce-5760-4f59-9921-feb3e589da8a-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:32.040777 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-11T23:12:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1366771090',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='tempest-device-tagging-server-1366771090',id=19,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC5UXUrCEEA/0gxvD1NavMz6RwD8U++JuZnAB48UjQLmwHKU2knd70tRMd/ODZENnwRMpvr28/C2g9VTy2gQO0/t/l3FqY9lxY/3+5+G6z+bb25kWd7QXQRH7lbyZDsb8w==',key_name='tempest-keypair-965487513',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6c1e407a42f24b34baf3ee44be9fb337',ramdisk_id='',reservation_id='r-dqc2uc2r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-37151554',owner_user_name='tempest-TaggedBootDevicesTest_v242-37151554-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-11T23:12:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3dd7997e0762451ca159ee06bf3d9c44',uuid=1d45c7ce-5760-4f59-9921-feb3e589da8a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5f9094e3-a3c6-48ea-bfbe-4fa25d19bcf2", "address": "fa:16:3e:b1:9e:6a", "network": {"id": "1cea4f00-aa2e-4d9d-8255-2e7ba484f3ec", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1566230580-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c1e407a42f24b34baf3ee44be9fb337", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f9094e3-a3", "ovs_interfaceid": "5f9094e3-a3c6-48ea-bfbe-4fa25d19bcf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 11 23:13:32.040777 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Converting VIF {"id": "5f9094e3-a3c6-48ea-bfbe-4fa25d19bcf2", "address": "fa:16:3e:b1:9e:6a", "network": {"id": "1cea4f00-aa2e-4d9d-8255-2e7ba484f3ec", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1566230580-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c1e407a42f24b34baf3ee44be9fb337", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f9094e3-a3", "ovs_interfaceid": "5f9094e3-a3c6-48ea-bfbe-4fa25d19bcf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:13:32.040777 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:9e:6a,bridge_name='br-int',has_traffic_filtering=True,id=5f9094e3-a3c6-48ea-bfbe-4fa25d19bcf2,network=Network(1cea4f00-aa2e-4d9d-8255-2e7ba484f3ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f9094e3-a3') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:13:32.040777 np0000002687 nova-compute[98431]: DEBUG os_vif [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:9e:6a,bridge_name='br-int',has_traffic_filtering=True,id=5f9094e3-a3c6-48ea-bfbe-4fa25d19bcf2,network=Network(1cea4f00-aa2e-4d9d-8255-2e7ba484f3ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f9094e3-a3') {{(pid=98431) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 11 23:13:32.044066 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:13:32.044066 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:32.045874 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:13:32.045874 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 11 23:13:32.049831 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:32.049831 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '76fc54b2-b97f-5b70-9caf-1b997dd12e2a', '_type': 'linux-noop'}}, row=False) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:13:32.051680 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:32.055011 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:13:32.069604 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:32.071109 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:32.073056 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:32.073300 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5f9094e3-a3, may_exist=True, interface_attrs={}) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:13:32.073674 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5f9094e3-a3, col_values=(('qos', UUID('593aec03-1f85-41f4-ae6e-89f60f15e605')),), if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:13:32.073835 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5f9094e3-a3, col_values=(('external_ids', {'iface-id': '5f9094e3-a3c6-48ea-bfbe-4fa25d19bcf2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b1:9e:6a', 'vm-uuid': '1d45c7ce-5760-4f59-9921-feb3e589da8a'}),), if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:13:32.074789 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:32.077831 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:13:32.090625 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:32.091723 np0000002687 nova-compute[98431]: INFO os_vif [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:9e:6a,bridge_name='br-int',has_traffic_filtering=True,id=5f9094e3-a3c6-48ea-bfbe-4fa25d19bcf2,network=Network(1cea4f00-aa2e-4d9d-8255-2e7ba484f3ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f9094e3-a3') Jun 11 23:13:32.092613 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-11T23:12:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1366771090',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='tempest-device-tagging-server-1366771090',id=19,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC5UXUrCEEA/0gxvD1NavMz6RwD8U++JuZnAB48UjQLmwHKU2knd70tRMd/ODZENnwRMpvr28/C2g9VTy2gQO0/t/l3FqY9lxY/3+5+G6z+bb25kWd7QXQRH7lbyZDsb8w==',key_name='tempest-keypair-965487513',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6c1e407a42f24b34baf3ee44be9fb337',ramdisk_id='',reservation_id='r-dqc2uc2r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-37151554',owner_user_name='tempest-TaggedBootDevicesTest_v242-37151554-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-11T23:12:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3dd7997e0762451ca159ee06bf3d9c44',uuid=1d45c7ce-5760-4f59-9921-feb3e589da8a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe1430ca-d60b-47c4-9ac9-96ba7d61f101", "address": "fa:16:3e:ca:17:0a", "network": {"id": "d84f8615-2bee-4c03-b721-d597e25acb42", "bridge": "br-int", "label": "tempest-device-tagging-net1-1869260730", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c1e407a42f24b34baf3ee44be9fb337", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe1430ca-d6", "ovs_interfaceid": "fe1430ca-d60b-47c4-9ac9-96ba7d61f101", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98431) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 11 23:13:32.092930 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Converting VIF {"id": "fe1430ca-d60b-47c4-9ac9-96ba7d61f101", "address": "fa:16:3e:ca:17:0a", "network": {"id": "d84f8615-2bee-4c03-b721-d597e25acb42", "bridge": "br-int", "label": "tempest-device-tagging-net1-1869260730", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c1e407a42f24b34baf3ee44be9fb337", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe1430ca-d6", "ovs_interfaceid": "fe1430ca-d60b-47c4-9ac9-96ba7d61f101", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:13:32.093525 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:17:0a,bridge_name='br-int',has_traffic_filtering=True,id=fe1430ca-d60b-47c4-9ac9-96ba7d61f101,network=Network(d84f8615-2bee-4c03-b721-d597e25acb42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfe1430ca-d6') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:13:32.093767 np0000002687 nova-compute[98431]: DEBUG os_vif [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:17:0a,bridge_name='br-int',has_traffic_filtering=True,id=fe1430ca-d60b-47c4-9ac9-96ba7d61f101,network=Network(d84f8615-2bee-4c03-b721-d597e25acb42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfe1430ca-d6') {{(pid=98431) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 11 23:13:32.094077 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:32.094405 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:13:32.094598 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 11 23:13:32.095743 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:32.095743 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '31ad24d5-35d5-583b-b0b3-42a7338e986f', '_type': 'linux-noop'}}, row=False) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:13:32.096670 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:32.097439 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:13:32.107583 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:13:32.114016 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:32.120560 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:32.120922 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfe1430ca-d6, may_exist=True, interface_attrs={}) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:13:32.122070 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfe1430ca-d6, col_values=(('qos', UUID('d0bf72f5-4b2a-4325-8b1f-3e349f364afe')),), if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:13:32.122070 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfe1430ca-d6, col_values=(('external_ids', {'iface-id': 'fe1430ca-d60b-47c4-9ac9-96ba7d61f101', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ca:17:0a', 'vm-uuid': '1d45c7ce-5760-4f59-9921-feb3e589da8a'}),), if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:13:32.123221 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:32.125098 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:13:32.143001 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:32.145922 np0000002687 nova-compute[98431]: INFO os_vif [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:17:0a,bridge_name='br-int',has_traffic_filtering=True,id=fe1430ca-d60b-47c4-9ac9-96ba7d61f101,network=Network(d84f8615-2bee-4c03-b721-d597e25acb42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfe1430ca-d6') Jun 11 23:13:32.146352 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-11T23:12:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1366771090',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='tempest-device-tagging-server-1366771090',id=19,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC5UXUrCEEA/0gxvD1NavMz6RwD8U++JuZnAB48UjQLmwHKU2knd70tRMd/ODZENnwRMpvr28/C2g9VTy2gQO0/t/l3FqY9lxY/3+5+G6z+bb25kWd7QXQRH7lbyZDsb8w==',key_name='tempest-keypair-965487513',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6c1e407a42f24b34baf3ee44be9fb337',ramdisk_id='',reservation_id='r-dqc2uc2r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-37151554',owner_user_name='tempest-TaggedBootDevicesTest_v242-37151554-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-11T23:12:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3dd7997e0762451ca159ee06bf3d9c44',uuid=1d45c7ce-5760-4f59-9921-feb3e589da8a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a39a55c7-874a-4a19-a069-8383a5f0bc5a", "address": "fa:16:3e:37:35:68", "network": {"id": "d84f8615-2bee-4c03-b721-d597e25acb42", "bridge": "br-int", "label": "tempest-device-tagging-net1-1869260730", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c1e407a42f24b34baf3ee44be9fb337", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa39a55c7-87", "ovs_interfaceid": "a39a55c7-874a-4a19-a069-8383a5f0bc5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98431) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 11 23:13:32.146739 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Converting VIF {"id": "a39a55c7-874a-4a19-a069-8383a5f0bc5a", "address": "fa:16:3e:37:35:68", "network": {"id": "d84f8615-2bee-4c03-b721-d597e25acb42", "bridge": "br-int", "label": "tempest-device-tagging-net1-1869260730", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c1e407a42f24b34baf3ee44be9fb337", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa39a55c7-87", "ovs_interfaceid": "a39a55c7-874a-4a19-a069-8383a5f0bc5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:13:32.147153 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:35:68,bridge_name='br-int',has_traffic_filtering=True,id=a39a55c7-874a-4a19-a069-8383a5f0bc5a,network=Network(d84f8615-2bee-4c03-b721-d597e25acb42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa39a55c7-87') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:13:32.148241 np0000002687 nova-compute[98431]: DEBUG os_vif [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:35:68,bridge_name='br-int',has_traffic_filtering=True,id=a39a55c7-874a-4a19-a069-8383a5f0bc5a,network=Network(d84f8615-2bee-4c03-b721-d597e25acb42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa39a55c7-87') {{(pid=98431) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 11 23:13:32.148241 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:32.148241 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:13:32.148241 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 11 23:13:32.150023 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:32.150023 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4923e40c-7c01-58a9-8084-43eaafcf8e97', '_type': 'linux-noop'}}, row=False) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:13:32.150709 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:32.151948 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:13:32.168935 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:32.176235 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:32.176857 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa39a55c7-87, may_exist=True, interface_attrs={}) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:13:32.177059 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa39a55c7-87, col_values=(('qos', UUID('49dbd637-d465-4290-9953-38179918395a')),), if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:13:32.177298 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa39a55c7-87, col_values=(('external_ids', {'iface-id': 'a39a55c7-874a-4a19-a069-8383a5f0bc5a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:37:35:68', 'vm-uuid': '1d45c7ce-5760-4f59-9921-feb3e589da8a'}),), if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:13:32.178361 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:32.179679 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:13:32.208431 np0000002687 nova-compute[98431]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.00044979800009059545 future=) submitted to {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:13:32.208903 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] Emitting event Stopped> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:13:32.209038 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] VM Stopped (Lifecycle Event) Jun 11 23:13:32.210390 np0000002687 nova-compute[98431]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:13:32.210598 np0000002687 nova-compute[98431]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=6.941400201000079 future=) {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:13:32.210860 np0000002687 nova-compute[98431]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=6.941224398000031 future=) was cancelled while queued, skipping {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:13:32.210860 np0000002687 nova-compute[98431]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:13:32.210957 np0000002687 nova-compute[98431]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=10.937731820000181 future=) {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:13:32.211022 np0000002687 nova-compute[98431]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=10.937642986000128 future=) {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:13:32.212937 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:32.214260 np0000002687 nova-compute[98431]: INFO os_vif [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:35:68,bridge_name='br-int',has_traffic_filtering=True,id=a39a55c7-874a-4a19-a069-8383a5f0bc5a,network=Network(d84f8615-2bee-4c03-b721-d597e25acb42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa39a55c7-87') Jun 11 23:13:32.215337 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-11T23:12:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1366771090',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='tempest-device-tagging-server-1366771090',id=19,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC5UXUrCEEA/0gxvD1NavMz6RwD8U++JuZnAB48UjQLmwHKU2knd70tRMd/ODZENnwRMpvr28/C2g9VTy2gQO0/t/l3FqY9lxY/3+5+G6z+bb25kWd7QXQRH7lbyZDsb8w==',key_name='tempest-keypair-965487513',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6c1e407a42f24b34baf3ee44be9fb337',ramdisk_id='',reservation_id='r-dqc2uc2r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-37151554',owner_user_name='tempest-TaggedBootDevicesTest_v242-37151554-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-11T23:12:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3dd7997e0762451ca159ee06bf3d9c44',uuid=1d45c7ce-5760-4f59-9921-feb3e589da8a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "37aa7cee-88a0-4428-9b2d-45700f1dcab6", "address": "fa:16:3e:12:f4:f7", "network": {"id": "d84f8615-2bee-4c03-b721-d597e25acb42", "bridge": "br-int", "label": "tempest-device-tagging-net1-1869260730", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c1e407a42f24b34baf3ee44be9fb337", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap37aa7cee-88", "ovs_interfaceid": "37aa7cee-88a0-4428-9b2d-45700f1dcab6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 11 23:13:32.215508 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Converting VIF {"id": "37aa7cee-88a0-4428-9b2d-45700f1dcab6", "address": "fa:16:3e:12:f4:f7", "network": {"id": "d84f8615-2bee-4c03-b721-d597e25acb42", "bridge": "br-int", "label": "tempest-device-tagging-net1-1869260730", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c1e407a42f24b34baf3ee44be9fb337", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap37aa7cee-88", "ovs_interfaceid": "37aa7cee-88a0-4428-9b2d-45700f1dcab6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:13:32.218114 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:f4:f7,bridge_name='br-int',has_traffic_filtering=True,id=37aa7cee-88a0-4428-9b2d-45700f1dcab6,network=Network(d84f8615-2bee-4c03-b721-d597e25acb42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37aa7cee-88') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:13:32.218449 np0000002687 nova-compute[98431]: DEBUG os_vif [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:f4:f7,bridge_name='br-int',has_traffic_filtering=True,id=37aa7cee-88a0-4428-9b2d-45700f1dcab6,network=Network(d84f8615-2bee-4c03-b721-d597e25acb42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37aa7cee-88') {{(pid=98431) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 11 23:13:32.218889 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:32.219218 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:13:32.219451 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 11 23:13:32.220976 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:32.221593 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '399bac34-2161-57f2-8f8a-0e911885f1da', '_type': 'linux-noop'}}, row=False) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:13:32.223201 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:32.223401 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:13:32.245217 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:32.251655 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:32.252205 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap37aa7cee-88, may_exist=True, interface_attrs={}) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:13:32.252826 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap37aa7cee-88, col_values=(('qos', UUID('1bd3c448-44ff-42e1-aafa-4bfae998fa22')),), if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:13:32.253019 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap37aa7cee-88, col_values=(('external_ids', {'iface-id': '37aa7cee-88a0-4428-9b2d-45700f1dcab6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:12:f4:f7', 'vm-uuid': '1d45c7ce-5760-4f59-9921-feb3e589da8a'}),), if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:13:32.254944 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:32.255955 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:13:32.285699 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:32.288915 np0000002687 nova-compute[98431]: INFO os_vif [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:f4:f7,bridge_name='br-int',has_traffic_filtering=True,id=37aa7cee-88a0-4428-9b2d-45700f1dcab6,network=Network(d84f8615-2bee-4c03-b721-d597e25acb42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37aa7cee-88') Jun 11 23:13:32.288915 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-11T23:12:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1366771090',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='tempest-device-tagging-server-1366771090',id=19,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC5UXUrCEEA/0gxvD1NavMz6RwD8U++JuZnAB48UjQLmwHKU2knd70tRMd/ODZENnwRMpvr28/C2g9VTy2gQO0/t/l3FqY9lxY/3+5+G6z+bb25kWd7QXQRH7lbyZDsb8w==',key_name='tempest-keypair-965487513',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6c1e407a42f24b34baf3ee44be9fb337',ramdisk_id='',reservation_id='r-dqc2uc2r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-37151554',owner_user_name='tempest-TaggedBootDevicesTest_v242-37151554-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-11T23:12:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3dd7997e0762451ca159ee06bf3d9c44',uuid=1d45c7ce-5760-4f59-9921-feb3e589da8a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e3269961-a3f1-42c8-a49e-37f728b2f3d8", "address": "fa:16:3e:7e:14:0b", "network": {"id": "d84f8615-2bee-4c03-b721-d597e25acb42", "bridge": "br-int", "label": "tempest-device-tagging-net1-1869260730", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c1e407a42f24b34baf3ee44be9fb337", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape3269961-a3", "ovs_interfaceid": "e3269961-a3f1-42c8-a49e-37f728b2f3d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 11 23:13:32.288915 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Converting VIF {"id": "e3269961-a3f1-42c8-a49e-37f728b2f3d8", "address": "fa:16:3e:7e:14:0b", "network": {"id": "d84f8615-2bee-4c03-b721-d597e25acb42", "bridge": "br-int", "label": "tempest-device-tagging-net1-1869260730", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c1e407a42f24b34baf3ee44be9fb337", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape3269961-a3", "ovs_interfaceid": "e3269961-a3f1-42c8-a49e-37f728b2f3d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:13:32.289457 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:14:0b,bridge_name='br-int',has_traffic_filtering=True,id=e3269961-a3f1-42c8-a49e-37f728b2f3d8,network=Network(d84f8615-2bee-4c03-b721-d597e25acb42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3269961-a3') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:13:32.290311 np0000002687 nova-compute[98431]: DEBUG os_vif [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:14:0b,bridge_name='br-int',has_traffic_filtering=True,id=e3269961-a3f1-42c8-a49e-37f728b2f3d8,network=Network(d84f8615-2bee-4c03-b721-d597e25acb42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3269961-a3') {{(pid=98431) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 11 23:13:32.290311 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:32.290562 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:13:32.290783 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 11 23:13:32.292853 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:32.296753 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7a220983-a146-59f7-9a6b-2c4a477ec06c', '_type': 'linux-noop'}}, row=False) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:13:32.298953 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:32.301286 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:13:32.330950 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:32.337223 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:32.337474 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape3269961-a3, may_exist=True, interface_attrs={}) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:13:32.337854 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape3269961-a3, col_values=(('qos', UUID('e80d3228-f5c6-4f65-a05a-dda8c34bb30a')),), if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:13:32.338074 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape3269961-a3, col_values=(('external_ids', {'iface-id': 'e3269961-a3f1-42c8-a49e-37f728b2f3d8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7e:14:0b', 'vm-uuid': '1d45c7ce-5760-4f59-9921-feb3e589da8a'}),), if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:13:32.341129 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:13:32.348180 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:13:32.380607 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:32.381696 np0000002687 nova-compute[98431]: INFO os_vif [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:14:0b,bridge_name='br-int',has_traffic_filtering=True,id=e3269961-a3f1-42c8-a49e-37f728b2f3d8,network=Network(d84f8615-2bee-4c03-b721-d597e25acb42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3269961-a3') Jun 11 23:13:32.382901 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-11T23:12:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1366771090',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='tempest-device-tagging-server-1366771090',id=19,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC5UXUrCEEA/0gxvD1NavMz6RwD8U++JuZnAB48UjQLmwHKU2knd70tRMd/ODZENnwRMpvr28/C2g9VTy2gQO0/t/l3FqY9lxY/3+5+G6z+bb25kWd7QXQRH7lbyZDsb8w==',key_name='tempest-keypair-965487513',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6c1e407a42f24b34baf3ee44be9fb337',ramdisk_id='',reservation_id='r-dqc2uc2r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-37151554',owner_user_name='tempest-TaggedBootDevicesTest_v242-37151554-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-11T23:12:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3dd7997e0762451ca159ee06bf3d9c44',uuid=1d45c7ce-5760-4f59-9921-feb3e589da8a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "351eaad5-bf70-43b4-8f79-5bc0027de663", "address": "fa:16:3e:ee:d2:51", "network": {"id": "b0d7ffe8-2fba-456a-8969-949ee402ce5b", "bridge": "br-int", "label": "tempest-device-tagging-net2-84998986", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c1e407a42f24b34baf3ee44be9fb337", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap351eaad5-bf", "ovs_interfaceid": "351eaad5-bf70-43b4-8f79-5bc0027de663", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 11 23:13:32.382901 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Converting VIF {"id": "351eaad5-bf70-43b4-8f79-5bc0027de663", "address": "fa:16:3e:ee:d2:51", "network": {"id": "b0d7ffe8-2fba-456a-8969-949ee402ce5b", "bridge": "br-int", "label": "tempest-device-tagging-net2-84998986", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c1e407a42f24b34baf3ee44be9fb337", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap351eaad5-bf", "ovs_interfaceid": "351eaad5-bf70-43b4-8f79-5bc0027de663", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:13:32.383264 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:d2:51,bridge_name='br-int',has_traffic_filtering=True,id=351eaad5-bf70-43b4-8f79-5bc0027de663,network=Network(b0d7ffe8-2fba-456a-8969-949ee402ce5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap351eaad5-bf') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:13:32.383995 np0000002687 nova-compute[98431]: DEBUG os_vif [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:d2:51,bridge_name='br-int',has_traffic_filtering=True,id=351eaad5-bf70-43b4-8f79-5bc0027de663,network=Network(b0d7ffe8-2fba-456a-8969-949ee402ce5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap351eaad5-bf') {{(pid=98431) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 11 23:13:32.384621 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:32.384844 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:13:32.384974 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 11 23:13:32.388282 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:32.388520 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c3c68bdb-c942-5552-b447-befca9d61e1e', '_type': 'linux-noop'}}, row=False) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:13:32.390769 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:13:32.401113 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: 67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f] Creating config drive at /opt/stack/data/nova/instances/67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f/disk.config Jun 11 23:13:32.409296 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp2nix7fm_ {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:13:32.436052 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:32.445048 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:32.445048 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap351eaad5-bf, may_exist=True, interface_attrs={}) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:13:32.445729 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap351eaad5-bf, col_values=(('qos', UUID('cc7acae8-013d-4002-b68f-d7f7ab624e4b')),), if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:13:32.447427 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap351eaad5-bf, col_values=(('external_ids', {'iface-id': '351eaad5-bf70-43b4-8f79-5bc0027de663', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ee:d2:51', 'vm-uuid': '1d45c7ce-5760-4f59-9921-feb3e589da8a'}),), if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:13:32.449127 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:32.451920 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:13:32.482729 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp2nix7fm_" returned: 0 in 0.073s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:13:32.488383 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-54535ab7-1df8-436d-a94f-1c2c20e7b236 req-59fb60b3-bde9-4175-b595-8c13a582cab8 service nova] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Received event network-vif-deleted-3c37ff2c-78c4-4423-b4a2-219e94df57ca {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:13:32.488698 np0000002687 nova-compute[98431]: INFO nova.compute.manager [req-54535ab7-1df8-436d-a94f-1c2c20e7b236 req-59fb60b3-bde9-4175-b595-8c13a582cab8 service nova] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Neutron deleted interface 3c37ff2c-78c4-4423-b4a2-219e94df57ca; detaching it from the instance and deleting it from the info cache Jun 11 23:13:32.493256 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-54535ab7-1df8-436d-a94f-1c2c20e7b236 req-59fb60b3-bde9-4175-b595-8c13a582cab8 service nova] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Detach interface failed, port_id=3c37ff2c-78c4-4423-b4a2-219e94df57ca, reason: Instance 0d352738-c7bf-42a2-8260-bf5574a7200d could not be found. {{(pid=98431) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}} Jun 11 23:13:32.497183 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:32.498585 np0000002687 nova-compute[98431]: INFO os_vif [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:d2:51,bridge_name='br-int',has_traffic_filtering=True,id=351eaad5-bf70-43b4-8f79-5bc0027de663,network=Network(b0d7ffe8-2fba-456a-8969-949ee402ce5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap351eaad5-bf') Jun 11 23:13:32.499501 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-11T23:12:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1366771090',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='tempest-device-tagging-server-1366771090',id=19,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC5UXUrCEEA/0gxvD1NavMz6RwD8U++JuZnAB48UjQLmwHKU2knd70tRMd/ODZENnwRMpvr28/C2g9VTy2gQO0/t/l3FqY9lxY/3+5+G6z+bb25kWd7QXQRH7lbyZDsb8w==',key_name='tempest-keypair-965487513',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6c1e407a42f24b34baf3ee44be9fb337',ramdisk_id='',reservation_id='r-dqc2uc2r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-37151554',owner_user_name='tempest-TaggedBootDevicesTest_v242-37151554-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-11T23:12:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3dd7997e0762451ca159ee06bf3d9c44',uuid=1d45c7ce-5760-4f59-9921-feb3e589da8a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "004fd6c0-58df-4ceb-9733-267396cae60c", "address": "fa:16:3e:5d:12:c5", "network": {"id": "b0d7ffe8-2fba-456a-8969-949ee402ce5b", "bridge": "br-int", "label": "tempest-device-tagging-net2-84998986", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c1e407a42f24b34baf3ee44be9fb337", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap004fd6c0-58", "ovs_interfaceid": "004fd6c0-58df-4ceb-9733-267396cae60c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 11 23:13:32.500428 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Converting VIF {"id": "004fd6c0-58df-4ceb-9733-267396cae60c", "address": "fa:16:3e:5d:12:c5", "network": {"id": "b0d7ffe8-2fba-456a-8969-949ee402ce5b", "bridge": "br-int", "label": "tempest-device-tagging-net2-84998986", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c1e407a42f24b34baf3ee44be9fb337", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap004fd6c0-58", "ovs_interfaceid": "004fd6c0-58df-4ceb-9733-267396cae60c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:13:32.501177 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:12:c5,bridge_name='br-int',has_traffic_filtering=True,id=004fd6c0-58df-4ceb-9733-267396cae60c,network=Network(b0d7ffe8-2fba-456a-8969-949ee402ce5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap004fd6c0-58') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:13:32.501491 np0000002687 nova-compute[98431]: DEBUG os_vif [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:12:c5,bridge_name='br-int',has_traffic_filtering=True,id=004fd6c0-58df-4ceb-9733-267396cae60c,network=Network(b0d7ffe8-2fba-456a-8969-949ee402ce5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap004fd6c0-58') {{(pid=98431) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 11 23:13:32.502812 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:32.503026 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:13:32.503445 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 11 23:13:32.507296 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:32.507657 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '50279be7-920d-56de-893c-5d46c8c9db1c', '_type': 'linux-noop'}}, row=False) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:13:32.509981 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:32.509981 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:13:32.553212 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:32.556507 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:32.557863 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap004fd6c0-58, may_exist=True, interface_attrs={}) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:13:32.557863 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap004fd6c0-58, col_values=(('qos', UUID('a655233e-45a0-45bc-9589-e9290c5ce7e4')),), if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:13:32.557863 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap004fd6c0-58, col_values=(('external_ids', {'iface-id': '004fd6c0-58df-4ceb-9733-267396cae60c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5d:12:c5', 'vm-uuid': '1d45c7ce-5760-4f59-9921-feb3e589da8a'}),), if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:13:32.559747 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:32.559747 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:13:32.609545 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:32.610856 np0000002687 nova-compute[98431]: INFO os_vif [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:12:c5,bridge_name='br-int',has_traffic_filtering=True,id=004fd6c0-58df-4ceb-9733-267396cae60c,network=Network(b0d7ffe8-2fba-456a-8969-949ee402ce5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap004fd6c0-58') Jun 11 23:13:32.712445 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-c1567288-aebe-4ee0-bc84-40c18a7b8da0 tempest-VolumesAdminNegativeTest-2097592246 tempest-VolumesAdminNegativeTest-2097592246-project-member] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:13:32.839846 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:13:32.901415 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:32.928994 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [-] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Updating instance_info_cache with network_info: [] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:13:33.076249 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Updating instance_info_cache with network_info: [{"id": "a1e7aeff-5992-43be-bb2c-d504e7019c64", "address": "fa:16:3e:1d:f7:18", "network": {"id": "710d3c5f-1a08-4a35-b3e1-e59f427989c2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2068802531-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62f47df2e0374879b837bc7431326e62", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1e7aeff-59", "ovs_interfaceid": "a1e7aeff-5992-43be-bb2c-d504e7019c64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:13:33.080650 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:33.151938 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:33.215412 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:33.298979 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:33.380147 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:33.430737 np0000002687 nova-compute[98431]: INFO nova.compute.manager [-] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Took 1.50 seconds to deallocate network for instance. Jun 11 23:13:33.562197 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-f958c576-ef4c-4b4a-b8ab-a9a6f7c05155 req-c3c42bb0-b3c0-4ff9-8b0b-c00e70d5b727 service nova] [instance: 67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f] Received event network-vif-plugged-59f62261-8a42-4e76-9609-68343996250d {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:13:33.563844 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-f958c576-ef4c-4b4a-b8ab-a9a6f7c05155 req-c3c42bb0-b3c0-4ff9-8b0b-c00e70d5b727 service nova] Acquiring lock "67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:33.563844 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-f958c576-ef4c-4b4a-b8ab-a9a6f7c05155 req-c3c42bb0-b3c0-4ff9-8b0b-c00e70d5b727 service nova] Lock "67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:33.563844 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-f958c576-ef4c-4b4a-b8ab-a9a6f7c05155 req-c3c42bb0-b3c0-4ff9-8b0b-c00e70d5b727 service nova] Lock "67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:33.563844 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-f958c576-ef4c-4b4a-b8ab-a9a6f7c05155 req-c3c42bb0-b3c0-4ff9-8b0b-c00e70d5b727 service nova] [instance: 67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f] Processing event network-vif-plugged-59f62261-8a42-4e76-9609-68343996250d {{(pid=98431) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 11 23:13:33.581844 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Releasing lock "refresh_cache-7609742e-a3a2-4be2-ba02-227efb2101e1" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 11 23:13:33.582359 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.209', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000002687', 'execute': None}" {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 11 23:13:33.606930 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.scaleio [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98431) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 11 23:13:33.646135 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Running cmd (subprocess): nvme version {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:13:33.696834 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] 'nvme version' failed. Not Retrying. {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 11 23:13:33.698491 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] nvme not present on system {{(pid=98431) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 11 23:13:33.707249 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.lightos [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98431) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 11 23:13:33.708817 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.lightos [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Current host hostNQN and IP(s) are ['10.4.3.209', 'fe80::f816:3eff:fea3:3707', '192.168.40.6', 'fe80::f816:3eff:fe06:bdab', '192.168.50.6', 'fe80::f816:3eff:fe7a:46f2', '192.168.10.6', 'fe80::f816:3eff:fe13:793b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::38fa:21ff:fe6c:3746', 'fe80::fc16:3eff:fe6c:eb30', 'fe80::20a8:54ff:fe51:da0a', 'fe80::fc16:3eff:fe77:488d', 'fe80::9469:f2ff:feae:5824', 'fe80::fc16:3eff:fec7:336a', 'fe80::fc16:3eff:fe61:b7fd', 'fe80::fc16:3eff:fec6:c65b', 'fe80::fc16:3eff:fed6:e34f', 'fe80::fc16:3eff:fe4b:2695', 'fe80::fc16:3eff:fe6f:4242', 'fe80::fc16:3eff:fe2b:91a7', 'fe80::38dc:c1ff:fee9:4731', 'fe80::fc16:3eff:fec2:8da4'] Jun 11 23:13:33.708962 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.lightos [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98431) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 11 23:13:33.709129 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.lightos [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] LIGHTOS: no hostnqn found. {{(pid=98431) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 11 23:13:33.709521 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.209', 'host': 'np0000002687', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:798b370f1cc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad465dfe-0ed1-4637-98c3-ddaebebd61a4', 'nvme_native_multipath': False} {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 11 23:13:33.800542 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:34.008038 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-4ed7a9fd-47f6-4b91-be24-b696520bc0cd tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Took 0.58 seconds to detach 1 volumes for instance. Jun 11 23:13:34.010736 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-4ed7a9fd-47f6-4b91-be24-b696520bc0cd tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Deleting volume: 484c7594-8b2e-4f2d-81d7-bdda56999859 {{(pid=98431) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}} Jun 11 23:13:34.075935 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] Stashing vm_state: active {{(pid=98431) _prep_resize /opt/stack/nova/nova/compute/manager.py:6338}} Jun 11 23:13:34.121588 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: 67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98431) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 11 23:13:34.123835 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Emitting event Started> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:13:34.125413 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f] VM Started (Lifecycle Event) Jun 11 23:13:34.128035 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: 67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f] Guest created on hypervisor {{(pid=98431) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}} Jun 11 23:13:34.131781 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [-] [instance: 67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f] Instance spawned successfully. Jun 11 23:13:34.133471 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: 67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 11 23:13:34.141809 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] No BDM found with device name hda, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:13:34.142140 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:13:34.142260 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] No VIF found with MAC fa:16:3e:b1:9e:6a, not building metadata {{(pid=98431) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13199}} Jun 11 23:13:34.142511 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] No VIF found with MAC fa:16:3e:7e:14:0b, not building metadata {{(pid=98431) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13199}} Jun 11 23:13:34.143339 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Using config drive Jun 11 23:13:34.562666 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-4ed7a9fd-47f6-4b91-be24-b696520bc0cd tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:34.563035 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-4ed7a9fd-47f6-4b91-be24-b696520bc0cd tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:34.627843 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:13:34.655752 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:13:34.659401 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98431) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 11 23:13:34.666061 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: 67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f] Found default for hw_cdrom_bus of ide {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:13:34.671432 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: 67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f] Found default for hw_disk_bus of virtio {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:13:34.671962 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: 67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f] Found default for hw_input_bus of None {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:13:34.679598 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: 67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f] Found default for hw_pointer_model of None {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:13:34.679598 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: 67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f] Found default for hw_video_model of virtio {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:13:34.679598 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: 67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f] Found default for hw_vif_model of virtio {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:13:34.684469 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:34.832347 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Starting finish_revert_migration {{(pid=98431) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12948}} Jun 11 23:13:34.848895 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Start _get_guest_xml network_info=[{"id": "a1e7aeff-5992-43be-bb2c-d504e7019c64", "address": "fa:16:3e:1d:f7:18", "network": {"id": "710d3c5f-1a08-4a35-b3e1-e59f427989c2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2068802531-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62f47df2e0374879b837bc7431326e62", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1e7aeff-59", "ovs_interfaceid": "a1e7aeff-5992-43be-bb2c-d504e7019c64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=,container_format='bare',created_at=,direct_url=,disk_format='qcow2',id=f30640f8-7aca-4300-a085-4706a5209a79,min_disk=1,min_ram=0,name=,owner=,properties=ImageMetaProps,protected=,size=,status=,tags=,updated_at=,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'image_id': 'f30640f8-7aca-4300-a085-4706a5209a79'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'mount_device': '/dev/vdb', 'attachment_id': '9aa8e1b7-9cba-4bfe-96fd-4badfc737232', 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979', 'iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2f2d8ccb-5d26-4f0b-bc60-abf6355bf979', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': '7609742e-a3a2-4be2-ba02-227efb2101e1', 'attached_at': '2026-06-11T23:13:34.000000', 'detached_at': '', 'volume_id': '2f2d8ccb-5d26-4f0b-bc60-abf6355bf979', 'serial': '2f2d8ccb-5d26-4f0b-bc60-abf6355bf979'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98431) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 11 23:13:34.856828 np0000002687 nova-compute[98431]: WARNING nova.virt.libvirt.driver [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 11 23:13:34.856828 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='f30640f8-7aca-4300-a085-4706a5209a79', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherB-server-872787611', uuid='7609742e-a3a2-4be2-ba02-227efb2101e1'), owner=OwnerMeta(userid='2b37a00a21a249339e412bcde7a87f82', username='tempest-ServerActionsTestOtherB-1260316994-project-member', projectid='62f47df2e0374879b837bc7431326e62', projectname='tempest-ServerActionsTestOtherB-1260316994'), image=ImageMeta(id='f30640f8-7aca-4300-a085-4706a5209a79', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "a1e7aeff-5992-43be-bb2c-d504e7019c64", "address": "fa:16:3e:1d:f7:18", "network": {"id": "710d3c5f-1a08-4a35-b3e1-e59f427989c2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2068802531-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62f47df2e0374879b837bc7431326e62", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1e7aeff-59", "ovs_interfaceid": "a1e7aeff-5992-43be-bb2c-d504e7019c64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1781219614.8551373) {{(pid=98431) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 11 23:13:34.858094 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Searching host: 'np0000002687' for CPU controller through CGroups V1... {{(pid=98431) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 11 23:13:34.861858 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] CPU controller missing on host. {{(pid=98431) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 11 23:13:34.870415 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Searching host: 'np0000002687' for CPU controller through CGroups V2... {{(pid=98431) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 11 23:13:34.871156 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] CPU controller found on host. {{(pid=98431) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 11 23:13:34.873987 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98431) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 11 23:13:34.873987 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-11T23:08:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=,container_format='bare',created_at=,direct_url=,disk_format='qcow2',id=f30640f8-7aca-4300-a085-4706a5209a79,min_disk=1,min_ram=0,name=,owner=,properties=ImageMetaProps,protected=,size=,status=,tags=,updated_at=,virtual_size=,visibility=), allow threads: True {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 11 23:13:34.873987 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Flavor limits 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 11 23:13:34.873987 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Image limits 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 11 23:13:34.873987 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Flavor pref 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 11 23:13:34.873987 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Image pref 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 11 23:13:34.873987 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 11 23:13:34.874498 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 11 23:13:34.874498 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98431) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 11 23:13:34.874498 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Got 1 possible topologies {{(pid=98431) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 11 23:13:34.874756 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 11 23:13:34.874756 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 11 23:13:34.877957 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7609742e-a3a2-4be2-ba02-227efb2101e1 {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:13:34.914867 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Creating config drive at /opt/stack/data/nova/instances/1d45c7ce-5760-4f59-9921-feb3e589da8a/disk.config Jun 11 23:13:34.918960 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/1d45c7ce-5760-4f59-9921-feb3e589da8a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpdhxnk54m {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:13:34.976944 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/1d45c7ce-5760-4f59-9921-feb3e589da8a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpdhxnk54m" returned: 0 in 0.058s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:13:35.171998 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f] During sync_power_state the instance has a pending task (spawning). Skip. Jun 11 23:13:35.174657 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Emitting event Paused> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:13:35.174910 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f] VM Paused (Lifecycle Event) Jun 11 23:13:35.189472 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: 67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f] Took 8.33 seconds to spawn the instance on the hypervisor. Jun 11 23:13:35.190397 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: 67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:13:35.395481 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7609742e-a3a2-4be2-ba02-227efb2101e1/disk.config --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:13:35.520372 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7609742e-a3a2-4be2-ba02-227efb2101e1/disk.config --force-share --output=json" returned: 0 in 0.125s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:13:35.522209 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Acquiring lock "/opt/stack/data/nova/instances/7609742e-a3a2-4be2-ba02-227efb2101e1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:35.524449 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Lock "/opt/stack/data/nova/instances/7609742e-a3a2-4be2-ba02-227efb2101e1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:35.524449 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Lock "/opt/stack/data/nova/instances/7609742e-a3a2-4be2-ba02-227efb2101e1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:35.524449 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Calling os-brick to attach iSCSI Volume {{(pid=98431) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 11 23:13:35.527203 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979', 'iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2f2d8ccb-5d26-4f0b-bc60-abf6355bf979', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 11 23:13:35.527402 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 11 23:13:35.528371 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:35.531352 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 11 23:13:35.531352 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979', 'iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2f2d8ccb-5d26-4f0b-bc60-abf6355bf979', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98431) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 11 23:13:35.552178 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 11 23:13:35.556560 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 11 23:13:35.557293 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.005s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 11 23:13:35.557508 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.iscsi [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 11 23:13:35.559622 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 11 23:13:35.559622 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.iscsi [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 11 23:13:35.577738 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 11 23:13:35.577738 np0000002687 nova-compute[98431]: {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:13:35.593549 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 11 23:13:35.593549 np0000002687 nova-compute[98431]: {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:13:35.600207 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:35.602344 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979] added Jun 11 23:13:35.602344 np0000002687 nova-compute[98431]: stderr=iscsiadm: Config file line 363 does not have value Jun 11 23:13:35.602344 np0000002687 nova-compute[98431]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 11 23:13:35.602344 np0000002687 nova-compute[98431]: iscsiadm: Config file line 363 does not have value Jun 11 23:13:35.602344 np0000002687 nova-compute[98431]: iscsiadm: Config file line 363 does not have value Jun 11 23:13:35.602344 np0000002687 nova-compute[98431]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 11 23:13:35.602344 np0000002687 nova-compute[98431]: {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:13:35.606865 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98431) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 11 23:13:35.606865 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.046(s), this was the 1st time calling it. {{(pid=98431) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 11 23:13:35.606865 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98431) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 11 23:13:35.613639 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-4ed7a9fd-47f6-4b91-be24-b696520bc0cd tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98431) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 11 23:13:35.613639 np0000002687 nova-compute[98431]: DEBUG nova.compute.provider_tree [None req-4ed7a9fd-47f6-4b91-be24-b696520bc0cd tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Inventory has not changed in ProviderTree for provider: e3e65fe2-9de9-4821-8b4a-ccae37c66e25 {{(pid=98431) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 11 23:13:35.619585 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979] added Jun 11 23:13:35.619585 np0000002687 nova-compute[98431]: stderr=iscsiadm: Config file line 363 does not have value Jun 11 23:13:35.619585 np0000002687 nova-compute[98431]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 11 23:13:35.619585 np0000002687 nova-compute[98431]: iscsiadm: Config file line 363 does not have value Jun 11 23:13:35.619585 np0000002687 nova-compute[98431]: iscsiadm: Config file line 363 does not have value Jun 11 23:13:35.619585 np0000002687 nova-compute[98431]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 11 23:13:35.619585 np0000002687 nova-compute[98431]: {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:13:35.619923 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98431) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 11 23:13:35.620038 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0617(s), this was the 1st time calling it. {{(pid=98431) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 11 23:13:35.620196 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98431) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 11 23:13:35.657203 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:35.659290 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:35.679205 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:13:35.702389 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Emitting event Resumed> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:13:35.702389 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f] VM Resumed (Lifecycle Event) Jun 11 23:13:35.711565 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: 67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f] Took 18.88 seconds to build instance. Jun 11 23:13:35.727119 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-ac735395-919d-485a-9cba-b3c8b72bf35c req-d4f367ac-1061-4010-961d-acbefcc62965 service nova] [instance: 67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f] Received event network-vif-plugged-59f62261-8a42-4e76-9609-68343996250d {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:13:35.727119 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-ac735395-919d-485a-9cba-b3c8b72bf35c req-d4f367ac-1061-4010-961d-acbefcc62965 service nova] Acquiring lock "67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:35.727119 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-ac735395-919d-485a-9cba-b3c8b72bf35c req-d4f367ac-1061-4010-961d-acbefcc62965 service nova] Lock "67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:35.727119 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-ac735395-919d-485a-9cba-b3c8b72bf35c req-d4f367ac-1061-4010-961d-acbefcc62965 service nova] Lock "67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:35.727119 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-ac735395-919d-485a-9cba-b3c8b72bf35c req-d4f367ac-1061-4010-961d-acbefcc62965 service nova] [instance: 67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f] No waiting events found dispatching network-vif-plugged-59f62261-8a42-4e76-9609-68343996250d {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:13:35.727119 np0000002687 nova-compute[98431]: WARNING nova.compute.manager [req-ac735395-919d-485a-9cba-b3c8b72bf35c req-d4f367ac-1061-4010-961d-acbefcc62965 service nova] [instance: 67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f] Received unexpected event network-vif-plugged-59f62261-8a42-4e76-9609-68343996250d for instance with vm_state active and task_state None. Jun 11 23:13:35.807823 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:35.837875 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:35.852465 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:35.894531 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:36.015201 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:36.024023 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:36.067273 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:36.118450 np0000002687 nova-compute[98431]: DEBUG nova.scheduler.client.report [None req-4ed7a9fd-47f6-4b91-be24-b696520bc0cd tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Inventory has not changed for provider e3e65fe2-9de9-4821-8b4a-ccae37c66e25 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98431) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 11 23:13:36.132692 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:36.142162 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:36.182872 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:36.191197 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:36.211850 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:13:36.214729 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Lock "67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 20.393s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:36.218305 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:36.220368 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98431) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 11 23:13:36.232040 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:36.279974 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:36.295408 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:36.367843 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:36.371629 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:36.424794 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:36.454820 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:36.462891 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:36.464395 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-3fec231c-a086-46db-86d7-d89ab98f1f28 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: 67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f] Rescuing Jun 11 23:13:36.464851 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-3fec231c-a086-46db-86d7-d89ab98f1f28 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Acquiring lock "refresh_cache-67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 11 23:13:36.465014 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-3fec231c-a086-46db-86d7-d89ab98f1f28 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Acquired lock "refresh_cache-67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 11 23:13:36.465223 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-3fec231c-a086-46db-86d7-d89ab98f1f28 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: 67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f] Building network info cache for instance {{(pid=98431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 11 23:13:36.588599 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:36.604290 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.iscsi [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 11 23:13:36.623513 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.iscsi [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 11 23:13:36.627124 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 11 23:13:36.627124 np0000002687 nova-compute[98431]: node.name = iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979 Jun 11 23:13:36.627124 np0000002687 nova-compute[98431]: node.tpgt = -1 Jun 11 23:13:36.627124 np0000002687 nova-compute[98431]: node.startup = manual Jun 11 23:13:36.627124 np0000002687 nova-compute[98431]: node.leading_login = No Jun 11 23:13:36.627124 np0000002687 nova-compute[98431]: iface.iscsi_ifacename = default Jun 11 23:13:36.627124 np0000002687 nova-compute[98431]: iface.net_ifacename = Jun 11 23:13:36.627124 np0000002687 nova-compute[98431]: iface.ipaddress = Jun 11 23:13:36.627124 np0000002687 nova-compute[98431]: iface.prefix_len = 0 Jun 11 23:13:36.627124 np0000002687 nova-compute[98431]: iface.hwaddress = Jun 11 23:13:36.627124 np0000002687 nova-compute[98431]: iface.transport_name = tcp Jun 11 23:13:36.627124 np0000002687 nova-compute[98431]: iface.initiatorname = Jun 11 23:13:36.627124 np0000002687 nova-compute[98431]: iface.state = Jun 11 23:13:36.627124 np0000002687 nova-compute[98431]: iface.vlan_id = 0 Jun 11 23:13:36.627124 np0000002687 nova-compute[98431]: iface.vlan_priority = 0 Jun 11 23:13:36.627124 np0000002687 nova-compute[98431]: iface.vlan_state = Jun 11 23:13:36.627124 np0000002687 nova-compute[98431]: iface.iface_num = 0 Jun 11 23:13:36.627124 np0000002687 nova-compute[98431]: iface.mtu = 0 Jun 11 23:13:36.627124 np0000002687 nova-compute[98431]: iface.port = 0 Jun 11 23:13:36.627124 np0000002687 nova-compute[98431]: iface.bootproto = Jun 11 23:13:36.627124 np0000002687 nova-compute[98431]: iface.subnet_mask = Jun 11 23:13:36.627124 np0000002687 nova-compute[98431]: iface.gateway = Jun 11 23:13:36.627124 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id_state = Jun 11 23:13:36.627124 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id = Jun 11 23:13:36.627124 np0000002687 nova-compute[98431]: iface.dhcp_dns = Jun 11 23:13:36.627124 np0000002687 nova-compute[98431]: iface.dhcp_learn_iqn = Jun 11 23:13:36.627124 np0000002687 nova-compute[98431]: iface.dhcp_req_vendor_id_state = Jun 11 23:13:36.627124 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id_state = Jun 11 23:13:36.627124 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id = Jun 11 23:13:36.627124 np0000002687 nova-compute[98431]: iface.dhcp_slp_da = Jun 11 23:13:36.627124 np0000002687 nova-compute[98431]: iface.fragmentation = Jun 11 23:13:36.627124 np0000002687 nova-compute[98431]: iface.gratuitous_arp = Jun 11 23:13:36.627124 np0000002687 nova-compute[98431]: iface.incoming_forwarding = Jun 11 23:13:36.627124 np0000002687 nova-compute[98431]: iface.tos_state = Jun 11 23:13:36.627124 np0000002687 nova-compute[98431]: iface.tos = 0 Jun 11 23:13:36.627124 np0000002687 nova-compute[98431]: iface.ttl = 0 Jun 11 23:13:36.627124 np0000002687 nova-compute[98431]: iface.delayed_ack = Jun 11 23:13:36.627124 np0000002687 nova-compute[98431]: iface.tcp_nagle = Jun 11 23:13:36.627124 np0000002687 nova-compute[98431]: iface.tcp_wsf_state = Jun 11 23:13:36.627124 np0000002687 nova-compute[98431]: iface.tcp_wsf = 0 Jun 11 23:13:36.627124 np0000002687 nova-compute[98431]: iface.tcp_timer_scale = 0 Jun 11 23:13:36.627124 np0000002687 nova-compute[98431]: iface.tcp_timestamp = Jun 11 23:13:36.627124 np0000002687 nova-compute[98431]: iface.redirect = Jun 11 23:13:36.627124 np0000002687 nova-compute[98431]: iface.def_task_mgmt_timeout = 0 Jun 11 23:13:36.627124 np0000002687 nova-compute[98431]: iface.header_digest = Jun 11 23:13:36.627124 np0000002687 nova-compute[98431]: iface.data_digest = Jun 11 23:13:36.627124 np0000002687 nova-compute[98431]: iface.immediate_data = Jun 11 23:13:36.627124 np0000002687 nova-compute[98431]: iface.initial_r2t = Jun 11 23:13:36.627124 np0000002687 nova-compute[98431]: iface.data_seq_inorder = Jun 11 23:13:36.627124 np0000002687 nova-compute[98431]: iface.data_pdu_inorder = Jun 11 23:13:36.627124 np0000002687 nova-compute[98431]: iface.erl = 0 Jun 11 23:13:36.627124 np0000002687 nova-compute[98431]: iface.max_receive_data_len = 0 Jun 11 23:13:36.627124 np0000002687 nova-compute[98431]: iface.first_burst_len = 0 Jun 11 23:13:36.627124 np0000002687 nova-compute[98431]: iface.max_outstanding_r2t = 0 Jun 11 23:13:36.627124 np0000002687 nova-compute[98431]: iface.max_burst_len = 0 Jun 11 23:13:36.627124 np0000002687 nova-compute[98431]: iface.chap_auth = Jun 11 23:13:36.627124 np0000002687 nova-compute[98431]: iface.bidi_chap = Jun 11 23:13:36.627124 np0000002687 nova-compute[98431]: iface.strict_login_compliance = Jun 11 23:13:36.627124 np0000002687 nova-compute[98431]: iface.discovery_auth = Jun 11 23:13:36.627124 np0000002687 nova-compute[98431]: iface.discovery_logout = Jun 11 23:13:36.627124 np0000002687 nova-compute[98431]: node.discovery_address = Jun 11 23:13:36.627124 np0000002687 nova-compute[98431]: node.discovery_port = 0 Jun 11 23:13:36.627124 np0000002687 nova-compute[98431]: node.discovery_type = fw Jun 11 23:13:36.627124 np0000002687 nova-compute[98431]: node.session.initial_cmdsn = 0 Jun 11 23:13:36.627124 np0000002687 nova-compute[98431]: node.session.initial_login_retry_max = 8 Jun 11 23:13:36.627124 np0000002687 nova-compute[98431]: node.session.xmit_thread_priority = 0 Jun 11 23:13:36.627124 np0000002687 nova-compute[98431]: node.session.cmds_max = 128 Jun 11 23:13:36.627124 np0000002687 nova-compute[98431]: node.session.queue_depth = 32 Jun 11 23:13:36.627124 np0000002687 nova-compute[98431]: node.session.nr_sessions = 1 Jun 11 23:13:36.627124 np0000002687 nova-compute[98431]: node.session.auth.authmethod = None Jun 11 23:13:36.627124 np0000002687 nova-compute[98431]: node.session.auth.username = Jun 11 23:13:36.627124 np0000002687 nova-compute[98431]: node.session.auth.password = *** Jun 11 23:13:36.627124 np0000002687 nova-compute[98431]: node.session.auth.username_in = Jun 11 23:13:36.627124 np0000002687 nova-compute[98431]: node.session.auth.password_in = Jun 11 23:13:36.627124 np0000002687 nova-compute[98431]: node.session.auth.chap_algs = SHA256 Jun 11 23:13:36.627124 np0000002687 nova-compute[98431]: node.session.timeo.replacement_timeout = 120 Jun 11 23:13:36.627124 np0000002687 nova-compute[98431]: node.session.err_timeo.abort_timeout = 15 Jun 11 23:13:36.627124 np0000002687 nova-compute[98431]: node.session.err_timeo.lu_reset_timeout = 30 Jun 11 23:13:36.627124 np0000002687 nova-compute[98431]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 11 23:13:36.627124 np0000002687 nova-compute[98431]: node.session.err_timeo.host_reset_timeout = 60 Jun 11 23:13:36.627124 np0000002687 nova-compute[98431]: node.session.iscsi.FastAbort = Yes Jun 11 23:13:36.627124 np0000002687 nova-compute[98431]: node.session.iscsi.InitialR2T = No Jun 11 23:13:36.627124 np0000002687 nova-compute[98431]: node.session.iscsi.ImmediateData = Yes Jun 11 23:13:36.627124 np0000002687 nova-compute[98431]: node.session.iscsi.FirstBurstLength = 262144 Jun 11 23:13:36.627124 np0000002687 nova-compute[98431]: node.session.iscsi.MaxBurstLength = 16776192 Jun 11 23:13:36.627124 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Retain = 0 Jun 11 23:13:36.627124 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Wait = 2 Jun 11 23:13:36.627124 np0000002687 nova-compute[98431]: node.session.iscsi.MaxConnections = 1 Jun 11 23:13:36.627124 np0000002687 nova-compute[98431]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 11 23:13:36.627124 np0000002687 nova-compute[98431]: node.session.iscsi.ERL = 0 Jun 11 23:13:36.627124 np0000002687 nova-compute[98431]: node.session.scan = auto Jun 11 23:13:36.627124 np0000002687 nova-compute[98431]: node.session.reopen_max = 0 Jun 11 23:13:36.627124 np0000002687 nova-compute[98431]: node.conn[0].address = 192.168.40.100 Jun 11 23:13:36.627124 np0000002687 nova-compute[98431]: node.conn[0].port = 3260 Jun 11 23:13:36.627124 np0000002687 nova-compute[98431]: node.conn[0].startup = manual Jun 11 23:13:36.627124 np0000002687 nova-compute[98431]: node.conn[0].tcp.window_size = 524288 Jun 11 23:13:36.627124 np0000002687 nova-compute[98431]: node.conn[0].tcp.type_of_service = 0 Jun 11 23:13:36.627124 np0000002687 nova-compute[98431]: node.conn[0].timeo.logout_timeout = 15 Jun 11 23:13:36.627124 np0000002687 nova-compute[98431]: node.conn[0].timeo.login_timeout = 15 Jun 11 23:13:36.627124 np0000002687 nova-compute[98431]: node.conn[0].timeo.auth_timeout = 45 Jun 11 23:13:36.627124 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_interval = 5 Jun 11 23:13:36.627124 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_timeout = 5 Jun 11 23:13:36.627124 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 11 23:13:36.627124 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 11 23:13:36.627124 np0000002687 nova-compute[98431]: node.conn[0].iscsi.HeaderDigest = None Jun 11 23:13:36.627124 np0000002687 nova-compute[98431]: node.conn[0].iscsi.DataDigest = None Jun 11 23:13:36.627124 np0000002687 nova-compute[98431]: node.conn[0].iscsi.IFMarker = No Jun 11 23:13:36.627124 np0000002687 nova-compute[98431]: node.conn[0].iscsi.OFMarker = No Jun 11 23:13:36.627124 np0000002687 nova-compute[98431]: # END RECORD Jun 11 23:13:36.627124 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:13:36.633559 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-4ed7a9fd-47f6-4b91-be24-b696520bc0cd tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 2.070s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:36.639111 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 1.963s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:36.640565 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 11 23:13:36.640565 np0000002687 nova-compute[98431]: node.name = iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979 Jun 11 23:13:36.640565 np0000002687 nova-compute[98431]: node.tpgt = -1 Jun 11 23:13:36.640565 np0000002687 nova-compute[98431]: node.startup = manual Jun 11 23:13:36.640565 np0000002687 nova-compute[98431]: node.leading_login = No Jun 11 23:13:36.640565 np0000002687 nova-compute[98431]: iface.iscsi_ifacename = default Jun 11 23:13:36.640565 np0000002687 nova-compute[98431]: iface.net_ifacename = Jun 11 23:13:36.640565 np0000002687 nova-compute[98431]: iface.ipaddress = Jun 11 23:13:36.640565 np0000002687 nova-compute[98431]: iface.prefix_len = 0 Jun 11 23:13:36.640565 np0000002687 nova-compute[98431]: iface.hwaddress = Jun 11 23:13:36.640565 np0000002687 nova-compute[98431]: iface.transport_name = tcp Jun 11 23:13:36.640565 np0000002687 nova-compute[98431]: iface.initiatorname = Jun 11 23:13:36.640565 np0000002687 nova-compute[98431]: iface.state = Jun 11 23:13:36.640565 np0000002687 nova-compute[98431]: iface.vlan_id = 0 Jun 11 23:13:36.640565 np0000002687 nova-compute[98431]: iface.vlan_priority = 0 Jun 11 23:13:36.640565 np0000002687 nova-compute[98431]: iface.vlan_state = Jun 11 23:13:36.640565 np0000002687 nova-compute[98431]: iface.iface_num = 0 Jun 11 23:13:36.640565 np0000002687 nova-compute[98431]: iface.mtu = 0 Jun 11 23:13:36.640565 np0000002687 nova-compute[98431]: iface.port = 0 Jun 11 23:13:36.640565 np0000002687 nova-compute[98431]: iface.bootproto = Jun 11 23:13:36.640565 np0000002687 nova-compute[98431]: iface.subnet_mask = Jun 11 23:13:36.640565 np0000002687 nova-compute[98431]: iface.gateway = Jun 11 23:13:36.640565 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id_state = Jun 11 23:13:36.640565 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id = Jun 11 23:13:36.640565 np0000002687 nova-compute[98431]: iface.dhcp_dns = Jun 11 23:13:36.640565 np0000002687 nova-compute[98431]: iface.dhcp_learn_iqn = Jun 11 23:13:36.640565 np0000002687 nova-compute[98431]: iface.dhcp_req_vendor_id_state = Jun 11 23:13:36.640565 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id_state = Jun 11 23:13:36.640565 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id = Jun 11 23:13:36.640565 np0000002687 nova-compute[98431]: iface.dhcp_slp_da = Jun 11 23:13:36.640565 np0000002687 nova-compute[98431]: iface.fragmentation = Jun 11 23:13:36.640565 np0000002687 nova-compute[98431]: iface.gratuitous_arp = Jun 11 23:13:36.640565 np0000002687 nova-compute[98431]: iface.incoming_forwarding = Jun 11 23:13:36.640565 np0000002687 nova-compute[98431]: iface.tos_state = Jun 11 23:13:36.640565 np0000002687 nova-compute[98431]: iface.tos = 0 Jun 11 23:13:36.640565 np0000002687 nova-compute[98431]: iface.ttl = 0 Jun 11 23:13:36.640565 np0000002687 nova-compute[98431]: iface.delayed_ack = Jun 11 23:13:36.640565 np0000002687 nova-compute[98431]: iface.tcp_nagle = Jun 11 23:13:36.640565 np0000002687 nova-compute[98431]: iface.tcp_wsf_state = Jun 11 23:13:36.640565 np0000002687 nova-compute[98431]: iface.tcp_wsf = 0 Jun 11 23:13:36.640565 np0000002687 nova-compute[98431]: iface.tcp_timer_scale = 0 Jun 11 23:13:36.640565 np0000002687 nova-compute[98431]: iface.tcp_timestamp = Jun 11 23:13:36.640565 np0000002687 nova-compute[98431]: iface.redirect = Jun 11 23:13:36.640565 np0000002687 nova-compute[98431]: iface.def_task_mgmt_timeout = 0 Jun 11 23:13:36.640565 np0000002687 nova-compute[98431]: iface.header_digest = Jun 11 23:13:36.640565 np0000002687 nova-compute[98431]: iface.data_digest = Jun 11 23:13:36.640565 np0000002687 nova-compute[98431]: iface.immediate_data = Jun 11 23:13:36.640565 np0000002687 nova-compute[98431]: iface.initial_r2t = Jun 11 23:13:36.640565 np0000002687 nova-compute[98431]: iface.data_seq_inorder = Jun 11 23:13:36.640565 np0000002687 nova-compute[98431]: iface.data_pdu_inorder = Jun 11 23:13:36.640565 np0000002687 nova-compute[98431]: iface.erl = 0 Jun 11 23:13:36.640565 np0000002687 nova-compute[98431]: iface.max_receive_data_len = 0 Jun 11 23:13:36.640565 np0000002687 nova-compute[98431]: iface.first_burst_len = 0 Jun 11 23:13:36.640565 np0000002687 nova-compute[98431]: iface.max_outstanding_r2t = 0 Jun 11 23:13:36.640565 np0000002687 nova-compute[98431]: iface.max_burst_len = 0 Jun 11 23:13:36.640565 np0000002687 nova-compute[98431]: iface.chap_auth = Jun 11 23:13:36.640565 np0000002687 nova-compute[98431]: iface.bidi_chap = Jun 11 23:13:36.640565 np0000002687 nova-compute[98431]: iface.strict_login_compliance = Jun 11 23:13:36.640565 np0000002687 nova-compute[98431]: iface.discovery_auth = Jun 11 23:13:36.640565 np0000002687 nova-compute[98431]: iface.discovery_logout = Jun 11 23:13:36.640565 np0000002687 nova-compute[98431]: node.discovery_address = Jun 11 23:13:36.640565 np0000002687 nova-compute[98431]: node.discovery_port = 0 Jun 11 23:13:36.640565 np0000002687 nova-compute[98431]: node.discovery_type = fw Jun 11 23:13:36.640565 np0000002687 nova-compute[98431]: node.session.initial_cmdsn = 0 Jun 11 23:13:36.640565 np0000002687 nova-compute[98431]: node.session.initial_login_retry_max = 8 Jun 11 23:13:36.640565 np0000002687 nova-compute[98431]: node.session.xmit_thread_priority = 0 Jun 11 23:13:36.640565 np0000002687 nova-compute[98431]: node.session.cmds_max = 128 Jun 11 23:13:36.640565 np0000002687 nova-compute[98431]: node.session.queue_depth = 32 Jun 11 23:13:36.640565 np0000002687 nova-compute[98431]: node.session.nr_sessions = 1 Jun 11 23:13:36.640565 np0000002687 nova-compute[98431]: node.session.auth.authmethod = None Jun 11 23:13:36.640565 np0000002687 nova-compute[98431]: node.session.auth.username = Jun 11 23:13:36.640565 np0000002687 nova-compute[98431]: node.session.auth.password = *** Jun 11 23:13:36.640565 np0000002687 nova-compute[98431]: node.session.auth.username_in = Jun 11 23:13:36.640565 np0000002687 nova-compute[98431]: node.session.auth.password_in = Jun 11 23:13:36.640565 np0000002687 nova-compute[98431]: node.session.auth.chap_algs = SHA256 Jun 11 23:13:36.640565 np0000002687 nova-compute[98431]: node.session.timeo.replacement_timeout = 120 Jun 11 23:13:36.640565 np0000002687 nova-compute[98431]: node.session.err_timeo.abort_timeout = 15 Jun 11 23:13:36.640565 np0000002687 nova-compute[98431]: node.session.err_timeo.lu_reset_timeout = 30 Jun 11 23:13:36.640565 np0000002687 nova-compute[98431]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 11 23:13:36.640565 np0000002687 nova-compute[98431]: node.session.err_timeo.host_reset_timeout = 60 Jun 11 23:13:36.640565 np0000002687 nova-compute[98431]: node.session.iscsi.FastAbort = Yes Jun 11 23:13:36.640565 np0000002687 nova-compute[98431]: node.session.iscsi.InitialR2T = No Jun 11 23:13:36.640565 np0000002687 nova-compute[98431]: node.session.iscsi.ImmediateData = Yes Jun 11 23:13:36.640565 np0000002687 nova-compute[98431]: node.session.iscsi.FirstBurstLength = 262144 Jun 11 23:13:36.640565 np0000002687 nova-compute[98431]: node.session.iscsi.MaxBurstLength = 16776192 Jun 11 23:13:36.640565 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Retain = 0 Jun 11 23:13:36.640565 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Wait = 2 Jun 11 23:13:36.640565 np0000002687 nova-compute[98431]: node.session.iscsi.MaxConnections = 1 Jun 11 23:13:36.640565 np0000002687 nova-compute[98431]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 11 23:13:36.640565 np0000002687 nova-compute[98431]: node.session.iscsi.ERL = 0 Jun 11 23:13:36.640565 np0000002687 nova-compute[98431]: node.session.scan = auto Jun 11 23:13:36.640565 np0000002687 nova-compute[98431]: node.session.reopen_max = 0 Jun 11 23:13:36.640565 np0000002687 nova-compute[98431]: node.conn[0].address = 192.168.50.100 Jun 11 23:13:36.640565 np0000002687 nova-compute[98431]: node.conn[0].port = 3260 Jun 11 23:13:36.640565 np0000002687 nova-compute[98431]: node.conn[0].startup = manual Jun 11 23:13:36.640565 np0000002687 nova-compute[98431]: node.conn[0].tcp.window_size = 524288 Jun 11 23:13:36.640565 np0000002687 nova-compute[98431]: node.conn[0].tcp.type_of_service = 0 Jun 11 23:13:36.640565 np0000002687 nova-compute[98431]: node.conn[0].timeo.logout_timeout = 15 Jun 11 23:13:36.640565 np0000002687 nova-compute[98431]: node.conn[0].timeo.login_timeout = 15 Jun 11 23:13:36.640565 np0000002687 nova-compute[98431]: node.conn[0].timeo.auth_timeout = 45 Jun 11 23:13:36.640565 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_interval = 5 Jun 11 23:13:36.640565 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_timeout = 5 Jun 11 23:13:36.640565 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 11 23:13:36.640565 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 11 23:13:36.640565 np0000002687 nova-compute[98431]: node.conn[0].iscsi.HeaderDigest = None Jun 11 23:13:36.640565 np0000002687 nova-compute[98431]: node.conn[0].iscsi.DataDigest = None Jun 11 23:13:36.640565 np0000002687 nova-compute[98431]: node.conn[0].iscsi.IFMarker = No Jun 11 23:13:36.640565 np0000002687 nova-compute[98431]: node.conn[0].iscsi.OFMarker = No Jun 11 23:13:36.640565 np0000002687 nova-compute[98431]: # END RECORD Jun 11 23:13:36.640565 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:13:36.647294 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:13:36.670770 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:36.670770 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:36.670770 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:36.670770 np0000002687 nova-compute[98431]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:13:36.670770 np0000002687 nova-compute[98431]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:13:36.670770 np0000002687 nova-compute[98431]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:13:36.670770 np0000002687 nova-compute[98431]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:13:36.670770 np0000002687 nova-compute[98431]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8 (non-flash) Jun 11 23:13:36.670770 np0000002687 nova-compute[98431]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8 (non-flash) Jun 11 23:13:36.670770 np0000002687 nova-compute[98431]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13 (non-flash) Jun 11 23:13:36.670770 np0000002687 nova-compute[98431]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13 (non-flash) Jun 11 23:13:36.670770 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:36.670770 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:13:36.671857 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] iscsi session list stdout=tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:36.671857 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:36.671857 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:36.671857 np0000002687 nova-compute[98431]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:13:36.671857 np0000002687 nova-compute[98431]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:13:36.671857 np0000002687 nova-compute[98431]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:13:36.671857 np0000002687 nova-compute[98431]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:13:36.671857 np0000002687 nova-compute[98431]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8 (non-flash) Jun 11 23:13:36.671857 np0000002687 nova-compute[98431]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8 (non-flash) Jun 11 23:13:36.671857 np0000002687 nova-compute[98431]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13 (non-flash) Jun 11 23:13:36.671857 np0000002687 nova-compute[98431]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13 (non-flash) Jun 11 23:13:36.671857 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:36.671857 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:13:36.671857 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:13:36.720341 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:36.720341 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:36.720341 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:36.720341 np0000002687 nova-compute[98431]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:13:36.720341 np0000002687 nova-compute[98431]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:13:36.720341 np0000002687 nova-compute[98431]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:13:36.720341 np0000002687 nova-compute[98431]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:13:36.720341 np0000002687 nova-compute[98431]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8 (non-flash) Jun 11 23:13:36.720341 np0000002687 nova-compute[98431]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8 (non-flash) Jun 11 23:13:36.720341 np0000002687 nova-compute[98431]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13 (non-flash) Jun 11 23:13:36.720341 np0000002687 nova-compute[98431]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13 (non-flash) Jun 11 23:13:36.720341 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:36.720341 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:13:36.720341 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] iscsi session list stdout=tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:36.720341 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:36.720341 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:36.720341 np0000002687 nova-compute[98431]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:13:36.720341 np0000002687 nova-compute[98431]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:13:36.720341 np0000002687 nova-compute[98431]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:13:36.720341 np0000002687 nova-compute[98431]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:13:36.720341 np0000002687 nova-compute[98431]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8 (non-flash) Jun 11 23:13:36.720341 np0000002687 nova-compute[98431]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8 (non-flash) Jun 11 23:13:36.720341 np0000002687 nova-compute[98431]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13 (non-flash) Jun 11 23:13:36.720341 np0000002687 nova-compute[98431]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13 (non-flash) Jun 11 23:13:36.720341 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:36.720341 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:13:36.729579 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f] During sync_power_state the instance has a pending task (rescuing). Skip. Jun 11 23:13:36.744647 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979, portal: 192.168.40.100,3260] Jun 11 23:13:36.744647 np0000002687 nova-compute[98431]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979, portal: 192.168.40.100,3260] successful. Jun 11 23:13:36.744647 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:13:36.758131 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-f4c18d46-e77e-4f5d-9aa0-b7754ab05d17 req-e96766e3-c0aa-487a-bbb8-4262b6f0a4f4 service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Received event network-vif-plugged-5f9094e3-a3c6-48ea-bfbe-4fa25d19bcf2 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:13:36.758131 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-f4c18d46-e77e-4f5d-9aa0-b7754ab05d17 req-e96766e3-c0aa-487a-bbb8-4262b6f0a4f4 service nova] Acquiring lock "1d45c7ce-5760-4f59-9921-feb3e589da8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:36.759500 np0000002687 nova-compute[98431]: INFO nova.scheduler.client.report [None req-4ed7a9fd-47f6-4b91-be24-b696520bc0cd tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Deleted allocations for instance 0d352738-c7bf-42a2-8260-bf5574a7200d Jun 11 23:13:36.761635 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-f4c18d46-e77e-4f5d-9aa0-b7754ab05d17 req-e96766e3-c0aa-487a-bbb8-4262b6f0a4f4 service nova] Lock "1d45c7ce-5760-4f59-9921-feb3e589da8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:36.765166 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-f4c18d46-e77e-4f5d-9aa0-b7754ab05d17 req-e96766e3-c0aa-487a-bbb8-4262b6f0a4f4 service nova] Lock "1d45c7ce-5760-4f59-9921-feb3e589da8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.004s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:36.765166 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-f4c18d46-e77e-4f5d-9aa0-b7754ab05d17 req-e96766e3-c0aa-487a-bbb8-4262b6f0a4f4 service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Processing event network-vif-plugged-5f9094e3-a3c6-48ea-bfbe-4fa25d19bcf2 {{(pid=98431) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 11 23:13:36.784730 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:13:36.798259 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979, portal: 192.168.50.100,3260] Jun 11 23:13:36.798259 np0000002687 nova-compute[98431]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979, portal: 192.168.50.100,3260] successful. Jun 11 23:13:36.798259 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:13:36.809545 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:36.809545 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:36.809545 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:36.809545 np0000002687 nova-compute[98431]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:13:36.809545 np0000002687 nova-compute[98431]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:13:36.809545 np0000002687 nova-compute[98431]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:13:36.809545 np0000002687 nova-compute[98431]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:13:36.809545 np0000002687 nova-compute[98431]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8 (non-flash) Jun 11 23:13:36.809545 np0000002687 nova-compute[98431]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8 (non-flash) Jun 11 23:13:36.809545 np0000002687 nova-compute[98431]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13 (non-flash) Jun 11 23:13:36.809545 np0000002687 nova-compute[98431]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13 (non-flash) Jun 11 23:13:36.809545 np0000002687 nova-compute[98431]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979 (non-flash) Jun 11 23:13:36.809545 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:36.809545 np0000002687 nova-compute[98431]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979 (non-flash) Jun 11 23:13:36.809545 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:13:36.810033 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] iscsi session list stdout=tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:36.810033 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:36.810033 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:36.810033 np0000002687 nova-compute[98431]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:13:36.810033 np0000002687 nova-compute[98431]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:13:36.810033 np0000002687 nova-compute[98431]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:13:36.810033 np0000002687 nova-compute[98431]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:13:36.810033 np0000002687 nova-compute[98431]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8 (non-flash) Jun 11 23:13:36.810033 np0000002687 nova-compute[98431]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8 (non-flash) Jun 11 23:13:36.810033 np0000002687 nova-compute[98431]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13 (non-flash) Jun 11 23:13:36.810033 np0000002687 nova-compute[98431]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13 (non-flash) Jun 11 23:13:36.810033 np0000002687 nova-compute[98431]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979 (non-flash) Jun 11 23:13:36.810033 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:36.810033 np0000002687 nova-compute[98431]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979 (non-flash) Jun 11 23:13:36.810033 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:13:36.810033 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.254s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 11 23:13:36.810387 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Connected to 192.168.40.100:3260 {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 11 23:13:36.811597 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] HCTL ('11', '-', '-', 0) found on session 39 with lun 0 {{(pid=98431) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 11 23:13:36.811782 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98431) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 11 23:13:36.821537 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:13:36.833902 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Searching for a device in session 39 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98431) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 11 23:13:36.833902 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2f2d8ccb-5d26-4f0b-bc60-abf6355bf979', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 11 23:13:36.851906 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:36.852915 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:36.852915 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:36.852915 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:36.852915 np0000002687 nova-compute[98431]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:13:36.852915 np0000002687 nova-compute[98431]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:13:36.852915 np0000002687 nova-compute[98431]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:13:36.852915 np0000002687 nova-compute[98431]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:13:36.852915 np0000002687 nova-compute[98431]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8 (non-flash) Jun 11 23:13:36.852915 np0000002687 nova-compute[98431]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8 (non-flash) Jun 11 23:13:36.852915 np0000002687 nova-compute[98431]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13 (non-flash) Jun 11 23:13:36.852915 np0000002687 nova-compute[98431]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13 (non-flash) Jun 11 23:13:36.852915 np0000002687 nova-compute[98431]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979 (non-flash) Jun 11 23:13:36.852915 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:36.852915 np0000002687 nova-compute[98431]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979 (non-flash) Jun 11 23:13:36.852915 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:13:36.855374 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] iscsi session list stdout=tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:36.855374 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:36.855374 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:36.855374 np0000002687 nova-compute[98431]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:13:36.855374 np0000002687 nova-compute[98431]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:13:36.855374 np0000002687 nova-compute[98431]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:13:36.855374 np0000002687 nova-compute[98431]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:13:36.855374 np0000002687 nova-compute[98431]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8 (non-flash) Jun 11 23:13:36.855374 np0000002687 nova-compute[98431]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8 (non-flash) Jun 11 23:13:36.855374 np0000002687 nova-compute[98431]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13 (non-flash) Jun 11 23:13:36.855374 np0000002687 nova-compute[98431]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13 (non-flash) Jun 11 23:13:36.855374 np0000002687 nova-compute[98431]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979 (non-flash) Jun 11 23:13:36.855374 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:36.855374 np0000002687 nova-compute[98431]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979 (non-flash) Jun 11 23:13:36.855374 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:13:36.855374 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.297s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 11 23:13:36.855374 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Connected to 192.168.50.100:3260 {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 11 23:13:36.860085 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] HCTL ('12', '-', '-', 0) found on session 40 with lun 0 {{(pid=98431) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 11 23:13:36.860085 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98431) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 11 23:13:36.888826 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Searching for a device in session 40 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98431) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 11 23:13:36.888826 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '2f2d8ccb-5d26-4f0b-bc60-abf6355bf979', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 11 23:13:36.943988 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:36.948085 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:36.956132 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:36.971177 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-3fec231c-a086-46db-86d7-d89ab98f1f28 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:13:36.983619 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:37.154934 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98431) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 11 23:13:37.155205 np0000002687 nova-compute[98431]: INFO nova.compute.claims [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] Claim successful on node np0000002687 Jun 11 23:13:37.352230 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:37.503202 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:37.559883 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98431) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 11 23:13:37.561157 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:37.582650 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:37.584758 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:37.666441 np0000002687 nova-compute[98431]: INFO nova.compute.resource_tracker [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] Updating resource usage from migration 89fc30bc-f302-4da8-8ae9-4f890f4d2fe2 Jun 11 23:13:37.782151 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-4ed7a9fd-47f6-4b91-be24-b696520bc0cd tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lock "0d352738-c7bf-42a2-8260-bf5574a7200d" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 10.520s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:37.858586 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:37.858586 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:37.906423 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:37.916515 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Emitting event Started> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:13:37.917735 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] VM Started (Lifecycle Event) Jun 11 23:13:37.921812 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-e330d5f3-085a-402f-bbd3-564424b45268 req-3aea8fbb-ff0d-4962-a309-703eb5cf9829 service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Received event network-vif-plugged-fe1430ca-d60b-47c4-9ac9-96ba7d61f101 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:13:37.925441 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-e330d5f3-085a-402f-bbd3-564424b45268 req-3aea8fbb-ff0d-4962-a309-703eb5cf9829 service nova] Acquiring lock "1d45c7ce-5760-4f59-9921-feb3e589da8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:37.925664 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-e330d5f3-085a-402f-bbd3-564424b45268 req-3aea8fbb-ff0d-4962-a309-703eb5cf9829 service nova] Lock "1d45c7ce-5760-4f59-9921-feb3e589da8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:37.925816 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-e330d5f3-085a-402f-bbd3-564424b45268 req-3aea8fbb-ff0d-4962-a309-703eb5cf9829 service nova] Lock "1d45c7ce-5760-4f59-9921-feb3e589da8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:37.926301 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-e330d5f3-085a-402f-bbd3-564424b45268 req-3aea8fbb-ff0d-4962-a309-703eb5cf9829 service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Processing event network-vif-plugged-fe1430ca-d60b-47c4-9ac9-96ba7d61f101 {{(pid=98431) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 11 23:13:37.927306 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-e330d5f3-085a-402f-bbd3-564424b45268 req-3aea8fbb-ff0d-4962-a309-703eb5cf9829 service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Received event network-vif-plugged-fe1430ca-d60b-47c4-9ac9-96ba7d61f101 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:13:37.927488 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-e330d5f3-085a-402f-bbd3-564424b45268 req-3aea8fbb-ff0d-4962-a309-703eb5cf9829 service nova] Acquiring lock "1d45c7ce-5760-4f59-9921-feb3e589da8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:37.927925 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-e330d5f3-085a-402f-bbd3-564424b45268 req-3aea8fbb-ff0d-4962-a309-703eb5cf9829 service nova] Lock "1d45c7ce-5760-4f59-9921-feb3e589da8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:37.928954 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-e330d5f3-085a-402f-bbd3-564424b45268 req-3aea8fbb-ff0d-4962-a309-703eb5cf9829 service nova] Lock "1d45c7ce-5760-4f59-9921-feb3e589da8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:37.928954 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-e330d5f3-085a-402f-bbd3-564424b45268 req-3aea8fbb-ff0d-4962-a309-703eb5cf9829 service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] No event matching network-vif-plugged-fe1430ca-d60b-47c4-9ac9-96ba7d61f101 in dict_keys([('network-vif-plugged', 'a39a55c7-874a-4a19-a069-8383a5f0bc5a'), ('network-vif-plugged', '37aa7cee-88a0-4428-9b2d-45700f1dcab6'), ('network-vif-plugged', 'e3269961-a3f1-42c8-a49e-37f728b2f3d8'), ('network-vif-plugged', '351eaad5-bf70-43b4-8f79-5bc0027de663'), ('network-vif-plugged', '004fd6c0-58df-4ceb-9733-267396cae60c')]) {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jun 11 23:13:37.928954 np0000002687 nova-compute[98431]: WARNING nova.compute.manager [req-e330d5f3-085a-402f-bbd3-564424b45268 req-3aea8fbb-ff0d-4962-a309-703eb5cf9829 service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Received unexpected event network-vif-plugged-fe1430ca-d60b-47c4-9ac9-96ba7d61f101 for instance with vm_state building and task_state spawning. Jun 11 23:13:37.928954 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-e330d5f3-085a-402f-bbd3-564424b45268 req-3aea8fbb-ff0d-4962-a309-703eb5cf9829 service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Received event network-vif-plugged-a39a55c7-874a-4a19-a069-8383a5f0bc5a {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:13:37.928954 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-e330d5f3-085a-402f-bbd3-564424b45268 req-3aea8fbb-ff0d-4962-a309-703eb5cf9829 service nova] Acquiring lock "1d45c7ce-5760-4f59-9921-feb3e589da8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:37.929112 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-e330d5f3-085a-402f-bbd3-564424b45268 req-3aea8fbb-ff0d-4962-a309-703eb5cf9829 service nova] Lock "1d45c7ce-5760-4f59-9921-feb3e589da8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:37.929112 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-e330d5f3-085a-402f-bbd3-564424b45268 req-3aea8fbb-ff0d-4962-a309-703eb5cf9829 service nova] Lock "1d45c7ce-5760-4f59-9921-feb3e589da8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:37.929206 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-e330d5f3-085a-402f-bbd3-564424b45268 req-3aea8fbb-ff0d-4962-a309-703eb5cf9829 service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Processing event network-vif-plugged-a39a55c7-874a-4a19-a069-8383a5f0bc5a {{(pid=98431) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 11 23:13:38.322741 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:38.324626 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:38.331727 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:38.337351 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-3fec231c-a086-46db-86d7-d89ab98f1f28 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:13:38.357495 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:38.423332 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:13:38.431856 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Emitting event Paused> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:13:38.431856 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] VM Paused (Lifecycle Event) Jun 11 23:13:38.585614 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Found WWN 3300000009550c01f for multipath device dm-4 {{(pid=98431) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 11 23:13:38.586273 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.056s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 11 23:13:38.586479 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] <== connect_volume: return (3058ms) {'type': 'block', 'scsi_wwn': '3300000009550c01f', 'path': '/dev/dm-4', 'multipath_id': '3300000009550c01f'} {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 11 23:13:38.587110 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000009550c01f', 'path': '/dev/dm-4', 'multipath_id': '3300000009550c01f'} {{(pid=98431) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 11 23:13:38.681171 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-3fec231c-a086-46db-86d7-d89ab98f1f28 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: 67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f] Updating instance_info_cache with network_info: [{"id": "59f62261-8a42-4e76-9609-68343996250d", "address": "fa:16:3e:c2:8d:a4", "network": {"id": "77fc4e10-1fed-4963-86b4-1fbb3a9c6f7f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1105404274-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b2b9f55b231c455ca1a4579d7ed54888", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap59f62261-8a", "ovs_interfaceid": "59f62261-8a42-4e76-9609-68343996250d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:13:38.730301 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:38.769183 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98431) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 11 23:13:38.769401 np0000002687 nova-compute[98431]: DEBUG nova.compute.provider_tree [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Inventory has not changed in ProviderTree for provider: e3e65fe2-9de9-4821-8b4a-ccae37c66e25 {{(pid=98431) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 11 23:13:38.892417 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-78319164-ecca-4357-9e33-a236f258d5b6 req-828775ab-ffe9-45ca-8730-96b8c3ea7ebd service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Received event network-vif-plugged-5f9094e3-a3c6-48ea-bfbe-4fa25d19bcf2 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:13:38.892845 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-78319164-ecca-4357-9e33-a236f258d5b6 req-828775ab-ffe9-45ca-8730-96b8c3ea7ebd service nova] Acquiring lock "1d45c7ce-5760-4f59-9921-feb3e589da8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:38.894114 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-78319164-ecca-4357-9e33-a236f258d5b6 req-828775ab-ffe9-45ca-8730-96b8c3ea7ebd service nova] Lock "1d45c7ce-5760-4f59-9921-feb3e589da8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:38.894545 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-78319164-ecca-4357-9e33-a236f258d5b6 req-828775ab-ffe9-45ca-8730-96b8c3ea7ebd service nova] Lock "1d45c7ce-5760-4f59-9921-feb3e589da8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:38.894737 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-78319164-ecca-4357-9e33-a236f258d5b6 req-828775ab-ffe9-45ca-8730-96b8c3ea7ebd service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] No event matching network-vif-plugged-5f9094e3-a3c6-48ea-bfbe-4fa25d19bcf2 in dict_keys([('network-vif-plugged', '37aa7cee-88a0-4428-9b2d-45700f1dcab6'), ('network-vif-plugged', 'e3269961-a3f1-42c8-a49e-37f728b2f3d8'), ('network-vif-plugged', '351eaad5-bf70-43b4-8f79-5bc0027de663'), ('network-vif-plugged', '004fd6c0-58df-4ceb-9733-267396cae60c')]) {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jun 11 23:13:38.895124 np0000002687 nova-compute[98431]: WARNING nova.compute.manager [req-78319164-ecca-4357-9e33-a236f258d5b6 req-828775ab-ffe9-45ca-8730-96b8c3ea7ebd service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Received unexpected event network-vif-plugged-5f9094e3-a3c6-48ea-bfbe-4fa25d19bcf2 for instance with vm_state building and task_state spawning. Jun 11 23:13:38.895124 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-78319164-ecca-4357-9e33-a236f258d5b6 req-828775ab-ffe9-45ca-8730-96b8c3ea7ebd service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Received event network-vif-plugged-004fd6c0-58df-4ceb-9733-267396cae60c {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:13:38.895124 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-78319164-ecca-4357-9e33-a236f258d5b6 req-828775ab-ffe9-45ca-8730-96b8c3ea7ebd service nova] Acquiring lock "1d45c7ce-5760-4f59-9921-feb3e589da8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:38.895382 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-78319164-ecca-4357-9e33-a236f258d5b6 req-828775ab-ffe9-45ca-8730-96b8c3ea7ebd service nova] Lock "1d45c7ce-5760-4f59-9921-feb3e589da8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:38.895476 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-78319164-ecca-4357-9e33-a236f258d5b6 req-828775ab-ffe9-45ca-8730-96b8c3ea7ebd service nova] Lock "1d45c7ce-5760-4f59-9921-feb3e589da8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:38.896960 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-78319164-ecca-4357-9e33-a236f258d5b6 req-828775ab-ffe9-45ca-8730-96b8c3ea7ebd service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Processing event network-vif-plugged-004fd6c0-58df-4ceb-9733-267396cae60c {{(pid=98431) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 11 23:13:38.896960 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-78319164-ecca-4357-9e33-a236f258d5b6 req-828775ab-ffe9-45ca-8730-96b8c3ea7ebd service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Received event network-vif-plugged-004fd6c0-58df-4ceb-9733-267396cae60c {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:13:38.896960 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-78319164-ecca-4357-9e33-a236f258d5b6 req-828775ab-ffe9-45ca-8730-96b8c3ea7ebd service nova] Acquiring lock "1d45c7ce-5760-4f59-9921-feb3e589da8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:38.896960 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-78319164-ecca-4357-9e33-a236f258d5b6 req-828775ab-ffe9-45ca-8730-96b8c3ea7ebd service nova] Lock "1d45c7ce-5760-4f59-9921-feb3e589da8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:38.896960 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-78319164-ecca-4357-9e33-a236f258d5b6 req-828775ab-ffe9-45ca-8730-96b8c3ea7ebd service nova] Lock "1d45c7ce-5760-4f59-9921-feb3e589da8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:38.896960 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-78319164-ecca-4357-9e33-a236f258d5b6 req-828775ab-ffe9-45ca-8730-96b8c3ea7ebd service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] No event matching network-vif-plugged-004fd6c0-58df-4ceb-9733-267396cae60c in dict_keys([('network-vif-plugged', '37aa7cee-88a0-4428-9b2d-45700f1dcab6'), ('network-vif-plugged', 'e3269961-a3f1-42c8-a49e-37f728b2f3d8'), ('network-vif-plugged', '351eaad5-bf70-43b4-8f79-5bc0027de663')]) {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jun 11 23:13:38.896960 np0000002687 nova-compute[98431]: WARNING nova.compute.manager [req-78319164-ecca-4357-9e33-a236f258d5b6 req-828775ab-ffe9-45ca-8730-96b8c3ea7ebd service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Received unexpected event network-vif-plugged-004fd6c0-58df-4ceb-9733-267396cae60c for instance with vm_state building and task_state spawning. Jun 11 23:13:38.935169 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:13:38.939791 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98431) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 11 23:13:39.109349 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-11T23:11:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-872787611',display_name='tempest-ServerActionsTestOtherB-server-872787611',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='tempest-serveractionstestotherb-server-872787611',id=13,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE8GCNW5zoKlPJg2gDz6psGsk5eAwUwS5EcLVqi+Ws93aBM9mzyZ9OA4e5k8HR4bk5PDkKar3oCgqC2LYEZaaYcONGX+UXm8H5giZlXKo/6E9eZdQg2l6SXnZTdbPKM4Aw==',key_name='tempest-keypair-1789476090',keypairs=,launch_index=0,launched_at=2026-06-11T23:13:11Z,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000002687',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='62f47df2e0374879b837bc7431326e62',ramdisk_id='',reservation_id='r-92sxxj92',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1260316994',owner_user_name='tempest-ServerActionsTestOtherB-1260316994-project-member'},tags=,task_state='resize_reverting',terminated_at=None,trusted_certs=,updated_at=2026-06-11T23:13:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2b37a00a21a249339e412bcde7a87f82',uuid=7609742e-a3a2-4be2-ba02-227efb2101e1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "a1e7aeff-5992-43be-bb2c-d504e7019c64", "address": "fa:16:3e:1d:f7:18", "network": {"id": "710d3c5f-1a08-4a35-b3e1-e59f427989c2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2068802531-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62f47df2e0374879b837bc7431326e62", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1e7aeff-59", "ovs_interfaceid": "a1e7aeff-5992-43be-bb2c-d504e7019c64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98431) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 11 23:13:39.109619 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Converting VIF {"id": "a1e7aeff-5992-43be-bb2c-d504e7019c64", "address": "fa:16:3e:1d:f7:18", "network": {"id": "710d3c5f-1a08-4a35-b3e1-e59f427989c2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2068802531-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62f47df2e0374879b837bc7431326e62", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1e7aeff-59", "ovs_interfaceid": "a1e7aeff-5992-43be-bb2c-d504e7019c64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:13:39.110378 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:f7:18,bridge_name='br-int',has_traffic_filtering=True,id=a1e7aeff-5992-43be-bb2c-d504e7019c64,network=Network(710d3c5f-1a08-4a35-b3e1-e59f427989c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1e7aeff-59') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:13:39.112588 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] End _get_guest_xml xml= Jun 11 23:13:39.112588 np0000002687 nova-compute[98431]: 7609742e-a3a2-4be2-ba02-227efb2101e1 Jun 11 23:13:39.112588 np0000002687 nova-compute[98431]: instance-0000000d Jun 11 23:13:39.112588 np0000002687 nova-compute[98431]: 196608 Jun 11 23:13:39.112588 np0000002687 nova-compute[98431]: 1 Jun 11 23:13:39.112588 np0000002687 nova-compute[98431]: Jun 11 23:13:39.112588 np0000002687 nova-compute[98431]: Jun 11 23:13:39.112588 np0000002687 nova-compute[98431]: Jun 11 23:13:39.112588 np0000002687 nova-compute[98431]: tempest-ServerActionsTestOtherB-server-872787611 Jun 11 23:13:39.112588 np0000002687 nova-compute[98431]: 2026-06-11 23:13:34 Jun 11 23:13:39.112588 np0000002687 nova-compute[98431]: Jun 11 23:13:39.112588 np0000002687 nova-compute[98431]: 192 Jun 11 23:13:39.112588 np0000002687 nova-compute[98431]: 1 Jun 11 23:13:39.112588 np0000002687 nova-compute[98431]: 0 Jun 11 23:13:39.112588 np0000002687 nova-compute[98431]: 0 Jun 11 23:13:39.112588 np0000002687 nova-compute[98431]: 1 Jun 11 23:13:39.112588 np0000002687 nova-compute[98431]: Jun 11 23:13:39.112588 np0000002687 nova-compute[98431]: True Jun 11 23:13:39.112588 np0000002687 nova-compute[98431]: Jun 11 23:13:39.112588 np0000002687 nova-compute[98431]: Jun 11 23:13:39.112588 np0000002687 nova-compute[98431]: Jun 11 23:13:39.112588 np0000002687 nova-compute[98431]: bare Jun 11 23:13:39.112588 np0000002687 nova-compute[98431]: qcow2 Jun 11 23:13:39.112588 np0000002687 nova-compute[98431]: 1 Jun 11 23:13:39.112588 np0000002687 nova-compute[98431]: 0 Jun 11 23:13:39.112588 np0000002687 nova-compute[98431]: Jun 11 23:13:39.112588 np0000002687 nova-compute[98431]: ide Jun 11 23:13:39.112588 np0000002687 nova-compute[98431]: virtio Jun 11 23:13:39.112588 np0000002687 nova-compute[98431]: pc Jun 11 23:13:39.112588 np0000002687 nova-compute[98431]: virtio Jun 11 23:13:39.112588 np0000002687 nova-compute[98431]: virtio Jun 11 23:13:39.112588 np0000002687 nova-compute[98431]: virtio Jun 11 23:13:39.112588 np0000002687 nova-compute[98431]: Jun 11 23:13:39.112588 np0000002687 nova-compute[98431]: Jun 11 23:13:39.112588 np0000002687 nova-compute[98431]: Jun 11 23:13:39.112588 np0000002687 nova-compute[98431]: tempest-ServerActionsTestOtherB-1260316994-project-member Jun 11 23:13:39.112588 np0000002687 nova-compute[98431]: tempest-ServerActionsTestOtherB-1260316994 Jun 11 23:13:39.112588 np0000002687 nova-compute[98431]: Jun 11 23:13:39.112588 np0000002687 nova-compute[98431]: Jun 11 23:13:39.112588 np0000002687 nova-compute[98431]: Jun 11 23:13:39.112588 np0000002687 nova-compute[98431]: Jun 11 23:13:39.112588 np0000002687 nova-compute[98431]: Jun 11 23:13:39.112588 np0000002687 nova-compute[98431]: Jun 11 23:13:39.112588 np0000002687 nova-compute[98431]: Jun 11 23:13:39.112588 np0000002687 nova-compute[98431]: Jun 11 23:13:39.112588 np0000002687 nova-compute[98431]: Jun 11 23:13:39.112588 np0000002687 nova-compute[98431]: Jun 11 23:13:39.112588 np0000002687 nova-compute[98431]: Jun 11 23:13:39.112588 np0000002687 nova-compute[98431]: OpenStack Foundation Jun 11 23:13:39.112588 np0000002687 nova-compute[98431]: OpenStack Nova Jun 11 23:13:39.112588 np0000002687 nova-compute[98431]: 33.1.0 Jun 11 23:13:39.112588 np0000002687 nova-compute[98431]: 7609742e-a3a2-4be2-ba02-227efb2101e1 Jun 11 23:13:39.112588 np0000002687 nova-compute[98431]: 7609742e-a3a2-4be2-ba02-227efb2101e1 Jun 11 23:13:39.112588 np0000002687 nova-compute[98431]: Virtual Machine Jun 11 23:13:39.112588 np0000002687 nova-compute[98431]: Jun 11 23:13:39.112588 np0000002687 nova-compute[98431]: Jun 11 23:13:39.112588 np0000002687 nova-compute[98431]: Jun 11 23:13:39.112588 np0000002687 nova-compute[98431]: hvm Jun 11 23:13:39.112588 np0000002687 nova-compute[98431]: Jun 11 23:13:39.112588 np0000002687 nova-compute[98431]: Jun 11 23:13:39.112588 np0000002687 nova-compute[98431]: Jun 11 23:13:39.112588 np0000002687 nova-compute[98431]: Jun 11 23:13:39.112588 np0000002687 nova-compute[98431]: Jun 11 23:13:39.112588 np0000002687 nova-compute[98431]: Jun 11 23:13:39.112588 np0000002687 nova-compute[98431]: 128 Jun 11 23:13:39.112588 np0000002687 nova-compute[98431]: Jun 11 23:13:39.112588 np0000002687 nova-compute[98431]: Jun 11 23:13:39.112588 np0000002687 nova-compute[98431]: Jun 11 23:13:39.112588 np0000002687 nova-compute[98431]: 1 Jun 11 23:13:39.112588 np0000002687 nova-compute[98431]: Jun 11 23:13:39.112588 np0000002687 nova-compute[98431]: Jun 11 23:13:39.112588 np0000002687 nova-compute[98431]: Nehalem Jun 11 23:13:39.112588 np0000002687 nova-compute[98431]: Jun 11 23:13:39.112588 np0000002687 nova-compute[98431]: Jun 11 23:13:39.112588 np0000002687 nova-compute[98431]: Jun 11 23:13:39.112588 np0000002687 nova-compute[98431]: Jun 11 23:13:39.112588 np0000002687 nova-compute[98431]: Jun 11 23:13:39.112588 np0000002687 nova-compute[98431]: Jun 11 23:13:39.112588 np0000002687 nova-compute[98431]: Jun 11 23:13:39.112588 np0000002687 nova-compute[98431]: Jun 11 23:13:39.112588 np0000002687 nova-compute[98431]: Jun 11 23:13:39.112588 np0000002687 nova-compute[98431]: Jun 11 23:13:39.112588 np0000002687 nova-compute[98431]: Jun 11 23:13:39.112588 np0000002687 nova-compute[98431]: Jun 11 23:13:39.112588 np0000002687 nova-compute[98431]: Jun 11 23:13:39.112588 np0000002687 nova-compute[98431]: Jun 11 23:13:39.112588 np0000002687 nova-compute[98431]: Jun 11 23:13:39.112588 np0000002687 nova-compute[98431]: Jun 11 23:13:39.112588 np0000002687 nova-compute[98431]: Jun 11 23:13:39.112588 np0000002687 nova-compute[98431]: Jun 11 23:13:39.112588 np0000002687 nova-compute[98431]: 2f2d8ccb-5d26-4f0b-bc60-abf6355bf979 Jun 11 23:13:39.112588 np0000002687 nova-compute[98431]: Jun 11 23:13:39.112588 np0000002687 nova-compute[98431]: Jun 11 23:13:39.112588 np0000002687 nova-compute[98431]: Jun 11 23:13:39.112588 np0000002687 nova-compute[98431]: Jun 11 23:13:39.112588 np0000002687 nova-compute[98431]: Jun 11 23:13:39.112588 np0000002687 nova-compute[98431]: Jun 11 23:13:39.112588 np0000002687 nova-compute[98431]: Jun 11 23:13:39.112588 np0000002687 nova-compute[98431]: Jun 11 23:13:39.112588 np0000002687 nova-compute[98431]: Jun 11 23:13:39.112588 np0000002687 nova-compute[98431]: Jun 11 23:13:39.112588 np0000002687 nova-compute[98431]: Jun 11 23:13:39.112588 np0000002687 nova-compute[98431]: Jun 11 23:13:39.112588 np0000002687 nova-compute[98431]: Jun 11 23:13:39.112588 np0000002687 nova-compute[98431]: Jun 11 23:13:39.112588 np0000002687 nova-compute[98431]: /dev/urandom Jun 11 23:13:39.112588 np0000002687 nova-compute[98431]: Jun 11 23:13:39.112588 np0000002687 nova-compute[98431]: Jun 11 23:13:39.112588 np0000002687 nova-compute[98431]: Jun 11 23:13:39.112588 np0000002687 nova-compute[98431]: Jun 11 23:13:39.112588 np0000002687 nova-compute[98431]: Jun 11 23:13:39.112588 np0000002687 nova-compute[98431]: Jun 11 23:13:39.112588 np0000002687 nova-compute[98431]: Jun 11 23:13:39.112588 np0000002687 nova-compute[98431]: {{(pid=98431) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 11 23:13:39.115308 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Preparing to wait for external event network-vif-plugged-a1e7aeff-5992-43be-bb2c-d504e7019c64 {{(pid=98431) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 11 23:13:39.115308 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Acquiring lock "7609742e-a3a2-4be2-ba02-227efb2101e1-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:39.115308 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Lock "7609742e-a3a2-4be2-ba02-227efb2101e1-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:39.115308 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Lock "7609742e-a3a2-4be2-ba02-227efb2101e1-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:39.115308 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-11T23:11:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-872787611',display_name='tempest-ServerActionsTestOtherB-server-872787611',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='tempest-serveractionstestotherb-server-872787611',id=13,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE8GCNW5zoKlPJg2gDz6psGsk5eAwUwS5EcLVqi+Ws93aBM9mzyZ9OA4e5k8HR4bk5PDkKar3oCgqC2LYEZaaYcONGX+UXm8H5giZlXKo/6E9eZdQg2l6SXnZTdbPKM4Aw==',key_name='tempest-keypair-1789476090',keypairs=,launch_index=0,launched_at=2026-06-11T23:13:11Z,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000002687',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='62f47df2e0374879b837bc7431326e62',ramdisk_id='',reservation_id='r-92sxxj92',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1260316994',owner_user_name='tempest-ServerActionsTestOtherB-1260316994-project-member'},tags=,task_state='resize_reverting',terminated_at=None,trusted_certs=,updated_at=2026-06-11T23:13:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2b37a00a21a249339e412bcde7a87f82',uuid=7609742e-a3a2-4be2-ba02-227efb2101e1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "a1e7aeff-5992-43be-bb2c-d504e7019c64", "address": "fa:16:3e:1d:f7:18", "network": {"id": "710d3c5f-1a08-4a35-b3e1-e59f427989c2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2068802531-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62f47df2e0374879b837bc7431326e62", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1e7aeff-59", "ovs_interfaceid": "a1e7aeff-5992-43be-bb2c-d504e7019c64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 11 23:13:39.115308 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Converting VIF {"id": "a1e7aeff-5992-43be-bb2c-d504e7019c64", "address": "fa:16:3e:1d:f7:18", "network": {"id": "710d3c5f-1a08-4a35-b3e1-e59f427989c2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2068802531-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62f47df2e0374879b837bc7431326e62", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1e7aeff-59", "ovs_interfaceid": "a1e7aeff-5992-43be-bb2c-d504e7019c64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:13:39.115308 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:f7:18,bridge_name='br-int',has_traffic_filtering=True,id=a1e7aeff-5992-43be-bb2c-d504e7019c64,network=Network(710d3c5f-1a08-4a35-b3e1-e59f427989c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1e7aeff-59') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:13:39.115777 np0000002687 nova-compute[98431]: DEBUG os_vif [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:f7:18,bridge_name='br-int',has_traffic_filtering=True,id=a1e7aeff-5992-43be-bb2c-d504e7019c64,network=Network(710d3c5f-1a08-4a35-b3e1-e59f427989c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1e7aeff-59') {{(pid=98431) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 11 23:13:39.115979 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:39.116389 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:13:39.116713 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 11 23:13:39.118183 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:39.118452 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '101d37d4-89c4-59c2-8f44-98622c0abb71', '_type': 'linux-noop'}}, row=False) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:13:39.119436 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:39.121383 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:13:39.121894 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:39.126172 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-09ab8ea8-82b6-47a1-980d-53de41015181 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Acquiring lock "8641b14d-785b-44b0-ad6d-bb537cbee5c7" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:39.126538 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-09ab8ea8-82b6-47a1-980d-53de41015181 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lock "8641b14d-785b-44b0-ad6d-bb537cbee5c7" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:39.126818 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-09ab8ea8-82b6-47a1-980d-53de41015181 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Acquiring lock "8641b14d-785b-44b0-ad6d-bb537cbee5c7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:39.127057 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-09ab8ea8-82b6-47a1-980d-53de41015181 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lock "8641b14d-785b-44b0-ad6d-bb537cbee5c7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:39.127218 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-09ab8ea8-82b6-47a1-980d-53de41015181 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lock "8641b14d-785b-44b0-ad6d-bb537cbee5c7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:39.129404 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:39.130096 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa1e7aeff-59, may_exist=True, interface_attrs={}) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:13:39.130622 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa1e7aeff-59, col_values=(('qos', UUID('7a523a4a-c4b5-45fb-a225-6c79fe2a2189')),), if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:13:39.131308 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa1e7aeff-59, col_values=(('external_ids', {'iface-id': 'a1e7aeff-5992-43be-bb2c-d504e7019c64', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1d:f7:18', 'vm-uuid': '7609742e-a3a2-4be2-ba02-227efb2101e1'}),), if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:13:39.132034 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-09ab8ea8-82b6-47a1-980d-53de41015181 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 8641b14d-785b-44b0-ad6d-bb537cbee5c7] Terminating instance Jun 11 23:13:39.135413 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:13:39.144651 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:39.145896 np0000002687 nova-compute[98431]: INFO os_vif [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:f7:18,bridge_name='br-int',has_traffic_filtering=True,id=a1e7aeff-5992-43be-bb2c-d504e7019c64,network=Network(710d3c5f-1a08-4a35-b3e1-e59f427989c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1e7aeff-59') Jun 11 23:13:39.194097 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-3fec231c-a086-46db-86d7-d89ab98f1f28 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Releasing lock "refresh_cache-67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 11 23:13:39.275766 np0000002687 nova-compute[98431]: DEBUG nova.scheduler.client.report [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Inventory has not changed for provider e3e65fe2-9de9-4821-8b4a-ccae37c66e25 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98431) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 11 23:13:39.443350 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] During sync_power_state the instance has a pending task (spawning). Skip. Jun 11 23:13:39.456432 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-3aba3091-9beb-40be-9972-7b8056adfbfd req-b0a05d7d-d28b-4aa7-aeda-46e391a8bb5d service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Received event network-vif-plugged-37aa7cee-88a0-4428-9b2d-45700f1dcab6 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:13:39.457103 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-3aba3091-9beb-40be-9972-7b8056adfbfd req-b0a05d7d-d28b-4aa7-aeda-46e391a8bb5d service nova] Acquiring lock "1d45c7ce-5760-4f59-9921-feb3e589da8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:39.457103 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-3aba3091-9beb-40be-9972-7b8056adfbfd req-b0a05d7d-d28b-4aa7-aeda-46e391a8bb5d service nova] Lock "1d45c7ce-5760-4f59-9921-feb3e589da8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:39.457303 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-3aba3091-9beb-40be-9972-7b8056adfbfd req-b0a05d7d-d28b-4aa7-aeda-46e391a8bb5d service nova] Lock "1d45c7ce-5760-4f59-9921-feb3e589da8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:39.457303 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-3aba3091-9beb-40be-9972-7b8056adfbfd req-b0a05d7d-d28b-4aa7-aeda-46e391a8bb5d service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Processing event network-vif-plugged-37aa7cee-88a0-4428-9b2d-45700f1dcab6 {{(pid=98431) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 11 23:13:39.638529 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-09ab8ea8-82b6-47a1-980d-53de41015181 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 8641b14d-785b-44b0-ad6d-bb537cbee5c7] Start destroying the instance on the hypervisor. {{(pid=98431) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}} Jun 11 23:13:39.681513 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:39.715842 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:39.722176 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:39.764952 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:39.785898 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 3.147s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:39.786132 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] Migrating Jun 11 23:13:39.786431 np0000002687 nova-compute[98431]: DEBUG nova.compute.rpcapi [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98431) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}} Jun 11 23:13:39.866698 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:39.937168 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:39.940948 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:40.018604 np0000002687 nova-compute[98431]: DEBUG nova.utils [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Queued Task(fn=>, remaining_delay=14.999709464999796 future=) {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:13:40.024679 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [-] [instance: 8641b14d-785b-44b0-ad6d-bb537cbee5c7] Instance destroyed successfully. Jun 11 23:13:40.025129 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-09ab8ea8-82b6-47a1-980d-53de41015181 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lazy-loading 'resources' on Instance uuid 8641b14d-785b-44b0-ad6d-bb537cbee5c7 {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:13:40.306646 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:40.323818 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Acquiring lock "refresh_cache-64d7833a-82e8-43e9-83ed-2507197b69bf" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 11 23:13:40.324010 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Acquired lock "refresh_cache-64d7833a-82e8-43e9-83ed-2507197b69bf" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 11 23:13:40.324171 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] Building network info cache for instance {{(pid=98431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 11 23:13:40.371335 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:40.378377 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:40.384722 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:40.411061 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:40.426588 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:40.531837 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-09ab8ea8-82b6-47a1-980d-53de41015181 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-11T23:12:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-46603657',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='tempest-serverbootfromvolumestablerescuetest-server-46603657',id=14,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-06-11T23:12:25Z,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='aaf744af828a4a5eba1e98da63373b2b',ramdisk_id='',reservation_id='r-o5768mnn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-539499192',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-11T23:12:35Z,user_data=None,user_id='72b6dac5eb744cfba6299636227aa59b',uuid=8641b14d-785b-44b0-ad6d-bb537cbee5c7,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "94c6b105-4ef1-4e7b-9b98-163702859f78", "address": "fa:16:3e:d6:e3:4f", "network": {"id": "2a770c99-2ec6-4fa2-945b-32830a59e7a7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-137493671-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aaf744af828a4a5eba1e98da63373b2b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap94c6b105-4e", "ovs_interfaceid": "94c6b105-4ef1-4e7b-9b98-163702859f78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 11 23:13:40.531837 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-09ab8ea8-82b6-47a1-980d-53de41015181 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Converting VIF {"id": "94c6b105-4ef1-4e7b-9b98-163702859f78", "address": "fa:16:3e:d6:e3:4f", "network": {"id": "2a770c99-2ec6-4fa2-945b-32830a59e7a7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-137493671-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aaf744af828a4a5eba1e98da63373b2b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap94c6b105-4e", "ovs_interfaceid": "94c6b105-4ef1-4e7b-9b98-163702859f78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:13:40.531837 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-09ab8ea8-82b6-47a1-980d-53de41015181 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:e3:4f,bridge_name='br-int',has_traffic_filtering=True,id=94c6b105-4ef1-4e7b-9b98-163702859f78,network=Network(2a770c99-2ec6-4fa2-945b-32830a59e7a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94c6b105-4e') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:13:40.531837 np0000002687 nova-compute[98431]: DEBUG os_vif [None req-09ab8ea8-82b6-47a1-980d-53de41015181 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:e3:4f,bridge_name='br-int',has_traffic_filtering=True,id=94c6b105-4ef1-4e7b-9b98-163702859f78,network=Network(2a770c99-2ec6-4fa2-945b-32830a59e7a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94c6b105-4e') {{(pid=98431) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 11 23:13:40.533199 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:40.533199 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap94c6b105-4e, bridge=br-int, if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:13:40.544141 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:40.548732 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:13:40.549592 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:40.549879 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c61511fe-6200-4638-88b5-2f7e4dbce9f9) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:13:40.552587 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:40.553661 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:13:40.560750 np0000002687 nova-compute[98431]: INFO os_vif [None req-09ab8ea8-82b6-47a1-980d-53de41015181 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:e3:4f,bridge_name='br-int',has_traffic_filtering=True,id=94c6b105-4ef1-4e7b-9b98-163702859f78,network=Network(2a770c99-2ec6-4fa2-945b-32830a59e7a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94c6b105-4e') Jun 11 23:13:40.560750 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-09ab8ea8-82b6-47a1-980d-53de41015181 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 8641b14d-785b-44b0-ad6d-bb537cbee5c7] Deleting instance files /opt/stack/data/nova/instances/8641b14d-785b-44b0-ad6d-bb537cbee5c7_del Jun 11 23:13:40.560750 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-09ab8ea8-82b6-47a1-980d-53de41015181 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 8641b14d-785b-44b0-ad6d-bb537cbee5c7] Deletion of /opt/stack/data/nova/instances/8641b14d-785b-44b0-ad6d-bb537cbee5c7_del complete Jun 11 23:13:40.585540 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-ca4ba6a4-17e9-4ef2-b396-68575d07afff req-1d8b849b-9f2b-4251-9580-2646135208e8 service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Received event network-vif-plugged-a39a55c7-874a-4a19-a069-8383a5f0bc5a {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:13:40.585703 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-ca4ba6a4-17e9-4ef2-b396-68575d07afff req-1d8b849b-9f2b-4251-9580-2646135208e8 service nova] Acquiring lock "1d45c7ce-5760-4f59-9921-feb3e589da8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:40.586728 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-ca4ba6a4-17e9-4ef2-b396-68575d07afff req-1d8b849b-9f2b-4251-9580-2646135208e8 service nova] Lock "1d45c7ce-5760-4f59-9921-feb3e589da8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:40.586728 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-ca4ba6a4-17e9-4ef2-b396-68575d07afff req-1d8b849b-9f2b-4251-9580-2646135208e8 service nova] Lock "1d45c7ce-5760-4f59-9921-feb3e589da8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:40.586728 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-ca4ba6a4-17e9-4ef2-b396-68575d07afff req-1d8b849b-9f2b-4251-9580-2646135208e8 service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] No event matching network-vif-plugged-a39a55c7-874a-4a19-a069-8383a5f0bc5a in dict_keys([('network-vif-plugged', 'e3269961-a3f1-42c8-a49e-37f728b2f3d8'), ('network-vif-plugged', '351eaad5-bf70-43b4-8f79-5bc0027de663')]) {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jun 11 23:13:40.586728 np0000002687 nova-compute[98431]: WARNING nova.compute.manager [req-ca4ba6a4-17e9-4ef2-b396-68575d07afff req-1d8b849b-9f2b-4251-9580-2646135208e8 service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Received unexpected event network-vif-plugged-a39a55c7-874a-4a19-a069-8383a5f0bc5a for instance with vm_state building and task_state spawning. Jun 11 23:13:40.833443 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:13:40.849899 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:40.856829 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:40.879556 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:41.000141 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Emitting event Started> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:13:41.000317 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] VM Started (Lifecycle Event) Jun 11 23:13:41.075303 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:41.076756 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-09ab8ea8-82b6-47a1-980d-53de41015181 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 8641b14d-785b-44b0-ad6d-bb537cbee5c7] Took 1.44 seconds to destroy the instance on the hypervisor. Jun 11 23:13:41.077510 np0000002687 nova-compute[98431]: DEBUG oslo.service.backend._common.loopingcall [None req-09ab8ea8-82b6-47a1-980d-53de41015181 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98431) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jun 11 23:13:41.077846 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [-] [instance: 8641b14d-785b-44b0-ad6d-bb537cbee5c7] Deallocating network for instance {{(pid=98431) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}} Jun 11 23:13:41.078136 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [-] [instance: 8641b14d-785b-44b0-ad6d-bb537cbee5c7] deallocate_for_instance() {{(pid=98431) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jun 11 23:13:41.078397 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:13:41.085672 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:41.173714 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [-] [instance: 67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f] Instance destroyed successfully. Jun 11 23:13:41.174172 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-3fec231c-a086-46db-86d7-d89ab98f1f28 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Lazy-loading 'numa_topology' on Instance uuid 67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:13:41.341334 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:13:41.411224 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:13:41.503211 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:13:41.509413 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Emitting event Paused> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:13:41.509630 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] VM Paused (Lifecycle Event) Jun 11 23:13:41.582024 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-b0dc0061-6143-4c3d-8d2a-8dd6a97a51cb req-04a91b34-845a-4be4-b5ad-c21e95a92e19 service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Received event network-vif-plugged-37aa7cee-88a0-4428-9b2d-45700f1dcab6 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:13:41.582372 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-b0dc0061-6143-4c3d-8d2a-8dd6a97a51cb req-04a91b34-845a-4be4-b5ad-c21e95a92e19 service nova] Acquiring lock "1d45c7ce-5760-4f59-9921-feb3e589da8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:41.583201 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-b0dc0061-6143-4c3d-8d2a-8dd6a97a51cb req-04a91b34-845a-4be4-b5ad-c21e95a92e19 service nova] Lock "1d45c7ce-5760-4f59-9921-feb3e589da8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:41.583381 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-b0dc0061-6143-4c3d-8d2a-8dd6a97a51cb req-04a91b34-845a-4be4-b5ad-c21e95a92e19 service nova] Lock "1d45c7ce-5760-4f59-9921-feb3e589da8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:41.583531 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-b0dc0061-6143-4c3d-8d2a-8dd6a97a51cb req-04a91b34-845a-4be4-b5ad-c21e95a92e19 service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] No event matching network-vif-plugged-37aa7cee-88a0-4428-9b2d-45700f1dcab6 in dict_keys([('network-vif-plugged', 'e3269961-a3f1-42c8-a49e-37f728b2f3d8'), ('network-vif-plugged', '351eaad5-bf70-43b4-8f79-5bc0027de663')]) {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jun 11 23:13:41.583654 np0000002687 nova-compute[98431]: WARNING nova.compute.manager [req-b0dc0061-6143-4c3d-8d2a-8dd6a97a51cb req-04a91b34-845a-4be4-b5ad-c21e95a92e19 service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Received unexpected event network-vif-plugged-37aa7cee-88a0-4428-9b2d-45700f1dcab6 for instance with vm_state building and task_state spawning. Jun 11 23:13:41.583748 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-b0dc0061-6143-4c3d-8d2a-8dd6a97a51cb req-04a91b34-845a-4be4-b5ad-c21e95a92e19 service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Received event network-vif-plugged-e3269961-a3f1-42c8-a49e-37f728b2f3d8 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:13:41.583926 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-b0dc0061-6143-4c3d-8d2a-8dd6a97a51cb req-04a91b34-845a-4be4-b5ad-c21e95a92e19 service nova] Acquiring lock "1d45c7ce-5760-4f59-9921-feb3e589da8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:41.584083 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-b0dc0061-6143-4c3d-8d2a-8dd6a97a51cb req-04a91b34-845a-4be4-b5ad-c21e95a92e19 service nova] Lock "1d45c7ce-5760-4f59-9921-feb3e589da8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:41.586589 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-b0dc0061-6143-4c3d-8d2a-8dd6a97a51cb req-04a91b34-845a-4be4-b5ad-c21e95a92e19 service nova] Lock "1d45c7ce-5760-4f59-9921-feb3e589da8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:41.586589 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-b0dc0061-6143-4c3d-8d2a-8dd6a97a51cb req-04a91b34-845a-4be4-b5ad-c21e95a92e19 service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Processing event network-vif-plugged-e3269961-a3f1-42c8-a49e-37f728b2f3d8 {{(pid=98431) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 11 23:13:41.586589 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-b0dc0061-6143-4c3d-8d2a-8dd6a97a51cb req-04a91b34-845a-4be4-b5ad-c21e95a92e19 service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Received event network-vif-plugged-e3269961-a3f1-42c8-a49e-37f728b2f3d8 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:13:41.586589 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-b0dc0061-6143-4c3d-8d2a-8dd6a97a51cb req-04a91b34-845a-4be4-b5ad-c21e95a92e19 service nova] Acquiring lock "1d45c7ce-5760-4f59-9921-feb3e589da8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:41.586589 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-b0dc0061-6143-4c3d-8d2a-8dd6a97a51cb req-04a91b34-845a-4be4-b5ad-c21e95a92e19 service nova] Lock "1d45c7ce-5760-4f59-9921-feb3e589da8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:41.586589 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-b0dc0061-6143-4c3d-8d2a-8dd6a97a51cb req-04a91b34-845a-4be4-b5ad-c21e95a92e19 service nova] Lock "1d45c7ce-5760-4f59-9921-feb3e589da8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:41.586589 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-b0dc0061-6143-4c3d-8d2a-8dd6a97a51cb req-04a91b34-845a-4be4-b5ad-c21e95a92e19 service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] No event matching network-vif-plugged-e3269961-a3f1-42c8-a49e-37f728b2f3d8 in dict_keys([('network-vif-plugged', '351eaad5-bf70-43b4-8f79-5bc0027de663')]) {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jun 11 23:13:41.586589 np0000002687 nova-compute[98431]: WARNING nova.compute.manager [req-b0dc0061-6143-4c3d-8d2a-8dd6a97a51cb req-04a91b34-845a-4be4-b5ad-c21e95a92e19 service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Received unexpected event network-vif-plugged-e3269961-a3f1-42c8-a49e-37f728b2f3d8 for instance with vm_state building and task_state spawning. Jun 11 23:13:41.586589 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-b0dc0061-6143-4c3d-8d2a-8dd6a97a51cb req-04a91b34-845a-4be4-b5ad-c21e95a92e19 service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Received event network-vif-plugged-351eaad5-bf70-43b4-8f79-5bc0027de663 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:13:41.586589 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-b0dc0061-6143-4c3d-8d2a-8dd6a97a51cb req-04a91b34-845a-4be4-b5ad-c21e95a92e19 service nova] Acquiring lock "1d45c7ce-5760-4f59-9921-feb3e589da8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:41.586589 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-b0dc0061-6143-4c3d-8d2a-8dd6a97a51cb req-04a91b34-845a-4be4-b5ad-c21e95a92e19 service nova] Lock "1d45c7ce-5760-4f59-9921-feb3e589da8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:41.586589 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-b0dc0061-6143-4c3d-8d2a-8dd6a97a51cb req-04a91b34-845a-4be4-b5ad-c21e95a92e19 service nova] Lock "1d45c7ce-5760-4f59-9921-feb3e589da8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:41.586589 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-b0dc0061-6143-4c3d-8d2a-8dd6a97a51cb req-04a91b34-845a-4be4-b5ad-c21e95a92e19 service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Processing event network-vif-plugged-351eaad5-bf70-43b4-8f79-5bc0027de663 {{(pid=98431) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 11 23:13:41.586589 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-b0dc0061-6143-4c3d-8d2a-8dd6a97a51cb req-04a91b34-845a-4be4-b5ad-c21e95a92e19 service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Received event network-vif-plugged-351eaad5-bf70-43b4-8f79-5bc0027de663 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:13:41.586589 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-b0dc0061-6143-4c3d-8d2a-8dd6a97a51cb req-04a91b34-845a-4be4-b5ad-c21e95a92e19 service nova] Acquiring lock "1d45c7ce-5760-4f59-9921-feb3e589da8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:41.586589 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-b0dc0061-6143-4c3d-8d2a-8dd6a97a51cb req-04a91b34-845a-4be4-b5ad-c21e95a92e19 service nova] Lock "1d45c7ce-5760-4f59-9921-feb3e589da8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:41.586589 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-b0dc0061-6143-4c3d-8d2a-8dd6a97a51cb req-04a91b34-845a-4be4-b5ad-c21e95a92e19 service nova] Lock "1d45c7ce-5760-4f59-9921-feb3e589da8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:41.586589 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-b0dc0061-6143-4c3d-8d2a-8dd6a97a51cb req-04a91b34-845a-4be4-b5ad-c21e95a92e19 service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] No waiting events found dispatching network-vif-plugged-351eaad5-bf70-43b4-8f79-5bc0027de663 {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:13:41.586589 np0000002687 nova-compute[98431]: WARNING nova.compute.manager [req-b0dc0061-6143-4c3d-8d2a-8dd6a97a51cb req-04a91b34-845a-4be4-b5ad-c21e95a92e19 service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Received unexpected event network-vif-plugged-351eaad5-bf70-43b4-8f79-5bc0027de663 for instance with vm_state building and task_state spawning. Jun 11 23:13:41.587681 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Instance event wait completed in 3 seconds for network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged {{(pid=98431) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 11 23:13:41.593046 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Guest created on hypervisor {{(pid=98431) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}} Jun 11 23:13:41.596827 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [-] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Instance spawned successfully. Jun 11 23:13:41.597109 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 11 23:13:41.681865 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-3fec231c-a086-46db-86d7-d89ab98f1f28 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: 67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f] Attempting rescue Jun 11 23:13:41.682265 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-3fec231c-a086-46db-86d7-d89ab98f1f28 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} {{(pid=98431) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4640}} Jun 11 23:13:41.690607 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-3fec231c-a086-46db-86d7-d89ab98f1f28 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: 67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f] Instance directory exists: not creating {{(pid=98431) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5217}} Jun 11 23:13:41.691151 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-3fec231c-a086-46db-86d7-d89ab98f1f28 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: 67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f] Creating image(s) Jun 11 23:13:41.691864 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-3fec231c-a086-46db-86d7-d89ab98f1f28 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Acquiring lock "/opt/stack/data/nova/instances/67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:41.692078 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-3fec231c-a086-46db-86d7-d89ab98f1f28 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Lock "/opt/stack/data/nova/instances/67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:41.692578 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-3fec231c-a086-46db-86d7-d89ab98f1f28 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Lock "/opt/stack/data/nova/instances/67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:41.692785 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-3fec231c-a086-46db-86d7-d89ab98f1f28 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Lazy-loading 'trusted_certs' on Instance uuid 67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:13:41.772421 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] Updating instance_info_cache with network_info: [{"id": "283962f2-faaf-4d85-8eda-9b77b55a5b0c", "address": "fa:16:3e:4b:26:95", "network": {"id": "17593db3-c22d-4354-ab29-933b1c6a5c3a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1094286565-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "81fd45f475a04e5c8e9bd9deb7ad4c1e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap283962f2-fa", "ovs_interfaceid": "283962f2-faaf-4d85-8eda-9b77b55a5b0c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:13:42.014512 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:13:42.017387 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 3 {{(pid=98431) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 11 23:13:42.105897 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Found default for hw_cdrom_bus of ide {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:13:42.106793 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Found default for hw_disk_bus of virtio {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:13:42.108511 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Found default for hw_input_bus of None {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:13:42.108891 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Found default for hw_pointer_model of None {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:13:42.109220 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Found default for hw_video_model of virtio {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:13:42.109506 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Found default for hw_vif_model of virtio {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:13:42.195645 np0000002687 nova-compute[98431]: DEBUG nova.objects.base [None req-3fec231c-a086-46db-86d7-d89ab98f1f28 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Object Instance<67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=98431) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 11 23:13:42.199024 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-3fec231c-a086-46db-86d7-d89ab98f1f28 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:13:42.219012 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-3fec231c-a086-46db-86d7-d89ab98f1f28 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:13:42.219012 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-3fec231c-a086-46db-86d7-d89ab98f1f28 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Acquiring lock "d2c441059b2992961b5de03c05b32d04aff77cb1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:42.219541 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-3fec231c-a086-46db-86d7-d89ab98f1f28 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Lock "d2c441059b2992961b5de03c05b32d04aff77cb1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.002s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:42.220045 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-3fec231c-a086-46db-86d7-d89ab98f1f28 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:13:42.224962 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-3fec231c-a086-46db-86d7-d89ab98f1f28 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:13:42.225813 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-3fec231c-a086-46db-86d7-d89ab98f1f28 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:13:42.276360 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Releasing lock "refresh_cache-64d7833a-82e8-43e9-83ed-2507197b69bf" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 11 23:13:42.299638 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [-] [instance: 8641b14d-785b-44b0-ad6d-bb537cbee5c7] Updating instance_info_cache with network_info: [] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:13:42.361635 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-3fec231c-a086-46db-86d7-d89ab98f1f28 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json" returned: 0 in 0.135s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:13:42.362175 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-3fec231c-a086-46db-86d7-d89ab98f1f28 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1,backing_fmt=raw /opt/stack/data/nova/instances/67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f/disk.rescue {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:13:42.415558 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-3fec231c-a086-46db-86d7-d89ab98f1f28 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1,backing_fmt=raw /opt/stack/data/nova/instances/67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f/disk.rescue" returned: 0 in 0.053s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:13:42.416324 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-3fec231c-a086-46db-86d7-d89ab98f1f28 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Lock "d2c441059b2992961b5de03c05b32d04aff77cb1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.197s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:42.416666 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-3fec231c-a086-46db-86d7-d89ab98f1f28 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Lazy-loading 'migration_context' on Instance uuid 67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:13:42.523449 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] During sync_power_state the instance has a pending task (resize_reverting). Skip. Jun 11 23:13:42.524711 np0000002687 nova-compute[98431]: DEBUG nova.utils [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Queued Task(fn=>, remaining_delay=14.99966312000015 future=) {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:13:42.525391 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Emitting event Resumed> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:13:42.525872 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] VM Resumed (Lifecycle Event) Jun 11 23:13:42.623389 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Took 36.48 seconds to spawn the instance on the hypervisor. Jun 11 23:13:42.623909 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:13:42.713375 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-f213cb03-f772-4cc4-89da-0f8554c77926 req-950837e1-5380-4494-82cd-06c893ac4dbf service nova] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Received event network-vif-plugged-a1e7aeff-5992-43be-bb2c-d504e7019c64 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:13:42.715866 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-f213cb03-f772-4cc4-89da-0f8554c77926 req-950837e1-5380-4494-82cd-06c893ac4dbf service nova] Acquiring lock "7609742e-a3a2-4be2-ba02-227efb2101e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:42.715866 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-f213cb03-f772-4cc4-89da-0f8554c77926 req-950837e1-5380-4494-82cd-06c893ac4dbf service nova] Lock "7609742e-a3a2-4be2-ba02-227efb2101e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:42.716881 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-f213cb03-f772-4cc4-89da-0f8554c77926 req-950837e1-5380-4494-82cd-06c893ac4dbf service nova] Lock "7609742e-a3a2-4be2-ba02-227efb2101e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:42.717412 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-f213cb03-f772-4cc4-89da-0f8554c77926 req-950837e1-5380-4494-82cd-06c893ac4dbf service nova] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Processing event network-vif-plugged-a1e7aeff-5992-43be-bb2c-d504e7019c64 {{(pid=98431) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 11 23:13:42.718080 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-f213cb03-f772-4cc4-89da-0f8554c77926 req-950837e1-5380-4494-82cd-06c893ac4dbf service nova] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Received event network-vif-plugged-a1e7aeff-5992-43be-bb2c-d504e7019c64 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:13:42.718825 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-f213cb03-f772-4cc4-89da-0f8554c77926 req-950837e1-5380-4494-82cd-06c893ac4dbf service nova] Acquiring lock "7609742e-a3a2-4be2-ba02-227efb2101e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:42.718825 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-f213cb03-f772-4cc4-89da-0f8554c77926 req-950837e1-5380-4494-82cd-06c893ac4dbf service nova] Lock "7609742e-a3a2-4be2-ba02-227efb2101e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:42.718825 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-f213cb03-f772-4cc4-89da-0f8554c77926 req-950837e1-5380-4494-82cd-06c893ac4dbf service nova] Lock "7609742e-a3a2-4be2-ba02-227efb2101e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:42.719000 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-f213cb03-f772-4cc4-89da-0f8554c77926 req-950837e1-5380-4494-82cd-06c893ac4dbf service nova] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] No waiting events found dispatching network-vif-plugged-a1e7aeff-5992-43be-bb2c-d504e7019c64 {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:13:42.719670 np0000002687 nova-compute[98431]: WARNING nova.compute.manager [req-f213cb03-f772-4cc4-89da-0f8554c77926 req-950837e1-5380-4494-82cd-06c893ac4dbf service nova] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Received unexpected event network-vif-plugged-a1e7aeff-5992-43be-bb2c-d504e7019c64 for instance with vm_state resized and task_state resize_reverting. Jun 11 23:13:42.719987 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-f213cb03-f772-4cc4-89da-0f8554c77926 req-950837e1-5380-4494-82cd-06c893ac4dbf service nova] [instance: 67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f] Received event network-vif-unplugged-59f62261-8a42-4e76-9609-68343996250d {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:13:42.720437 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-f213cb03-f772-4cc4-89da-0f8554c77926 req-950837e1-5380-4494-82cd-06c893ac4dbf service nova] Acquiring lock "67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:42.720934 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-f213cb03-f772-4cc4-89da-0f8554c77926 req-950837e1-5380-4494-82cd-06c893ac4dbf service nova] Lock "67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:42.721417 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-f213cb03-f772-4cc4-89da-0f8554c77926 req-950837e1-5380-4494-82cd-06c893ac4dbf service nova] Lock "67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:42.721670 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-f213cb03-f772-4cc4-89da-0f8554c77926 req-950837e1-5380-4494-82cd-06c893ac4dbf service nova] [instance: 67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f] No waiting events found dispatching network-vif-unplugged-59f62261-8a42-4e76-9609-68343996250d {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:13:42.722103 np0000002687 nova-compute[98431]: WARNING nova.compute.manager [req-f213cb03-f772-4cc4-89da-0f8554c77926 req-950837e1-5380-4494-82cd-06c893ac4dbf service nova] [instance: 67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f] Received unexpected event network-vif-unplugged-59f62261-8a42-4e76-9609-68343996250d for instance with vm_state active and task_state rescuing. Jun 11 23:13:42.722624 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-f213cb03-f772-4cc4-89da-0f8554c77926 req-950837e1-5380-4494-82cd-06c893ac4dbf service nova] [instance: 67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f] Received event network-vif-unplugged-59f62261-8a42-4e76-9609-68343996250d {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:13:42.722975 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-f213cb03-f772-4cc4-89da-0f8554c77926 req-950837e1-5380-4494-82cd-06c893ac4dbf service nova] Acquiring lock "67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:42.723486 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-f213cb03-f772-4cc4-89da-0f8554c77926 req-950837e1-5380-4494-82cd-06c893ac4dbf service nova] Lock "67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:42.724016 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-f213cb03-f772-4cc4-89da-0f8554c77926 req-950837e1-5380-4494-82cd-06c893ac4dbf service nova] Lock "67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:42.724075 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-f213cb03-f772-4cc4-89da-0f8554c77926 req-950837e1-5380-4494-82cd-06c893ac4dbf service nova] [instance: 67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f] No waiting events found dispatching network-vif-unplugged-59f62261-8a42-4e76-9609-68343996250d {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:13:42.724742 np0000002687 nova-compute[98431]: WARNING nova.compute.manager [req-f213cb03-f772-4cc4-89da-0f8554c77926 req-950837e1-5380-4494-82cd-06c893ac4dbf service nova] [instance: 67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f] Received unexpected event network-vif-unplugged-59f62261-8a42-4e76-9609-68343996250d for instance with vm_state active and task_state rescuing. Jun 11 23:13:42.725028 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-f213cb03-f772-4cc4-89da-0f8554c77926 req-950837e1-5380-4494-82cd-06c893ac4dbf service nova] [instance: 8641b14d-785b-44b0-ad6d-bb537cbee5c7] Received event network-vif-deleted-94c6b105-4ef1-4e7b-9b98-163702859f78 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:13:42.727498 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=98431) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 11 23:13:42.734676 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [-] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Instance running successfully. Jun 11 23:13:42.736560 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] finish_revert_migration finished successfully. {{(pid=98431) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12994}} Jun 11 23:13:42.813135 np0000002687 nova-compute[98431]: INFO nova.compute.manager [-] [instance: 8641b14d-785b-44b0-ad6d-bb537cbee5c7] Took 1.74 seconds to deallocate network for instance. Jun 11 23:13:42.908070 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:42.921597 np0000002687 nova-compute[98431]: DEBUG nova.objects.base [None req-3fec231c-a086-46db-86d7-d89ab98f1f28 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Object Instance<67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=98431) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 11 23:13:42.922117 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-3fec231c-a086-46db-86d7-d89ab98f1f28 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: 67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f] Created local disks {{(pid=98431) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}} Jun 11 23:13:42.922354 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-3fec231c-a086-46db-86d7-d89ab98f1f28 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: 67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f] Start _get_guest_xml network_info=[{"id": "59f62261-8a42-4e76-9609-68343996250d", "address": "fa:16:3e:c2:8d:a4", "network": {"id": "77fc4e10-1fed-4963-86b4-1fbb3a9c6f7f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1105404274-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1105404274-network", "vif_mac": "fa:16:3e:c2:8d:a4"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b2b9f55b231c455ca1a4579d7ed54888", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap59f62261-8a", "ovs_interfaceid": "59f62261-8a42-4e76-9609-68343996250d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-11T23:08:20Z,direct_url=,disk_format='qcow2',id=f30640f8-7aca-4300-a085-4706a5209a79,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ce012f9fabdb4ee5a73e212437f59d97',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-11T23:08:23Z,virtual_size=,visibility=) rescue={'image_id': 'f30640f8-7aca-4300-a085-4706a5209a79', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=Noneshare_info=ShareMappingList(objects=[]) {{(pid=98431) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 11 23:13:42.922523 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-3fec231c-a086-46db-86d7-d89ab98f1f28 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Lazy-loading 'resources' on Instance uuid 67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:13:43.030469 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:13:43.033746 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98431) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 11 23:13:43.144311 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Took 49.58 seconds to build instance. Jun 11 23:13:43.149390 np0000002687 nova-compute[98431]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0004152089998115116 future=) submitted to {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:13:43.151275 np0000002687 nova-compute[98431]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:13:43.151275 np0000002687 nova-compute[98431]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=11.868588821000003 future=) {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:13:43.151275 np0000002687 nova-compute[98431]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=11.868487452999943 future=) {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:13:43.151275 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Emitting event Stopped> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:13:43.151275 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] VM Stopped (Lifecycle Event) Jun 11 23:13:43.336323 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-09ab8ea8-82b6-47a1-980d-53de41015181 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:43.337539 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-09ab8ea8-82b6-47a1-980d-53de41015181 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:43.427445 np0000002687 nova-compute[98431]: DEBUG nova.objects.base [None req-3fec231c-a086-46db-86d7-d89ab98f1f28 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Object Instance<67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=98431) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 11 23:13:43.431834 np0000002687 nova-compute[98431]: WARNING nova.virt.libvirt.driver [None req-3fec231c-a086-46db-86d7-d89ab98f1f28 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 11 23:13:43.433100 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-3fec231c-a086-46db-86d7-d89ab98f1f28 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='f30640f8-7aca-4300-a085-4706a5209a79', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-1084057464', uuid='67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f'), owner=OwnerMeta(userid='eaecdd9c05b5485b9422171463cccf92', username='tempest-ServerRescueNegativeTestJSON-2027875711-project-member', projectid='b2b9f55b231c455ca1a4579d7ed54888', projectname='tempest-ServerRescueNegativeTestJSON-2027875711'), image=ImageMeta(id='f30640f8-7aca-4300-a085-4706a5209a79', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "59f62261-8a42-4e76-9609-68343996250d", "address": "fa:16:3e:c2:8d:a4", "network": {"id": "77fc4e10-1fed-4963-86b4-1fbb3a9c6f7f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1105404274-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1105404274-network", "vif_mac": "fa:16:3e:c2:8d:a4"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b2b9f55b231c455ca1a4579d7ed54888", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap59f62261-8a", "ovs_interfaceid": "59f62261-8a42-4e76-9609-68343996250d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1781219623.432606) {{(pid=98431) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 11 23:13:43.434089 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-3fec231c-a086-46db-86d7-d89ab98f1f28 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Searching host: 'np0000002687' for CPU controller through CGroups V1... {{(pid=98431) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 11 23:13:43.434482 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-3fec231c-a086-46db-86d7-d89ab98f1f28 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] CPU controller missing on host. {{(pid=98431) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 11 23:13:43.435512 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-3fec231c-a086-46db-86d7-d89ab98f1f28 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Searching host: 'np0000002687' for CPU controller through CGroups V2... {{(pid=98431) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 11 23:13:43.436157 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-3fec231c-a086-46db-86d7-d89ab98f1f28 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] CPU controller found on host. {{(pid=98431) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 11 23:13:43.437622 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-3fec231c-a086-46db-86d7-d89ab98f1f28 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98431) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 11 23:13:43.439094 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-3fec231c-a086-46db-86d7-d89ab98f1f28 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-11T23:08:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-11T23:08:20Z,direct_url=,disk_format='qcow2',id=f30640f8-7aca-4300-a085-4706a5209a79,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ce012f9fabdb4ee5a73e212437f59d97',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-11T23:08:23Z,virtual_size=,visibility=), allow threads: True {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 11 23:13:43.439094 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-3fec231c-a086-46db-86d7-d89ab98f1f28 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Flavor limits 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 11 23:13:43.439094 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-3fec231c-a086-46db-86d7-d89ab98f1f28 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Image limits 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 11 23:13:43.439094 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-3fec231c-a086-46db-86d7-d89ab98f1f28 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Flavor pref 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 11 23:13:43.439094 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-3fec231c-a086-46db-86d7-d89ab98f1f28 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Image pref 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 11 23:13:43.439094 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-3fec231c-a086-46db-86d7-d89ab98f1f28 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 11 23:13:43.439473 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-3fec231c-a086-46db-86d7-d89ab98f1f28 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 11 23:13:43.439887 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-3fec231c-a086-46db-86d7-d89ab98f1f28 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98431) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 11 23:13:43.440073 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-3fec231c-a086-46db-86d7-d89ab98f1f28 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Got 1 possible topologies {{(pid=98431) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 11 23:13:43.440235 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-3fec231c-a086-46db-86d7-d89ab98f1f28 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 11 23:13:43.440454 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-3fec231c-a086-46db-86d7-d89ab98f1f28 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 11 23:13:43.442092 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-3fec231c-a086-46db-86d7-d89ab98f1f28 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Lazy-loading 'vcpu_model' on Instance uuid 67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:13:43.537235 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Emitting event Resumed> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:13:43.537388 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] VM Resumed (Lifecycle Event) Jun 11 23:13:43.644326 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-c7bbdf8d-3dbc-40e3-ab1d-c15c274f09b2 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Lock "1d45c7ce-5760-4f59-9921-feb3e589da8a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 51.090s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:43.653547 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: 0d352738-c7bf-42a2-8260-bf5574a7200d] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:13:43.794993 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] Starting migrate_disk_and_power_off {{(pid=98431) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:12616}} Jun 11 23:13:43.826984 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-1c82e4e1-7a44-4894-bf2a-bc1e81fe7910 tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Updating instance to original state: 'active' Jun 11 23:13:43.838033 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:43.843405 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:43.869534 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:43.943279 np0000002687 nova-compute[98431]: DEBUG nova.objects.base [None req-3fec231c-a086-46db-86d7-d89ab98f1f28 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Object Instance<67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=98431) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 11 23:13:43.967573 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-3fec231c-a086-46db-86d7-d89ab98f1f28 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-11T23:13:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1084057464',display_name='tempest-ServerRescueNegativeTestJSON-server-1084057464',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='tempest-serverrescuenegativetestjson-server-1084057464',id=21,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-06-11T23:13:35Z,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='b2b9f55b231c455ca1a4579d7ed54888',ramdisk_id='',reservation_id='r-gp5qd3p1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2027875711',owner_user_name='tempest-ServerRescueNegativeTestJSON-2027875711-project-member'},tags=,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-06-11T23:13:35Z,user_data=None,user_id='eaecdd9c05b5485b9422171463cccf92',uuid=67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "59f62261-8a42-4e76-9609-68343996250d", "address": "fa:16:3e:c2:8d:a4", "network": {"id": "77fc4e10-1fed-4963-86b4-1fbb3a9c6f7f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1105404274-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1105404274-network", "vif_mac": "fa:16:3e:c2:8d:a4"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b2b9f55b231c455ca1a4579d7ed54888", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap59f62261-8a", "ovs_interfaceid": "59f62261-8a42-4e76-9609-68343996250d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98431) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 11 23:13:43.967897 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-3fec231c-a086-46db-86d7-d89ab98f1f28 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Converting VIF {"id": "59f62261-8a42-4e76-9609-68343996250d", "address": "fa:16:3e:c2:8d:a4", "network": {"id": "77fc4e10-1fed-4963-86b4-1fbb3a9c6f7f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1105404274-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1105404274-network", "vif_mac": "fa:16:3e:c2:8d:a4"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b2b9f55b231c455ca1a4579d7ed54888", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap59f62261-8a", "ovs_interfaceid": "59f62261-8a42-4e76-9609-68343996250d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:13:43.968705 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-3fec231c-a086-46db-86d7-d89ab98f1f28 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c2:8d:a4,bridge_name='br-int',has_traffic_filtering=True,id=59f62261-8a42-4e76-9609-68343996250d,network=Network(77fc4e10-1fed-4963-86b4-1fbb3a9c6f7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59f62261-8a') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:13:43.970380 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-3fec231c-a086-46db-86d7-d89ab98f1f28 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Lazy-loading 'pci_devices' on Instance uuid 67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:13:44.042345 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:44.044705 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:13:44.054051 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:44.054051 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=98431) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 11 23:13:44.172206 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-ad0b0c6e-07e7-4304-aa8d-40c0024c9703 req-bb66cd00-9690-4c92-ab91-d7d8b98995ae service nova] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] Received event network-vif-unplugged-283962f2-faaf-4d85-8eda-9b77b55a5b0c {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:13:44.173514 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-ad0b0c6e-07e7-4304-aa8d-40c0024c9703 req-bb66cd00-9690-4c92-ab91-d7d8b98995ae service nova] Acquiring lock "64d7833a-82e8-43e9-83ed-2507197b69bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:44.174136 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-ad0b0c6e-07e7-4304-aa8d-40c0024c9703 req-bb66cd00-9690-4c92-ab91-d7d8b98995ae service nova] Lock "64d7833a-82e8-43e9-83ed-2507197b69bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:44.174270 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-ad0b0c6e-07e7-4304-aa8d-40c0024c9703 req-bb66cd00-9690-4c92-ab91-d7d8b98995ae service nova] Lock "64d7833a-82e8-43e9-83ed-2507197b69bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:44.174530 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-ad0b0c6e-07e7-4304-aa8d-40c0024c9703 req-bb66cd00-9690-4c92-ab91-d7d8b98995ae service nova] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] No waiting events found dispatching network-vif-unplugged-283962f2-faaf-4d85-8eda-9b77b55a5b0c {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:13:44.175201 np0000002687 nova-compute[98431]: WARNING nova.compute.manager [req-ad0b0c6e-07e7-4304-aa8d-40c0024c9703 req-bb66cd00-9690-4c92-ab91-d7d8b98995ae service nova] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] Received unexpected event network-vif-unplugged-283962f2-faaf-4d85-8eda-9b77b55a5b0c for instance with vm_state active and task_state resize_migrating. Jun 11 23:13:44.175966 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [-] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] Instance destroyed successfully. Jun 11 23:13:44.177756 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-11T23:12:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='multiattach-server-0',id=15,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHngWA9S/0M7yAiCaKN7wJ0iqGBq18p6o1N91kfGTes8iMQtxmsCxH/Iqg51e2HEWFsjD10S17Kahb+vCzu07nJJQGe3fNUonThwHNf0exiWq4jZuXjSZtHJPO0dbow48A==',key_name='tempest-keypair-1974490716',keypairs=,launch_index=0,launched_at=2026-06-11T23:12:35Z,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='81fd45f475a04e5c8e9bd9deb7ad4c1e',ramdisk_id='',reservation_id='r-5y4c4ios',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-1514006700',owner_user_name='tempest-AttachVolumeMultiAttachTest-1514006700-project-member'},tags=,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2026-06-11T23:13:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c17e84202f404c3c8e73292bb59d7b27',uuid=64d7833a-82e8-43e9-83ed-2507197b69bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "283962f2-faaf-4d85-8eda-9b77b55a5b0c", "address": "fa:16:3e:4b:26:95", "network": {"id": "17593db3-c22d-4354-ab29-933b1c6a5c3a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1094286565-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1094286565-network", "vif_mac": "fa:16:3e:4b:26:95"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "81fd45f475a04e5c8e9bd9deb7ad4c1e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap283962f2-fa", "ovs_interfaceid": "283962f2-faaf-4d85-8eda-9b77b55a5b0c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 11 23:13:44.178090 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Converting VIF {"id": "283962f2-faaf-4d85-8eda-9b77b55a5b0c", "address": "fa:16:3e:4b:26:95", "network": {"id": "17593db3-c22d-4354-ab29-933b1c6a5c3a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1094286565-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1094286565-network", "vif_mac": "fa:16:3e:4b:26:95"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "81fd45f475a04e5c8e9bd9deb7ad4c1e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap283962f2-fa", "ovs_interfaceid": "283962f2-faaf-4d85-8eda-9b77b55a5b0c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:13:44.178782 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4b:26:95,bridge_name='br-int',has_traffic_filtering=True,id=283962f2-faaf-4d85-8eda-9b77b55a5b0c,network=Network(17593db3-c22d-4354-ab29-933b1c6a5c3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap283962f2-fa') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:13:44.179617 np0000002687 nova-compute[98431]: DEBUG os_vif [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4b:26:95,bridge_name='br-int',has_traffic_filtering=True,id=283962f2-faaf-4d85-8eda-9b77b55a5b0c,network=Network(17593db3-c22d-4354-ab29-933b1c6a5c3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap283962f2-fa') {{(pid=98431) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 11 23:13:44.183124 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:44.183646 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap283962f2-fa, bridge=br-int, if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:13:44.185061 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:44.185922 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:13:44.192256 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:44.193930 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:44.193930 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a030b47f-a990-4f87-b0d3-f98f066a1640) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:13:44.194542 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:44.195038 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:13:44.203513 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:44.206543 np0000002687 nova-compute[98431]: INFO os_vif [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4b:26:95,bridge_name='br-int',has_traffic_filtering=True,id=283962f2-faaf-4d85-8eda-9b77b55a5b0c,network=Network(17593db3-c22d-4354-ab29-933b1c6a5c3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap283962f2-fa') Jun 11 23:13:44.318903 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-09ab8ea8-82b6-47a1-980d-53de41015181 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98431) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 11 23:13:44.318903 np0000002687 nova-compute[98431]: DEBUG nova.compute.provider_tree [None req-09ab8ea8-82b6-47a1-980d-53de41015181 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Inventory has not changed in ProviderTree for provider: e3e65fe2-9de9-4821-8b4a-ccae37c66e25 {{(pid=98431) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 11 23:13:44.477982 np0000002687 nova-compute[98431]: DEBUG nova.objects.base [None req-3fec231c-a086-46db-86d7-d89ab98f1f28 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Object Instance<67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=98431) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 11 23:13:44.479421 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-3fec231c-a086-46db-86d7-d89ab98f1f28 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: 67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f] End _get_guest_xml xml= Jun 11 23:13:44.479421 np0000002687 nova-compute[98431]: 67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f Jun 11 23:13:44.479421 np0000002687 nova-compute[98431]: instance-00000015 Jun 11 23:13:44.479421 np0000002687 nova-compute[98431]: 196608 Jun 11 23:13:44.479421 np0000002687 nova-compute[98431]: 1 Jun 11 23:13:44.479421 np0000002687 nova-compute[98431]: Jun 11 23:13:44.479421 np0000002687 nova-compute[98431]: Jun 11 23:13:44.479421 np0000002687 nova-compute[98431]: Jun 11 23:13:44.479421 np0000002687 nova-compute[98431]: tempest-ServerRescueNegativeTestJSON-server-1084057464 Jun 11 23:13:44.479421 np0000002687 nova-compute[98431]: 2026-06-11 23:13:43 Jun 11 23:13:44.479421 np0000002687 nova-compute[98431]: Jun 11 23:13:44.479421 np0000002687 nova-compute[98431]: 192 Jun 11 23:13:44.479421 np0000002687 nova-compute[98431]: 1 Jun 11 23:13:44.479421 np0000002687 nova-compute[98431]: 0 Jun 11 23:13:44.479421 np0000002687 nova-compute[98431]: 0 Jun 11 23:13:44.479421 np0000002687 nova-compute[98431]: 1 Jun 11 23:13:44.479421 np0000002687 nova-compute[98431]: Jun 11 23:13:44.479421 np0000002687 nova-compute[98431]: True Jun 11 23:13:44.479421 np0000002687 nova-compute[98431]: Jun 11 23:13:44.479421 np0000002687 nova-compute[98431]: Jun 11 23:13:44.479421 np0000002687 nova-compute[98431]: Jun 11 23:13:44.479421 np0000002687 nova-compute[98431]: bare Jun 11 23:13:44.479421 np0000002687 nova-compute[98431]: qcow2 Jun 11 23:13:44.479421 np0000002687 nova-compute[98431]: 1 Jun 11 23:13:44.479421 np0000002687 nova-compute[98431]: 0 Jun 11 23:13:44.479421 np0000002687 nova-compute[98431]: Jun 11 23:13:44.479421 np0000002687 nova-compute[98431]: ide Jun 11 23:13:44.479421 np0000002687 nova-compute[98431]: virtio Jun 11 23:13:44.479421 np0000002687 nova-compute[98431]: pc Jun 11 23:13:44.479421 np0000002687 nova-compute[98431]: virtio Jun 11 23:13:44.479421 np0000002687 nova-compute[98431]: virtio Jun 11 23:13:44.479421 np0000002687 nova-compute[98431]: virtio Jun 11 23:13:44.479421 np0000002687 nova-compute[98431]: Jun 11 23:13:44.479421 np0000002687 nova-compute[98431]: Jun 11 23:13:44.479421 np0000002687 nova-compute[98431]: Jun 11 23:13:44.479421 np0000002687 nova-compute[98431]: tempest-ServerRescueNegativeTestJSON-2027875711-project-member Jun 11 23:13:44.479421 np0000002687 nova-compute[98431]: tempest-ServerRescueNegativeTestJSON-2027875711 Jun 11 23:13:44.479421 np0000002687 nova-compute[98431]: Jun 11 23:13:44.479421 np0000002687 nova-compute[98431]: Jun 11 23:13:44.479421 np0000002687 nova-compute[98431]: Jun 11 23:13:44.479421 np0000002687 nova-compute[98431]: Jun 11 23:13:44.479421 np0000002687 nova-compute[98431]: Jun 11 23:13:44.479421 np0000002687 nova-compute[98431]: Jun 11 23:13:44.479421 np0000002687 nova-compute[98431]: Jun 11 23:13:44.479421 np0000002687 nova-compute[98431]: Jun 11 23:13:44.479421 np0000002687 nova-compute[98431]: Jun 11 23:13:44.479421 np0000002687 nova-compute[98431]: Jun 11 23:13:44.479421 np0000002687 nova-compute[98431]: Jun 11 23:13:44.479421 np0000002687 nova-compute[98431]: OpenStack Foundation Jun 11 23:13:44.479421 np0000002687 nova-compute[98431]: OpenStack Nova Jun 11 23:13:44.479421 np0000002687 nova-compute[98431]: 33.1.0 Jun 11 23:13:44.479421 np0000002687 nova-compute[98431]: 67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f Jun 11 23:13:44.479421 np0000002687 nova-compute[98431]: 67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f Jun 11 23:13:44.479421 np0000002687 nova-compute[98431]: Virtual Machine Jun 11 23:13:44.479421 np0000002687 nova-compute[98431]: Jun 11 23:13:44.479421 np0000002687 nova-compute[98431]: Jun 11 23:13:44.479421 np0000002687 nova-compute[98431]: Jun 11 23:13:44.479421 np0000002687 nova-compute[98431]: hvm Jun 11 23:13:44.479421 np0000002687 nova-compute[98431]: Jun 11 23:13:44.479421 np0000002687 nova-compute[98431]: Jun 11 23:13:44.479421 np0000002687 nova-compute[98431]: Jun 11 23:13:44.479421 np0000002687 nova-compute[98431]: Jun 11 23:13:44.479421 np0000002687 nova-compute[98431]: Jun 11 23:13:44.479421 np0000002687 nova-compute[98431]: 128 Jun 11 23:13:44.479421 np0000002687 nova-compute[98431]: Jun 11 23:13:44.479421 np0000002687 nova-compute[98431]: Jun 11 23:13:44.479421 np0000002687 nova-compute[98431]: Jun 11 23:13:44.479421 np0000002687 nova-compute[98431]: 1 Jun 11 23:13:44.479421 np0000002687 nova-compute[98431]: Jun 11 23:13:44.479421 np0000002687 nova-compute[98431]: Jun 11 23:13:44.479421 np0000002687 nova-compute[98431]: Nehalem Jun 11 23:13:44.479421 np0000002687 nova-compute[98431]: Jun 11 23:13:44.479421 np0000002687 nova-compute[98431]: Jun 11 23:13:44.479421 np0000002687 nova-compute[98431]: Jun 11 23:13:44.479421 np0000002687 nova-compute[98431]: Jun 11 23:13:44.479421 np0000002687 nova-compute[98431]: Jun 11 23:13:44.479421 np0000002687 nova-compute[98431]: Jun 11 23:13:44.479421 np0000002687 nova-compute[98431]: Jun 11 23:13:44.479421 np0000002687 nova-compute[98431]: Jun 11 23:13:44.479421 np0000002687 nova-compute[98431]: Jun 11 23:13:44.479421 np0000002687 nova-compute[98431]: Jun 11 23:13:44.479421 np0000002687 nova-compute[98431]: Jun 11 23:13:44.479421 np0000002687 nova-compute[98431]: Jun 11 23:13:44.479421 np0000002687 nova-compute[98431]: Jun 11 23:13:44.479421 np0000002687 nova-compute[98431]: Jun 11 23:13:44.479421 np0000002687 nova-compute[98431]: Jun 11 23:13:44.479421 np0000002687 nova-compute[98431]: Jun 11 23:13:44.479421 np0000002687 nova-compute[98431]: Jun 11 23:13:44.479421 np0000002687 nova-compute[98431]: Jun 11 23:13:44.479421 np0000002687 nova-compute[98431]: Jun 11 23:13:44.479421 np0000002687 nova-compute[98431]: Jun 11 23:13:44.479421 np0000002687 nova-compute[98431]: Jun 11 23:13:44.479421 np0000002687 nova-compute[98431]: Jun 11 23:13:44.479421 np0000002687 nova-compute[98431]: Jun 11 23:13:44.479421 np0000002687 nova-compute[98431]: Jun 11 23:13:44.479421 np0000002687 nova-compute[98431]: Jun 11 23:13:44.479421 np0000002687 nova-compute[98431]: Jun 11 23:13:44.479421 np0000002687 nova-compute[98431]: Jun 11 23:13:44.479421 np0000002687 nova-compute[98431]: Jun 11 23:13:44.479421 np0000002687 nova-compute[98431]: Jun 11 23:13:44.479421 np0000002687 nova-compute[98431]: Jun 11 23:13:44.479421 np0000002687 nova-compute[98431]: Jun 11 23:13:44.479421 np0000002687 nova-compute[98431]: /dev/urandom Jun 11 23:13:44.479421 np0000002687 nova-compute[98431]: Jun 11 23:13:44.479421 np0000002687 nova-compute[98431]: Jun 11 23:13:44.479421 np0000002687 nova-compute[98431]: Jun 11 23:13:44.479421 np0000002687 nova-compute[98431]: Jun 11 23:13:44.479421 np0000002687 nova-compute[98431]: Jun 11 23:13:44.479421 np0000002687 nova-compute[98431]: Jun 11 23:13:44.479421 np0000002687 nova-compute[98431]: Jun 11 23:13:44.479421 np0000002687 nova-compute[98431]: {{(pid=98431) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 11 23:13:44.483209 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [-] [instance: 67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f] Instance destroyed successfully. Jun 11 23:13:44.557544 np0000002687 nova-compute[98431]: DEBUG nova.utils [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Queued Task(fn=>, remaining_delay=14.999705777999907 future=) {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:13:44.771611 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Detected multiple connections on this host for volume: f535b91b-3bff-46ad-905e-644bd012b9ff, skipping target disconnect. Jun 11 23:13:44.779096 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64d7833a-82e8-43e9-83ed-2507197b69bf/disk --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:13:44.806573 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-8dd2726e-a6f6-48cb-9c5f-d339ab2afea2 req-585210db-2937-453b-a667-02380dc6cb11 service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Received event network-changed-5f9094e3-a3c6-48ea-bfbe-4fa25d19bcf2 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:13:44.806573 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-8dd2726e-a6f6-48cb-9c5f-d339ab2afea2 req-585210db-2937-453b-a667-02380dc6cb11 service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Refreshing instance network info cache due to event network-changed-5f9094e3-a3c6-48ea-bfbe-4fa25d19bcf2. {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 11 23:13:44.807476 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-8dd2726e-a6f6-48cb-9c5f-d339ab2afea2 req-585210db-2937-453b-a667-02380dc6cb11 service nova] Acquiring lock "refresh_cache-1d45c7ce-5760-4f59-9921-feb3e589da8a" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 11 23:13:44.807476 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-8dd2726e-a6f6-48cb-9c5f-d339ab2afea2 req-585210db-2937-453b-a667-02380dc6cb11 service nova] Acquired lock "refresh_cache-1d45c7ce-5760-4f59-9921-feb3e589da8a" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 11 23:13:44.807476 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-8dd2726e-a6f6-48cb-9c5f-d339ab2afea2 req-585210db-2937-453b-a667-02380dc6cb11 service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Refreshing network info cache for port 5f9094e3-a3c6-48ea-bfbe-4fa25d19bcf2 {{(pid=98431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 11 23:13:44.826492 np0000002687 nova-compute[98431]: DEBUG nova.scheduler.client.report [None req-09ab8ea8-82b6-47a1-980d-53de41015181 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Inventory has not changed for provider e3e65fe2-9de9-4821-8b4a-ccae37c66e25 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98431) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 11 23:13:44.879271 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64d7833a-82e8-43e9-83ed-2507197b69bf/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:13:44.879689 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64d7833a-82e8-43e9-83ed-2507197b69bf/disk --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:13:44.964144 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64d7833a-82e8-43e9-83ed-2507197b69bf/disk --force-share --output=json" returned: 0 in 0.084s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:13:44.964614 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] skipping disk /dev/dm-7 (vdb) as it is a volume {{(pid=98431) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12344}} Jun 11 23:13:44.965435 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/64d7833a-82e8-43e9-83ed-2507197b69bf_resize/disk /opt/stack/data/nova/instances/64d7833a-82e8-43e9-83ed-2507197b69bf/disk {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:13:45.059390 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] CMD "cp -r /opt/stack/data/nova/instances/64d7833a-82e8-43e9-83ed-2507197b69bf_resize/disk /opt/stack/data/nova/instances/64d7833a-82e8-43e9-83ed-2507197b69bf/disk" returned: 0 in 0.094s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:13:45.059843 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/64d7833a-82e8-43e9-83ed-2507197b69bf_resize/disk.config /opt/stack/data/nova/instances/64d7833a-82e8-43e9-83ed-2507197b69bf/disk.config {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:13:45.119634 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] CMD "cp -r /opt/stack/data/nova/instances/64d7833a-82e8-43e9-83ed-2507197b69bf_resize/disk.config /opt/stack/data/nova/instances/64d7833a-82e8-43e9-83ed-2507197b69bf/disk.config" returned: 0 in 0.060s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:13:45.119984 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/64d7833a-82e8-43e9-83ed-2507197b69bf_resize/disk.info /opt/stack/data/nova/instances/64d7833a-82e8-43e9-83ed-2507197b69bf/disk.info {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:13:45.178393 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] CMD "cp -r /opt/stack/data/nova/instances/64d7833a-82e8-43e9-83ed-2507197b69bf_resize/disk.info /opt/stack/data/nova/instances/64d7833a-82e8-43e9-83ed-2507197b69bf/disk.info" returned: 0 in 0.058s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:13:45.237024 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:45.311268 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [req-8dd2726e-a6f6-48cb-9c5f-d339ab2afea2 req-585210db-2937-453b-a667-02380dc6cb11 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:13:45.339243 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-09ab8ea8-82b6-47a1-980d-53de41015181 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 2.003s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:45.411359 np0000002687 nova-compute[98431]: INFO nova.scheduler.client.report [None req-09ab8ea8-82b6-47a1-980d-53de41015181 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Deleted allocations for instance 8641b14d-785b-44b0-ad6d-bb537cbee5c7 Jun 11 23:13:46.006611 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-3fec231c-a086-46db-86d7-d89ab98f1f28 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] No BDM found with device name vda, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:13:46.007172 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-3fec231c-a086-46db-86d7-d89ab98f1f28 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:13:46.007172 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-3fec231c-a086-46db-86d7-d89ab98f1f28 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] No BDM found with device name hda, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:13:46.007172 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-3fec231c-a086-46db-86d7-d89ab98f1f28 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] No VIF found with MAC fa:16:3e:c2:8d:a4, not building metadata {{(pid=98431) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13199}} Jun 11 23:13:46.007626 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-3fec231c-a086-46db-86d7-d89ab98f1f28 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: 67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f] Using config drive Jun 11 23:13:46.300327 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-b68157af-f882-4ef7-9d3e-020f9f430a5f req-804afe9a-7a08-444d-960a-0f65c5ab5bdc service nova] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] Received event network-vif-unplugged-283962f2-faaf-4d85-8eda-9b77b55a5b0c {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:13:46.300327 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-b68157af-f882-4ef7-9d3e-020f9f430a5f req-804afe9a-7a08-444d-960a-0f65c5ab5bdc service nova] Acquiring lock "64d7833a-82e8-43e9-83ed-2507197b69bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:46.300327 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-b68157af-f882-4ef7-9d3e-020f9f430a5f req-804afe9a-7a08-444d-960a-0f65c5ab5bdc service nova] Lock "64d7833a-82e8-43e9-83ed-2507197b69bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:46.300327 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-b68157af-f882-4ef7-9d3e-020f9f430a5f req-804afe9a-7a08-444d-960a-0f65c5ab5bdc service nova] Lock "64d7833a-82e8-43e9-83ed-2507197b69bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:46.300327 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-b68157af-f882-4ef7-9d3e-020f9f430a5f req-804afe9a-7a08-444d-960a-0f65c5ab5bdc service nova] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] No waiting events found dispatching network-vif-unplugged-283962f2-faaf-4d85-8eda-9b77b55a5b0c {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:13:46.300327 np0000002687 nova-compute[98431]: WARNING nova.compute.manager [req-b68157af-f882-4ef7-9d3e-020f9f430a5f req-804afe9a-7a08-444d-960a-0f65c5ab5bdc service nova] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] Received unexpected event network-vif-unplugged-283962f2-faaf-4d85-8eda-9b77b55a5b0c for instance with vm_state active and task_state resize_migrating. Jun 11 23:13:46.372536 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:13:46.372914 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:13:46.425668 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-09ab8ea8-82b6-47a1-980d-53de41015181 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lock "8641b14d-785b-44b0-ad6d-bb537cbee5c7" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 7.299s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:46.479003 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [req-8dd2726e-a6f6-48cb-9c5f-d339ab2afea2 req-585210db-2937-453b-a667-02380dc6cb11 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:13:46.510669 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-3fec231c-a086-46db-86d7-d89ab98f1f28 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Lazy-loading 'ec2_ids' on Instance uuid 67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:13:46.622307 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] Port 283962f2-faaf-4d85-8eda-9b77b55a5b0c binding to destination host np0000002687 is already ACTIVE {{(pid=98431) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3210}} Jun 11 23:13:46.752902 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:47.015535 np0000002687 nova-compute[98431]: DEBUG nova.objects.base [None req-3fec231c-a086-46db-86d7-d89ab98f1f28 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Object Instance<67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=98431) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 11 23:13:47.015535 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-3fec231c-a086-46db-86d7-d89ab98f1f28 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Lazy-loading 'keypairs' on Instance uuid 67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:13:47.169996 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-8dd2726e-a6f6-48cb-9c5f-d339ab2afea2 req-585210db-2937-453b-a667-02380dc6cb11 service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Updated VIF entry in instance network info cache for port 5f9094e3-a3c6-48ea-bfbe-4fa25d19bcf2. {{(pid=98431) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 11 23:13:47.170854 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-8dd2726e-a6f6-48cb-9c5f-d339ab2afea2 req-585210db-2937-453b-a667-02380dc6cb11 service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Updating instance_info_cache with network_info: [{"id": "5f9094e3-a3c6-48ea-bfbe-4fa25d19bcf2", "address": "fa:16:3e:b1:9e:6a", "network": {"id": "1cea4f00-aa2e-4d9d-8255-2e7ba484f3ec", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1566230580-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c1e407a42f24b34baf3ee44be9fb337", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f9094e3-a3", "ovs_interfaceid": "5f9094e3-a3c6-48ea-bfbe-4fa25d19bcf2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fe1430ca-d60b-47c4-9ac9-96ba7d61f101", "address": "fa:16:3e:ca:17:0a", "network": {"id": "d84f8615-2bee-4c03-b721-d597e25acb42", "bridge": "br-int", "label": "tempest-device-tagging-net1-1869260730", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c1e407a42f24b34baf3ee44be9fb337", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe1430ca-d6", "ovs_interfaceid": "fe1430ca-d60b-47c4-9ac9-96ba7d61f101", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a39a55c7-874a-4a19-a069-8383a5f0bc5a", "address": "fa:16:3e:37:35:68", "network": {"id": "d84f8615-2bee-4c03-b721-d597e25acb42", "bridge": "br-int", "label": "tempest-device-tagging-net1-1869260730", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c1e407a42f24b34baf3ee44be9fb337", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa39a55c7-87", "ovs_interfaceid": "a39a55c7-874a-4a19-a069-8383a5f0bc5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "37aa7cee-88a0-4428-9b2d-45700f1dcab6", "address": "fa:16:3e:12:f4:f7", "network": {"id": "d84f8615-2bee-4c03-b721-d597e25acb42", "bridge": "br-int", "label": "tempest-device-tagging-net1-1869260730", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c1e407a42f24b34baf3ee44be9fb337", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap37aa7cee-88", "ovs_interfaceid": "37aa7cee-88a0-4428-9b2d-45700f1dcab6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e3269961-a3f1-42c8-a49e-37f728b2f3d8", "address": "fa:16:3e:7e:14:0b", "network": {"id": "d84f8615-2bee-4c03-b721-d597e25acb42", "bridge": "br-int", "label": "tempest-device-tagging-net1-1869260730", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c1e407a42f24b34baf3ee44be9fb337", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape3269961-a3", "ovs_interfaceid": "e3269961-a3f1-42c8-a49e-37f728b2f3d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "351eaad5-bf70-43b4-8f79-5bc0027de663", "address": "fa:16:3e:ee:d2:51", "network": {"id": "b0d7ffe8-2fba-456a-8969-949ee402ce5b", "bridge": "br-int", "label": "tempest-device-tagging-net2-84998986", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c1e407a42f24b34baf3ee44be9fb337", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap351eaad5-bf", "ovs_interfaceid": "351eaad5-bf70-43b4-8f79-5bc0027de663", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "004fd6c0-58df-4ceb-9733-267396cae60c", "address": "fa:16:3e:5d:12:c5", "network": {"id": "b0d7ffe8-2fba-456a-8969-949ee402ce5b", "bridge": "br-int", "label": "tempest-device-tagging-net2-84998986", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c1e407a42f24b34baf3ee44be9fb337", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap004fd6c0-58", "ovs_interfaceid": "004fd6c0-58df-4ceb-9733-267396cae60c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:13:47.519575 np0000002687 nova-compute[98431]: DEBUG nova.objects.base [None req-3fec231c-a086-46db-86d7-d89ab98f1f28 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Object Instance<67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98431) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 11 23:13:47.523446 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-3fec231c-a086-46db-86d7-d89ab98f1f28 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:13:47.640595 np0000002687 nova-compute[98431]: DEBUG nova.compute.rpcapi [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98431) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}} Jun 11 23:13:47.660140 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Acquiring lock "64d7833a-82e8-43e9-83ed-2507197b69bf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:47.660687 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "64d7833a-82e8-43e9-83ed-2507197b69bf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:47.660901 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "64d7833a-82e8-43e9-83ed-2507197b69bf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:47.672956 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-8dd2726e-a6f6-48cb-9c5f-d339ab2afea2 req-585210db-2937-453b-a667-02380dc6cb11 service nova] Releasing lock "refresh_cache-1d45c7ce-5760-4f59-9921-feb3e589da8a" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 11 23:13:47.742929 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-51795300-f265-41aa-a885-80fa394eb2b7 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Acquiring lock "c82748e6-1c78-4372-ad4b-48d1c6448efa" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:47.743100 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-51795300-f265-41aa-a885-80fa394eb2b7 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lock "c82748e6-1c78-4372-ad4b-48d1c6448efa" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:47.743231 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-51795300-f265-41aa-a885-80fa394eb2b7 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Acquiring lock "c82748e6-1c78-4372-ad4b-48d1c6448efa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:47.743344 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-51795300-f265-41aa-a885-80fa394eb2b7 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lock "c82748e6-1c78-4372-ad4b-48d1c6448efa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:47.743443 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-51795300-f265-41aa-a885-80fa394eb2b7 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lock "c82748e6-1c78-4372-ad4b-48d1c6448efa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:47.746582 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-51795300-f265-41aa-a885-80fa394eb2b7 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Terminating instance Jun 11 23:13:47.912755 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:47.937744 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-3fec231c-a086-46db-86d7-d89ab98f1f28 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: 67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f] Creating config drive at /opt/stack/data/nova/instances/67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f/disk.config.rescue Jun 11 23:13:47.941235 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-3fec231c-a086-46db-86d7-d89ab98f1f28 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpybbyd_9f {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:13:47.999048 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-3fec231c-a086-46db-86d7-d89ab98f1f28 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpybbyd_9f" returned: 0 in 0.057s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:13:48.000830 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-e9af58bf-3453-4693-8641-c909a40c185f tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Acquiring lock "7609742e-a3a2-4be2-ba02-227efb2101e1" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:48.001502 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-e9af58bf-3453-4693-8641-c909a40c185f tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Lock "7609742e-a3a2-4be2-ba02-227efb2101e1" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:48.001502 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-e9af58bf-3453-4693-8641-c909a40c185f tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Acquiring lock "7609742e-a3a2-4be2-ba02-227efb2101e1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:48.001615 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-e9af58bf-3453-4693-8641-c909a40c185f tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Lock "7609742e-a3a2-4be2-ba02-227efb2101e1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:48.001824 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-e9af58bf-3453-4693-8641-c909a40c185f tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Lock "7609742e-a3a2-4be2-ba02-227efb2101e1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:48.011697 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-e9af58bf-3453-4693-8641-c909a40c185f tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Terminating instance Jun 11 23:13:48.249982 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-51795300-f265-41aa-a885-80fa394eb2b7 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Start destroying the instance on the hypervisor. {{(pid=98431) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}} Jun 11 23:13:48.295885 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:48.300222 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:48.320760 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:48.482557 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:48.495395 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:48.522602 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-e9af58bf-3453-4693-8641-c909a40c185f tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Start destroying the instance on the hypervisor. {{(pid=98431) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}} Jun 11 23:13:48.544402 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:48.558173 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:48.562479 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:48.626007 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:48.672087 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:13:48.690093 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:48.761730 np0000002687 nova-compute[98431]: DEBUG nova.utils [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Queued Task(fn=>, remaining_delay=14.99964788300008 future=) {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:13:48.769339 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [-] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Instance destroyed successfully. Jun 11 23:13:48.770311 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-51795300-f265-41aa-a885-80fa394eb2b7 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lazy-loading 'resources' on Instance uuid c82748e6-1c78-4372-ad4b-48d1c6448efa {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:13:48.774623 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:48.799423 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:48.826992 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Acquiring lock "refresh_cache-64d7833a-82e8-43e9-83ed-2507197b69bf" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 11 23:13:48.827671 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Acquired lock "refresh_cache-64d7833a-82e8-43e9-83ed-2507197b69bf" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 11 23:13:48.827671 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] Building network info cache for instance {{(pid=98431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 11 23:13:48.830924 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:48.859877 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:48.899402 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-c96ff89b-b1af-44b9-93ca-c14ebd50c870 req-243530b0-d9e1-4d45-bd19-0873c599bd8e service nova] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Received event network-vif-unplugged-852fc4ec-82e1-4185-a33c-3c45ff42351e {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:13:48.900372 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-c96ff89b-b1af-44b9-93ca-c14ebd50c870 req-243530b0-d9e1-4d45-bd19-0873c599bd8e service nova] Acquiring lock "c82748e6-1c78-4372-ad4b-48d1c6448efa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:48.900724 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-c96ff89b-b1af-44b9-93ca-c14ebd50c870 req-243530b0-d9e1-4d45-bd19-0873c599bd8e service nova] Lock "c82748e6-1c78-4372-ad4b-48d1c6448efa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:48.901018 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-c96ff89b-b1af-44b9-93ca-c14ebd50c870 req-243530b0-d9e1-4d45-bd19-0873c599bd8e service nova] Lock "c82748e6-1c78-4372-ad4b-48d1c6448efa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:48.901241 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-c96ff89b-b1af-44b9-93ca-c14ebd50c870 req-243530b0-d9e1-4d45-bd19-0873c599bd8e service nova] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] No waiting events found dispatching network-vif-unplugged-852fc4ec-82e1-4185-a33c-3c45ff42351e {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:13:48.901518 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-c96ff89b-b1af-44b9-93ca-c14ebd50c870 req-243530b0-d9e1-4d45-bd19-0873c599bd8e service nova] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Received event network-vif-unplugged-852fc4ec-82e1-4185-a33c-3c45ff42351e for instance with task_state deleting. {{(pid=98431) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 11 23:13:48.934553 np0000002687 nova-compute[98431]: DEBUG nova.utils [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Queued Task(fn=>, remaining_delay=14.99965989400016 future=) {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:13:48.943342 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [-] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Instance destroyed successfully. Jun 11 23:13:48.943828 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-e9af58bf-3453-4693-8641-c909a40c185f tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Lazy-loading 'resources' on Instance uuid 7609742e-a3a2-4be2-ba02-227efb2101e1 {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:13:49.201291 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:49.276607 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-51795300-f265-41aa-a885-80fa394eb2b7 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-11T23:11:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-28433977',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='tempest-serverbootfromvolumestablerescuetest-server-28433977',id=11,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-06-11T23:11:57Z,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='aaf744af828a4a5eba1e98da63373b2b',ramdisk_id='',reservation_id='r-mqq12a2i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-539499192',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-11T23:12:05Z,user_data=None,user_id='72b6dac5eb744cfba6299636227aa59b',uuid=c82748e6-1c78-4372-ad4b-48d1c6448efa,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "852fc4ec-82e1-4185-a33c-3c45ff42351e", "address": "fa:16:3e:c6:c6:5b", "network": {"id": "2a770c99-2ec6-4fa2-945b-32830a59e7a7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-137493671-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aaf744af828a4a5eba1e98da63373b2b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap852fc4ec-82", "ovs_interfaceid": "852fc4ec-82e1-4185-a33c-3c45ff42351e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 11 23:13:49.279478 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-51795300-f265-41aa-a885-80fa394eb2b7 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Converting VIF {"id": "852fc4ec-82e1-4185-a33c-3c45ff42351e", "address": "fa:16:3e:c6:c6:5b", "network": {"id": "2a770c99-2ec6-4fa2-945b-32830a59e7a7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-137493671-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aaf744af828a4a5eba1e98da63373b2b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap852fc4ec-82", "ovs_interfaceid": "852fc4ec-82e1-4185-a33c-3c45ff42351e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:13:49.279478 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-51795300-f265-41aa-a885-80fa394eb2b7 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c6:c6:5b,bridge_name='br-int',has_traffic_filtering=True,id=852fc4ec-82e1-4185-a33c-3c45ff42351e,network=Network(2a770c99-2ec6-4fa2-945b-32830a59e7a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap852fc4ec-82') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:13:49.279478 np0000002687 nova-compute[98431]: DEBUG os_vif [None req-51795300-f265-41aa-a885-80fa394eb2b7 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:c6:5b,bridge_name='br-int',has_traffic_filtering=True,id=852fc4ec-82e1-4185-a33c-3c45ff42351e,network=Network(2a770c99-2ec6-4fa2-945b-32830a59e7a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap852fc4ec-82') {{(pid=98431) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 11 23:13:49.283081 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:49.283268 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap852fc4ec-82, bridge=br-int, if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:13:49.284391 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:49.285119 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:13:49.292353 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:49.293566 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:49.293708 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0cd33629-2980-48f5-b2ed-1bcfdd2f291f) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:13:49.294725 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:49.294725 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:13:49.302333 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:49.306119 np0000002687 nova-compute[98431]: INFO os_vif [None req-51795300-f265-41aa-a885-80fa394eb2b7 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:c6:5b,bridge_name='br-int',has_traffic_filtering=True,id=852fc4ec-82e1-4185-a33c-3c45ff42351e,network=Network(2a770c99-2ec6-4fa2-945b-32830a59e7a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap852fc4ec-82') Jun 11 23:13:49.309995 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51795300-f265-41aa-a885-80fa394eb2b7 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] calling os-brick to detach iSCSI Volume {{(pid=98431) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jun 11 23:13:49.309995 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-51795300-f265-41aa-a885-80fa394eb2b7 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea', 'iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5498d0af-4b75-4132-b06e-56f2b5b013ea', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, None), 'kwargs': {'force': True}}" {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 11 23:13:49.309995 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-51795300-f265-41aa-a885-80fa394eb2b7 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 11 23:13:49.309995 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-51795300-f265-41aa-a885-80fa394eb2b7 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 11 23:13:49.309995 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-51795300-f265-41aa-a885-80fa394eb2b7 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea', 'iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5498d0af-4b75-4132-b06e-56f2b5b013ea', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 11 23:13:49.309995 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-51795300-f265-41aa-a885-80fa394eb2b7 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea', 0)] {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 11 23:13:49.331019 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:13:49.346048 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-51795300-f265-41aa-a885-80fa394eb2b7 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:49.346048 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:49.346048 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:49.346048 np0000002687 nova-compute[98431]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:13:49.346048 np0000002687 nova-compute[98431]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:13:49.346048 np0000002687 nova-compute[98431]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:13:49.346048 np0000002687 nova-compute[98431]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:13:49.346048 np0000002687 nova-compute[98431]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8 (non-flash) Jun 11 23:13:49.346048 np0000002687 nova-compute[98431]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8 (non-flash) Jun 11 23:13:49.346048 np0000002687 nova-compute[98431]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13 (non-flash) Jun 11 23:13:49.346048 np0000002687 nova-compute[98431]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13 (non-flash) Jun 11 23:13:49.346048 np0000002687 nova-compute[98431]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979 (non-flash) Jun 11 23:13:49.346048 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:49.346048 np0000002687 nova-compute[98431]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979 (non-flash) Jun 11 23:13:49.346048 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:13:49.348681 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-51795300-f265-41aa-a885-80fa394eb2b7 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] iscsi session list stdout=tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:49.348681 np0000002687 nova-compute[98431]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea (non-flash) Jun 11 23:13:49.348681 np0000002687 nova-compute[98431]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:49.348681 np0000002687 nova-compute[98431]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:13:49.348681 np0000002687 nova-compute[98431]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:13:49.348681 np0000002687 nova-compute[98431]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:13:49.348681 np0000002687 nova-compute[98431]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:13:49.348681 np0000002687 nova-compute[98431]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8 (non-flash) Jun 11 23:13:49.348681 np0000002687 nova-compute[98431]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8 (non-flash) Jun 11 23:13:49.348681 np0000002687 nova-compute[98431]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13 (non-flash) Jun 11 23:13:49.348681 np0000002687 nova-compute[98431]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13 (non-flash) Jun 11 23:13:49.348681 np0000002687 nova-compute[98431]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979 (non-flash) Jun 11 23:13:49.348681 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:49.348681 np0000002687 nova-compute[98431]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979 (non-flash) Jun 11 23:13:49.348681 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:13:49.348681 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-51795300-f265-41aa-a885-80fa394eb2b7 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea', '13'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea', '14'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9', '3'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff', '31'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff', '32'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc', '33'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc', '34'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8', '35'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8', '36'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13', '37'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13', '38'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979', '39'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9', '4'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979', '40')] {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 11 23:13:49.348681 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-51795300-f265-41aa-a885-80fa394eb2b7 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea', '14')] {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 11 23:13:49.351845 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-51795300-f265-41aa-a885-80fa394eb2b7 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea', '13')] {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 11 23:13:49.352128 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-51795300-f265-41aa-a885-80fa394eb2b7 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Resulting device map defaultdict(. at 0x7e1e941b9760>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea'): ({'sdk'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea'): ({'sdj'}, set())}) {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 11 23:13:49.352348 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-51795300-f265-41aa-a885-80fa394eb2b7 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Removing multipathed devices sdj, sdk {{(pid=98431) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 11 23:13:49.352575 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-51795300-f265-41aa-a885-80fa394eb2b7 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Flush multipath device 330000000b5e39cd6 {{(pid=98431) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jun 11 23:13:49.391120 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-51795300-f265-41aa-a885-80fa394eb2b7 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=98431) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 11 23:13:49.435051 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-51795300-f265-41aa-a885-80fa394eb2b7 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98431) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 11 23:13:49.447675 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-e9af58bf-3453-4693-8641-c909a40c185f tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-11T23:11:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-872787611',display_name='tempest-ServerActionsTestOtherB-server-872787611',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='tempest-serveractionstestotherb-server-872787611',id=13,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE8GCNW5zoKlPJg2gDz6psGsk5eAwUwS5EcLVqi+Ws93aBM9mzyZ9OA4e5k8HR4bk5PDkKar3oCgqC2LYEZaaYcONGX+UXm8H5giZlXKo/6E9eZdQg2l6SXnZTdbPKM4Aw==',key_name='tempest-keypair-1789476090',keypairs=,launch_index=0,launched_at=2026-06-11T23:13:43Z,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='62f47df2e0374879b837bc7431326e62',ramdisk_id='',reservation_id='r-92sxxj92',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1260316994',owner_user_name='tempest-ServerActionsTestOtherB-1260316994-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-11T23:13:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2b37a00a21a249339e412bcde7a87f82',uuid=7609742e-a3a2-4be2-ba02-227efb2101e1,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a1e7aeff-5992-43be-bb2c-d504e7019c64", "address": "fa:16:3e:1d:f7:18", "network": {"id": "710d3c5f-1a08-4a35-b3e1-e59f427989c2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2068802531-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62f47df2e0374879b837bc7431326e62", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1e7aeff-59", "ovs_interfaceid": "a1e7aeff-5992-43be-bb2c-d504e7019c64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 11 23:13:49.447675 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-e9af58bf-3453-4693-8641-c909a40c185f tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Converting VIF {"id": "a1e7aeff-5992-43be-bb2c-d504e7019c64", "address": "fa:16:3e:1d:f7:18", "network": {"id": "710d3c5f-1a08-4a35-b3e1-e59f427989c2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2068802531-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62f47df2e0374879b837bc7431326e62", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1e7aeff-59", "ovs_interfaceid": "a1e7aeff-5992-43be-bb2c-d504e7019c64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:13:49.448395 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-e9af58bf-3453-4693-8641-c909a40c185f tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:f7:18,bridge_name='br-int',has_traffic_filtering=True,id=a1e7aeff-5992-43be-bb2c-d504e7019c64,network=Network(710d3c5f-1a08-4a35-b3e1-e59f427989c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1e7aeff-59') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:13:49.448690 np0000002687 nova-compute[98431]: DEBUG os_vif [None req-e9af58bf-3453-4693-8641-c909a40c185f tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:f7:18,bridge_name='br-int',has_traffic_filtering=True,id=a1e7aeff-5992-43be-bb2c-d504e7019c64,network=Network(710d3c5f-1a08-4a35-b3e1-e59f427989c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1e7aeff-59') {{(pid=98431) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 11 23:13:49.450928 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:49.453696 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:49.453696 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa1e7aeff-59, bridge=br-int, if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:13:49.456842 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:49.458483 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:13:49.460340 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:49.460437 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7a523a4a-c4b5-45fb-a225-6c79fe2a2189) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:13:49.461970 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:49.463034 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:13:49.464943 np0000002687 nova-compute[98431]: INFO os_vif [None req-e9af58bf-3453-4693-8641-c909a40c185f tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:f7:18,bridge_name='br-int',has_traffic_filtering=True,id=a1e7aeff-5992-43be-bb2c-d504e7019c64,network=Network(710d3c5f-1a08-4a35-b3e1-e59f427989c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1e7aeff-59') Jun 11 23:13:49.471094 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9af58bf-3453-4693-8641-c909a40c185f tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] calling os-brick to detach iSCSI Volume {{(pid=98431) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jun 11 23:13:49.471530 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9af58bf-3453-4693-8641-c909a40c185f tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979', 'iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2f2d8ccb-5d26-4f0b-bc60-abf6355bf979', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': True}}" {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 11 23:13:49.471752 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-e9af58bf-3453-4693-8641-c909a40c185f tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 11 23:13:49.477505 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-51795300-f265-41aa-a885-80fa394eb2b7 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Checking to see if SCSI volumes sdj, sdk have been removed. {{(pid=98431) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 11 23:13:49.477745 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-51795300-f265-41aa-a885-80fa394eb2b7 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] SCSI volumes sdj, sdk have been removed. {{(pid=98431) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 11 23:13:49.481367 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-51795300-f265-41aa-a885-80fa394eb2b7 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Checking to see if device paths {'sdj', 'sdk'} are still under multipathd monitoring {{(pid=98431) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 11 23:13:49.497815 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-51795300-f265-41aa-a885-80fa394eb2b7 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Device paths {'sdj', 'sdk'} have been removed from multipathd monitoring. {{(pid=98431) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 11 23:13:49.498127 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-51795300-f265-41aa-a885-80fa394eb2b7 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea')] {{(pid=98431) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 11 23:13:49.518091 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-51795300-f265-41aa-a885-80fa394eb2b7 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:13:49.554323 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-51795300-f265-41aa-a885-80fa394eb2b7 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea, portal: 192.168.40.100,3260] Jun 11 23:13:49.554323 np0000002687 nova-compute[98431]: Logout of [sid: 14, target: iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea, portal: 192.168.40.100,3260] successful. Jun 11 23:13:49.554323 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:13:49.581015 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-51795300-f265-41aa-a885-80fa394eb2b7 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:13:49.594854 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-51795300-f265-41aa-a885-80fa394eb2b7 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:13:49.643062 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-51795300-f265-41aa-a885-80fa394eb2b7 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea, portal: 192.168.50.100,3260] Jun 11 23:13:49.643062 np0000002687 nova-compute[98431]: Logout of [sid: 13, target: iqn.2023-03.storpool.com:os--volume-5498d0af-4b75-4132-b06e-56f2b5b013ea, portal: 192.168.50.100,3260] successful. Jun 11 23:13:49.643062 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:13:49.675197 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-51795300-f265-41aa-a885-80fa394eb2b7 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:13:49.676165 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-51795300-f265-41aa-a885-80fa394eb2b7 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.367s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 11 23:13:49.677038 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-51795300-f265-41aa-a885-80fa394eb2b7 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] <== disconnect_volume: return (367ms) None {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 11 23:13:49.678524 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51795300-f265-41aa-a885-80fa394eb2b7 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Disconnected iSCSI Volume {{(pid=98431) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jun 11 23:13:49.678524 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-e9af58bf-3453-4693-8641-c909a40c185f tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.206s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 11 23:13:49.678879 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9af58bf-3453-4693-8641-c909a40c185f tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979', 'iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2f2d8ccb-5d26-4f0b-bc60-abf6355bf979', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 11 23:13:49.679015 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9af58bf-3453-4693-8641-c909a40c185f tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979', 0)] {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 11 23:13:49.686182 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-51795300-f265-41aa-a885-80fa394eb2b7 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Deleting instance files /opt/stack/data/nova/instances/c82748e6-1c78-4372-ad4b-48d1c6448efa_del Jun 11 23:13:49.686182 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-51795300-f265-41aa-a885-80fa394eb2b7 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Deletion of /opt/stack/data/nova/instances/c82748e6-1c78-4372-ad4b-48d1c6448efa_del complete Jun 11 23:13:49.720983 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9af58bf-3453-4693-8641-c909a40c185f tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:49.720983 np0000002687 nova-compute[98431]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:13:49.720983 np0000002687 nova-compute[98431]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:13:49.720983 np0000002687 nova-compute[98431]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:13:49.720983 np0000002687 nova-compute[98431]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:13:49.720983 np0000002687 nova-compute[98431]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8 (non-flash) Jun 11 23:13:49.720983 np0000002687 nova-compute[98431]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8 (non-flash) Jun 11 23:13:49.720983 np0000002687 nova-compute[98431]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13 (non-flash) Jun 11 23:13:49.720983 np0000002687 nova-compute[98431]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13 (non-flash) Jun 11 23:13:49.720983 np0000002687 nova-compute[98431]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979 (non-flash) Jun 11 23:13:49.720983 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:49.720983 np0000002687 nova-compute[98431]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979 (non-flash) Jun 11 23:13:49.720983 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:13:49.720983 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9af58bf-3453-4693-8641-c909a40c185f tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:49.720983 np0000002687 nova-compute[98431]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:13:49.720983 np0000002687 nova-compute[98431]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:13:49.720983 np0000002687 nova-compute[98431]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:13:49.720983 np0000002687 nova-compute[98431]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:13:49.720983 np0000002687 nova-compute[98431]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8 (non-flash) Jun 11 23:13:49.720983 np0000002687 nova-compute[98431]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8 (non-flash) Jun 11 23:13:49.720983 np0000002687 nova-compute[98431]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13 (non-flash) Jun 11 23:13:49.720983 np0000002687 nova-compute[98431]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13 (non-flash) Jun 11 23:13:49.720983 np0000002687 nova-compute[98431]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979 (non-flash) Jun 11 23:13:49.720983 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:49.720983 np0000002687 nova-compute[98431]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979 (non-flash) Jun 11 23:13:49.720983 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:13:49.720983 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9af58bf-3453-4693-8641-c909a40c185f tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9', '3'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff', '31'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff', '32'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc', '33'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc', '34'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8', '35'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8', '36'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13', '37'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13', '38'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979', '39'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9', '4'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979', '40')] {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 11 23:13:49.720983 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9af58bf-3453-4693-8641-c909a40c185f tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979', '39')] {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 11 23:13:49.720983 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9af58bf-3453-4693-8641-c909a40c185f tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979', '40')] {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 11 23:13:49.722280 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9af58bf-3453-4693-8641-c909a40c185f tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Resulting device map defaultdict(. at 0x7e1ea01ab060>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979'): ({'sdg'}, set())}) {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 11 23:13:49.723344 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-e9af58bf-3453-4693-8641-c909a40c185f tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Removing multipathed devices sdf, sdg {{(pid=98431) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 11 23:13:49.723344 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-e9af58bf-3453-4693-8641-c909a40c185f tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Flush multipath device 3300000009550c01f {{(pid=98431) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jun 11 23:13:49.760348 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-e9af58bf-3453-4693-8641-c909a40c185f tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98431) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 11 23:13:49.793111 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Removed pending STOPPED event for 67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f due to new event Resumed> {{(pid=98431) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:519}} Jun 11 23:13:49.793288 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Emitting event Resumed> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:13:49.793420 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f] VM Resumed (Lifecycle Event) Jun 11 23:13:49.799139 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-3fec231c-a086-46db-86d7-d89ab98f1f28 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: 67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:13:49.820404 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-e9af58bf-3453-4693-8641-c909a40c185f tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98431) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 11 23:13:49.867678 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-e9af58bf-3453-4693-8641-c909a40c185f tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98431) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 11 23:13:49.867678 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-e9af58bf-3453-4693-8641-c909a40c185f tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98431) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 11 23:13:49.868477 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-e9af58bf-3453-4693-8641-c909a40c185f tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98431) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 11 23:13:49.881121 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-e9af58bf-3453-4693-8641-c909a40c185f tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98431) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 11 23:13:49.881497 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9af58bf-3453-4693-8641-c909a40c185f tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979')] {{(pid=98431) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 11 23:13:49.896537 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9af58bf-3453-4693-8641-c909a40c185f tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:13:49.944089 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9af58bf-3453-4693-8641-c909a40c185f tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979, portal: 192.168.40.100,3260] Jun 11 23:13:49.944089 np0000002687 nova-compute[98431]: Logout of [sid: 39, target: iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979, portal: 192.168.40.100,3260] successful. Jun 11 23:13:49.944089 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:13:49.955465 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:13:49.969142 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9af58bf-3453-4693-8641-c909a40c185f tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:13:49.986673 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9af58bf-3453-4693-8641-c909a40c185f tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:13:50.022782 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9af58bf-3453-4693-8641-c909a40c185f tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979, portal: 192.168.50.100,3260] Jun 11 23:13:50.022782 np0000002687 nova-compute[98431]: Logout of [sid: 40, target: iqn.2023-03.storpool.com:os--volume-2f2d8ccb-5d26-4f0b-bc60-abf6355bf979, portal: 192.168.50.100,3260] successful. Jun 11 23:13:50.022782 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:13:50.043894 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9af58bf-3453-4693-8641-c909a40c185f tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:13:50.044241 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-e9af58bf-3453-4693-8641-c909a40c185f tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.367s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 11 23:13:50.044500 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9af58bf-3453-4693-8641-c909a40c185f tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] <== disconnect_volume: return (572ms) None {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 11 23:13:50.044705 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9af58bf-3453-4693-8641-c909a40c185f tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Disconnected iSCSI Volume {{(pid=98431) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jun 11 23:13:50.045111 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-e9af58bf-3453-4693-8641-c909a40c185f tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Deleting instance files /opt/stack/data/nova/instances/7609742e-a3a2-4be2-ba02-227efb2101e1_del Jun 11 23:13:50.052213 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-e9af58bf-3453-4693-8641-c909a40c185f tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Deletion of /opt/stack/data/nova/instances/7609742e-a3a2-4be2-ba02-227efb2101e1_del complete Jun 11 23:13:50.165680 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] Updating instance_info_cache with network_info: [{"id": "283962f2-faaf-4d85-8eda-9b77b55a5b0c", "address": "fa:16:3e:4b:26:95", "network": {"id": "17593db3-c22d-4354-ab29-933b1c6a5c3a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1094286565-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "81fd45f475a04e5c8e9bd9deb7ad4c1e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap283962f2-fa", "ovs_interfaceid": "283962f2-faaf-4d85-8eda-9b77b55a5b0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:13:50.193567 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-51795300-f265-41aa-a885-80fa394eb2b7 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Took 1.94 seconds to destroy the instance on the hypervisor. Jun 11 23:13:50.194062 np0000002687 nova-compute[98431]: DEBUG oslo.service.backend._common.loopingcall [None req-51795300-f265-41aa-a885-80fa394eb2b7 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98431) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jun 11 23:13:50.194201 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [-] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Deallocating network for instance {{(pid=98431) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}} Jun 11 23:13:50.194262 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [-] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] deallocate_for_instance() {{(pid=98431) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jun 11 23:13:50.194451 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:13:50.267500 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:13:50.298260 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:13:50.300128 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98431) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 11 23:13:50.471099 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-a028953a-07a8-4aaa-bc2e-6deef03b4ccf req-2a13bd38-5999-4b66-8acb-a7048aecf644 service nova] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Received event network-vif-unplugged-a1e7aeff-5992-43be-bb2c-d504e7019c64 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:13:50.471264 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-a028953a-07a8-4aaa-bc2e-6deef03b4ccf req-2a13bd38-5999-4b66-8acb-a7048aecf644 service nova] Acquiring lock "7609742e-a3a2-4be2-ba02-227efb2101e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:50.471428 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-a028953a-07a8-4aaa-bc2e-6deef03b4ccf req-2a13bd38-5999-4b66-8acb-a7048aecf644 service nova] Lock "7609742e-a3a2-4be2-ba02-227efb2101e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:50.471539 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-a028953a-07a8-4aaa-bc2e-6deef03b4ccf req-2a13bd38-5999-4b66-8acb-a7048aecf644 service nova] Lock "7609742e-a3a2-4be2-ba02-227efb2101e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:50.471647 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-a028953a-07a8-4aaa-bc2e-6deef03b4ccf req-2a13bd38-5999-4b66-8acb-a7048aecf644 service nova] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] No waiting events found dispatching network-vif-unplugged-a1e7aeff-5992-43be-bb2c-d504e7019c64 {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:13:50.471810 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-a028953a-07a8-4aaa-bc2e-6deef03b4ccf req-2a13bd38-5999-4b66-8acb-a7048aecf644 service nova] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Received event network-vif-unplugged-a1e7aeff-5992-43be-bb2c-d504e7019c64 for instance with task_state deleting. {{(pid=98431) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 11 23:13:50.562929 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-e9af58bf-3453-4693-8641-c909a40c185f tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Took 2.04 seconds to destroy the instance on the hypervisor. Jun 11 23:13:50.563562 np0000002687 nova-compute[98431]: DEBUG oslo.service.backend._common.loopingcall [None req-e9af58bf-3453-4693-8641-c909a40c185f tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98431) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jun 11 23:13:50.564870 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [-] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Deallocating network for instance {{(pid=98431) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}} Jun 11 23:13:50.564870 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [-] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] deallocate_for_instance() {{(pid=98431) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jun 11 23:13:50.565071 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:13:50.667820 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Releasing lock "refresh_cache-64d7833a-82e8-43e9-83ed-2507197b69bf" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 11 23:13:50.749639 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:13:50.803350 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Emitting event Started> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:13:50.803564 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f] VM Started (Lifecycle Event) Jun 11 23:13:51.103143 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [-] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Updating instance_info_cache with network_info: [] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:13:51.178196 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.209', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000002687', 'execute': None}" {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 11 23:13:51.189591 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.scaleio [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98431) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 11 23:13:51.215438 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Running cmd (subprocess): nvme version {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:13:51.262703 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] 'nvme version' failed. Not Retrying. {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 11 23:13:51.262703 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.nvmeof [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] nvme not present on system {{(pid=98431) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 11 23:13:51.276159 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.lightos [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98431) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 11 23:13:51.276815 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.lightos [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Current host hostNQN and IP(s) are ['10.4.3.209', 'fe80::f816:3eff:fea3:3707', '192.168.40.6', 'fe80::f816:3eff:fe06:bdab', '192.168.50.6', 'fe80::f816:3eff:fe7a:46f2', '192.168.10.6', 'fe80::f816:3eff:fe13:793b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::38fa:21ff:fe6c:3746', 'fe80::fc16:3eff:fe6c:eb30', 'fe80::20a8:54ff:fe51:da0a', 'fe80::fc16:3eff:fe77:488d', 'fe80::9469:f2ff:feae:5824', 'fe80::fc16:3eff:fec7:336a', 'fe80::fc16:3eff:fe61:b7fd', 'fe80::fc16:3eff:fe6f:4242', 'fe80::fc16:3eff:fe2b:91a7', 'fe80::38dc:c1ff:fee9:4731', 'fe80::fc16:3eff:feb1:9e6a', 'fe80::fc16:3eff:feca:170a', 'fe80::38da:b9ff:fe6f:c47f', 'fe80::fc16:3eff:fe37:3568', 'fe80::fc16:3eff:fe12:f4f7', 'fe80::fc16:3eff:fe7e:140b', 'fe80::fc16:3eff:feee:d251', 'fe80::fc16:3eff:fe5d:12c5', 'fe80::f07e:ffff:fef1:a8c0', 'fe80::4c8e:e4ff:feff:6e14', 'fe80::fc16:3eff:fec2:8da4'] Jun 11 23:13:51.276939 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.lightos [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98431) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 11 23:13:51.277033 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.lightos [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] LIGHTOS: no hostnqn found. {{(pid=98431) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 11 23:13:51.277259 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] <== get_connector_properties: return (98ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.209', 'host': 'np0000002687', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:798b370f1cc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad465dfe-0ed1-4637-98c3-ddaebebd61a4', 'nvme_native_multipath': False} {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 11 23:13:51.309954 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:13:51.314818 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98431) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 11 23:13:51.576642 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-3c53892c-dd85-496f-8e29-d9260526435e req-806249bd-5e62-48c0-afe4-da20d5a4bb6b service nova] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Received event network-vif-unplugged-852fc4ec-82e1-4185-a33c-3c45ff42351e {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:13:51.578551 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-3c53892c-dd85-496f-8e29-d9260526435e req-806249bd-5e62-48c0-afe4-da20d5a4bb6b service nova] Acquiring lock "c82748e6-1c78-4372-ad4b-48d1c6448efa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:51.579372 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-3c53892c-dd85-496f-8e29-d9260526435e req-806249bd-5e62-48c0-afe4-da20d5a4bb6b service nova] Lock "c82748e6-1c78-4372-ad4b-48d1c6448efa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.002s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:51.579372 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-3c53892c-dd85-496f-8e29-d9260526435e req-806249bd-5e62-48c0-afe4-da20d5a4bb6b service nova] Lock "c82748e6-1c78-4372-ad4b-48d1c6448efa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:51.579437 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-3c53892c-dd85-496f-8e29-d9260526435e req-806249bd-5e62-48c0-afe4-da20d5a4bb6b service nova] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] No waiting events found dispatching network-vif-unplugged-852fc4ec-82e1-4185-a33c-3c45ff42351e {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:13:51.580379 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-3c53892c-dd85-496f-8e29-d9260526435e req-806249bd-5e62-48c0-afe4-da20d5a4bb6b service nova] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Received event network-vif-unplugged-852fc4ec-82e1-4185-a33c-3c45ff42351e for instance with task_state deleting. {{(pid=98431) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 11 23:13:51.581768 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-3c53892c-dd85-496f-8e29-d9260526435e req-806249bd-5e62-48c0-afe4-da20d5a4bb6b service nova] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Received event network-vif-deleted-852fc4ec-82e1-4185-a33c-3c45ff42351e {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:13:51.604564 np0000002687 nova-compute[98431]: INFO nova.compute.manager [-] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Took 1.41 seconds to deallocate network for instance. Jun 11 23:13:51.810852 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:52.195637 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-51795300-f265-41aa-a885-80fa394eb2b7 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Took 0.59 seconds to detach 1 volumes for instance. Jun 11 23:13:52.202140 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-51795300-f265-41aa-a885-80fa394eb2b7 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Deleting volume: 5498d0af-4b75-4132-b06e-56f2b5b013ea {{(pid=98431) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}} Jun 11 23:13:52.272353 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [-] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Updating instance_info_cache with network_info: [] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:13:52.468136 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] Starting finish_migration {{(pid=98431) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12803}} Jun 11 23:13:52.469764 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] Instance directory exists: not creating {{(pid=98431) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5217}} Jun 11 23:13:52.470102 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] Creating image(s) Jun 11 23:13:52.470961 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:13:52.576285 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-df5a5487-ff73-4e20-83e4-77b9f23d81f4 req-2831763f-274a-4214-a6db-bc9dfbaffd86 service nova] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Received event network-vif-unplugged-a1e7aeff-5992-43be-bb2c-d504e7019c64 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:13:52.576596 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-df5a5487-ff73-4e20-83e4-77b9f23d81f4 req-2831763f-274a-4214-a6db-bc9dfbaffd86 service nova] Acquiring lock "7609742e-a3a2-4be2-ba02-227efb2101e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:52.582038 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-df5a5487-ff73-4e20-83e4-77b9f23d81f4 req-2831763f-274a-4214-a6db-bc9dfbaffd86 service nova] Lock "7609742e-a3a2-4be2-ba02-227efb2101e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.005s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:52.582252 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-df5a5487-ff73-4e20-83e4-77b9f23d81f4 req-2831763f-274a-4214-a6db-bc9dfbaffd86 service nova] Lock "7609742e-a3a2-4be2-ba02-227efb2101e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:52.582336 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-df5a5487-ff73-4e20-83e4-77b9f23d81f4 req-2831763f-274a-4214-a6db-bc9dfbaffd86 service nova] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] No waiting events found dispatching network-vif-unplugged-a1e7aeff-5992-43be-bb2c-d504e7019c64 {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:13:52.582569 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-df5a5487-ff73-4e20-83e4-77b9f23d81f4 req-2831763f-274a-4214-a6db-bc9dfbaffd86 service nova] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Received event network-vif-unplugged-a1e7aeff-5992-43be-bb2c-d504e7019c64 for instance with task_state deleting. {{(pid=98431) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 11 23:13:52.583064 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-df5a5487-ff73-4e20-83e4-77b9f23d81f4 req-2831763f-274a-4214-a6db-bc9dfbaffd86 service nova] [instance: 67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f] Received event network-vif-plugged-59f62261-8a42-4e76-9609-68343996250d {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:13:52.583064 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-df5a5487-ff73-4e20-83e4-77b9f23d81f4 req-2831763f-274a-4214-a6db-bc9dfbaffd86 service nova] Acquiring lock "67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:52.583229 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-df5a5487-ff73-4e20-83e4-77b9f23d81f4 req-2831763f-274a-4214-a6db-bc9dfbaffd86 service nova] Lock "67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:52.583993 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-df5a5487-ff73-4e20-83e4-77b9f23d81f4 req-2831763f-274a-4214-a6db-bc9dfbaffd86 service nova] Lock "67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:52.583993 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-df5a5487-ff73-4e20-83e4-77b9f23d81f4 req-2831763f-274a-4214-a6db-bc9dfbaffd86 service nova] [instance: 67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f] No waiting events found dispatching network-vif-plugged-59f62261-8a42-4e76-9609-68343996250d {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:13:52.585575 np0000002687 nova-compute[98431]: WARNING nova.compute.manager [req-df5a5487-ff73-4e20-83e4-77b9f23d81f4 req-2831763f-274a-4214-a6db-bc9dfbaffd86 service nova] [instance: 67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f] Received unexpected event network-vif-plugged-59f62261-8a42-4e76-9609-68343996250d for instance with vm_state rescued and task_state None. Jun 11 23:13:52.585575 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-df5a5487-ff73-4e20-83e4-77b9f23d81f4 req-2831763f-274a-4214-a6db-bc9dfbaffd86 service nova] [instance: 67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f] Received event network-vif-plugged-59f62261-8a42-4e76-9609-68343996250d {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:13:52.585575 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-df5a5487-ff73-4e20-83e4-77b9f23d81f4 req-2831763f-274a-4214-a6db-bc9dfbaffd86 service nova] Acquiring lock "67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:52.585575 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-df5a5487-ff73-4e20-83e4-77b9f23d81f4 req-2831763f-274a-4214-a6db-bc9dfbaffd86 service nova] Lock "67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:52.585575 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-df5a5487-ff73-4e20-83e4-77b9f23d81f4 req-2831763f-274a-4214-a6db-bc9dfbaffd86 service nova] Lock "67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:52.585575 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-df5a5487-ff73-4e20-83e4-77b9f23d81f4 req-2831763f-274a-4214-a6db-bc9dfbaffd86 service nova] [instance: 67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f] No waiting events found dispatching network-vif-plugged-59f62261-8a42-4e76-9609-68343996250d {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:13:52.585575 np0000002687 nova-compute[98431]: WARNING nova.compute.manager [req-df5a5487-ff73-4e20-83e4-77b9f23d81f4 req-2831763f-274a-4214-a6db-bc9dfbaffd86 service nova] [instance: 67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f] Received unexpected event network-vif-plugged-59f62261-8a42-4e76-9609-68343996250d for instance with vm_state rescued and task_state None. Jun 11 23:13:52.590103 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-df5a5487-ff73-4e20-83e4-77b9f23d81f4 req-2831763f-274a-4214-a6db-bc9dfbaffd86 service nova] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Received event network-vif-deleted-a1e7aeff-5992-43be-bb2c-d504e7019c64 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:13:52.591337 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json" returned: 0 in 0.119s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:13:52.591855 np0000002687 nova-compute[98431]: DEBUG nova.virt.disk.api [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Checking if we can resize image /opt/stack/data/nova/instances/64d7833a-82e8-43e9-83ed-2507197b69bf/disk. size=1073741824 {{(pid=98431) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 11 23:13:52.592150 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64d7833a-82e8-43e9-83ed-2507197b69bf/disk --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:13:52.687098 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64d7833a-82e8-43e9-83ed-2507197b69bf/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:13:52.687650 np0000002687 nova-compute[98431]: DEBUG nova.virt.disk.api [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Cannot resize image /opt/stack/data/nova/instances/64d7833a-82e8-43e9-83ed-2507197b69bf/disk to a smaller size. {{(pid=98431) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 11 23:13:52.756178 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-51795300-f265-41aa-a885-80fa394eb2b7 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:52.756178 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-51795300-f265-41aa-a885-80fa394eb2b7 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:52.778658 np0000002687 nova-compute[98431]: INFO nova.compute.manager [-] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Took 2.21 seconds to deallocate network for instance. Jun 11 23:13:52.913860 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:53.192556 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] Did not create local disks {{(pid=98431) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}} Jun 11 23:13:53.192746 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] Ensure instance console log exists: /opt/stack/data/nova/instances/64d7833a-82e8-43e9-83ed-2507197b69bf/console.log {{(pid=98431) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}} Jun 11 23:13:53.193404 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:53.193404 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:53.193404 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:53.195567 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] Start _get_guest_xml network_info=[{"id": "283962f2-faaf-4d85-8eda-9b77b55a5b0c", "address": "fa:16:3e:4b:26:95", "network": {"id": "17593db3-c22d-4354-ab29-933b1c6a5c3a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1094286565-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1094286565-network", "vif_mac": "fa:16:3e:4b:26:95"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "81fd45f475a04e5c8e9bd9deb7ad4c1e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap283962f2-fa", "ovs_interfaceid": "283962f2-faaf-4d85-8eda-9b77b55a5b0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-11T23:08:20Z,direct_url=,disk_format='qcow2',id=f30640f8-7aca-4300-a085-4706a5209a79,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ce012f9fabdb4ee5a73e212437f59d97',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-11T23:08:23Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'image_id': 'f30640f8-7aca-4300-a085-4706a5209a79'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'mount_device': '/dev/vdb', 'attachment_id': '98b7c7d3-56b6-41ec-afc6-f3df5cafd047', 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff', 'iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f535b91b-3bff-46ad-905e-644bd012b9ff', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': '64d7833a-82e8-43e9-83ed-2507197b69bf', 'attached_at': '2026-06-11T23:13:51.000000', 'detached_at': '', 'volume_id': 'f535b91b-3bff-46ad-905e-644bd012b9ff', 'multiattach': True, 'serial': 'f535b91b-3bff-46ad-905e-644bd012b9ff'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98431) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 11 23:13:53.200824 np0000002687 nova-compute[98431]: WARNING nova.virt.libvirt.driver [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 11 23:13:53.202002 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='f30640f8-7aca-4300-a085-4706a5209a79', instance_meta=NovaInstanceMeta(name='multiattach-server-0', uuid='64d7833a-82e8-43e9-83ed-2507197b69bf'), owner=OwnerMeta(userid='c17e84202f404c3c8e73292bb59d7b27', username='tempest-AttachVolumeMultiAttachTest-1514006700-project-member', projectid='81fd45f475a04e5c8e9bd9deb7ad4c1e', projectname='tempest-AttachVolumeMultiAttachTest-1514006700'), image=ImageMeta(id='f30640f8-7aca-4300-a085-4706a5209a79', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.micro', flavorid='84', memory_mb=256, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "283962f2-faaf-4d85-8eda-9b77b55a5b0c", "address": "fa:16:3e:4b:26:95", "network": {"id": "17593db3-c22d-4354-ab29-933b1c6a5c3a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1094286565-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1094286565-network", "vif_mac": "fa:16:3e:4b:26:95"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "81fd45f475a04e5c8e9bd9deb7ad4c1e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap283962f2-fa", "ovs_interfaceid": "283962f2-faaf-4d85-8eda-9b77b55a5b0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1781219633.2014287) {{(pid=98431) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 11 23:13:53.202603 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:53.204467 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Searching host: 'np0000002687' for CPU controller through CGroups V1... {{(pid=98431) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 11 23:13:53.204564 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] CPU controller missing on host. {{(pid=98431) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 11 23:13:53.205437 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Searching host: 'np0000002687' for CPU controller through CGroups V2... {{(pid=98431) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 11 23:13:53.205437 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] CPU controller found on host. {{(pid=98431) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 11 23:13:53.207052 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98431) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 11 23:13:53.207052 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-11T23:08:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=256,name='m1.micro',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-11T23:08:20Z,direct_url=,disk_format='qcow2',id=f30640f8-7aca-4300-a085-4706a5209a79,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ce012f9fabdb4ee5a73e212437f59d97',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-11T23:08:23Z,virtual_size=,visibility=), allow threads: True {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 11 23:13:53.207052 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Flavor limits 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 11 23:13:53.207052 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Image limits 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 11 23:13:53.207052 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Flavor pref 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 11 23:13:53.207052 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Image pref 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 11 23:13:53.207052 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 11 23:13:53.207052 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 11 23:13:53.207355 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98431) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 11 23:13:53.207355 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Got 1 possible topologies {{(pid=98431) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 11 23:13:53.207355 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 11 23:13:53.207474 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 11 23:13:53.216967 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64d7833a-82e8-43e9-83ed-2507197b69bf/disk.config --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:13:53.325662 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64d7833a-82e8-43e9-83ed-2507197b69bf/disk.config --force-share --output=json" returned: 0 in 0.109s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:13:53.326082 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Acquiring lock "/opt/stack/data/nova/instances/64d7833a-82e8-43e9-83ed-2507197b69bf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:53.326294 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "/opt/stack/data/nova/instances/64d7833a-82e8-43e9-83ed-2507197b69bf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:53.329860 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "/opt/stack/data/nova/instances/64d7833a-82e8-43e9-83ed-2507197b69bf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:53.329860 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] Calling os-brick to attach iSCSI Volume {{(pid=98431) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 11 23:13:53.329860 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff', 'iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f535b91b-3bff-46ad-905e-644bd012b9ff', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 11 23:13:53.329860 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 11 23:13:53.329860 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 11 23:13:53.329860 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff', 'iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f535b91b-3bff-46ad-905e-644bd012b9ff', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98431) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 11 23:13:53.345099 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 11 23:13:53.346415 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 11 23:13:53.348708 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 11 23:13:53.349011 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.iscsi [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 11 23:13:53.349629 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 11 23:13:53.350444 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.iscsi [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 11 23:13:53.364578 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 11 23:13:53.364578 np0000002687 nova-compute[98431]: node.name = iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff Jun 11 23:13:53.364578 np0000002687 nova-compute[98431]: node.tpgt = -1 Jun 11 23:13:53.364578 np0000002687 nova-compute[98431]: node.startup = automatic Jun 11 23:13:53.364578 np0000002687 nova-compute[98431]: node.leading_login = No Jun 11 23:13:53.364578 np0000002687 nova-compute[98431]: iface.iscsi_ifacename = default Jun 11 23:13:53.364578 np0000002687 nova-compute[98431]: iface.net_ifacename = Jun 11 23:13:53.364578 np0000002687 nova-compute[98431]: iface.ipaddress = Jun 11 23:13:53.364578 np0000002687 nova-compute[98431]: iface.prefix_len = 0 Jun 11 23:13:53.364578 np0000002687 nova-compute[98431]: iface.hwaddress = Jun 11 23:13:53.364578 np0000002687 nova-compute[98431]: iface.transport_name = tcp Jun 11 23:13:53.364578 np0000002687 nova-compute[98431]: iface.initiatorname = Jun 11 23:13:53.364578 np0000002687 nova-compute[98431]: iface.state = Jun 11 23:13:53.364578 np0000002687 nova-compute[98431]: iface.vlan_id = 0 Jun 11 23:13:53.364578 np0000002687 nova-compute[98431]: iface.vlan_priority = 0 Jun 11 23:13:53.364578 np0000002687 nova-compute[98431]: iface.vlan_state = Jun 11 23:13:53.364578 np0000002687 nova-compute[98431]: iface.iface_num = 0 Jun 11 23:13:53.364578 np0000002687 nova-compute[98431]: iface.mtu = 0 Jun 11 23:13:53.364578 np0000002687 nova-compute[98431]: iface.port = 0 Jun 11 23:13:53.364578 np0000002687 nova-compute[98431]: iface.bootproto = Jun 11 23:13:53.364578 np0000002687 nova-compute[98431]: iface.subnet_mask = Jun 11 23:13:53.364578 np0000002687 nova-compute[98431]: iface.gateway = Jun 11 23:13:53.364578 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id_state = Jun 11 23:13:53.364578 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id = Jun 11 23:13:53.364578 np0000002687 nova-compute[98431]: iface.dhcp_dns = Jun 11 23:13:53.364578 np0000002687 nova-compute[98431]: iface.dhcp_learn_iqn = Jun 11 23:13:53.364578 np0000002687 nova-compute[98431]: iface.dhcp_req_vendor_id_state = Jun 11 23:13:53.364578 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id_state = Jun 11 23:13:53.364578 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id = Jun 11 23:13:53.364578 np0000002687 nova-compute[98431]: iface.dhcp_slp_da = Jun 11 23:13:53.364578 np0000002687 nova-compute[98431]: iface.fragmentation = Jun 11 23:13:53.364578 np0000002687 nova-compute[98431]: iface.gratuitous_arp = Jun 11 23:13:53.364578 np0000002687 nova-compute[98431]: iface.incoming_forwarding = Jun 11 23:13:53.364578 np0000002687 nova-compute[98431]: iface.tos_state = Jun 11 23:13:53.364578 np0000002687 nova-compute[98431]: iface.tos = 0 Jun 11 23:13:53.364578 np0000002687 nova-compute[98431]: iface.ttl = 0 Jun 11 23:13:53.364578 np0000002687 nova-compute[98431]: iface.delayed_ack = Jun 11 23:13:53.364578 np0000002687 nova-compute[98431]: iface.tcp_nagle = Jun 11 23:13:53.364578 np0000002687 nova-compute[98431]: iface.tcp_wsf_state = Jun 11 23:13:53.364578 np0000002687 nova-compute[98431]: iface.tcp_wsf = 0 Jun 11 23:13:53.364578 np0000002687 nova-compute[98431]: iface.tcp_timer_scale = 0 Jun 11 23:13:53.364578 np0000002687 nova-compute[98431]: iface.tcp_timestamp = Jun 11 23:13:53.364578 np0000002687 nova-compute[98431]: iface.redirect = Jun 11 23:13:53.364578 np0000002687 nova-compute[98431]: iface.def_task_mgmt_timeout = 0 Jun 11 23:13:53.364578 np0000002687 nova-compute[98431]: iface.header_digest = Jun 11 23:13:53.364578 np0000002687 nova-compute[98431]: iface.data_digest = Jun 11 23:13:53.364578 np0000002687 nova-compute[98431]: iface.immediate_data = Jun 11 23:13:53.364578 np0000002687 nova-compute[98431]: iface.initial_r2t = Jun 11 23:13:53.364578 np0000002687 nova-compute[98431]: iface.data_seq_inorder = Jun 11 23:13:53.364578 np0000002687 nova-compute[98431]: iface.data_pdu_inorder = Jun 11 23:13:53.364578 np0000002687 nova-compute[98431]: iface.erl = 0 Jun 11 23:13:53.364578 np0000002687 nova-compute[98431]: iface.max_receive_data_len = 0 Jun 11 23:13:53.364578 np0000002687 nova-compute[98431]: iface.first_burst_len = 0 Jun 11 23:13:53.364578 np0000002687 nova-compute[98431]: iface.max_outstanding_r2t = 0 Jun 11 23:13:53.364578 np0000002687 nova-compute[98431]: iface.max_burst_len = 0 Jun 11 23:13:53.364578 np0000002687 nova-compute[98431]: iface.chap_auth = Jun 11 23:13:53.364578 np0000002687 nova-compute[98431]: iface.bidi_chap = Jun 11 23:13:53.364578 np0000002687 nova-compute[98431]: iface.strict_login_compliance = Jun 11 23:13:53.364578 np0000002687 nova-compute[98431]: iface.discovery_auth = Jun 11 23:13:53.364578 np0000002687 nova-compute[98431]: iface.discovery_logout = Jun 11 23:13:53.364578 np0000002687 nova-compute[98431]: node.discovery_address = Jun 11 23:13:53.364578 np0000002687 nova-compute[98431]: node.discovery_port = 0 Jun 11 23:13:53.364578 np0000002687 nova-compute[98431]: node.discovery_type = fw Jun 11 23:13:53.364578 np0000002687 nova-compute[98431]: node.session.initial_cmdsn = 0 Jun 11 23:13:53.364578 np0000002687 nova-compute[98431]: node.session.initial_login_retry_max = 8 Jun 11 23:13:53.364578 np0000002687 nova-compute[98431]: node.session.xmit_thread_priority = 0 Jun 11 23:13:53.364578 np0000002687 nova-compute[98431]: node.session.cmds_max = 128 Jun 11 23:13:53.364578 np0000002687 nova-compute[98431]: node.session.queue_depth = 32 Jun 11 23:13:53.364578 np0000002687 nova-compute[98431]: node.session.nr_sessions = 1 Jun 11 23:13:53.364578 np0000002687 nova-compute[98431]: node.session.auth.authmethod = None Jun 11 23:13:53.364578 np0000002687 nova-compute[98431]: node.session.auth.username = Jun 11 23:13:53.364578 np0000002687 nova-compute[98431]: node.session.auth.password = *** Jun 11 23:13:53.364578 np0000002687 nova-compute[98431]: node.session.auth.username_in = Jun 11 23:13:53.364578 np0000002687 nova-compute[98431]: node.session.auth.password_in = Jun 11 23:13:53.364578 np0000002687 nova-compute[98431]: node.session.auth.chap_algs = SHA256 Jun 11 23:13:53.364578 np0000002687 nova-compute[98431]: node.session.timeo.replacement_timeout = 120 Jun 11 23:13:53.364578 np0000002687 nova-compute[98431]: node.session.err_timeo.abort_timeout = 15 Jun 11 23:13:53.364578 np0000002687 nova-compute[98431]: node.session.err_timeo.lu_reset_timeout = 30 Jun 11 23:13:53.364578 np0000002687 nova-compute[98431]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 11 23:13:53.364578 np0000002687 nova-compute[98431]: node.session.err_timeo.host_reset_timeout = 60 Jun 11 23:13:53.364578 np0000002687 nova-compute[98431]: node.session.iscsi.FastAbort = Yes Jun 11 23:13:53.364578 np0000002687 nova-compute[98431]: node.session.iscsi.InitialR2T = No Jun 11 23:13:53.364578 np0000002687 nova-compute[98431]: node.session.iscsi.ImmediateData = Yes Jun 11 23:13:53.364578 np0000002687 nova-compute[98431]: node.session.iscsi.FirstBurstLength = 262144 Jun 11 23:13:53.364578 np0000002687 nova-compute[98431]: node.session.iscsi.MaxBurstLength = 16776192 Jun 11 23:13:53.364578 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Retain = 0 Jun 11 23:13:53.364578 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Wait = 2 Jun 11 23:13:53.364578 np0000002687 nova-compute[98431]: node.session.iscsi.MaxConnections = 1 Jun 11 23:13:53.364578 np0000002687 nova-compute[98431]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 11 23:13:53.364578 np0000002687 nova-compute[98431]: node.session.iscsi.ERL = 0 Jun 11 23:13:53.364578 np0000002687 nova-compute[98431]: node.session.scan = manual Jun 11 23:13:53.364578 np0000002687 nova-compute[98431]: node.session.reopen_max = 0 Jun 11 23:13:53.364578 np0000002687 nova-compute[98431]: node.conn[0].address = 192.168.40.100 Jun 11 23:13:53.364578 np0000002687 nova-compute[98431]: node.conn[0].port = 3260 Jun 11 23:13:53.364578 np0000002687 nova-compute[98431]: node.conn[0].startup = manual Jun 11 23:13:53.364578 np0000002687 nova-compute[98431]: node.conn[0].tcp.window_size = 524288 Jun 11 23:13:53.364578 np0000002687 nova-compute[98431]: node.conn[0].tcp.type_of_service = 0 Jun 11 23:13:53.364578 np0000002687 nova-compute[98431]: node.conn[0].timeo.logout_timeout = 15 Jun 11 23:13:53.364578 np0000002687 nova-compute[98431]: node.conn[0].timeo.login_timeout = 15 Jun 11 23:13:53.364578 np0000002687 nova-compute[98431]: node.conn[0].timeo.auth_timeout = 45 Jun 11 23:13:53.364578 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_interval = 5 Jun 11 23:13:53.364578 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_timeout = 5 Jun 11 23:13:53.364578 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 11 23:13:53.364578 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 11 23:13:53.364578 np0000002687 nova-compute[98431]: node.conn[0].iscsi.HeaderDigest = None Jun 11 23:13:53.364578 np0000002687 nova-compute[98431]: node.conn[0].iscsi.DataDigest = None Jun 11 23:13:53.364578 np0000002687 nova-compute[98431]: node.conn[0].iscsi.IFMarker = No Jun 11 23:13:53.364578 np0000002687 nova-compute[98431]: node.conn[0].iscsi.OFMarker = No Jun 11 23:13:53.364578 np0000002687 nova-compute[98431]: # END RECORD Jun 11 23:13:53.364578 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:13:53.368712 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-e9af58bf-3453-4693-8641-c909a40c185f tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Took 0.59 seconds to detach 1 volumes for instance. Jun 11 23:13:53.377155 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 11 23:13:53.377155 np0000002687 nova-compute[98431]: node.name = iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff Jun 11 23:13:53.377155 np0000002687 nova-compute[98431]: node.tpgt = -1 Jun 11 23:13:53.377155 np0000002687 nova-compute[98431]: node.startup = automatic Jun 11 23:13:53.377155 np0000002687 nova-compute[98431]: node.leading_login = No Jun 11 23:13:53.377155 np0000002687 nova-compute[98431]: iface.iscsi_ifacename = default Jun 11 23:13:53.377155 np0000002687 nova-compute[98431]: iface.net_ifacename = Jun 11 23:13:53.377155 np0000002687 nova-compute[98431]: iface.ipaddress = Jun 11 23:13:53.377155 np0000002687 nova-compute[98431]: iface.prefix_len = 0 Jun 11 23:13:53.377155 np0000002687 nova-compute[98431]: iface.hwaddress = Jun 11 23:13:53.377155 np0000002687 nova-compute[98431]: iface.transport_name = tcp Jun 11 23:13:53.377155 np0000002687 nova-compute[98431]: iface.initiatorname = Jun 11 23:13:53.377155 np0000002687 nova-compute[98431]: iface.state = Jun 11 23:13:53.377155 np0000002687 nova-compute[98431]: iface.vlan_id = 0 Jun 11 23:13:53.377155 np0000002687 nova-compute[98431]: iface.vlan_priority = 0 Jun 11 23:13:53.377155 np0000002687 nova-compute[98431]: iface.vlan_state = Jun 11 23:13:53.377155 np0000002687 nova-compute[98431]: iface.iface_num = 0 Jun 11 23:13:53.377155 np0000002687 nova-compute[98431]: iface.mtu = 0 Jun 11 23:13:53.377155 np0000002687 nova-compute[98431]: iface.port = 0 Jun 11 23:13:53.377155 np0000002687 nova-compute[98431]: iface.bootproto = Jun 11 23:13:53.377155 np0000002687 nova-compute[98431]: iface.subnet_mask = Jun 11 23:13:53.377155 np0000002687 nova-compute[98431]: iface.gateway = Jun 11 23:13:53.377155 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id_state = Jun 11 23:13:53.377155 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id = Jun 11 23:13:53.377155 np0000002687 nova-compute[98431]: iface.dhcp_dns = Jun 11 23:13:53.377155 np0000002687 nova-compute[98431]: iface.dhcp_learn_iqn = Jun 11 23:13:53.377155 np0000002687 nova-compute[98431]: iface.dhcp_req_vendor_id_state = Jun 11 23:13:53.377155 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id_state = Jun 11 23:13:53.377155 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id = Jun 11 23:13:53.377155 np0000002687 nova-compute[98431]: iface.dhcp_slp_da = Jun 11 23:13:53.377155 np0000002687 nova-compute[98431]: iface.fragmentation = Jun 11 23:13:53.377155 np0000002687 nova-compute[98431]: iface.gratuitous_arp = Jun 11 23:13:53.377155 np0000002687 nova-compute[98431]: iface.incoming_forwarding = Jun 11 23:13:53.377155 np0000002687 nova-compute[98431]: iface.tos_state = Jun 11 23:13:53.377155 np0000002687 nova-compute[98431]: iface.tos = 0 Jun 11 23:13:53.377155 np0000002687 nova-compute[98431]: iface.ttl = 0 Jun 11 23:13:53.377155 np0000002687 nova-compute[98431]: iface.delayed_ack = Jun 11 23:13:53.377155 np0000002687 nova-compute[98431]: iface.tcp_nagle = Jun 11 23:13:53.377155 np0000002687 nova-compute[98431]: iface.tcp_wsf_state = Jun 11 23:13:53.377155 np0000002687 nova-compute[98431]: iface.tcp_wsf = 0 Jun 11 23:13:53.377155 np0000002687 nova-compute[98431]: iface.tcp_timer_scale = 0 Jun 11 23:13:53.377155 np0000002687 nova-compute[98431]: iface.tcp_timestamp = Jun 11 23:13:53.377155 np0000002687 nova-compute[98431]: iface.redirect = Jun 11 23:13:53.377155 np0000002687 nova-compute[98431]: iface.def_task_mgmt_timeout = 0 Jun 11 23:13:53.377155 np0000002687 nova-compute[98431]: iface.header_digest = Jun 11 23:13:53.377155 np0000002687 nova-compute[98431]: iface.data_digest = Jun 11 23:13:53.377155 np0000002687 nova-compute[98431]: iface.immediate_data = Jun 11 23:13:53.377155 np0000002687 nova-compute[98431]: iface.initial_r2t = Jun 11 23:13:53.377155 np0000002687 nova-compute[98431]: iface.data_seq_inorder = Jun 11 23:13:53.377155 np0000002687 nova-compute[98431]: iface.data_pdu_inorder = Jun 11 23:13:53.377155 np0000002687 nova-compute[98431]: iface.erl = 0 Jun 11 23:13:53.377155 np0000002687 nova-compute[98431]: iface.max_receive_data_len = 0 Jun 11 23:13:53.377155 np0000002687 nova-compute[98431]: iface.first_burst_len = 0 Jun 11 23:13:53.377155 np0000002687 nova-compute[98431]: iface.max_outstanding_r2t = 0 Jun 11 23:13:53.377155 np0000002687 nova-compute[98431]: iface.max_burst_len = 0 Jun 11 23:13:53.377155 np0000002687 nova-compute[98431]: iface.chap_auth = Jun 11 23:13:53.377155 np0000002687 nova-compute[98431]: iface.bidi_chap = Jun 11 23:13:53.377155 np0000002687 nova-compute[98431]: iface.strict_login_compliance = Jun 11 23:13:53.377155 np0000002687 nova-compute[98431]: iface.discovery_auth = Jun 11 23:13:53.377155 np0000002687 nova-compute[98431]: iface.discovery_logout = Jun 11 23:13:53.377155 np0000002687 nova-compute[98431]: node.discovery_address = Jun 11 23:13:53.377155 np0000002687 nova-compute[98431]: node.discovery_port = 0 Jun 11 23:13:53.377155 np0000002687 nova-compute[98431]: node.discovery_type = fw Jun 11 23:13:53.377155 np0000002687 nova-compute[98431]: node.session.initial_cmdsn = 0 Jun 11 23:13:53.377155 np0000002687 nova-compute[98431]: node.session.initial_login_retry_max = 8 Jun 11 23:13:53.377155 np0000002687 nova-compute[98431]: node.session.xmit_thread_priority = 0 Jun 11 23:13:53.377155 np0000002687 nova-compute[98431]: node.session.cmds_max = 128 Jun 11 23:13:53.377155 np0000002687 nova-compute[98431]: node.session.queue_depth = 32 Jun 11 23:13:53.377155 np0000002687 nova-compute[98431]: node.session.nr_sessions = 1 Jun 11 23:13:53.377155 np0000002687 nova-compute[98431]: node.session.auth.authmethod = None Jun 11 23:13:53.377155 np0000002687 nova-compute[98431]: node.session.auth.username = Jun 11 23:13:53.377155 np0000002687 nova-compute[98431]: node.session.auth.password = *** Jun 11 23:13:53.377155 np0000002687 nova-compute[98431]: node.session.auth.username_in = Jun 11 23:13:53.377155 np0000002687 nova-compute[98431]: node.session.auth.password_in = Jun 11 23:13:53.377155 np0000002687 nova-compute[98431]: node.session.auth.chap_algs = SHA256 Jun 11 23:13:53.377155 np0000002687 nova-compute[98431]: node.session.timeo.replacement_timeout = 120 Jun 11 23:13:53.377155 np0000002687 nova-compute[98431]: node.session.err_timeo.abort_timeout = 15 Jun 11 23:13:53.377155 np0000002687 nova-compute[98431]: node.session.err_timeo.lu_reset_timeout = 30 Jun 11 23:13:53.377155 np0000002687 nova-compute[98431]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 11 23:13:53.377155 np0000002687 nova-compute[98431]: node.session.err_timeo.host_reset_timeout = 60 Jun 11 23:13:53.377155 np0000002687 nova-compute[98431]: node.session.iscsi.FastAbort = Yes Jun 11 23:13:53.377155 np0000002687 nova-compute[98431]: node.session.iscsi.InitialR2T = No Jun 11 23:13:53.377155 np0000002687 nova-compute[98431]: node.session.iscsi.ImmediateData = Yes Jun 11 23:13:53.377155 np0000002687 nova-compute[98431]: node.session.iscsi.FirstBurstLength = 262144 Jun 11 23:13:53.377155 np0000002687 nova-compute[98431]: node.session.iscsi.MaxBurstLength = 16776192 Jun 11 23:13:53.377155 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Retain = 0 Jun 11 23:13:53.377155 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Wait = 2 Jun 11 23:13:53.377155 np0000002687 nova-compute[98431]: node.session.iscsi.MaxConnections = 1 Jun 11 23:13:53.377155 np0000002687 nova-compute[98431]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 11 23:13:53.377155 np0000002687 nova-compute[98431]: node.session.iscsi.ERL = 0 Jun 11 23:13:53.377155 np0000002687 nova-compute[98431]: node.session.scan = manual Jun 11 23:13:53.377155 np0000002687 nova-compute[98431]: node.session.reopen_max = 0 Jun 11 23:13:53.377155 np0000002687 nova-compute[98431]: node.conn[0].address = 192.168.50.100 Jun 11 23:13:53.377155 np0000002687 nova-compute[98431]: node.conn[0].port = 3260 Jun 11 23:13:53.377155 np0000002687 nova-compute[98431]: node.conn[0].startup = manual Jun 11 23:13:53.377155 np0000002687 nova-compute[98431]: node.conn[0].tcp.window_size = 524288 Jun 11 23:13:53.377155 np0000002687 nova-compute[98431]: node.conn[0].tcp.type_of_service = 0 Jun 11 23:13:53.377155 np0000002687 nova-compute[98431]: node.conn[0].timeo.logout_timeout = 15 Jun 11 23:13:53.377155 np0000002687 nova-compute[98431]: node.conn[0].timeo.login_timeout = 15 Jun 11 23:13:53.377155 np0000002687 nova-compute[98431]: node.conn[0].timeo.auth_timeout = 45 Jun 11 23:13:53.377155 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_interval = 5 Jun 11 23:13:53.377155 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_timeout = 5 Jun 11 23:13:53.377155 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 11 23:13:53.377155 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 11 23:13:53.377155 np0000002687 nova-compute[98431]: node.conn[0].iscsi.HeaderDigest = None Jun 11 23:13:53.377155 np0000002687 nova-compute[98431]: node.conn[0].iscsi.DataDigest = None Jun 11 23:13:53.377155 np0000002687 nova-compute[98431]: node.conn[0].iscsi.IFMarker = No Jun 11 23:13:53.377155 np0000002687 nova-compute[98431]: node.conn[0].iscsi.OFMarker = No Jun 11 23:13:53.377155 np0000002687 nova-compute[98431]: # END RECORD Jun 11 23:13:53.377155 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:13:53.387201 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:13:53.396904 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:13:53.410393 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:53.410393 np0000002687 nova-compute[98431]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:13:53.410393 np0000002687 nova-compute[98431]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:13:53.410393 np0000002687 nova-compute[98431]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:13:53.410393 np0000002687 nova-compute[98431]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:13:53.410393 np0000002687 nova-compute[98431]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8 (non-flash) Jun 11 23:13:53.410393 np0000002687 nova-compute[98431]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8 (non-flash) Jun 11 23:13:53.410393 np0000002687 nova-compute[98431]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13 (non-flash) Jun 11 23:13:53.410393 np0000002687 nova-compute[98431]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13 (non-flash) Jun 11 23:13:53.410393 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:53.410393 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:13:53.410393 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:53.410393 np0000002687 nova-compute[98431]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:13:53.410393 np0000002687 nova-compute[98431]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:13:53.410393 np0000002687 nova-compute[98431]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:13:53.410393 np0000002687 nova-compute[98431]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:13:53.410393 np0000002687 nova-compute[98431]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8 (non-flash) Jun 11 23:13:53.410393 np0000002687 nova-compute[98431]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8 (non-flash) Jun 11 23:13:53.410393 np0000002687 nova-compute[98431]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13 (non-flash) Jun 11 23:13:53.410393 np0000002687 nova-compute[98431]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13 (non-flash) Jun 11 23:13:53.410393 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:53.410393 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:13:53.410919 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.063s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 11 23:13:53.410919 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Connected to 192.168.40.100:3260 {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 11 23:13:53.411760 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] HCTL ('13', '0', '0', 0) found on session 31 with lun 0 {{(pid=98431) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 11 23:13:53.412150 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Scanning host 13 c: 0, t: 0, l: 0) {{(pid=98431) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 11 23:13:53.420767 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:53.420767 np0000002687 nova-compute[98431]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:13:53.420767 np0000002687 nova-compute[98431]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:13:53.420767 np0000002687 nova-compute[98431]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:13:53.420767 np0000002687 nova-compute[98431]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:13:53.420767 np0000002687 nova-compute[98431]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8 (non-flash) Jun 11 23:13:53.420767 np0000002687 nova-compute[98431]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8 (non-flash) Jun 11 23:13:53.420767 np0000002687 nova-compute[98431]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13 (non-flash) Jun 11 23:13:53.420767 np0000002687 nova-compute[98431]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13 (non-flash) Jun 11 23:13:53.420767 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:53.420767 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:13:53.420767 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:53.420767 np0000002687 nova-compute[98431]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:13:53.420767 np0000002687 nova-compute[98431]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:13:53.420767 np0000002687 nova-compute[98431]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:13:53.420767 np0000002687 nova-compute[98431]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:13:53.420767 np0000002687 nova-compute[98431]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8 (non-flash) Jun 11 23:13:53.420767 np0000002687 nova-compute[98431]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8 (non-flash) Jun 11 23:13:53.420767 np0000002687 nova-compute[98431]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13 (non-flash) Jun 11 23:13:53.420767 np0000002687 nova-compute[98431]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13 (non-flash) Jun 11 23:13:53.420767 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:13:53.420767 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:13:53.420767 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.072s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 11 23:13:53.420767 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Connected to 192.168.50.100:3260 {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 11 23:13:53.421533 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] HCTL ('14', '0', '0', 0) found on session 32 with lun 0 {{(pid=98431) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 11 23:13:53.421533 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Scanning host 14 c: 0, t: 0, l: 0) {{(pid=98431) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 11 23:13:53.431483 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Searching for a device in session 31 and hctl ('13', '0', '0', 0) yield: sdh {{(pid=98431) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 11 23:13:53.431483 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f535b91b-3bff-46ad-905e-644bd012b9ff', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 11 23:13:53.435960 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Searching for a device in session 32 and hctl ('14', '0', '0', 0) yield: sdi {{(pid=98431) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 11 23:13:53.436025 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'f535b91b-3bff-46ad-905e-644bd012b9ff', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 11 23:13:53.745111 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-51795300-f265-41aa-a885-80fa394eb2b7 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98431) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 11 23:13:53.745965 np0000002687 nova-compute[98431]: DEBUG nova.compute.provider_tree [None req-51795300-f265-41aa-a885-80fa394eb2b7 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Inventory has not changed in ProviderTree for provider: e3e65fe2-9de9-4821-8b4a-ccae37c66e25 {{(pid=98431) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 11 23:13:53.776532 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-1832c4d4-44f6-4f69-b46b-29924f655c1c tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: dd1dd46c-2231-40b4-aa61-0121733a932d] Rescuing Jun 11 23:13:53.776772 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-1832c4d4-44f6-4f69-b46b-29924f655c1c tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Acquiring lock "refresh_cache-dd1dd46c-2231-40b4-aa61-0121733a932d" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 11 23:13:53.776940 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-1832c4d4-44f6-4f69-b46b-29924f655c1c tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Acquired lock "refresh_cache-dd1dd46c-2231-40b4-aa61-0121733a932d" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 11 23:13:53.777119 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-1832c4d4-44f6-4f69-b46b-29924f655c1c tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: dd1dd46c-2231-40b4-aa61-0121733a932d] Building network info cache for instance {{(pid=98431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 11 23:13:53.888939 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-e9af58bf-3453-4693-8641-c909a40c185f tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:54.249047 np0000002687 nova-compute[98431]: DEBUG nova.scheduler.client.report [None req-51795300-f265-41aa-a885-80fa394eb2b7 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Inventory has not changed for provider e3e65fe2-9de9-4821-8b4a-ccae37c66e25 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98431) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 11 23:13:54.281790 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-1832c4d4-44f6-4f69-b46b-29924f655c1c tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:13:54.352294 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98431) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 11 23:13:54.464097 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:54.585198 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:54.757459 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-51795300-f265-41aa-a885-80fa394eb2b7 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 2.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:54.759906 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-e9af58bf-3453-4693-8641-c909a40c185f tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.871s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:54.761432 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-e9af58bf-3453-4693-8641-c909a40c185f tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.002s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:54.851094 np0000002687 nova-compute[98431]: INFO nova.scheduler.client.report [None req-51795300-f265-41aa-a885-80fa394eb2b7 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Deleted allocations for instance c82748e6-1c78-4372-ad4b-48d1c6448efa Jun 11 23:13:54.861430 np0000002687 nova-compute[98431]: INFO nova.scheduler.client.report [None req-e9af58bf-3453-4693-8641-c909a40c185f tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Deleted allocations for instance 7609742e-a3a2-4be2-ba02-227efb2101e1 Jun 11 23:13:54.890112 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-1832c4d4-44f6-4f69-b46b-29924f655c1c tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:13:55.018843 np0000002687 nova-compute[98431]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.00038568800005123194 future=) submitted to {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:13:55.018843 np0000002687 nova-compute[98431]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:13:55.019027 np0000002687 nova-compute[98431]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=2.5053962350000347 future=) {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:13:55.019027 np0000002687 nova-compute[98431]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=2.5052911010000116 future=) was cancelled while queued, skipping {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:13:55.019110 np0000002687 nova-compute[98431]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:13:55.019151 np0000002687 nova-compute[98431]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=4.5377949440000975 future=) {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:13:55.020332 np0000002687 nova-compute[98431]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=4.537726318000068 future=) {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:13:55.020332 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Emitting event Stopped> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:13:55.020332 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 8641b14d-785b-44b0-ad6d-bb537cbee5c7] VM Stopped (Lifecycle Event) Jun 11 23:13:55.065050 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-1832c4d4-44f6-4f69-b46b-29924f655c1c tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: dd1dd46c-2231-40b4-aa61-0121733a932d] Updating instance_info_cache with network_info: [{"id": "98c628a8-e152-4189-94f1-e166c406cf10", "address": "fa:16:3e:2b:91:a7", "network": {"id": "77fc4e10-1fed-4963-86b4-1fbb3a9c6f7f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1105404274-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b2b9f55b231c455ca1a4579d7ed54888", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap98c628a8-e1", "ovs_interfaceid": "98c628a8-e152-4189-94f1-e166c406cf10", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:13:55.157384 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:55.523469 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 8641b14d-785b-44b0-ad6d-bb537cbee5c7] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:13:55.567112 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-1832c4d4-44f6-4f69-b46b-29924f655c1c tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Releasing lock "refresh_cache-dd1dd46c-2231-40b4-aa61-0121733a932d" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 11 23:13:55.864568 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-51795300-f265-41aa-a885-80fa394eb2b7 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lock "c82748e6-1c78-4372-ad4b-48d1c6448efa" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 8.121s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:55.873823 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-e9af58bf-3453-4693-8641-c909a40c185f tempest-ServerActionsTestOtherB-1260316994 tempest-ServerActionsTestOtherB-1260316994-project-member] Lock "7609742e-a3a2-4be2-ba02-227efb2101e1" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 7.873s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:57.270224 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:57.273907 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:57.296718 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:57.450878 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:57.457111 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:57.495728 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:57.504976 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:57.531466 np0000002687 nova-compute[98431]: DEBUG nova.utils [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Queued Task(fn=>, remaining_delay=14.999655778000033 future=) {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:13:57.532969 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [-] [instance: dd1dd46c-2231-40b4-aa61-0121733a932d] Instance destroyed successfully. Jun 11 23:13:57.533542 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-1832c4d4-44f6-4f69-b46b-29924f655c1c tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Lazy-loading 'numa_topology' on Instance uuid dd1dd46c-2231-40b4-aa61-0121733a932d {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:13:57.608217 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-991a3102-9958-4e0f-aff2-b6cd83e76728 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Acquiring lock "8aec3cea-109d-43f8-983c-1d5ee2f71181" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:57.609094 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-991a3102-9958-4e0f-aff2-b6cd83e76728 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lock "8aec3cea-109d-43f8-983c-1d5ee2f71181" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.003s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:57.609094 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-991a3102-9958-4e0f-aff2-b6cd83e76728 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Acquiring lock "8aec3cea-109d-43f8-983c-1d5ee2f71181-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:57.609451 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-991a3102-9958-4e0f-aff2-b6cd83e76728 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lock "8aec3cea-109d-43f8-983c-1d5ee2f71181-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:57.609998 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-991a3102-9958-4e0f-aff2-b6cd83e76728 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lock "8aec3cea-109d-43f8-983c-1d5ee2f71181-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:57.615648 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-991a3102-9958-4e0f-aff2-b6cd83e76728 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 8aec3cea-109d-43f8-983c-1d5ee2f71181] Terminating instance Jun 11 23:13:57.915812 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:58.012455 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-7406dc28-3cf3-452c-85c8-9fe8693ab8a6 req-a122d1ba-859f-4752-9562-83573ef199a8 service nova] [instance: dd1dd46c-2231-40b4-aa61-0121733a932d] Received event network-vif-unplugged-98c628a8-e152-4189-94f1-e166c406cf10 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:13:58.013561 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-7406dc28-3cf3-452c-85c8-9fe8693ab8a6 req-a122d1ba-859f-4752-9562-83573ef199a8 service nova] Acquiring lock "dd1dd46c-2231-40b4-aa61-0121733a932d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:58.013861 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-7406dc28-3cf3-452c-85c8-9fe8693ab8a6 req-a122d1ba-859f-4752-9562-83573ef199a8 service nova] Lock "dd1dd46c-2231-40b4-aa61-0121733a932d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:58.014177 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-7406dc28-3cf3-452c-85c8-9fe8693ab8a6 req-a122d1ba-859f-4752-9562-83573ef199a8 service nova] Lock "dd1dd46c-2231-40b4-aa61-0121733a932d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:58.014177 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-7406dc28-3cf3-452c-85c8-9fe8693ab8a6 req-a122d1ba-859f-4752-9562-83573ef199a8 service nova] [instance: dd1dd46c-2231-40b4-aa61-0121733a932d] No waiting events found dispatching network-vif-unplugged-98c628a8-e152-4189-94f1-e166c406cf10 {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:13:58.014380 np0000002687 nova-compute[98431]: WARNING nova.compute.manager [req-7406dc28-3cf3-452c-85c8-9fe8693ab8a6 req-a122d1ba-859f-4752-9562-83573ef199a8 service nova] [instance: dd1dd46c-2231-40b4-aa61-0121733a932d] Received unexpected event network-vif-unplugged-98c628a8-e152-4189-94f1-e166c406cf10 for instance with vm_state active and task_state rescuing. Jun 11 23:13:58.037839 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-1832c4d4-44f6-4f69-b46b-29924f655c1c tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: dd1dd46c-2231-40b4-aa61-0121733a932d] Attempting rescue Jun 11 23:13:58.039145 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-1832c4d4-44f6-4f69-b46b-29924f655c1c tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} {{(pid=98431) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4640}} Jun 11 23:13:58.044417 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-1832c4d4-44f6-4f69-b46b-29924f655c1c tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: dd1dd46c-2231-40b4-aa61-0121733a932d] Instance directory exists: not creating {{(pid=98431) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5217}} Jun 11 23:13:58.044417 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-1832c4d4-44f6-4f69-b46b-29924f655c1c tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: dd1dd46c-2231-40b4-aa61-0121733a932d] Creating image(s) Jun 11 23:13:58.044417 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-1832c4d4-44f6-4f69-b46b-29924f655c1c tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Acquiring lock "/opt/stack/data/nova/instances/dd1dd46c-2231-40b4-aa61-0121733a932d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:58.044417 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-1832c4d4-44f6-4f69-b46b-29924f655c1c tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Lock "/opt/stack/data/nova/instances/dd1dd46c-2231-40b4-aa61-0121733a932d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:58.045111 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-1832c4d4-44f6-4f69-b46b-29924f655c1c tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Lock "/opt/stack/data/nova/instances/dd1dd46c-2231-40b4-aa61-0121733a932d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:58.045385 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-1832c4d4-44f6-4f69-b46b-29924f655c1c tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Lazy-loading 'trusted_certs' on Instance uuid dd1dd46c-2231-40b4-aa61-0121733a932d {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:13:58.119589 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-991a3102-9958-4e0f-aff2-b6cd83e76728 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 8aec3cea-109d-43f8-983c-1d5ee2f71181] Start destroying the instance on the hypervisor. {{(pid=98431) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}} Jun 11 23:13:58.149976 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:58.171283 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:58.200364 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:58.502085 np0000002687 nova-compute[98431]: DEBUG nova.utils [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Queued Task(fn=>, remaining_delay=14.999650256999985 future=) {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:13:58.503941 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [-] [instance: 8aec3cea-109d-43f8-983c-1d5ee2f71181] Instance destroyed successfully. Jun 11 23:13:58.504378 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-991a3102-9958-4e0f-aff2-b6cd83e76728 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lazy-loading 'resources' on Instance uuid 8aec3cea-109d-43f8-983c-1d5ee2f71181 {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:13:58.549621 np0000002687 nova-compute[98431]: DEBUG nova.objects.base [None req-1832c4d4-44f6-4f69-b46b-29924f655c1c tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs {{(pid=98431) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 11 23:13:58.550340 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-1832c4d4-44f6-4f69-b46b-29924f655c1c tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:13:58.555865 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-1832c4d4-44f6-4f69-b46b-29924f655c1c tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:13:58.560334 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-1832c4d4-44f6-4f69-b46b-29924f655c1c tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Acquiring lock "d2c441059b2992961b5de03c05b32d04aff77cb1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:13:58.560866 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-1832c4d4-44f6-4f69-b46b-29924f655c1c tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Lock "d2c441059b2992961b5de03c05b32d04aff77cb1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:13:58.561334 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-1832c4d4-44f6-4f69-b46b-29924f655c1c tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:13:58.565038 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-1832c4d4-44f6-4f69-b46b-29924f655c1c tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:13:58.565431 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-1832c4d4-44f6-4f69-b46b-29924f655c1c tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:13:58.678933 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-1832c4d4-44f6-4f69-b46b-29924f655c1c tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json" returned: 0 in 0.113s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:13:58.679687 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-1832c4d4-44f6-4f69-b46b-29924f655c1c tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1,backing_fmt=raw /opt/stack/data/nova/instances/dd1dd46c-2231-40b4-aa61-0121733a932d/disk.rescue {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:13:58.752119 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-1832c4d4-44f6-4f69-b46b-29924f655c1c tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1,backing_fmt=raw /opt/stack/data/nova/instances/dd1dd46c-2231-40b4-aa61-0121733a932d/disk.rescue" returned: 0 in 0.072s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:13:58.753938 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-1832c4d4-44f6-4f69-b46b-29924f655c1c tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Lock "d2c441059b2992961b5de03c05b32d04aff77cb1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.193s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:13:58.753938 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-1832c4d4-44f6-4f69-b46b-29924f655c1c tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Lazy-loading 'migration_context' on Instance uuid dd1dd46c-2231-40b4-aa61-0121733a932d {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:13:59.007266 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-991a3102-9958-4e0f-aff2-b6cd83e76728 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-11T23:10:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-969621487',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='tempest-serverbootfromvolumestablerescuetest-server-969621487',id=1,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-06-11T23:10:58Z,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='aaf744af828a4a5eba1e98da63373b2b',ramdisk_id='',reservation_id='r-232rbmf3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-539499192',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-11T23:11:09Z,user_data=None,user_id='72b6dac5eb744cfba6299636227aa59b',uuid=8aec3cea-109d-43f8-983c-1d5ee2f71181,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6d2a143c-c69d-424d-8c91-e8553a8166a9", "address": "fa:16:3e:6c:eb:30", "network": {"id": "2a770c99-2ec6-4fa2-945b-32830a59e7a7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-137493671-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aaf744af828a4a5eba1e98da63373b2b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d2a143c-c6", "ovs_interfaceid": "6d2a143c-c69d-424d-8c91-e8553a8166a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 11 23:13:59.007497 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-991a3102-9958-4e0f-aff2-b6cd83e76728 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Converting VIF {"id": "6d2a143c-c69d-424d-8c91-e8553a8166a9", "address": "fa:16:3e:6c:eb:30", "network": {"id": "2a770c99-2ec6-4fa2-945b-32830a59e7a7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-137493671-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aaf744af828a4a5eba1e98da63373b2b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d2a143c-c6", "ovs_interfaceid": "6d2a143c-c69d-424d-8c91-e8553a8166a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:13:59.008399 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-991a3102-9958-4e0f-aff2-b6cd83e76728 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:eb:30,bridge_name='br-int',has_traffic_filtering=True,id=6d2a143c-c69d-424d-8c91-e8553a8166a9,network=Network(2a770c99-2ec6-4fa2-945b-32830a59e7a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d2a143c-c6') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:13:59.008757 np0000002687 nova-compute[98431]: DEBUG os_vif [None req-991a3102-9958-4e0f-aff2-b6cd83e76728 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:eb:30,bridge_name='br-int',has_traffic_filtering=True,id=6d2a143c-c69d-424d-8c91-e8553a8166a9,network=Network(2a770c99-2ec6-4fa2-945b-32830a59e7a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d2a143c-c6') {{(pid=98431) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 11 23:13:59.010364 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:59.011491 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6d2a143c-c6, bridge=br-int, if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:13:59.012942 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:59.014245 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:13:59.020741 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:59.021894 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:59.022051 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e1e31cdf-458c-48f2-a198-24a894412141) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:13:59.022684 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:59.023243 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:13:59.030125 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:13:59.036350 np0000002687 nova-compute[98431]: INFO os_vif [None req-991a3102-9958-4e0f-aff2-b6cd83e76728 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:eb:30,bridge_name='br-int',has_traffic_filtering=True,id=6d2a143c-c69d-424d-8c91-e8553a8166a9,network=Network(2a770c99-2ec6-4fa2-945b-32830a59e7a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d2a143c-c6') Jun 11 23:13:59.036959 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-991a3102-9958-4e0f-aff2-b6cd83e76728 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 8aec3cea-109d-43f8-983c-1d5ee2f71181] Deleting instance files /opt/stack/data/nova/instances/8aec3cea-109d-43f8-983c-1d5ee2f71181_del Jun 11 23:13:59.037753 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-991a3102-9958-4e0f-aff2-b6cd83e76728 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 8aec3cea-109d-43f8-983c-1d5ee2f71181] Deletion of /opt/stack/data/nova/instances/8aec3cea-109d-43f8-983c-1d5ee2f71181_del complete Jun 11 23:13:59.258094 np0000002687 nova-compute[98431]: DEBUG nova.objects.base [None req-1832c4d4-44f6-4f69-b46b-29924f655c1c tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=98431) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 11 23:13:59.258379 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-1832c4d4-44f6-4f69-b46b-29924f655c1c tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: dd1dd46c-2231-40b4-aa61-0121733a932d] Created local disks {{(pid=98431) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}} Jun 11 23:13:59.259021 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-1832c4d4-44f6-4f69-b46b-29924f655c1c tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: dd1dd46c-2231-40b4-aa61-0121733a932d] Start _get_guest_xml network_info=[{"id": "98c628a8-e152-4189-94f1-e166c406cf10", "address": "fa:16:3e:2b:91:a7", "network": {"id": "77fc4e10-1fed-4963-86b4-1fbb3a9c6f7f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1105404274-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1105404274-network", "vif_mac": "fa:16:3e:2b:91:a7"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b2b9f55b231c455ca1a4579d7ed54888", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap98c628a8-e1", "ovs_interfaceid": "98c628a8-e152-4189-94f1-e166c406cf10", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-11T23:08:20Z,direct_url=,disk_format='qcow2',id=f30640f8-7aca-4300-a085-4706a5209a79,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ce012f9fabdb4ee5a73e212437f59d97',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-11T23:08:23Z,virtual_size=,visibility=) rescue={'image_id': 'f30640f8-7aca-4300-a085-4706a5209a79', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=Noneshare_info=ShareMappingList(objects=[]) {{(pid=98431) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 11 23:13:59.259211 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-1832c4d4-44f6-4f69-b46b-29924f655c1c tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Lazy-loading 'resources' on Instance uuid dd1dd46c-2231-40b4-aa61-0121733a932d {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:13:59.547222 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-991a3102-9958-4e0f-aff2-b6cd83e76728 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] [instance: 8aec3cea-109d-43f8-983c-1d5ee2f71181] Took 1.43 seconds to destroy the instance on the hypervisor. Jun 11 23:13:59.549251 np0000002687 nova-compute[98431]: DEBUG oslo.service.backend._common.loopingcall [None req-991a3102-9958-4e0f-aff2-b6cd83e76728 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98431) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jun 11 23:13:59.549525 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [-] [instance: 8aec3cea-109d-43f8-983c-1d5ee2f71181] Deallocating network for instance {{(pid=98431) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}} Jun 11 23:13:59.549703 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [-] [instance: 8aec3cea-109d-43f8-983c-1d5ee2f71181] deallocate_for_instance() {{(pid=98431) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jun 11 23:13:59.550185 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:13:59.558117 np0000002687 nova-compute[98431]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0010755390001122578 future=) submitted to {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:13:59.558258 np0000002687 nova-compute[98431]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:13:59.558258 np0000002687 nova-compute[98431]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=4.203091769000139 future=) {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:13:59.558351 np0000002687 nova-compute[98431]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=4.203014667000161 future=) {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:13:59.560887 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-5fb13b9c-f80a-4d3f-95ec-d4a0ba88e636 None None] Emitting event Stopped> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:13:59.560887 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-5fb13b9c-f80a-4d3f-95ec-d4a0ba88e636 None None] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] VM Stopped (Lifecycle Event) Jun 11 23:13:59.697871 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:13:59.761369 np0000002687 nova-compute[98431]: DEBUG nova.objects.base [None req-1832c4d4-44f6-4f69-b46b-29924f655c1c tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=98431) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 11 23:13:59.764138 np0000002687 nova-compute[98431]: WARNING nova.virt.libvirt.driver [None req-1832c4d4-44f6-4f69-b46b-29924f655c1c tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 11 23:13:59.765417 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-1832c4d4-44f6-4f69-b46b-29924f655c1c tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='f30640f8-7aca-4300-a085-4706a5209a79', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-2077015389', uuid='dd1dd46c-2231-40b4-aa61-0121733a932d'), owner=OwnerMeta(userid='eaecdd9c05b5485b9422171463cccf92', username='tempest-ServerRescueNegativeTestJSON-2027875711-project-member', projectid='b2b9f55b231c455ca1a4579d7ed54888', projectname='tempest-ServerRescueNegativeTestJSON-2027875711'), image=ImageMeta(id='f30640f8-7aca-4300-a085-4706a5209a79', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "98c628a8-e152-4189-94f1-e166c406cf10", "address": "fa:16:3e:2b:91:a7", "network": {"id": "77fc4e10-1fed-4963-86b4-1fbb3a9c6f7f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1105404274-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1105404274-network", "vif_mac": "fa:16:3e:2b:91:a7"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b2b9f55b231c455ca1a4579d7ed54888", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap98c628a8-e1", "ovs_interfaceid": "98c628a8-e152-4189-94f1-e166c406cf10", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1781219639.7649617) {{(pid=98431) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 11 23:13:59.767205 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-1832c4d4-44f6-4f69-b46b-29924f655c1c tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Searching host: 'np0000002687' for CPU controller through CGroups V1... {{(pid=98431) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 11 23:13:59.767569 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-1832c4d4-44f6-4f69-b46b-29924f655c1c tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] CPU controller missing on host. {{(pid=98431) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 11 23:13:59.769040 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-1832c4d4-44f6-4f69-b46b-29924f655c1c tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Searching host: 'np0000002687' for CPU controller through CGroups V2... {{(pid=98431) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 11 23:13:59.769294 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-1832c4d4-44f6-4f69-b46b-29924f655c1c tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] CPU controller found on host. {{(pid=98431) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 11 23:13:59.770601 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-1832c4d4-44f6-4f69-b46b-29924f655c1c tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98431) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 11 23:13:59.771017 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-1832c4d4-44f6-4f69-b46b-29924f655c1c tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-11T23:08:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-11T23:08:20Z,direct_url=,disk_format='qcow2',id=f30640f8-7aca-4300-a085-4706a5209a79,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ce012f9fabdb4ee5a73e212437f59d97',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-11T23:08:23Z,virtual_size=,visibility=), allow threads: True {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 11 23:13:59.771200 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-1832c4d4-44f6-4f69-b46b-29924f655c1c tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Flavor limits 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 11 23:13:59.771360 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-1832c4d4-44f6-4f69-b46b-29924f655c1c tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Image limits 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 11 23:13:59.771478 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-1832c4d4-44f6-4f69-b46b-29924f655c1c tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Flavor pref 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 11 23:13:59.771591 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-1832c4d4-44f6-4f69-b46b-29924f655c1c tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Image pref 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 11 23:13:59.771664 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-1832c4d4-44f6-4f69-b46b-29924f655c1c tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 11 23:13:59.771904 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-1832c4d4-44f6-4f69-b46b-29924f655c1c tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 11 23:13:59.772136 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-1832c4d4-44f6-4f69-b46b-29924f655c1c tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98431) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 11 23:13:59.772283 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-1832c4d4-44f6-4f69-b46b-29924f655c1c tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Got 1 possible topologies {{(pid=98431) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 11 23:13:59.772510 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-1832c4d4-44f6-4f69-b46b-29924f655c1c tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 11 23:13:59.772636 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-1832c4d4-44f6-4f69-b46b-29924f655c1c tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 11 23:13:59.772775 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-1832c4d4-44f6-4f69-b46b-29924f655c1c tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Lazy-loading 'vcpu_model' on Instance uuid dd1dd46c-2231-40b4-aa61-0121733a932d {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:14:00.064071 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-5fb13b9c-f80a-4d3f-95ec-d4a0ba88e636 None None] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:14:00.075149 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-5fb13b9c-f80a-4d3f-95ec-d4a0ba88e636 None None] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=98431) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 11 23:14:00.125623 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:00.271607 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-8f372f63-1a08-4f68-b3d3-6a3b55e5c78d req-0a492326-e780-4555-9578-f741c0782d91 service nova] [instance: dd1dd46c-2231-40b4-aa61-0121733a932d] Received event network-vif-unplugged-98c628a8-e152-4189-94f1-e166c406cf10 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:14:00.273647 np0000002687 nova-compute[98431]: DEBUG oslo_service.periodic_task [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 11 23:14:00.273919 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-8f372f63-1a08-4f68-b3d3-6a3b55e5c78d req-0a492326-e780-4555-9578-f741c0782d91 service nova] Acquiring lock "dd1dd46c-2231-40b4-aa61-0121733a932d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:14:00.274322 np0000002687 nova-compute[98431]: DEBUG oslo_service.periodic_task [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 11 23:14:00.274589 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-8f372f63-1a08-4f68-b3d3-6a3b55e5c78d req-0a492326-e780-4555-9578-f741c0782d91 service nova] Lock "dd1dd46c-2231-40b4-aa61-0121733a932d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:14:00.274681 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-8f372f63-1a08-4f68-b3d3-6a3b55e5c78d req-0a492326-e780-4555-9578-f741c0782d91 service nova] Lock "dd1dd46c-2231-40b4-aa61-0121733a932d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:14:00.274892 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-8f372f63-1a08-4f68-b3d3-6a3b55e5c78d req-0a492326-e780-4555-9578-f741c0782d91 service nova] [instance: dd1dd46c-2231-40b4-aa61-0121733a932d] No waiting events found dispatching network-vif-unplugged-98c628a8-e152-4189-94f1-e166c406cf10 {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:14:00.275115 np0000002687 nova-compute[98431]: WARNING nova.compute.manager [req-8f372f63-1a08-4f68-b3d3-6a3b55e5c78d req-0a492326-e780-4555-9578-f741c0782d91 service nova] [instance: dd1dd46c-2231-40b4-aa61-0121733a932d] Received unexpected event network-vif-unplugged-98c628a8-e152-4189-94f1-e166c406cf10 for instance with vm_state active and task_state rescuing. Jun 11 23:14:00.275165 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-8f372f63-1a08-4f68-b3d3-6a3b55e5c78d req-0a492326-e780-4555-9578-f741c0782d91 service nova] [instance: 8aec3cea-109d-43f8-983c-1d5ee2f71181] Received event network-vif-unplugged-6d2a143c-c69d-424d-8c91-e8553a8166a9 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:14:00.275260 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-8f372f63-1a08-4f68-b3d3-6a3b55e5c78d req-0a492326-e780-4555-9578-f741c0782d91 service nova] Acquiring lock "8aec3cea-109d-43f8-983c-1d5ee2f71181-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:14:00.275381 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-8f372f63-1a08-4f68-b3d3-6a3b55e5c78d req-0a492326-e780-4555-9578-f741c0782d91 service nova] Lock "8aec3cea-109d-43f8-983c-1d5ee2f71181-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:14:00.275586 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-8f372f63-1a08-4f68-b3d3-6a3b55e5c78d req-0a492326-e780-4555-9578-f741c0782d91 service nova] Lock "8aec3cea-109d-43f8-983c-1d5ee2f71181-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:14:00.275586 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-8f372f63-1a08-4f68-b3d3-6a3b55e5c78d req-0a492326-e780-4555-9578-f741c0782d91 service nova] [instance: 8aec3cea-109d-43f8-983c-1d5ee2f71181] No waiting events found dispatching network-vif-unplugged-6d2a143c-c69d-424d-8c91-e8553a8166a9 {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:14:00.275698 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-8f372f63-1a08-4f68-b3d3-6a3b55e5c78d req-0a492326-e780-4555-9578-f741c0782d91 service nova] [instance: 8aec3cea-109d-43f8-983c-1d5ee2f71181] Received event network-vif-unplugged-6d2a143c-c69d-424d-8c91-e8553a8166a9 for instance with task_state deleting. {{(pid=98431) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 11 23:14:00.275943 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-8f372f63-1a08-4f68-b3d3-6a3b55e5c78d req-0a492326-e780-4555-9578-f741c0782d91 service nova] [instance: 8aec3cea-109d-43f8-983c-1d5ee2f71181] Received event network-vif-unplugged-6d2a143c-c69d-424d-8c91-e8553a8166a9 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:14:00.276095 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-8f372f63-1a08-4f68-b3d3-6a3b55e5c78d req-0a492326-e780-4555-9578-f741c0782d91 service nova] Acquiring lock "8aec3cea-109d-43f8-983c-1d5ee2f71181-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:14:00.276705 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-8f372f63-1a08-4f68-b3d3-6a3b55e5c78d req-0a492326-e780-4555-9578-f741c0782d91 service nova] Lock "8aec3cea-109d-43f8-983c-1d5ee2f71181-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:14:00.277425 np0000002687 nova-compute[98431]: DEBUG oslo_service.periodic_task [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 11 23:14:00.277618 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-8f372f63-1a08-4f68-b3d3-6a3b55e5c78d req-0a492326-e780-4555-9578-f741c0782d91 service nova] Lock "8aec3cea-109d-43f8-983c-1d5ee2f71181-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:14:00.277959 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-8f372f63-1a08-4f68-b3d3-6a3b55e5c78d req-0a492326-e780-4555-9578-f741c0782d91 service nova] [instance: 8aec3cea-109d-43f8-983c-1d5ee2f71181] No waiting events found dispatching network-vif-unplugged-6d2a143c-c69d-424d-8c91-e8553a8166a9 {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:14:00.278158 np0000002687 nova-compute[98431]: DEBUG oslo_service.periodic_task [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 11 23:14:00.278676 np0000002687 nova-compute[98431]: DEBUG nova.objects.base [None req-1832c4d4-44f6-4f69-b46b-29924f655c1c tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=98431) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 11 23:14:00.291883 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-8f372f63-1a08-4f68-b3d3-6a3b55e5c78d req-0a492326-e780-4555-9578-f741c0782d91 service nova] [instance: 8aec3cea-109d-43f8-983c-1d5ee2f71181] Received event network-vif-unplugged-6d2a143c-c69d-424d-8c91-e8553a8166a9 for instance with task_state deleting. {{(pid=98431) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 11 23:14:00.297763 np0000002687 nova-compute[98431]: DEBUG oslo_service.periodic_task [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 11 23:14:00.298588 np0000002687 nova-compute[98431]: DEBUG oslo_service.periodic_task [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 11 23:14:00.298588 np0000002687 nova-compute[98431]: DEBUG oslo_service.periodic_task [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 11 23:14:00.298588 np0000002687 nova-compute[98431]: DEBUG oslo_service.periodic_task [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 11 23:14:00.298588 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98431) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}} Jun 11 23:14:00.298835 np0000002687 nova-compute[98431]: DEBUG oslo_service.periodic_task [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running periodic task ComputeManager.update_available_resource {{(pid=98431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 11 23:14:00.308017 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-e4b36783-08eb-45c4-8b54-467190289b28 req-5dc4f50a-4c1c-472d-9fb6-dd0b276450bd service nova] [instance: 8aec3cea-109d-43f8-983c-1d5ee2f71181] Received event network-vif-deleted-6d2a143c-c69d-424d-8c91-e8553a8166a9 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:14:00.308168 np0000002687 nova-compute[98431]: INFO nova.compute.manager [req-e4b36783-08eb-45c4-8b54-467190289b28 req-5dc4f50a-4c1c-472d-9fb6-dd0b276450bd service nova] [instance: 8aec3cea-109d-43f8-983c-1d5ee2f71181] Neutron deleted interface 6d2a143c-c69d-424d-8c91-e8553a8166a9; detaching it from the instance and deleting it from the info cache Jun 11 23:14:00.313931 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-1832c4d4-44f6-4f69-b46b-29924f655c1c tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-11T23:13:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2077015389',display_name='tempest-ServerRescueNegativeTestJSON-server-2077015389',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='tempest-serverrescuenegativetestjson-server-2077015389',id=20,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-06-11T23:13:29Z,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='b2b9f55b231c455ca1a4579d7ed54888',ramdisk_id='',reservation_id='r-a0ty5rvr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2027875711',owner_user_name='tempest-ServerRescueNegativeTestJSON-2027875711-project-member'},tags=,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-06-11T23:13:30Z,user_data=None,user_id='eaecdd9c05b5485b9422171463cccf92',uuid=dd1dd46c-2231-40b4-aa61-0121733a932d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "98c628a8-e152-4189-94f1-e166c406cf10", "address": "fa:16:3e:2b:91:a7", "network": {"id": "77fc4e10-1fed-4963-86b4-1fbb3a9c6f7f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1105404274-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1105404274-network", "vif_mac": "fa:16:3e:2b:91:a7"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b2b9f55b231c455ca1a4579d7ed54888", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap98c628a8-e1", "ovs_interfaceid": "98c628a8-e152-4189-94f1-e166c406cf10", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98431) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 11 23:14:00.315349 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-e4b36783-08eb-45c4-8b54-467190289b28 req-5dc4f50a-4c1c-472d-9fb6-dd0b276450bd service nova] [instance: 8aec3cea-109d-43f8-983c-1d5ee2f71181] Detach interface failed, port_id=6d2a143c-c69d-424d-8c91-e8553a8166a9, reason: Instance 8aec3cea-109d-43f8-983c-1d5ee2f71181 could not be found. {{(pid=98431) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}} Jun 11 23:14:00.317093 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-1832c4d4-44f6-4f69-b46b-29924f655c1c tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Converting VIF {"id": "98c628a8-e152-4189-94f1-e166c406cf10", "address": "fa:16:3e:2b:91:a7", "network": {"id": "77fc4e10-1fed-4963-86b4-1fbb3a9c6f7f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1105404274-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1105404274-network", "vif_mac": "fa:16:3e:2b:91:a7"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b2b9f55b231c455ca1a4579d7ed54888", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap98c628a8-e1", "ovs_interfaceid": "98c628a8-e152-4189-94f1-e166c406cf10", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:14:00.317093 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-1832c4d4-44f6-4f69-b46b-29924f655c1c tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2b:91:a7,bridge_name='br-int',has_traffic_filtering=True,id=98c628a8-e152-4189-94f1-e166c406cf10,network=Network(77fc4e10-1fed-4963-86b4-1fbb3a9c6f7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98c628a8-e1') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:14:00.317093 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-1832c4d4-44f6-4f69-b46b-29924f655c1c tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Lazy-loading 'pci_devices' on Instance uuid dd1dd46c-2231-40b4-aa61-0121733a932d {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:14:00.583662 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-5fb13b9c-f80a-4d3f-95ec-d4a0ba88e636 None None] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] During sync_power_state the instance has a pending task (resize_finish). Skip. Jun 11 23:14:00.707788 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [-] [instance: 8aec3cea-109d-43f8-983c-1d5ee2f71181] Updating instance_info_cache with network_info: [] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:14:00.812026 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:14:00.812320 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:14:00.813426 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:14:00.813426 np0000002687 nova-compute[98431]: DEBUG nova.compute.resource_tracker [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Auditing locally available compute resources for np0000002687 (node: np0000002687) {{(pid=98431) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}} Jun 11 23:14:00.819745 np0000002687 nova-compute[98431]: DEBUG nova.objects.base [None req-1832c4d4-44f6-4f69-b46b-29924f655c1c tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=98431) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 11 23:14:00.823032 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-1832c4d4-44f6-4f69-b46b-29924f655c1c tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: dd1dd46c-2231-40b4-aa61-0121733a932d] End _get_guest_xml xml= Jun 11 23:14:00.823032 np0000002687 nova-compute[98431]: dd1dd46c-2231-40b4-aa61-0121733a932d Jun 11 23:14:00.823032 np0000002687 nova-compute[98431]: instance-00000014 Jun 11 23:14:00.823032 np0000002687 nova-compute[98431]: 196608 Jun 11 23:14:00.823032 np0000002687 nova-compute[98431]: 1 Jun 11 23:14:00.823032 np0000002687 nova-compute[98431]: Jun 11 23:14:00.823032 np0000002687 nova-compute[98431]: Jun 11 23:14:00.823032 np0000002687 nova-compute[98431]: Jun 11 23:14:00.823032 np0000002687 nova-compute[98431]: tempest-ServerRescueNegativeTestJSON-server-2077015389 Jun 11 23:14:00.823032 np0000002687 nova-compute[98431]: 2026-06-11 23:13:59 Jun 11 23:14:00.823032 np0000002687 nova-compute[98431]: Jun 11 23:14:00.823032 np0000002687 nova-compute[98431]: 192 Jun 11 23:14:00.823032 np0000002687 nova-compute[98431]: 1 Jun 11 23:14:00.823032 np0000002687 nova-compute[98431]: 0 Jun 11 23:14:00.823032 np0000002687 nova-compute[98431]: 0 Jun 11 23:14:00.823032 np0000002687 nova-compute[98431]: 1 Jun 11 23:14:00.823032 np0000002687 nova-compute[98431]: Jun 11 23:14:00.823032 np0000002687 nova-compute[98431]: True Jun 11 23:14:00.823032 np0000002687 nova-compute[98431]: Jun 11 23:14:00.823032 np0000002687 nova-compute[98431]: Jun 11 23:14:00.823032 np0000002687 nova-compute[98431]: Jun 11 23:14:00.823032 np0000002687 nova-compute[98431]: bare Jun 11 23:14:00.823032 np0000002687 nova-compute[98431]: qcow2 Jun 11 23:14:00.823032 np0000002687 nova-compute[98431]: 1 Jun 11 23:14:00.823032 np0000002687 nova-compute[98431]: 0 Jun 11 23:14:00.823032 np0000002687 nova-compute[98431]: Jun 11 23:14:00.823032 np0000002687 nova-compute[98431]: ide Jun 11 23:14:00.823032 np0000002687 nova-compute[98431]: virtio Jun 11 23:14:00.823032 np0000002687 nova-compute[98431]: pc Jun 11 23:14:00.823032 np0000002687 nova-compute[98431]: virtio Jun 11 23:14:00.823032 np0000002687 nova-compute[98431]: virtio Jun 11 23:14:00.823032 np0000002687 nova-compute[98431]: virtio Jun 11 23:14:00.823032 np0000002687 nova-compute[98431]: Jun 11 23:14:00.823032 np0000002687 nova-compute[98431]: Jun 11 23:14:00.823032 np0000002687 nova-compute[98431]: Jun 11 23:14:00.823032 np0000002687 nova-compute[98431]: tempest-ServerRescueNegativeTestJSON-2027875711-project-member Jun 11 23:14:00.823032 np0000002687 nova-compute[98431]: tempest-ServerRescueNegativeTestJSON-2027875711 Jun 11 23:14:00.823032 np0000002687 nova-compute[98431]: Jun 11 23:14:00.823032 np0000002687 nova-compute[98431]: Jun 11 23:14:00.823032 np0000002687 nova-compute[98431]: Jun 11 23:14:00.823032 np0000002687 nova-compute[98431]: Jun 11 23:14:00.823032 np0000002687 nova-compute[98431]: Jun 11 23:14:00.823032 np0000002687 nova-compute[98431]: Jun 11 23:14:00.823032 np0000002687 nova-compute[98431]: Jun 11 23:14:00.823032 np0000002687 nova-compute[98431]: Jun 11 23:14:00.823032 np0000002687 nova-compute[98431]: Jun 11 23:14:00.823032 np0000002687 nova-compute[98431]: Jun 11 23:14:00.823032 np0000002687 nova-compute[98431]: Jun 11 23:14:00.823032 np0000002687 nova-compute[98431]: OpenStack Foundation Jun 11 23:14:00.823032 np0000002687 nova-compute[98431]: OpenStack Nova Jun 11 23:14:00.823032 np0000002687 nova-compute[98431]: 33.1.0 Jun 11 23:14:00.823032 np0000002687 nova-compute[98431]: dd1dd46c-2231-40b4-aa61-0121733a932d Jun 11 23:14:00.823032 np0000002687 nova-compute[98431]: dd1dd46c-2231-40b4-aa61-0121733a932d Jun 11 23:14:00.823032 np0000002687 nova-compute[98431]: Virtual Machine Jun 11 23:14:00.823032 np0000002687 nova-compute[98431]: Jun 11 23:14:00.823032 np0000002687 nova-compute[98431]: Jun 11 23:14:00.823032 np0000002687 nova-compute[98431]: Jun 11 23:14:00.823032 np0000002687 nova-compute[98431]: hvm Jun 11 23:14:00.823032 np0000002687 nova-compute[98431]: Jun 11 23:14:00.823032 np0000002687 nova-compute[98431]: Jun 11 23:14:00.823032 np0000002687 nova-compute[98431]: Jun 11 23:14:00.823032 np0000002687 nova-compute[98431]: Jun 11 23:14:00.823032 np0000002687 nova-compute[98431]: Jun 11 23:14:00.823032 np0000002687 nova-compute[98431]: 128 Jun 11 23:14:00.823032 np0000002687 nova-compute[98431]: Jun 11 23:14:00.823032 np0000002687 nova-compute[98431]: Jun 11 23:14:00.823032 np0000002687 nova-compute[98431]: Jun 11 23:14:00.823032 np0000002687 nova-compute[98431]: 1 Jun 11 23:14:00.823032 np0000002687 nova-compute[98431]: Jun 11 23:14:00.823032 np0000002687 nova-compute[98431]: Jun 11 23:14:00.823032 np0000002687 nova-compute[98431]: Nehalem Jun 11 23:14:00.823032 np0000002687 nova-compute[98431]: Jun 11 23:14:00.823032 np0000002687 nova-compute[98431]: Jun 11 23:14:00.823032 np0000002687 nova-compute[98431]: Jun 11 23:14:00.823032 np0000002687 nova-compute[98431]: Jun 11 23:14:00.823032 np0000002687 nova-compute[98431]: Jun 11 23:14:00.823032 np0000002687 nova-compute[98431]: Jun 11 23:14:00.823032 np0000002687 nova-compute[98431]: Jun 11 23:14:00.823032 np0000002687 nova-compute[98431]: Jun 11 23:14:00.823032 np0000002687 nova-compute[98431]: Jun 11 23:14:00.823032 np0000002687 nova-compute[98431]: Jun 11 23:14:00.823032 np0000002687 nova-compute[98431]: Jun 11 23:14:00.823032 np0000002687 nova-compute[98431]: Jun 11 23:14:00.823032 np0000002687 nova-compute[98431]: Jun 11 23:14:00.823032 np0000002687 nova-compute[98431]: Jun 11 23:14:00.823032 np0000002687 nova-compute[98431]: Jun 11 23:14:00.823032 np0000002687 nova-compute[98431]: Jun 11 23:14:00.823032 np0000002687 nova-compute[98431]: Jun 11 23:14:00.823032 np0000002687 nova-compute[98431]: Jun 11 23:14:00.823032 np0000002687 nova-compute[98431]: Jun 11 23:14:00.823032 np0000002687 nova-compute[98431]: Jun 11 23:14:00.823032 np0000002687 nova-compute[98431]: Jun 11 23:14:00.823032 np0000002687 nova-compute[98431]: Jun 11 23:14:00.823032 np0000002687 nova-compute[98431]: Jun 11 23:14:00.823032 np0000002687 nova-compute[98431]: Jun 11 23:14:00.823032 np0000002687 nova-compute[98431]: Jun 11 23:14:00.823032 np0000002687 nova-compute[98431]: Jun 11 23:14:00.823032 np0000002687 nova-compute[98431]: Jun 11 23:14:00.823032 np0000002687 nova-compute[98431]: Jun 11 23:14:00.823032 np0000002687 nova-compute[98431]: Jun 11 23:14:00.823032 np0000002687 nova-compute[98431]: Jun 11 23:14:00.823032 np0000002687 nova-compute[98431]: Jun 11 23:14:00.823032 np0000002687 nova-compute[98431]: /dev/urandom Jun 11 23:14:00.823032 np0000002687 nova-compute[98431]: Jun 11 23:14:00.823032 np0000002687 nova-compute[98431]: Jun 11 23:14:00.823032 np0000002687 nova-compute[98431]: Jun 11 23:14:00.823032 np0000002687 nova-compute[98431]: Jun 11 23:14:00.823032 np0000002687 nova-compute[98431]: Jun 11 23:14:00.823032 np0000002687 nova-compute[98431]: Jun 11 23:14:00.823032 np0000002687 nova-compute[98431]: Jun 11 23:14:00.823032 np0000002687 nova-compute[98431]: {{(pid=98431) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 11 23:14:00.833031 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [-] [instance: dd1dd46c-2231-40b4-aa61-0121733a932d] Instance destroyed successfully. Jun 11 23:14:01.211985 np0000002687 nova-compute[98431]: INFO nova.compute.manager [-] [instance: 8aec3cea-109d-43f8-983c-1d5ee2f71181] Took 1.66 seconds to deallocate network for instance. Jun 11 23:14:01.398632 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Found WWN 33000000000dc7ddd for multipath device dm-7 {{(pid=98431) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 11 23:14:01.399000 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 8.071s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 11 23:14:01.399173 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] <== connect_volume: return (8071ms) {'type': 'block', 'scsi_wwn': '33000000000dc7ddd', 'path': '/dev/dm-7', 'multipath_id': '33000000000dc7ddd'} {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 11 23:14:01.399296 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000000dc7ddd', 'path': '/dev/dm-7', 'multipath_id': '33000000000dc7ddd'} {{(pid=98431) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 11 23:14:01.527493 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-c6408d00-6828-43e9-8650-3e2a3fb2cff4 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Acquiring lock "ae596459-1e34-4a2a-9a33-69a02f50fd1c" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:14:01.527862 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-c6408d00-6828-43e9-8650-3e2a3fb2cff4 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Lock "ae596459-1e34-4a2a-9a33-69a02f50fd1c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:14:01.721305 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-991a3102-9958-4e0f-aff2-b6cd83e76728 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:14:01.721976 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-991a3102-9958-4e0f-aff2-b6cd83e76728 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:14:01.867957 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ffa4bbe-7ead-4029-aba5-28f031f6e784/disk --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:14:01.908558 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-11T23:12:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(12),hidden=False,host='np0000002687',hostname='multiattach-server-0',id=15,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHngWA9S/0M7yAiCaKN7wJ0iqGBq18p6o1N91kfGTes8iMQtxmsCxH/Iqg51e2HEWFsjD10S17Kahb+vCzu07nJJQGe3fNUonThwHNf0exiWq4jZuXjSZtHJPO0dbow48A==',key_name='tempest-keypair-1974490716',keypairs=,launch_index=0,launched_at=2026-06-11T23:12:35Z,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000002687',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='81fd45f475a04e5c8e9bd9deb7ad4c1e',ramdisk_id='',reservation_id='r-5y4c4ios',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-1514006700',owner_user_name='tempest-AttachVolumeMultiAttachTest-1514006700-project-member'},tags=,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-06-11T23:13:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c17e84202f404c3c8e73292bb59d7b27',uuid=64d7833a-82e8-43e9-83ed-2507197b69bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "283962f2-faaf-4d85-8eda-9b77b55a5b0c", "address": "fa:16:3e:4b:26:95", "network": {"id": "17593db3-c22d-4354-ab29-933b1c6a5c3a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1094286565-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1094286565-network", "vif_mac": "fa:16:3e:4b:26:95"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "81fd45f475a04e5c8e9bd9deb7ad4c1e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap283962f2-fa", "ovs_interfaceid": "283962f2-faaf-4d85-8eda-9b77b55a5b0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98431) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 11 23:14:01.908924 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Converting VIF {"id": "283962f2-faaf-4d85-8eda-9b77b55a5b0c", "address": "fa:16:3e:4b:26:95", "network": {"id": "17593db3-c22d-4354-ab29-933b1c6a5c3a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1094286565-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1094286565-network", "vif_mac": "fa:16:3e:4b:26:95"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "81fd45f475a04e5c8e9bd9deb7ad4c1e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap283962f2-fa", "ovs_interfaceid": "283962f2-faaf-4d85-8eda-9b77b55a5b0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:14:01.910644 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:26:95,bridge_name='br-int',has_traffic_filtering=True,id=283962f2-faaf-4d85-8eda-9b77b55a5b0c,network=Network(17593db3-c22d-4354-ab29-933b1c6a5c3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap283962f2-fa') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:14:01.918660 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] End _get_guest_xml xml= Jun 11 23:14:01.918660 np0000002687 nova-compute[98431]: 64d7833a-82e8-43e9-83ed-2507197b69bf Jun 11 23:14:01.918660 np0000002687 nova-compute[98431]: instance-0000000f Jun 11 23:14:01.918660 np0000002687 nova-compute[98431]: 262144 Jun 11 23:14:01.918660 np0000002687 nova-compute[98431]: 1 Jun 11 23:14:01.918660 np0000002687 nova-compute[98431]: Jun 11 23:14:01.918660 np0000002687 nova-compute[98431]: Jun 11 23:14:01.918660 np0000002687 nova-compute[98431]: Jun 11 23:14:01.918660 np0000002687 nova-compute[98431]: multiattach-server-0 Jun 11 23:14:01.918660 np0000002687 nova-compute[98431]: 2026-06-11 23:13:53 Jun 11 23:14:01.918660 np0000002687 nova-compute[98431]: Jun 11 23:14:01.918660 np0000002687 nova-compute[98431]: 256 Jun 11 23:14:01.918660 np0000002687 nova-compute[98431]: 1 Jun 11 23:14:01.918660 np0000002687 nova-compute[98431]: 0 Jun 11 23:14:01.918660 np0000002687 nova-compute[98431]: 0 Jun 11 23:14:01.918660 np0000002687 nova-compute[98431]: 1 Jun 11 23:14:01.918660 np0000002687 nova-compute[98431]: Jun 11 23:14:01.918660 np0000002687 nova-compute[98431]: True Jun 11 23:14:01.918660 np0000002687 nova-compute[98431]: Jun 11 23:14:01.918660 np0000002687 nova-compute[98431]: Jun 11 23:14:01.918660 np0000002687 nova-compute[98431]: Jun 11 23:14:01.918660 np0000002687 nova-compute[98431]: bare Jun 11 23:14:01.918660 np0000002687 nova-compute[98431]: qcow2 Jun 11 23:14:01.918660 np0000002687 nova-compute[98431]: 1 Jun 11 23:14:01.918660 np0000002687 nova-compute[98431]: 0 Jun 11 23:14:01.918660 np0000002687 nova-compute[98431]: Jun 11 23:14:01.918660 np0000002687 nova-compute[98431]: ide Jun 11 23:14:01.918660 np0000002687 nova-compute[98431]: virtio Jun 11 23:14:01.918660 np0000002687 nova-compute[98431]: pc Jun 11 23:14:01.918660 np0000002687 nova-compute[98431]: virtio Jun 11 23:14:01.918660 np0000002687 nova-compute[98431]: virtio Jun 11 23:14:01.918660 np0000002687 nova-compute[98431]: virtio Jun 11 23:14:01.918660 np0000002687 nova-compute[98431]: Jun 11 23:14:01.918660 np0000002687 nova-compute[98431]: Jun 11 23:14:01.918660 np0000002687 nova-compute[98431]: Jun 11 23:14:01.918660 np0000002687 nova-compute[98431]: tempest-AttachVolumeMultiAttachTest-1514006700-project-member Jun 11 23:14:01.918660 np0000002687 nova-compute[98431]: tempest-AttachVolumeMultiAttachTest-1514006700 Jun 11 23:14:01.918660 np0000002687 nova-compute[98431]: Jun 11 23:14:01.918660 np0000002687 nova-compute[98431]: Jun 11 23:14:01.918660 np0000002687 nova-compute[98431]: Jun 11 23:14:01.918660 np0000002687 nova-compute[98431]: Jun 11 23:14:01.918660 np0000002687 nova-compute[98431]: Jun 11 23:14:01.918660 np0000002687 nova-compute[98431]: Jun 11 23:14:01.918660 np0000002687 nova-compute[98431]: Jun 11 23:14:01.918660 np0000002687 nova-compute[98431]: Jun 11 23:14:01.918660 np0000002687 nova-compute[98431]: Jun 11 23:14:01.918660 np0000002687 nova-compute[98431]: Jun 11 23:14:01.918660 np0000002687 nova-compute[98431]: Jun 11 23:14:01.918660 np0000002687 nova-compute[98431]: OpenStack Foundation Jun 11 23:14:01.918660 np0000002687 nova-compute[98431]: OpenStack Nova Jun 11 23:14:01.918660 np0000002687 nova-compute[98431]: 33.1.0 Jun 11 23:14:01.918660 np0000002687 nova-compute[98431]: 64d7833a-82e8-43e9-83ed-2507197b69bf Jun 11 23:14:01.918660 np0000002687 nova-compute[98431]: 64d7833a-82e8-43e9-83ed-2507197b69bf Jun 11 23:14:01.918660 np0000002687 nova-compute[98431]: Virtual Machine Jun 11 23:14:01.918660 np0000002687 nova-compute[98431]: Jun 11 23:14:01.918660 np0000002687 nova-compute[98431]: Jun 11 23:14:01.918660 np0000002687 nova-compute[98431]: Jun 11 23:14:01.918660 np0000002687 nova-compute[98431]: hvm Jun 11 23:14:01.918660 np0000002687 nova-compute[98431]: Jun 11 23:14:01.918660 np0000002687 nova-compute[98431]: Jun 11 23:14:01.918660 np0000002687 nova-compute[98431]: Jun 11 23:14:01.918660 np0000002687 nova-compute[98431]: Jun 11 23:14:01.918660 np0000002687 nova-compute[98431]: Jun 11 23:14:01.918660 np0000002687 nova-compute[98431]: Jun 11 23:14:01.918660 np0000002687 nova-compute[98431]: 128 Jun 11 23:14:01.918660 np0000002687 nova-compute[98431]: Jun 11 23:14:01.918660 np0000002687 nova-compute[98431]: Jun 11 23:14:01.918660 np0000002687 nova-compute[98431]: Jun 11 23:14:01.918660 np0000002687 nova-compute[98431]: 1 Jun 11 23:14:01.918660 np0000002687 nova-compute[98431]: Jun 11 23:14:01.918660 np0000002687 nova-compute[98431]: Jun 11 23:14:01.918660 np0000002687 nova-compute[98431]: Nehalem Jun 11 23:14:01.918660 np0000002687 nova-compute[98431]: Jun 11 23:14:01.918660 np0000002687 nova-compute[98431]: Jun 11 23:14:01.918660 np0000002687 nova-compute[98431]: Jun 11 23:14:01.918660 np0000002687 nova-compute[98431]: Jun 11 23:14:01.918660 np0000002687 nova-compute[98431]: Jun 11 23:14:01.918660 np0000002687 nova-compute[98431]: Jun 11 23:14:01.918660 np0000002687 nova-compute[98431]: Jun 11 23:14:01.918660 np0000002687 nova-compute[98431]: Jun 11 23:14:01.918660 np0000002687 nova-compute[98431]: Jun 11 23:14:01.918660 np0000002687 nova-compute[98431]: Jun 11 23:14:01.918660 np0000002687 nova-compute[98431]: Jun 11 23:14:01.918660 np0000002687 nova-compute[98431]: Jun 11 23:14:01.918660 np0000002687 nova-compute[98431]: Jun 11 23:14:01.918660 np0000002687 nova-compute[98431]: Jun 11 23:14:01.918660 np0000002687 nova-compute[98431]: Jun 11 23:14:01.918660 np0000002687 nova-compute[98431]: Jun 11 23:14:01.918660 np0000002687 nova-compute[98431]: Jun 11 23:14:01.918660 np0000002687 nova-compute[98431]: Jun 11 23:14:01.918660 np0000002687 nova-compute[98431]: f535b91b-3bff-46ad-905e-644bd012b9ff Jun 11 23:14:01.918660 np0000002687 nova-compute[98431]: Jun 11 23:14:01.918660 np0000002687 nova-compute[98431]: Jun 11 23:14:01.918660 np0000002687 nova-compute[98431]: Jun 11 23:14:01.918660 np0000002687 nova-compute[98431]: Jun 11 23:14:01.918660 np0000002687 nova-compute[98431]: Jun 11 23:14:01.918660 np0000002687 nova-compute[98431]: Jun 11 23:14:01.918660 np0000002687 nova-compute[98431]: Jun 11 23:14:01.918660 np0000002687 nova-compute[98431]: Jun 11 23:14:01.918660 np0000002687 nova-compute[98431]: Jun 11 23:14:01.918660 np0000002687 nova-compute[98431]: Jun 11 23:14:01.918660 np0000002687 nova-compute[98431]: Jun 11 23:14:01.918660 np0000002687 nova-compute[98431]: Jun 11 23:14:01.918660 np0000002687 nova-compute[98431]: Jun 11 23:14:01.918660 np0000002687 nova-compute[98431]: Jun 11 23:14:01.918660 np0000002687 nova-compute[98431]: Jun 11 23:14:01.918660 np0000002687 nova-compute[98431]: /dev/urandom Jun 11 23:14:01.918660 np0000002687 nova-compute[98431]: Jun 11 23:14:01.918660 np0000002687 nova-compute[98431]: Jun 11 23:14:01.918660 np0000002687 nova-compute[98431]: Jun 11 23:14:01.918660 np0000002687 nova-compute[98431]: Jun 11 23:14:01.918660 np0000002687 nova-compute[98431]: Jun 11 23:14:01.918660 np0000002687 nova-compute[98431]: Jun 11 23:14:01.918660 np0000002687 nova-compute[98431]: Jun 11 23:14:01.918660 np0000002687 nova-compute[98431]: {{(pid=98431) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 11 23:14:01.922369 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-11T23:12:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(12),hidden=False,host='np0000002687',hostname='multiattach-server-0',id=15,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHngWA9S/0M7yAiCaKN7wJ0iqGBq18p6o1N91kfGTes8iMQtxmsCxH/Iqg51e2HEWFsjD10S17Kahb+vCzu07nJJQGe3fNUonThwHNf0exiWq4jZuXjSZtHJPO0dbow48A==',key_name='tempest-keypair-1974490716',keypairs=,launch_index=0,launched_at=2026-06-11T23:12:35Z,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000002687',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='81fd45f475a04e5c8e9bd9deb7ad4c1e',ramdisk_id='',reservation_id='r-5y4c4ios',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-1514006700',owner_user_name='tempest-AttachVolumeMultiAttachTest-1514006700-project-member'},tags=,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-06-11T23:13:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c17e84202f404c3c8e73292bb59d7b27',uuid=64d7833a-82e8-43e9-83ed-2507197b69bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "283962f2-faaf-4d85-8eda-9b77b55a5b0c", "address": "fa:16:3e:4b:26:95", "network": {"id": "17593db3-c22d-4354-ab29-933b1c6a5c3a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1094286565-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1094286565-network", "vif_mac": "fa:16:3e:4b:26:95"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "81fd45f475a04e5c8e9bd9deb7ad4c1e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap283962f2-fa", "ovs_interfaceid": "283962f2-faaf-4d85-8eda-9b77b55a5b0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 11 23:14:01.922369 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Converting VIF {"id": "283962f2-faaf-4d85-8eda-9b77b55a5b0c", "address": "fa:16:3e:4b:26:95", "network": {"id": "17593db3-c22d-4354-ab29-933b1c6a5c3a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1094286565-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1094286565-network", "vif_mac": "fa:16:3e:4b:26:95"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "81fd45f475a04e5c8e9bd9deb7ad4c1e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap283962f2-fa", "ovs_interfaceid": "283962f2-faaf-4d85-8eda-9b77b55a5b0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:14:01.923782 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:26:95,bridge_name='br-int',has_traffic_filtering=True,id=283962f2-faaf-4d85-8eda-9b77b55a5b0c,network=Network(17593db3-c22d-4354-ab29-933b1c6a5c3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap283962f2-fa') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:14:01.924224 np0000002687 nova-compute[98431]: DEBUG os_vif [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:26:95,bridge_name='br-int',has_traffic_filtering=True,id=283962f2-faaf-4d85-8eda-9b77b55a5b0c,network=Network(17593db3-c22d-4354-ab29-933b1c6a5c3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap283962f2-fa') {{(pid=98431) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 11 23:14:01.925506 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:01.925960 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:14:01.926321 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 11 23:14:01.929032 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:01.929284 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '898bb006-bc28-5fa5-9458-725eb2b86ae7', '_type': 'linux-noop'}}, row=False) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:14:01.933967 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:01.935926 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:14:01.941483 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:01.948564 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:01.948732 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap283962f2-fa, may_exist=True, interface_attrs={}) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:14:01.949194 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap283962f2-fa, col_values=(('qos', UUID('0e271ab3-0469-4db9-8fee-930b4d230af1')),), if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:14:01.949397 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap283962f2-fa, col_values=(('external_ids', {'iface-id': '283962f2-faaf-4d85-8eda-9b77b55a5b0c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4b:26:95', 'vm-uuid': '64d7833a-82e8-43e9-83ed-2507197b69bf'}),), if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:14:01.950581 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:01.952518 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:14:01.964111 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:01.965833 np0000002687 nova-compute[98431]: INFO os_vif [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:26:95,bridge_name='br-int',has_traffic_filtering=True,id=283962f2-faaf-4d85-8eda-9b77b55a5b0c,network=Network(17593db3-c22d-4354-ab29-933b1c6a5c3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap283962f2-fa') Jun 11 23:14:01.987062 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ffa4bbe-7ead-4029-aba5-28f031f6e784/disk --force-share --output=json" returned: 0 in 0.119s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:14:01.987786 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ffa4bbe-7ead-4029-aba5-28f031f6e784/disk --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:14:02.035498 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-c6408d00-6828-43e9-8650-3e2a3fb2cff4 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] [instance: ae596459-1e34-4a2a-9a33-69a02f50fd1c] Starting instance... {{(pid=98431) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 11 23:14:02.096358 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ffa4bbe-7ead-4029-aba5-28f031f6e784/disk --force-share --output=json" returned: 0 in 0.108s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:14:02.098619 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd1dd46c-2231-40b4-aa61-0121733a932d/disk.rescue --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:14:02.221786 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd1dd46c-2231-40b4-aa61-0121733a932d/disk.rescue --force-share --output=json" returned: 0 in 0.123s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:14:02.222353 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd1dd46c-2231-40b4-aa61-0121733a932d/disk.rescue --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:14:02.307573 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd1dd46c-2231-40b4-aa61-0121733a932d/disk.rescue --force-share --output=json" returned: 0 in 0.085s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:14:02.309772 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd1dd46c-2231-40b4-aa61-0121733a932d/disk --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:14:02.368009 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-1832c4d4-44f6-4f69-b46b-29924f655c1c tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] No BDM found with device name vda, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:14:02.375671 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-1832c4d4-44f6-4f69-b46b-29924f655c1c tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:14:02.376012 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-1832c4d4-44f6-4f69-b46b-29924f655c1c tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] No BDM found with device name hda, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:14:02.376180 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-1832c4d4-44f6-4f69-b46b-29924f655c1c tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] No VIF found with MAC fa:16:3e:2b:91:a7, not building metadata {{(pid=98431) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13199}} Jun 11 23:14:02.377264 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-1832c4d4-44f6-4f69-b46b-29924f655c1c tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: dd1dd46c-2231-40b4-aa61-0121733a932d] Using config drive Jun 11 23:14:02.416507 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd1dd46c-2231-40b4-aa61-0121733a932d/disk --force-share --output=json" returned: 0 in 0.107s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:14:02.416963 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd1dd46c-2231-40b4-aa61-0121733a932d/disk --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:14:02.502119 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd1dd46c-2231-40b4-aa61-0121733a932d/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:14:02.502768 np0000002687 nova-compute[98431]: WARNING nova.virt.libvirt.driver [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Periodic task is updating the host stat, it is trying to get disk instance-00000014, but disk file was removed by concurrent operations such as resize.: FileNotFoundError: [Errno 2] No such file or directory: '/opt/stack/data/nova/instances/dd1dd46c-2231-40b4-aa61-0121733a932d/disk.config.rescue' Jun 11 23:14:02.506426 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98431) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12344}} Jun 11 23:14:02.508933 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a45e04f-3516-4c39-bea1-820104411f17/disk --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:14:02.567687 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-991a3102-9958-4e0f-aff2-b6cd83e76728 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98431) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 11 23:14:02.567962 np0000002687 nova-compute[98431]: DEBUG nova.compute.provider_tree [None req-991a3102-9958-4e0f-aff2-b6cd83e76728 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Inventory has not changed in ProviderTree for provider: e3e65fe2-9de9-4821-8b4a-ccae37c66e25 {{(pid=98431) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 11 23:14:02.592392 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a45e04f-3516-4c39-bea1-820104411f17/disk --force-share --output=json" returned: 0 in 0.083s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:14:02.592838 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a45e04f-3516-4c39-bea1-820104411f17/disk --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:14:02.640526 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-c6408d00-6828-43e9-8650-3e2a3fb2cff4 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:14:02.676085 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a45e04f-3516-4c39-bea1-820104411f17/disk --force-share --output=json" returned: 0 in 0.083s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:14:02.676876 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] skipping disk /dev/dm-7 (vdb) as it is a volume {{(pid=98431) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12344}} Jun 11 23:14:02.680821 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64d7833a-82e8-43e9-83ed-2507197b69bf/disk --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:14:02.783315 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64d7833a-82e8-43e9-83ed-2507197b69bf/disk --force-share --output=json" returned: 0 in 0.101s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:14:02.783912 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64d7833a-82e8-43e9-83ed-2507197b69bf/disk --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:14:02.880209 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64d7833a-82e8-43e9-83ed-2507197b69bf/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:14:02.880740 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] skipping disk /dev/dm-7 (vdb) as it is a volume {{(pid=98431) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12344}} Jun 11 23:14:02.883009 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-1832c4d4-44f6-4f69-b46b-29924f655c1c tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Lazy-loading 'ec2_ids' on Instance uuid dd1dd46c-2231-40b4-aa61-0121733a932d {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:14:02.891959 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] skipping disk /dev/dm-3 (vda) as it is a volume {{(pid=98431) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12344}} Jun 11 23:14:02.892116 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] skipping disk /dev/dm-11 (vdb) as it is a volume {{(pid=98431) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12344}} Jun 11 23:14:02.892553 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] skipping disk /dev/dm-12 (vdc) as it is a volume {{(pid=98431) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12344}} Jun 11 23:14:02.895159 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f/disk.rescue --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:14:02.918368 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:03.001141 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f/disk.rescue --force-share --output=json" returned: 0 in 0.106s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:14:03.001695 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f/disk.rescue --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:14:03.074310 np0000002687 nova-compute[98431]: DEBUG nova.scheduler.client.report [None req-991a3102-9958-4e0f-aff2-b6cd83e76728 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Inventory has not changed for provider e3e65fe2-9de9-4821-8b4a-ccae37c66e25 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98431) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 11 23:14:03.103166 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f/disk.rescue --force-share --output=json" returned: 0 in 0.101s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:14:03.103765 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f/disk --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:14:03.195474 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:14:03.195987 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f/disk --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:14:03.286109 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:14:03.291012 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/206476b7-d805-4c6c-b7fb-db8b5c2a94a6/disk --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:14:03.390938 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/206476b7-d805-4c6c-b7fb-db8b5c2a94a6/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:14:03.392178 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/206476b7-d805-4c6c-b7fb-db8b5c2a94a6/disk --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:14:03.413097 np0000002687 nova-compute[98431]: DEBUG nova.objects.base [None req-1832c4d4-44f6-4f69-b46b-29924f655c1c tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=98431) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 11 23:14:03.413097 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-1832c4d4-44f6-4f69-b46b-29924f655c1c tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Lazy-loading 'keypairs' on Instance uuid dd1dd46c-2231-40b4-aa61-0121733a932d {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:14:03.490417 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/206476b7-d805-4c6c-b7fb-db8b5c2a94a6/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:14:03.496901 np0000002687 nova-compute[98431]: WARNING nova.virt.libvirt.driver [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 11 23:14:03.498464 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:14:03.544520 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] CMD "env LANG=C uptime" returned: 0 in 0.046s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:14:03.545096 np0000002687 nova-compute[98431]: DEBUG nova.compute.resource_tracker [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Hypervisor/Node resource view: name=np0000002687 free_ram=12554MB free_disk=74.1911735534668GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}] {{(pid=98431) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}} Jun 11 23:14:03.545339 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:14:03.547979 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] No BDM found with device name vda, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:14:03.548817 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:14:03.548817 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] No BDM found with device name hda, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:14:03.548817 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] No VIF found with MAC fa:16:3e:4b:26:95, not building metadata {{(pid=98431) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13199}} Jun 11 23:14:03.549328 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] Using config drive Jun 11 23:14:03.588878 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-991a3102-9958-4e0f-aff2-b6cd83e76728 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.867s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:14:03.592556 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-c6408d00-6828-43e9-8650-3e2a3fb2cff4 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.949s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:14:03.598029 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-c6408d00-6828-43e9-8650-3e2a3fb2cff4 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98431) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 11 23:14:03.598301 np0000002687 nova-compute[98431]: INFO nova.compute.claims [None req-c6408d00-6828-43e9-8650-3e2a3fb2cff4 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] [instance: ae596459-1e34-4a2a-9a33-69a02f50fd1c] Claim successful on node np0000002687 Jun 11 23:14:03.699762 np0000002687 nova-compute[98431]: INFO nova.scheduler.client.report [None req-991a3102-9958-4e0f-aff2-b6cd83e76728 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Deleted allocations for instance 8aec3cea-109d-43f8-983c-1d5ee2f71181 Jun 11 23:14:03.762174 np0000002687 nova-compute[98431]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0007724959998540726 future=) submitted to {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:14:03.762292 np0000002687 nova-compute[98431]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:14:03.762474 np0000002687 nova-compute[98431]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=0.17180624500019803 future=) {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:14:03.762474 np0000002687 nova-compute[98431]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=0.1716900210001313 future=) {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:14:03.762899 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Emitting event Stopped> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:14:03.763060 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] VM Stopped (Lifecycle Event) Jun 11 23:14:03.919985 np0000002687 nova-compute[98431]: DEBUG nova.objects.base [None req-1832c4d4-44f6-4f69-b46b-29924f655c1c tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98431) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 11 23:14:03.921385 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-1832c4d4-44f6-4f69-b46b-29924f655c1c tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:14:03.936819 np0000002687 nova-compute[98431]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0010083289998874534 future=) submitted to {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:14:03.936819 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Emitting event Stopped> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:14:03.936819 np0000002687 nova-compute[98431]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:14:03.936819 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] VM Stopped (Lifecycle Event) Jun 11 23:14:03.936819 np0000002687 nova-compute[98431]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=8.594606099999964 future=) {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:14:03.936819 np0000002687 nova-compute[98431]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=8.594450193000057 future=) {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:14:04.087995 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:04.091993 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-1832c4d4-44f6-4f69-b46b-29924f655c1c tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: dd1dd46c-2231-40b4-aa61-0121733a932d] Creating config drive at /opt/stack/data/nova/instances/dd1dd46c-2231-40b4-aa61-0121733a932d/disk.config.rescue Jun 11 23:14:04.110969 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-1832c4d4-44f6-4f69-b46b-29924f655c1c tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/dd1dd46c-2231-40b4-aa61-0121733a932d/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmprtixtgg1 {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:14:04.129664 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:04.170843 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-1832c4d4-44f6-4f69-b46b-29924f655c1c tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/dd1dd46c-2231-40b4-aa61-0121733a932d/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmprtixtgg1" returned: 0 in 0.060s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:14:04.220369 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:04.266856 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-821b889e-6def-4260-898f-25a8ea7a6c15 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: c82748e6-1c78-4372-ad4b-48d1c6448efa] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:14:04.296659 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:04.304353 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:04.392910 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-7922f8ff-8e8a-4b8a-bf06-98f5eeba668b req-e4dddc60-7d3a-450b-aab9-4498b730c012 service nova] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] Received event network-vif-plugged-283962f2-faaf-4d85-8eda-9b77b55a5b0c {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:14:04.393251 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-7922f8ff-8e8a-4b8a-bf06-98f5eeba668b req-e4dddc60-7d3a-450b-aab9-4498b730c012 service nova] Acquiring lock "64d7833a-82e8-43e9-83ed-2507197b69bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:14:04.393523 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-7922f8ff-8e8a-4b8a-bf06-98f5eeba668b req-e4dddc60-7d3a-450b-aab9-4498b730c012 service nova] Lock "64d7833a-82e8-43e9-83ed-2507197b69bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:14:04.393703 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-7922f8ff-8e8a-4b8a-bf06-98f5eeba668b req-e4dddc60-7d3a-450b-aab9-4498b730c012 service nova] Lock "64d7833a-82e8-43e9-83ed-2507197b69bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:14:04.393998 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-7922f8ff-8e8a-4b8a-bf06-98f5eeba668b req-e4dddc60-7d3a-450b-aab9-4498b730c012 service nova] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] No waiting events found dispatching network-vif-plugged-283962f2-faaf-4d85-8eda-9b77b55a5b0c {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:14:04.394089 np0000002687 nova-compute[98431]: WARNING nova.compute.manager [req-7922f8ff-8e8a-4b8a-bf06-98f5eeba668b req-e4dddc60-7d3a-450b-aab9-4498b730c012 service nova] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] Received unexpected event network-vif-plugged-283962f2-faaf-4d85-8eda-9b77b55a5b0c for instance with vm_state active and task_state resize_finish. Jun 11 23:14:04.440113 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-da55f108-d512-4acc-b769-eaa21384cb86 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 7609742e-a3a2-4be2-ba02-227efb2101e1] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:14:04.717639 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-991a3102-9958-4e0f-aff2-b6cd83e76728 tempest-ServerBootFromVolumeStableRescueTest-539499192 tempest-ServerBootFromVolumeStableRescueTest-539499192-project-member] Lock "8aec3cea-109d-43f8-983c-1d5ee2f71181" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 7.109s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:14:04.802928 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:04.836612 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:04.973578 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:05.037933 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:05.039683 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:05.253734 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-2b805d78-0e42-491e-bc36-da75dcfa5dd9 req-45848d46-e4cb-4f09-95c3-fa5146f38c4d service nova] [instance: dd1dd46c-2231-40b4-aa61-0121733a932d] Received event network-vif-plugged-98c628a8-e152-4189-94f1-e166c406cf10 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:14:05.253734 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-2b805d78-0e42-491e-bc36-da75dcfa5dd9 req-45848d46-e4cb-4f09-95c3-fa5146f38c4d service nova] Acquiring lock "dd1dd46c-2231-40b4-aa61-0121733a932d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:14:05.253734 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-2b805d78-0e42-491e-bc36-da75dcfa5dd9 req-45848d46-e4cb-4f09-95c3-fa5146f38c4d service nova] Lock "dd1dd46c-2231-40b4-aa61-0121733a932d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:14:05.253877 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-2b805d78-0e42-491e-bc36-da75dcfa5dd9 req-45848d46-e4cb-4f09-95c3-fa5146f38c4d service nova] Lock "dd1dd46c-2231-40b4-aa61-0121733a932d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:14:05.254379 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-2b805d78-0e42-491e-bc36-da75dcfa5dd9 req-45848d46-e4cb-4f09-95c3-fa5146f38c4d service nova] [instance: dd1dd46c-2231-40b4-aa61-0121733a932d] No waiting events found dispatching network-vif-plugged-98c628a8-e152-4189-94f1-e166c406cf10 {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:14:05.256102 np0000002687 nova-compute[98431]: WARNING nova.compute.manager [req-2b805d78-0e42-491e-bc36-da75dcfa5dd9 req-45848d46-e4cb-4f09-95c3-fa5146f38c4d service nova] [instance: dd1dd46c-2231-40b4-aa61-0121733a932d] Received unexpected event network-vif-plugged-98c628a8-e152-4189-94f1-e166c406cf10 for instance with vm_state active and task_state rescuing. Jun 11 23:14:05.373321 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-c6408d00-6828-43e9-8650-3e2a3fb2cff4 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98431) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 11 23:14:05.373548 np0000002687 nova-compute[98431]: DEBUG nova.compute.provider_tree [None req-c6408d00-6828-43e9-8650-3e2a3fb2cff4 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Inventory has not changed in ProviderTree for provider: e3e65fe2-9de9-4821-8b4a-ccae37c66e25 {{(pid=98431) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 11 23:14:05.537035 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:05.700621 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Emitting event Resumed> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:14:05.700621 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] VM Resumed (Lifecycle Event) Jun 11 23:14:05.704862 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] Instance event wait completed in 0 seconds for {{(pid=98431) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 11 23:14:05.710356 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [-] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] Instance running successfully. Jun 11 23:14:05.716073 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.guest [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] Failed to set time: agent not configured {{(pid=98431) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:194}} Jun 11 23:14:05.716073 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-aab7ff2e-7f51-42c2-a855-b5bf8ed6f310 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] finish_migration finished successfully. {{(pid=98431) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12898}} Jun 11 23:14:05.872917 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-1832c4d4-44f6-4f69-b46b-29924f655c1c tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: dd1dd46c-2231-40b4-aa61-0121733a932d] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:14:05.879465 np0000002687 nova-compute[98431]: DEBUG nova.scheduler.client.report [None req-c6408d00-6828-43e9-8650-3e2a3fb2cff4 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Inventory has not changed for provider e3e65fe2-9de9-4821-8b4a-ccae37c66e25 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98431) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 11 23:14:06.207633 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:14:06.213332 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=98431) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 11 23:14:06.402759 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-c6408d00-6828-43e9-8650-3e2a3fb2cff4 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.813s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:14:06.405958 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-c6408d00-6828-43e9-8650-3e2a3fb2cff4 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] [instance: ae596459-1e34-4a2a-9a33-69a02f50fd1c] Start building networks asynchronously for instance. {{(pid=98431) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 11 23:14:06.419711 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 2.860s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:14:06.497086 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-75cf6767-211e-4a8c-8dc4-a6f781f2acae req-9e1210d0-75b2-42fd-b930-b68ce65650cd service nova] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] Received event network-vif-plugged-283962f2-faaf-4d85-8eda-9b77b55a5b0c {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:14:06.498384 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-75cf6767-211e-4a8c-8dc4-a6f781f2acae req-9e1210d0-75b2-42fd-b930-b68ce65650cd service nova] Acquiring lock "64d7833a-82e8-43e9-83ed-2507197b69bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:14:06.499091 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-75cf6767-211e-4a8c-8dc4-a6f781f2acae req-9e1210d0-75b2-42fd-b930-b68ce65650cd service nova] Lock "64d7833a-82e8-43e9-83ed-2507197b69bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:14:06.499304 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-75cf6767-211e-4a8c-8dc4-a6f781f2acae req-9e1210d0-75b2-42fd-b930-b68ce65650cd service nova] Lock "64d7833a-82e8-43e9-83ed-2507197b69bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:14:06.499521 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-75cf6767-211e-4a8c-8dc4-a6f781f2acae req-9e1210d0-75b2-42fd-b930-b68ce65650cd service nova] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] No waiting events found dispatching network-vif-plugged-283962f2-faaf-4d85-8eda-9b77b55a5b0c {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:14:06.499521 np0000002687 nova-compute[98431]: WARNING nova.compute.manager [req-75cf6767-211e-4a8c-8dc4-a6f781f2acae req-9e1210d0-75b2-42fd-b930-b68ce65650cd service nova] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] Received unexpected event network-vif-plugged-283962f2-faaf-4d85-8eda-9b77b55a5b0c for instance with vm_state resized and task_state None. Jun 11 23:14:06.717355 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] During sync_power_state the instance has a pending task (resize_finish). Skip. Jun 11 23:14:06.719543 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Emitting event Started> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:14:06.719543 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] VM Started (Lifecycle Event) Jun 11 23:14:06.923214 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-c6408d00-6828-43e9-8650-3e2a3fb2cff4 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] [instance: ae596459-1e34-4a2a-9a33-69a02f50fd1c] Allocating IP information in the background. {{(pid=98431) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 11 23:14:06.924009 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-c6408d00-6828-43e9-8650-3e2a3fb2cff4 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] [instance: ae596459-1e34-4a2a-9a33-69a02f50fd1c] allocate_for_instance() {{(pid=98431) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 11 23:14:06.926332 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-c6408d00-6828-43e9-8650-3e2a3fb2cff4 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:14:06.926332 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-c6408d00-6828-43e9-8650-3e2a3fb2cff4 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:14:06.952536 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:07.029333 np0000002687 nova-compute[98431]: DEBUG nova.policy [None req-c6408d00-6828-43e9-8650-3e2a3fb2cff4 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '56116a7118a54aa6b259414512446b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03be033a975c41efba46c4d480df190f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98431) authorize /opt/stack/nova/nova/policy.py:192}} Jun 11 23:14:07.222633 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:14:07.234874 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98431) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 11 23:14:07.238149 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:07.352966 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-11ccf08f-d41a-43e5-a133-518beec6689f req-cb65cfa6-0190-413e-93dc-4dd1c956b101 service nova] [instance: dd1dd46c-2231-40b4-aa61-0121733a932d] Received event network-vif-plugged-98c628a8-e152-4189-94f1-e166c406cf10 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:14:07.352966 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-11ccf08f-d41a-43e5-a133-518beec6689f req-cb65cfa6-0190-413e-93dc-4dd1c956b101 service nova] Acquiring lock "dd1dd46c-2231-40b4-aa61-0121733a932d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:14:07.352966 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-11ccf08f-d41a-43e5-a133-518beec6689f req-cb65cfa6-0190-413e-93dc-4dd1c956b101 service nova] Lock "dd1dd46c-2231-40b4-aa61-0121733a932d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:14:07.352966 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-11ccf08f-d41a-43e5-a133-518beec6689f req-cb65cfa6-0190-413e-93dc-4dd1c956b101 service nova] Lock "dd1dd46c-2231-40b4-aa61-0121733a932d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:14:07.352966 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-11ccf08f-d41a-43e5-a133-518beec6689f req-cb65cfa6-0190-413e-93dc-4dd1c956b101 service nova] [instance: dd1dd46c-2231-40b4-aa61-0121733a932d] No waiting events found dispatching network-vif-plugged-98c628a8-e152-4189-94f1-e166c406cf10 {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:14:07.352966 np0000002687 nova-compute[98431]: WARNING nova.compute.manager [req-11ccf08f-d41a-43e5-a133-518beec6689f req-cb65cfa6-0190-413e-93dc-4dd1c956b101 service nova] [instance: dd1dd46c-2231-40b4-aa61-0121733a932d] Received unexpected event network-vif-plugged-98c628a8-e152-4189-94f1-e166c406cf10 for instance with vm_state rescued and task_state unrescuing. Jun 11 23:14:07.425518 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-c6408d00-6828-43e9-8650-3e2a3fb2cff4 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] [instance: ae596459-1e34-4a2a-9a33-69a02f50fd1c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 11 23:14:07.440202 np0000002687 nova-compute[98431]: DEBUG nova.compute.resource_tracker [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Applying migration context for instance 64d7833a-82e8-43e9-83ed-2507197b69bf as it has an incoming, in-progress migration 89fc30bc-f302-4da8-8ae9-4f890f4d2fe2. Migration status is finished {{(pid=98431) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1046}} Jun 11 23:14:07.444970 np0000002687 nova-compute[98431]: INFO nova.compute.resource_tracker [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] Updating resource usage from migration 89fc30bc-f302-4da8-8ae9-4f890f4d2fe2 Jun 11 23:14:07.528860 np0000002687 nova-compute[98431]: DEBUG nova.compute.resource_tracker [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Instance de4372a4-a0cc-4541-a5a2-87be3152c50e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98431) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 11 23:14:07.528982 np0000002687 nova-compute[98431]: DEBUG nova.compute.resource_tracker [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Instance 206476b7-d805-4c6c-b7fb-db8b5c2a94a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98431) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 11 23:14:07.529121 np0000002687 nova-compute[98431]: DEBUG nova.compute.resource_tracker [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Instance 8ffa4bbe-7ead-4029-aba5-28f031f6e784 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98431) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 11 23:14:07.529422 np0000002687 nova-compute[98431]: DEBUG nova.compute.resource_tracker [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Instance 8a45e04f-3516-4c39-bea1-820104411f17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98431) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 11 23:14:07.529553 np0000002687 nova-compute[98431]: DEBUG nova.compute.resource_tracker [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Instance 1d45c7ce-5760-4f59-9921-feb3e589da8a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98431) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 11 23:14:07.529678 np0000002687 nova-compute[98431]: DEBUG nova.compute.resource_tracker [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Instance dd1dd46c-2231-40b4-aa61-0121733a932d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98431) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 11 23:14:07.529779 np0000002687 nova-compute[98431]: DEBUG nova.compute.resource_tracker [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Instance 67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98431) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 11 23:14:07.530300 np0000002687 nova-compute[98431]: DEBUG nova.compute.resource_tracker [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Migration 89fc30bc-f302-4da8-8ae9-4f890f4d2fe2 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98431) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1745}} Jun 11 23:14:07.530300 np0000002687 nova-compute[98431]: DEBUG nova.compute.resource_tracker [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Instance 64d7833a-82e8-43e9-83ed-2507197b69bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=98431) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 11 23:14:07.530300 np0000002687 nova-compute[98431]: DEBUG nova.compute.resource_tracker [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Instance ae596459-1e34-4a2a-9a33-69a02f50fd1c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98431) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 11 23:14:07.530422 np0000002687 nova-compute[98431]: DEBUG nova.compute.resource_tracker [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=98431) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}} Jun 11 23:14:07.530556 np0000002687 nova-compute[98431]: DEBUG nova.compute.resource_tracker [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Final resource view: name=np0000002687 phys_ram=24030MB used_ram=2496MB phys_disk=95GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 23:14:03 up 28 min, 2 users, load average: 10.96, 6.22, 2.92\n', 'num_instances': '9', 'num_vm_active': '5', 'num_task_None': '9', 'num_os_type_None': '9', 'num_proj_81fd45f475a04e5c8e9bd9deb7ad4c1e': '5', 'io_workload': '1', 'num_vm_resized': '1', 'num_proj_6c1e407a42f24b34baf3ee44be9fb337': '1', 'num_vm_rescued': '2', 'num_proj_b2b9f55b231c455ca1a4579d7ed54888': '2', 'num_vm_building': '1', 'num_proj_03be033a975c41efba46c4d480df190f': '1'} {{(pid=98431) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}} Jun 11 23:14:07.617127 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-893e6351-4b11-447b-9fd8-27ba21e0534c tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: dd1dd46c-2231-40b4-aa61-0121733a932d] Unrescuing Jun 11 23:14:07.617373 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-893e6351-4b11-447b-9fd8-27ba21e0534c tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Acquiring lock "refresh_cache-dd1dd46c-2231-40b4-aa61-0121733a932d" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 11 23:14:07.617708 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-893e6351-4b11-447b-9fd8-27ba21e0534c tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Acquired lock "refresh_cache-dd1dd46c-2231-40b4-aa61-0121733a932d" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 11 23:14:07.617791 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-893e6351-4b11-447b-9fd8-27ba21e0534c tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: dd1dd46c-2231-40b4-aa61-0121733a932d] Building network info cache for instance {{(pid=98431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 11 23:14:07.738530 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Removed pending STOPPED event for dd1dd46c-2231-40b4-aa61-0121733a932d due to new event Resumed> {{(pid=98431) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:519}} Jun 11 23:14:07.738694 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Emitting event Resumed> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:14:07.739230 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: dd1dd46c-2231-40b4-aa61-0121733a932d] VM Resumed (Lifecycle Event) Jun 11 23:14:07.756335 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-c6408d00-6828-43e9-8650-3e2a3fb2cff4 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] [instance: ae596459-1e34-4a2a-9a33-69a02f50fd1c] Successfully created port: 1f920031-116a-4009-be97-ea5f1389a374 {{(pid=98431) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 11 23:14:07.926145 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:07.930884 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-c6408d00-6828-43e9-8650-3e2a3fb2cff4 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] [instance: ae596459-1e34-4a2a-9a33-69a02f50fd1c] Start building block device mappings for instance. {{(pid=98431) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 11 23:14:08.123649 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-893e6351-4b11-447b-9fd8-27ba21e0534c tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:14:08.241760 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: dd1dd46c-2231-40b4-aa61-0121733a932d] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:14:08.251038 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: dd1dd46c-2231-40b4-aa61-0121733a932d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98431) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 11 23:14:08.357037 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98431) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 11 23:14:08.357389 np0000002687 nova-compute[98431]: DEBUG nova.compute.provider_tree [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Inventory has not changed in ProviderTree for provider: e3e65fe2-9de9-4821-8b4a-ccae37c66e25 {{(pid=98431) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 11 23:14:08.659331 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-d5e1885a-7eec-4c2a-b886-1069d090fa54 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Acquiring lock "64d7833a-82e8-43e9-83ed-2507197b69bf" by "nova.compute.manager.ComputeManager.confirm_resize..do_confirm_resize" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:14:08.659615 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-d5e1885a-7eec-4c2a-b886-1069d090fa54 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "64d7833a-82e8-43e9-83ed-2507197b69bf" acquired by "nova.compute.manager.ComputeManager.confirm_resize..do_confirm_resize" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:14:08.659845 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-d5e1885a-7eec-4c2a-b886-1069d090fa54 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] Going to confirm migration 2 {{(pid=98431) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:5452}} Jun 11 23:14:08.752946 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: dd1dd46c-2231-40b4-aa61-0121733a932d] During sync_power_state the instance has a pending task (unrescuing). Skip. Jun 11 23:14:08.754528 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Emitting event Started> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:14:08.754528 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: dd1dd46c-2231-40b4-aa61-0121733a932d] VM Started (Lifecycle Event) Jun 11 23:14:08.842759 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-c6408d00-6828-43e9-8650-3e2a3fb2cff4 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] [instance: ae596459-1e34-4a2a-9a33-69a02f50fd1c] Successfully updated port: 1f920031-116a-4009-be97-ea5f1389a374 {{(pid=98431) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 11 23:14:08.862879 np0000002687 nova-compute[98431]: DEBUG nova.scheduler.client.report [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Inventory has not changed for provider e3e65fe2-9de9-4821-8b4a-ccae37c66e25 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98431) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 11 23:14:08.922615 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-d73d4756-5450-4fb2-a7cb-86ef00b433a8 req-c2f85b12-4ab2-4a7e-a1cd-4364b7b18bb2 service nova] [instance: ae596459-1e34-4a2a-9a33-69a02f50fd1c] Received event network-changed-1f920031-116a-4009-be97-ea5f1389a374 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:14:08.922735 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-d73d4756-5450-4fb2-a7cb-86ef00b433a8 req-c2f85b12-4ab2-4a7e-a1cd-4364b7b18bb2 service nova] [instance: ae596459-1e34-4a2a-9a33-69a02f50fd1c] Refreshing instance network info cache due to event network-changed-1f920031-116a-4009-be97-ea5f1389a374. {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 11 23:14:08.922950 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-d73d4756-5450-4fb2-a7cb-86ef00b433a8 req-c2f85b12-4ab2-4a7e-a1cd-4364b7b18bb2 service nova] Acquiring lock "refresh_cache-ae596459-1e34-4a2a-9a33-69a02f50fd1c" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 11 23:14:08.923003 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-d73d4756-5450-4fb2-a7cb-86ef00b433a8 req-c2f85b12-4ab2-4a7e-a1cd-4364b7b18bb2 service nova] Acquired lock "refresh_cache-ae596459-1e34-4a2a-9a33-69a02f50fd1c" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 11 23:14:08.924114 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-d73d4756-5450-4fb2-a7cb-86ef00b433a8 req-c2f85b12-4ab2-4a7e-a1cd-4364b7b18bb2 service nova] [instance: ae596459-1e34-4a2a-9a33-69a02f50fd1c] Refreshing network info cache for port 1f920031-116a-4009-be97-ea5f1389a374 {{(pid=98431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 11 23:14:08.946422 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-c6408d00-6828-43e9-8650-3e2a3fb2cff4 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] [instance: ae596459-1e34-4a2a-9a33-69a02f50fd1c] Start spawning the instance on the hypervisor. {{(pid=98431) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 11 23:14:08.949286 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-c6408d00-6828-43e9-8650-3e2a3fb2cff4 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] [instance: ae596459-1e34-4a2a-9a33-69a02f50fd1c] Creating instance directory {{(pid=98431) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}} Jun 11 23:14:08.950164 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-c6408d00-6828-43e9-8650-3e2a3fb2cff4 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] [instance: ae596459-1e34-4a2a-9a33-69a02f50fd1c] Creating image(s) Jun 11 23:14:08.950920 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-c6408d00-6828-43e9-8650-3e2a3fb2cff4 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Acquiring lock "/opt/stack/data/nova/instances/ae596459-1e34-4a2a-9a33-69a02f50fd1c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:14:08.951052 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-c6408d00-6828-43e9-8650-3e2a3fb2cff4 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Lock "/opt/stack/data/nova/instances/ae596459-1e34-4a2a-9a33-69a02f50fd1c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:14:08.953902 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-c6408d00-6828-43e9-8650-3e2a3fb2cff4 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Lock "/opt/stack/data/nova/instances/ae596459-1e34-4a2a-9a33-69a02f50fd1c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.003s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:14:08.956323 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-c6408d00-6828-43e9-8650-3e2a3fb2cff4 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:14:08.961446 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-c6408d00-6828-43e9-8650-3e2a3fb2cff4 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:14:08.965461 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-c6408d00-6828-43e9-8650-3e2a3fb2cff4 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:14:09.036736 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-893e6351-4b11-447b-9fd8-27ba21e0534c tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:14:09.090427 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-c6408d00-6828-43e9-8650-3e2a3fb2cff4 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json" returned: 0 in 0.125s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:14:09.090909 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-c6408d00-6828-43e9-8650-3e2a3fb2cff4 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Acquiring lock "d2c441059b2992961b5de03c05b32d04aff77cb1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:14:09.091864 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-c6408d00-6828-43e9-8650-3e2a3fb2cff4 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Lock "d2c441059b2992961b5de03c05b32d04aff77cb1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:14:09.091864 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-c6408d00-6828-43e9-8650-3e2a3fb2cff4 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:14:09.096111 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-c6408d00-6828-43e9-8650-3e2a3fb2cff4 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:14:09.096988 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-c6408d00-6828-43e9-8650-3e2a3fb2cff4 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:14:09.172431 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-d5e1885a-7eec-4c2a-b886-1069d090fa54 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:14:09.220691 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-c6408d00-6828-43e9-8650-3e2a3fb2cff4 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json" returned: 0 in 0.124s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:14:09.221290 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-c6408d00-6828-43e9-8650-3e2a3fb2cff4 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1,backing_fmt=raw /opt/stack/data/nova/instances/ae596459-1e34-4a2a-9a33-69a02f50fd1c/disk 1073741824 {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:14:09.259264 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: dd1dd46c-2231-40b4-aa61-0121733a932d] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:14:09.264021 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: dd1dd46c-2231-40b4-aa61-0121733a932d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98431) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 11 23:14:09.295975 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-c6408d00-6828-43e9-8650-3e2a3fb2cff4 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1,backing_fmt=raw /opt/stack/data/nova/instances/ae596459-1e34-4a2a-9a33-69a02f50fd1c/disk 1073741824" returned: 0 in 0.074s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:14:09.297103 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-c6408d00-6828-43e9-8650-3e2a3fb2cff4 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Lock "d2c441059b2992961b5de03c05b32d04aff77cb1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.206s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:14:09.297481 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-c6408d00-6828-43e9-8650-3e2a3fb2cff4 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:14:09.350792 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-c6408d00-6828-43e9-8650-3e2a3fb2cff4 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Acquiring lock "refresh_cache-ae596459-1e34-4a2a-9a33-69a02f50fd1c" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 11 23:14:09.372660 np0000002687 nova-compute[98431]: DEBUG nova.compute.resource_tracker [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Compute_service record updated for np0000002687:np0000002687 {{(pid=98431) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}} Jun 11 23:14:09.372941 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.968s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:14:09.376301 np0000002687 nova-compute[98431]: DEBUG oslo.service.backend._threading.loopingcall [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 60.00 seconds {{(pid=98431) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jun 11 23:14:09.388687 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-d5e1885a-7eec-4c2a-b886-1069d090fa54 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:14:09.388687 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-d5e1885a-7eec-4c2a-b886-1069d090fa54 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Acquiring lock "refresh_cache-64d7833a-82e8-43e9-83ed-2507197b69bf" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 11 23:14:09.388687 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-d5e1885a-7eec-4c2a-b886-1069d090fa54 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Acquired lock "refresh_cache-64d7833a-82e8-43e9-83ed-2507197b69bf" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 11 23:14:09.388687 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-d5e1885a-7eec-4c2a-b886-1069d090fa54 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] Building network info cache for instance {{(pid=98431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 11 23:14:09.389764 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-d5e1885a-7eec-4c2a-b886-1069d090fa54 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lazy-loading 'info_cache' on Instance uuid 64d7833a-82e8-43e9-83ed-2507197b69bf {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:14:09.429590 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-c6408d00-6828-43e9-8650-3e2a3fb2cff4 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json" returned: 0 in 0.132s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:14:09.430939 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [req-d73d4756-5450-4fb2-a7cb-86ef00b433a8 req-c2f85b12-4ab2-4a7e-a1cd-4364b7b18bb2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:14:09.438740 np0000002687 nova-compute[98431]: DEBUG nova.virt.disk.api [None req-c6408d00-6828-43e9-8650-3e2a3fb2cff4 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ae596459-1e34-4a2a-9a33-69a02f50fd1c/disk. size=1073741824 {{(pid=98431) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 11 23:14:09.440003 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-c6408d00-6828-43e9-8650-3e2a3fb2cff4 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae596459-1e34-4a2a-9a33-69a02f50fd1c/disk --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:14:09.460762 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-893e6351-4b11-447b-9fd8-27ba21e0534c tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: dd1dd46c-2231-40b4-aa61-0121733a932d] Updating instance_info_cache with network_info: [{"id": "98c628a8-e152-4189-94f1-e166c406cf10", "address": "fa:16:3e:2b:91:a7", "network": {"id": "77fc4e10-1fed-4963-86b4-1fbb3a9c6f7f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1105404274-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b2b9f55b231c455ca1a4579d7ed54888", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap98c628a8-e1", "ovs_interfaceid": "98c628a8-e152-4189-94f1-e166c406cf10", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:14:09.573416 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-c6408d00-6828-43e9-8650-3e2a3fb2cff4 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae596459-1e34-4a2a-9a33-69a02f50fd1c/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:14:09.575266 np0000002687 nova-compute[98431]: DEBUG nova.virt.disk.api [None req-c6408d00-6828-43e9-8650-3e2a3fb2cff4 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Cannot resize image /opt/stack/data/nova/instances/ae596459-1e34-4a2a-9a33-69a02f50fd1c/disk to a smaller size. {{(pid=98431) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 11 23:14:09.576457 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-c6408d00-6828-43e9-8650-3e2a3fb2cff4 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] [instance: ae596459-1e34-4a2a-9a33-69a02f50fd1c] Created local disks {{(pid=98431) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}} Jun 11 23:14:09.576558 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-c6408d00-6828-43e9-8650-3e2a3fb2cff4 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] [instance: ae596459-1e34-4a2a-9a33-69a02f50fd1c] Ensure instance console log exists: /opt/stack/data/nova/instances/ae596459-1e34-4a2a-9a33-69a02f50fd1c/console.log {{(pid=98431) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}} Jun 11 23:14:09.577693 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-c6408d00-6828-43e9-8650-3e2a3fb2cff4 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:14:09.578782 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-c6408d00-6828-43e9-8650-3e2a3fb2cff4 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:14:09.579157 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-c6408d00-6828-43e9-8650-3e2a3fb2cff4 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:14:09.640599 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-d73d4756-5450-4fb2-a7cb-86ef00b433a8 req-c2f85b12-4ab2-4a7e-a1cd-4364b7b18bb2 service nova] [instance: ae596459-1e34-4a2a-9a33-69a02f50fd1c] Instance cache missing network info. {{(pid=98431) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 11 23:14:09.771034 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: dd1dd46c-2231-40b4-aa61-0121733a932d] During sync_power_state the instance has a pending task (unrescuing). Skip. Jun 11 23:14:09.966551 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-893e6351-4b11-447b-9fd8-27ba21e0534c tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Releasing lock "refresh_cache-dd1dd46c-2231-40b4-aa61-0121733a932d" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 11 23:14:09.967170 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-893e6351-4b11-447b-9fd8-27ba21e0534c tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Lazy-loading 'flavor' on Instance uuid dd1dd46c-2231-40b4-aa61-0121733a932d {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:14:09.978379 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-d73d4756-5450-4fb2-a7cb-86ef00b433a8 req-c2f85b12-4ab2-4a7e-a1cd-4364b7b18bb2 service nova] [instance: ae596459-1e34-4a2a-9a33-69a02f50fd1c] Updating instance_info_cache with network_info: [] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:14:10.130149 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:10.396715 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-d5e1885a-7eec-4c2a-b886-1069d090fa54 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:14:10.484650 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-d73d4756-5450-4fb2-a7cb-86ef00b433a8 req-c2f85b12-4ab2-4a7e-a1cd-4364b7b18bb2 service nova] Releasing lock "refresh_cache-ae596459-1e34-4a2a-9a33-69a02f50fd1c" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 11 23:14:10.486720 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-c6408d00-6828-43e9-8650-3e2a3fb2cff4 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Acquired lock "refresh_cache-ae596459-1e34-4a2a-9a33-69a02f50fd1c" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 11 23:14:10.486720 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-c6408d00-6828-43e9-8650-3e2a3fb2cff4 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] [instance: ae596459-1e34-4a2a-9a33-69a02f50fd1c] Building network info cache for instance {{(pid=98431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 11 23:14:10.511416 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:10.541224 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:10.769944 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:10.778663 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:10.792022 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-969c1da3-8c71-48c1-8f1f-e8ac19a7353b req-c81ade88-a82b-4be1-8282-87132c2f9eb9 service nova] [instance: dd1dd46c-2231-40b4-aa61-0121733a932d] Received event network-vif-unplugged-98c628a8-e152-4189-94f1-e166c406cf10 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:14:10.792359 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-969c1da3-8c71-48c1-8f1f-e8ac19a7353b req-c81ade88-a82b-4be1-8282-87132c2f9eb9 service nova] Acquiring lock "dd1dd46c-2231-40b4-aa61-0121733a932d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:14:10.792507 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-969c1da3-8c71-48c1-8f1f-e8ac19a7353b req-c81ade88-a82b-4be1-8282-87132c2f9eb9 service nova] Lock "dd1dd46c-2231-40b4-aa61-0121733a932d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:14:10.792664 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-969c1da3-8c71-48c1-8f1f-e8ac19a7353b req-c81ade88-a82b-4be1-8282-87132c2f9eb9 service nova] Lock "dd1dd46c-2231-40b4-aa61-0121733a932d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:14:10.792835 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-969c1da3-8c71-48c1-8f1f-e8ac19a7353b req-c81ade88-a82b-4be1-8282-87132c2f9eb9 service nova] [instance: dd1dd46c-2231-40b4-aa61-0121733a932d] No waiting events found dispatching network-vif-unplugged-98c628a8-e152-4189-94f1-e166c406cf10 {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:14:10.793019 np0000002687 nova-compute[98431]: WARNING nova.compute.manager [req-969c1da3-8c71-48c1-8f1f-e8ac19a7353b req-c81ade88-a82b-4be1-8282-87132c2f9eb9 service nova] [instance: dd1dd46c-2231-40b4-aa61-0121733a932d] Received unexpected event network-vif-unplugged-98c628a8-e152-4189-94f1-e166c406cf10 for instance with vm_state rescued and task_state unrescuing. Jun 11 23:14:10.894998 np0000002687 nova-compute[98431]: DEBUG nova.utils [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Queued Task(fn=>, remaining_delay=14.99969794399999 future=) {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:14:10.899910 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [-] [instance: dd1dd46c-2231-40b4-aa61-0121733a932d] Instance destroyed successfully. Jun 11 23:14:10.901485 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-893e6351-4b11-447b-9fd8-27ba21e0534c tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Lazy-loading 'numa_topology' on Instance uuid dd1dd46c-2231-40b4-aa61-0121733a932d {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:14:10.947118 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-d5e1885a-7eec-4c2a-b886-1069d090fa54 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:14:11.086116 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-aca297be-5eab-460e-a735-827415d51f8e req-1c3ec9f1-9e8c-40bb-af31-39c1c5f559e3 service nova] [instance: ae596459-1e34-4a2a-9a33-69a02f50fd1c] Received event network-vif-unplugged-1f920031-116a-4009-be97-ea5f1389a374 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:14:11.086176 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-aca297be-5eab-460e-a735-827415d51f8e req-1c3ec9f1-9e8c-40bb-af31-39c1c5f559e3 service nova] Acquiring lock "ae596459-1e34-4a2a-9a33-69a02f50fd1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:14:11.086473 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-aca297be-5eab-460e-a735-827415d51f8e req-1c3ec9f1-9e8c-40bb-af31-39c1c5f559e3 service nova] Lock "ae596459-1e34-4a2a-9a33-69a02f50fd1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:14:11.086580 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-aca297be-5eab-460e-a735-827415d51f8e req-1c3ec9f1-9e8c-40bb-af31-39c1c5f559e3 service nova] Lock "ae596459-1e34-4a2a-9a33-69a02f50fd1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:14:11.086755 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-aca297be-5eab-460e-a735-827415d51f8e req-1c3ec9f1-9e8c-40bb-af31-39c1c5f559e3 service nova] [instance: ae596459-1e34-4a2a-9a33-69a02f50fd1c] No waiting events found dispatching network-vif-unplugged-1f920031-116a-4009-be97-ea5f1389a374 {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:14:11.086887 np0000002687 nova-compute[98431]: WARNING nova.compute.manager [req-aca297be-5eab-460e-a735-827415d51f8e req-1c3ec9f1-9e8c-40bb-af31-39c1c5f559e3 service nova] [instance: ae596459-1e34-4a2a-9a33-69a02f50fd1c] Received unexpected event network-vif-unplugged-1f920031-116a-4009-be97-ea5f1389a374 for instance with vm_state building and task_state spawning. Jun 11 23:14:11.107087 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-c6408d00-6828-43e9-8650-3e2a3fb2cff4 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] [instance: ae596459-1e34-4a2a-9a33-69a02f50fd1c] Instance cache missing network info. {{(pid=98431) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 11 23:14:11.185837 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-d5e1885a-7eec-4c2a-b886-1069d090fa54 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] Updating instance_info_cache with network_info: [{"id": "283962f2-faaf-4d85-8eda-9b77b55a5b0c", "address": "fa:16:3e:4b:26:95", "network": {"id": "17593db3-c22d-4354-ab29-933b1c6a5c3a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1094286565-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "81fd45f475a04e5c8e9bd9deb7ad4c1e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap283962f2-fa", "ovs_interfaceid": "283962f2-faaf-4d85-8eda-9b77b55a5b0c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:14:11.343662 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-c6408d00-6828-43e9-8650-3e2a3fb2cff4 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:14:11.405925 np0000002687 nova-compute[98431]: DEBUG nova.objects.base [None req-893e6351-4b11-447b-9fd8-27ba21e0534c tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Object Instance lazy-loaded attributes: flavor,numa_topology {{(pid=98431) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 11 23:14:11.528302 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-c6408d00-6828-43e9-8650-3e2a3fb2cff4 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] [instance: ae596459-1e34-4a2a-9a33-69a02f50fd1c] Updating instance_info_cache with network_info: [{"id": "1f920031-116a-4009-be97-ea5f1389a374", "address": "fa:16:3e:6c:78:be", "network": {"id": "e7cf6fb9-33e8-4362-8236-472d2d07f60a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-749809800-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "03be033a975c41efba46c4d480df190f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f920031-11", "ovs_interfaceid": "1f920031-116a-4009-be97-ea5f1389a374", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:14:11.688401 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-d5e1885a-7eec-4c2a-b886-1069d090fa54 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Releasing lock "refresh_cache-64d7833a-82e8-43e9-83ed-2507197b69bf" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 11 23:14:11.689591 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-d5e1885a-7eec-4c2a-b886-1069d090fa54 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lazy-loading 'migration_context' on Instance uuid 64d7833a-82e8-43e9-83ed-2507197b69bf {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:14:11.956835 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:11.990243 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:11.999875 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:12.031563 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-c6408d00-6828-43e9-8650-3e2a3fb2cff4 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Releasing lock "refresh_cache-ae596459-1e34-4a2a-9a33-69a02f50fd1c" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 11 23:14:12.031563 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-c6408d00-6828-43e9-8650-3e2a3fb2cff4 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] [instance: ae596459-1e34-4a2a-9a33-69a02f50fd1c] Instance network_info: |[{"id": "1f920031-116a-4009-be97-ea5f1389a374", "address": "fa:16:3e:6c:78:be", "network": {"id": "e7cf6fb9-33e8-4362-8236-472d2d07f60a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-749809800-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "03be033a975c41efba46c4d480df190f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f920031-11", "ovs_interfaceid": "1f920031-116a-4009-be97-ea5f1389a374", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98431) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 11 23:14:12.034031 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-c6408d00-6828-43e9-8650-3e2a3fb2cff4 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] [instance: ae596459-1e34-4a2a-9a33-69a02f50fd1c] Start _get_guest_xml network_info=[{"id": "1f920031-116a-4009-be97-ea5f1389a374", "address": "fa:16:3e:6c:78:be", "network": {"id": "e7cf6fb9-33e8-4362-8236-472d2d07f60a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-749809800-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "03be033a975c41efba46c4d480df190f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f920031-11", "ovs_interfaceid": "1f920031-116a-4009-be97-ea5f1389a374", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-11T23:08:20Z,direct_url=,disk_format='qcow2',id=f30640f8-7aca-4300-a085-4706a5209a79,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ce012f9fabdb4ee5a73e212437f59d97',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-11T23:08:23Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'image_id': 'f30640f8-7aca-4300-a085-4706a5209a79'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98431) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 11 23:14:12.046542 np0000002687 nova-compute[98431]: WARNING nova.virt.libvirt.driver [None req-c6408d00-6828-43e9-8650-3e2a3fb2cff4 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 11 23:14:12.048501 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-c6408d00-6828-43e9-8650-3e2a3fb2cff4 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='f30640f8-7aca-4300-a085-4706a5209a79', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-1094546666', uuid='ae596459-1e34-4a2a-9a33-69a02f50fd1c'), owner=OwnerMeta(userid='56116a7118a54aa6b259414512446b40', username='tempest-TaggedAttachmentsTest-1378608456-project-member', projectid='03be033a975c41efba46c4d480df190f', projectname='tempest-TaggedAttachmentsTest-1378608456'), image=ImageMeta(id='f30640f8-7aca-4300-a085-4706a5209a79', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "1f920031-116a-4009-be97-ea5f1389a374", "address": "fa:16:3e:6c:78:be", "network": {"id": "e7cf6fb9-33e8-4362-8236-472d2d07f60a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-749809800-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "03be033a975c41efba46c4d480df190f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f920031-11", "ovs_interfaceid": "1f920031-116a-4009-be97-ea5f1389a374", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1781219652.0476825) {{(pid=98431) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 11 23:14:12.053475 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-c6408d00-6828-43e9-8650-3e2a3fb2cff4 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Searching host: 'np0000002687' for CPU controller through CGroups V1... {{(pid=98431) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 11 23:14:12.055829 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-c6408d00-6828-43e9-8650-3e2a3fb2cff4 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] CPU controller missing on host. {{(pid=98431) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 11 23:14:12.056847 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-c6408d00-6828-43e9-8650-3e2a3fb2cff4 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Searching host: 'np0000002687' for CPU controller through CGroups V2... {{(pid=98431) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 11 23:14:12.058041 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-c6408d00-6828-43e9-8650-3e2a3fb2cff4 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] CPU controller found on host. {{(pid=98431) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 11 23:14:12.061368 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-c6408d00-6828-43e9-8650-3e2a3fb2cff4 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98431) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 11 23:14:12.061368 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-c6408d00-6828-43e9-8650-3e2a3fb2cff4 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-11T23:08:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-11T23:08:20Z,direct_url=,disk_format='qcow2',id=f30640f8-7aca-4300-a085-4706a5209a79,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ce012f9fabdb4ee5a73e212437f59d97',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-11T23:08:23Z,virtual_size=,visibility=), allow threads: True {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 11 23:14:12.061368 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-c6408d00-6828-43e9-8650-3e2a3fb2cff4 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Flavor limits 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 11 23:14:12.061368 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-c6408d00-6828-43e9-8650-3e2a3fb2cff4 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Image limits 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 11 23:14:12.061368 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-c6408d00-6828-43e9-8650-3e2a3fb2cff4 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Flavor pref 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 11 23:14:12.061368 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-c6408d00-6828-43e9-8650-3e2a3fb2cff4 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Image pref 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 11 23:14:12.061368 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-c6408d00-6828-43e9-8650-3e2a3fb2cff4 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 11 23:14:12.061791 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-c6408d00-6828-43e9-8650-3e2a3fb2cff4 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 11 23:14:12.061856 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-c6408d00-6828-43e9-8650-3e2a3fb2cff4 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98431) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 11 23:14:12.062090 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-c6408d00-6828-43e9-8650-3e2a3fb2cff4 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Got 1 possible topologies {{(pid=98431) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 11 23:14:12.062335 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-c6408d00-6828-43e9-8650-3e2a3fb2cff4 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 11 23:14:12.063054 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-c6408d00-6828-43e9-8650-3e2a3fb2cff4 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 11 23:14:12.079391 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-c6408d00-6828-43e9-8650-3e2a3fb2cff4 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-11T23:14:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1094546666',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='tempest-device-tagging-server-1094546666',id=22,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBL2B+Qi+I3pgfpGsUuP1N6pjhXiP01lrt0dza1VGJ8kct4NaxOPSJEfUBZOLcAcvGFp3NUiLtr1bJ6t1i7htNBE4tCeF5rEUWrutMgZ/N9MVsridCRaWUxTp0gQnqFN3A==',key_name='tempest-keypair-1726377568',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='03be033a975c41efba46c4d480df190f',ramdisk_id='',reservation_id='r-irju1qds',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1378608456',owner_user_name='tempest-TaggedAttachmentsTest-1378608456-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-11T23:14:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='56116a7118a54aa6b259414512446b40',uuid=ae596459-1e34-4a2a-9a33-69a02f50fd1c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f920031-116a-4009-be97-ea5f1389a374", "address": "fa:16:3e:6c:78:be", "network": {"id": "e7cf6fb9-33e8-4362-8236-472d2d07f60a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-749809800-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "03be033a975c41efba46c4d480df190f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f920031-11", "ovs_interfaceid": "1f920031-116a-4009-be97-ea5f1389a374", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98431) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 11 23:14:12.079391 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-c6408d00-6828-43e9-8650-3e2a3fb2cff4 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Converting VIF {"id": "1f920031-116a-4009-be97-ea5f1389a374", "address": "fa:16:3e:6c:78:be", "network": {"id": "e7cf6fb9-33e8-4362-8236-472d2d07f60a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-749809800-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "03be033a975c41efba46c4d480df190f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f920031-11", "ovs_interfaceid": "1f920031-116a-4009-be97-ea5f1389a374", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:14:12.080162 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-c6408d00-6828-43e9-8650-3e2a3fb2cff4 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:78:be,bridge_name='br-int',has_traffic_filtering=True,id=1f920031-116a-4009-be97-ea5f1389a374,network=Network(e7cf6fb9-33e8-4362-8236-472d2d07f60a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f920031-11') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:14:12.080876 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-c6408d00-6828-43e9-8650-3e2a3fb2cff4 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Lazy-loading 'pci_devices' on Instance uuid ae596459-1e34-4a2a-9a33-69a02f50fd1c {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:14:12.125537 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:12.190938 np0000002687 nova-compute[98431]: DEBUG nova.objects.base [None req-d5e1885a-7eec-4c2a-b886-1069d090fa54 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Object Instance<64d7833a-82e8-43e9-83ed-2507197b69bf> lazy-loaded attributes: info_cache,migration_context {{(pid=98431) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 11 23:14:12.197856 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:12.202112 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-d5e1885a-7eec-4c2a-b886-1069d090fa54 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:14:12.202112 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-d5e1885a-7eec-4c2a-b886-1069d090fa54 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:14:12.531579 np0000002687 nova-compute[98431]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0004384280000522267 future=) was cancelled during its delay period, skipping {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:14:12.532131 np0000002687 nova-compute[98431]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:14:12.532131 np0000002687 nova-compute[98431]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=0.9697844750000968 future=) {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:14:12.532131 np0000002687 nova-compute[98431]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=0.9696606269999393 future=) {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:14:12.584541 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-c6408d00-6828-43e9-8650-3e2a3fb2cff4 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] [instance: ae596459-1e34-4a2a-9a33-69a02f50fd1c] End _get_guest_xml xml= Jun 11 23:14:12.584541 np0000002687 nova-compute[98431]: ae596459-1e34-4a2a-9a33-69a02f50fd1c Jun 11 23:14:12.584541 np0000002687 nova-compute[98431]: instance-00000016 Jun 11 23:14:12.584541 np0000002687 nova-compute[98431]: 196608 Jun 11 23:14:12.584541 np0000002687 nova-compute[98431]: 1 Jun 11 23:14:12.584541 np0000002687 nova-compute[98431]: Jun 11 23:14:12.584541 np0000002687 nova-compute[98431]: Jun 11 23:14:12.584541 np0000002687 nova-compute[98431]: Jun 11 23:14:12.584541 np0000002687 nova-compute[98431]: tempest-device-tagging-server-1094546666 Jun 11 23:14:12.584541 np0000002687 nova-compute[98431]: 2026-06-11 23:14:12 Jun 11 23:14:12.584541 np0000002687 nova-compute[98431]: Jun 11 23:14:12.584541 np0000002687 nova-compute[98431]: 192 Jun 11 23:14:12.584541 np0000002687 nova-compute[98431]: 1 Jun 11 23:14:12.584541 np0000002687 nova-compute[98431]: 0 Jun 11 23:14:12.584541 np0000002687 nova-compute[98431]: 0 Jun 11 23:14:12.584541 np0000002687 nova-compute[98431]: 1 Jun 11 23:14:12.584541 np0000002687 nova-compute[98431]: Jun 11 23:14:12.584541 np0000002687 nova-compute[98431]: True Jun 11 23:14:12.584541 np0000002687 nova-compute[98431]: Jun 11 23:14:12.584541 np0000002687 nova-compute[98431]: Jun 11 23:14:12.584541 np0000002687 nova-compute[98431]: Jun 11 23:14:12.584541 np0000002687 nova-compute[98431]: bare Jun 11 23:14:12.584541 np0000002687 nova-compute[98431]: qcow2 Jun 11 23:14:12.584541 np0000002687 nova-compute[98431]: 1 Jun 11 23:14:12.584541 np0000002687 nova-compute[98431]: 0 Jun 11 23:14:12.584541 np0000002687 nova-compute[98431]: Jun 11 23:14:12.584541 np0000002687 nova-compute[98431]: virtio Jun 11 23:14:12.584541 np0000002687 nova-compute[98431]: Jun 11 23:14:12.584541 np0000002687 nova-compute[98431]: Jun 11 23:14:12.584541 np0000002687 nova-compute[98431]: Jun 11 23:14:12.584541 np0000002687 nova-compute[98431]: tempest-TaggedAttachmentsTest-1378608456-project-member Jun 11 23:14:12.584541 np0000002687 nova-compute[98431]: tempest-TaggedAttachmentsTest-1378608456 Jun 11 23:14:12.584541 np0000002687 nova-compute[98431]: Jun 11 23:14:12.584541 np0000002687 nova-compute[98431]: Jun 11 23:14:12.584541 np0000002687 nova-compute[98431]: Jun 11 23:14:12.584541 np0000002687 nova-compute[98431]: Jun 11 23:14:12.584541 np0000002687 nova-compute[98431]: Jun 11 23:14:12.584541 np0000002687 nova-compute[98431]: Jun 11 23:14:12.584541 np0000002687 nova-compute[98431]: Jun 11 23:14:12.584541 np0000002687 nova-compute[98431]: Jun 11 23:14:12.584541 np0000002687 nova-compute[98431]: Jun 11 23:14:12.584541 np0000002687 nova-compute[98431]: Jun 11 23:14:12.584541 np0000002687 nova-compute[98431]: Jun 11 23:14:12.584541 np0000002687 nova-compute[98431]: OpenStack Foundation Jun 11 23:14:12.584541 np0000002687 nova-compute[98431]: OpenStack Nova Jun 11 23:14:12.584541 np0000002687 nova-compute[98431]: 33.1.0 Jun 11 23:14:12.584541 np0000002687 nova-compute[98431]: ae596459-1e34-4a2a-9a33-69a02f50fd1c Jun 11 23:14:12.584541 np0000002687 nova-compute[98431]: ae596459-1e34-4a2a-9a33-69a02f50fd1c Jun 11 23:14:12.584541 np0000002687 nova-compute[98431]: Virtual Machine Jun 11 23:14:12.584541 np0000002687 nova-compute[98431]: Jun 11 23:14:12.584541 np0000002687 nova-compute[98431]: Jun 11 23:14:12.584541 np0000002687 nova-compute[98431]: Jun 11 23:14:12.584541 np0000002687 nova-compute[98431]: hvm Jun 11 23:14:12.584541 np0000002687 nova-compute[98431]: Jun 11 23:14:12.584541 np0000002687 nova-compute[98431]: Jun 11 23:14:12.584541 np0000002687 nova-compute[98431]: Jun 11 23:14:12.584541 np0000002687 nova-compute[98431]: Jun 11 23:14:12.584541 np0000002687 nova-compute[98431]: Jun 11 23:14:12.584541 np0000002687 nova-compute[98431]: Jun 11 23:14:12.584541 np0000002687 nova-compute[98431]: 128 Jun 11 23:14:12.584541 np0000002687 nova-compute[98431]: Jun 11 23:14:12.584541 np0000002687 nova-compute[98431]: Jun 11 23:14:12.584541 np0000002687 nova-compute[98431]: Jun 11 23:14:12.584541 np0000002687 nova-compute[98431]: 1 Jun 11 23:14:12.584541 np0000002687 nova-compute[98431]: Jun 11 23:14:12.584541 np0000002687 nova-compute[98431]: Jun 11 23:14:12.584541 np0000002687 nova-compute[98431]: Nehalem Jun 11 23:14:12.584541 np0000002687 nova-compute[98431]: Jun 11 23:14:12.584541 np0000002687 nova-compute[98431]: Jun 11 23:14:12.584541 np0000002687 nova-compute[98431]: Jun 11 23:14:12.584541 np0000002687 nova-compute[98431]: Jun 11 23:14:12.584541 np0000002687 nova-compute[98431]: Jun 11 23:14:12.584541 np0000002687 nova-compute[98431]: Jun 11 23:14:12.584541 np0000002687 nova-compute[98431]: Jun 11 23:14:12.584541 np0000002687 nova-compute[98431]: Jun 11 23:14:12.584541 np0000002687 nova-compute[98431]: Jun 11 23:14:12.584541 np0000002687 nova-compute[98431]: Jun 11 23:14:12.584541 np0000002687 nova-compute[98431]: Jun 11 23:14:12.584541 np0000002687 nova-compute[98431]: Jun 11 23:14:12.584541 np0000002687 nova-compute[98431]: Jun 11 23:14:12.584541 np0000002687 nova-compute[98431]: Jun 11 23:14:12.584541 np0000002687 nova-compute[98431]: Jun 11 23:14:12.584541 np0000002687 nova-compute[98431]: Jun 11 23:14:12.584541 np0000002687 nova-compute[98431]: Jun 11 23:14:12.584541 np0000002687 nova-compute[98431]: Jun 11 23:14:12.584541 np0000002687 nova-compute[98431]: Jun 11 23:14:12.584541 np0000002687 nova-compute[98431]: Jun 11 23:14:12.584541 np0000002687 nova-compute[98431]: Jun 11 23:14:12.584541 np0000002687 nova-compute[98431]: Jun 11 23:14:12.584541 np0000002687 nova-compute[98431]: Jun 11 23:14:12.584541 np0000002687 nova-compute[98431]: Jun 11 23:14:12.584541 np0000002687 nova-compute[98431]: Jun 11 23:14:12.584541 np0000002687 nova-compute[98431]: Jun 11 23:14:12.584541 np0000002687 nova-compute[98431]: /dev/urandom Jun 11 23:14:12.584541 np0000002687 nova-compute[98431]: Jun 11 23:14:12.584541 np0000002687 nova-compute[98431]: Jun 11 23:14:12.584541 np0000002687 nova-compute[98431]: Jun 11 23:14:12.584541 np0000002687 nova-compute[98431]: Jun 11 23:14:12.584541 np0000002687 nova-compute[98431]: Jun 11 23:14:12.584541 np0000002687 nova-compute[98431]: Jun 11 23:14:12.584541 np0000002687 nova-compute[98431]: Jun 11 23:14:12.584541 np0000002687 nova-compute[98431]: {{(pid=98431) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 11 23:14:12.587766 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-c6408d00-6828-43e9-8650-3e2a3fb2cff4 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] [instance: ae596459-1e34-4a2a-9a33-69a02f50fd1c] Preparing to wait for external event network-vif-plugged-1f920031-116a-4009-be97-ea5f1389a374 {{(pid=98431) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 11 23:14:12.587766 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-c6408d00-6828-43e9-8650-3e2a3fb2cff4 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Acquiring lock "ae596459-1e34-4a2a-9a33-69a02f50fd1c-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:14:12.587766 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-c6408d00-6828-43e9-8650-3e2a3fb2cff4 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Lock "ae596459-1e34-4a2a-9a33-69a02f50fd1c-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:14:12.587766 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-c6408d00-6828-43e9-8650-3e2a3fb2cff4 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Lock "ae596459-1e34-4a2a-9a33-69a02f50fd1c-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:14:12.587766 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-c6408d00-6828-43e9-8650-3e2a3fb2cff4 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-11T23:14:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1094546666',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='tempest-device-tagging-server-1094546666',id=22,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBL2B+Qi+I3pgfpGsUuP1N6pjhXiP01lrt0dza1VGJ8kct4NaxOPSJEfUBZOLcAcvGFp3NUiLtr1bJ6t1i7htNBE4tCeF5rEUWrutMgZ/N9MVsridCRaWUxTp0gQnqFN3A==',key_name='tempest-keypair-1726377568',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='03be033a975c41efba46c4d480df190f',ramdisk_id='',reservation_id='r-irju1qds',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1378608456',owner_user_name='tempest-TaggedAttachmentsTest-1378608456-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-11T23:14:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='56116a7118a54aa6b259414512446b40',uuid=ae596459-1e34-4a2a-9a33-69a02f50fd1c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f920031-116a-4009-be97-ea5f1389a374", "address": "fa:16:3e:6c:78:be", "network": {"id": "e7cf6fb9-33e8-4362-8236-472d2d07f60a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-749809800-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "03be033a975c41efba46c4d480df190f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f920031-11", "ovs_interfaceid": "1f920031-116a-4009-be97-ea5f1389a374", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 11 23:14:12.587766 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-c6408d00-6828-43e9-8650-3e2a3fb2cff4 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Converting VIF {"id": "1f920031-116a-4009-be97-ea5f1389a374", "address": "fa:16:3e:6c:78:be", "network": {"id": "e7cf6fb9-33e8-4362-8236-472d2d07f60a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-749809800-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "03be033a975c41efba46c4d480df190f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f920031-11", "ovs_interfaceid": "1f920031-116a-4009-be97-ea5f1389a374", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:14:12.587766 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-c6408d00-6828-43e9-8650-3e2a3fb2cff4 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:78:be,bridge_name='br-int',has_traffic_filtering=True,id=1f920031-116a-4009-be97-ea5f1389a374,network=Network(e7cf6fb9-33e8-4362-8236-472d2d07f60a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f920031-11') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:14:12.587766 np0000002687 nova-compute[98431]: DEBUG os_vif [None req-c6408d00-6828-43e9-8650-3e2a3fb2cff4 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:78:be,bridge_name='br-int',has_traffic_filtering=True,id=1f920031-116a-4009-be97-ea5f1389a374,network=Network(e7cf6fb9-33e8-4362-8236-472d2d07f60a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f920031-11') {{(pid=98431) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 11 23:14:12.588409 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:12.589092 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:14:12.589454 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 11 23:14:12.592176 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:12.592472 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4614668d-2f1e-5fd8-ab71-b5d9bf602f66', '_type': 'linux-noop'}}, row=False) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:14:12.595736 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:12.595736 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:14:12.596935 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:12.599629 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:12.599879 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1f920031-11, may_exist=True, interface_attrs={}) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:14:12.600306 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1f920031-11, col_values=(('qos', UUID('68c1ebc3-85fb-4955-9515-a5fa95486bc3')),), if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:14:12.600492 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1f920031-11, col_values=(('external_ids', {'iface-id': '1f920031-116a-4009-be97-ea5f1389a374', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6c:78:be', 'vm-uuid': 'ae596459-1e34-4a2a-9a33-69a02f50fd1c'}),), if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:14:12.601476 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:12.603140 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:14:12.609398 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:12.610639 np0000002687 nova-compute[98431]: INFO os_vif [None req-c6408d00-6828-43e9-8650-3e2a3fb2cff4 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:78:be,bridge_name='br-int',has_traffic_filtering=True,id=1f920031-116a-4009-be97-ea5f1389a374,network=Network(e7cf6fb9-33e8-4362-8236-472d2d07f60a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f920031-11') Jun 11 23:14:12.888233 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-96c0a6cc-754f-42d5-b7ef-4c033de92672 req-4c6a3870-5915-47ba-90db-8f772d4920b3 service nova] [instance: dd1dd46c-2231-40b4-aa61-0121733a932d] Received event network-vif-unplugged-98c628a8-e152-4189-94f1-e166c406cf10 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:14:12.888307 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-96c0a6cc-754f-42d5-b7ef-4c033de92672 req-4c6a3870-5915-47ba-90db-8f772d4920b3 service nova] Acquiring lock "dd1dd46c-2231-40b4-aa61-0121733a932d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:14:12.888552 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-96c0a6cc-754f-42d5-b7ef-4c033de92672 req-4c6a3870-5915-47ba-90db-8f772d4920b3 service nova] Lock "dd1dd46c-2231-40b4-aa61-0121733a932d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:14:12.888737 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-96c0a6cc-754f-42d5-b7ef-4c033de92672 req-4c6a3870-5915-47ba-90db-8f772d4920b3 service nova] Lock "dd1dd46c-2231-40b4-aa61-0121733a932d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:14:12.888929 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-96c0a6cc-754f-42d5-b7ef-4c033de92672 req-4c6a3870-5915-47ba-90db-8f772d4920b3 service nova] [instance: dd1dd46c-2231-40b4-aa61-0121733a932d] No waiting events found dispatching network-vif-unplugged-98c628a8-e152-4189-94f1-e166c406cf10 {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:14:12.889146 np0000002687 nova-compute[98431]: WARNING nova.compute.manager [req-96c0a6cc-754f-42d5-b7ef-4c033de92672 req-4c6a3870-5915-47ba-90db-8f772d4920b3 service nova] [instance: dd1dd46c-2231-40b4-aa61-0121733a932d] Received unexpected event network-vif-unplugged-98c628a8-e152-4189-94f1-e166c406cf10 for instance with vm_state rescued and task_state unrescuing. Jun 11 23:14:12.890374 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-96c0a6cc-754f-42d5-b7ef-4c033de92672 req-4c6a3870-5915-47ba-90db-8f772d4920b3 service nova] [instance: dd1dd46c-2231-40b4-aa61-0121733a932d] Received event network-vif-plugged-98c628a8-e152-4189-94f1-e166c406cf10 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:14:12.891300 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-96c0a6cc-754f-42d5-b7ef-4c033de92672 req-4c6a3870-5915-47ba-90db-8f772d4920b3 service nova] Acquiring lock "dd1dd46c-2231-40b4-aa61-0121733a932d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:14:12.891570 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-96c0a6cc-754f-42d5-b7ef-4c033de92672 req-4c6a3870-5915-47ba-90db-8f772d4920b3 service nova] Lock "dd1dd46c-2231-40b4-aa61-0121733a932d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:14:12.898895 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-96c0a6cc-754f-42d5-b7ef-4c033de92672 req-4c6a3870-5915-47ba-90db-8f772d4920b3 service nova] Lock "dd1dd46c-2231-40b4-aa61-0121733a932d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.007s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:14:12.899133 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-96c0a6cc-754f-42d5-b7ef-4c033de92672 req-4c6a3870-5915-47ba-90db-8f772d4920b3 service nova] [instance: dd1dd46c-2231-40b4-aa61-0121733a932d] No waiting events found dispatching network-vif-plugged-98c628a8-e152-4189-94f1-e166c406cf10 {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:14:12.899333 np0000002687 nova-compute[98431]: WARNING nova.compute.manager [req-96c0a6cc-754f-42d5-b7ef-4c033de92672 req-4c6a3870-5915-47ba-90db-8f772d4920b3 service nova] [instance: dd1dd46c-2231-40b4-aa61-0121733a932d] Received unexpected event network-vif-plugged-98c628a8-e152-4189-94f1-e166c406cf10 for instance with vm_state rescued and task_state unrescuing. Jun 11 23:14:12.900091 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-96c0a6cc-754f-42d5-b7ef-4c033de92672 req-4c6a3870-5915-47ba-90db-8f772d4920b3 service nova] [instance: dd1dd46c-2231-40b4-aa61-0121733a932d] Received event network-vif-plugged-98c628a8-e152-4189-94f1-e166c406cf10 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:14:12.900091 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-96c0a6cc-754f-42d5-b7ef-4c033de92672 req-4c6a3870-5915-47ba-90db-8f772d4920b3 service nova] Acquiring lock "dd1dd46c-2231-40b4-aa61-0121733a932d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:14:12.900091 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-96c0a6cc-754f-42d5-b7ef-4c033de92672 req-4c6a3870-5915-47ba-90db-8f772d4920b3 service nova] Lock "dd1dd46c-2231-40b4-aa61-0121733a932d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:14:12.900091 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-96c0a6cc-754f-42d5-b7ef-4c033de92672 req-4c6a3870-5915-47ba-90db-8f772d4920b3 service nova] Lock "dd1dd46c-2231-40b4-aa61-0121733a932d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:14:12.900320 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-96c0a6cc-754f-42d5-b7ef-4c033de92672 req-4c6a3870-5915-47ba-90db-8f772d4920b3 service nova] [instance: dd1dd46c-2231-40b4-aa61-0121733a932d] No waiting events found dispatching network-vif-plugged-98c628a8-e152-4189-94f1-e166c406cf10 {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:14:12.900320 np0000002687 nova-compute[98431]: WARNING nova.compute.manager [req-96c0a6cc-754f-42d5-b7ef-4c033de92672 req-4c6a3870-5915-47ba-90db-8f772d4920b3 service nova] [instance: dd1dd46c-2231-40b4-aa61-0121733a932d] Received unexpected event network-vif-plugged-98c628a8-e152-4189-94f1-e166c406cf10 for instance with vm_state rescued and task_state unrescuing. Jun 11 23:14:12.925606 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:13.086349 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Removed pending STOPPED event for dd1dd46c-2231-40b4-aa61-0121733a932d due to new event Resumed> {{(pid=98431) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:519}} Jun 11 23:14:13.086483 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Emitting event Resumed> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:14:13.086593 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: dd1dd46c-2231-40b4-aa61-0121733a932d] VM Resumed (Lifecycle Event) Jun 11 23:14:13.092652 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-893e6351-4b11-447b-9fd8-27ba21e0534c tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: dd1dd46c-2231-40b4-aa61-0121733a932d] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:14:13.381325 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-d5e1885a-7eec-4c2a-b886-1069d090fa54 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98431) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 11 23:14:13.381514 np0000002687 nova-compute[98431]: DEBUG nova.compute.provider_tree [None req-d5e1885a-7eec-4c2a-b886-1069d090fa54 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Inventory has not changed in ProviderTree for provider: e3e65fe2-9de9-4821-8b4a-ccae37c66e25 {{(pid=98431) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 11 23:14:13.502735 np0000002687 nova-compute[98431]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0006547820000832871 future=) submitted to {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:14:13.502735 np0000002687 nova-compute[98431]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:14:13.502735 np0000002687 nova-compute[98431]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=12.392018015000076 future=) {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:14:13.502735 np0000002687 nova-compute[98431]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=12.391909796000164 future=) was cancelled while queued, skipping {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:14:13.502735 np0000002687 nova-compute[98431]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:14:13.505217 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Emitting event Stopped> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:14:13.505217 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 8aec3cea-109d-43f8-983c-1d5ee2f71181] VM Stopped (Lifecycle Event) Jun 11 23:14:13.591945 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: dd1dd46c-2231-40b4-aa61-0121733a932d] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:14:13.599264 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: dd1dd46c-2231-40b4-aa61-0121733a932d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98431) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 11 23:14:13.887079 np0000002687 nova-compute[98431]: DEBUG nova.scheduler.client.report [None req-d5e1885a-7eec-4c2a-b886-1069d090fa54 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Inventory has not changed for provider e3e65fe2-9de9-4821-8b4a-ccae37c66e25 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98431) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 11 23:14:14.007783 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-76781ff7-7f7a-4144-baf4-3b32b57f017f tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 8aec3cea-109d-43f8-983c-1d5ee2f71181] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:14:14.107477 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Emitting event Started> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:14:14.107477 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: dd1dd46c-2231-40b4-aa61-0121733a932d] VM Started (Lifecycle Event) Jun 11 23:14:14.135740 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-c6408d00-6828-43e9-8650-3e2a3fb2cff4 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] No BDM found with device name vda, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:14:14.135962 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-c6408d00-6828-43e9-8650-3e2a3fb2cff4 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] No BDM found with device name hda, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:14:14.136095 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-c6408d00-6828-43e9-8650-3e2a3fb2cff4 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] No VIF found with MAC fa:16:3e:6c:78:be, not building metadata {{(pid=98431) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13199}} Jun 11 23:14:14.136691 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-c6408d00-6828-43e9-8650-3e2a3fb2cff4 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] [instance: ae596459-1e34-4a2a-9a33-69a02f50fd1c] Using config drive Jun 11 23:14:14.611086 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: dd1dd46c-2231-40b4-aa61-0121733a932d] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:14:14.613298 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: dd1dd46c-2231-40b4-aa61-0121733a932d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98431) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 11 23:14:14.643134 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-c6408d00-6828-43e9-8650-3e2a3fb2cff4 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:14:14.813154 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-c6408d00-6828-43e9-8650-3e2a3fb2cff4 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] [instance: ae596459-1e34-4a2a-9a33-69a02f50fd1c] Creating config drive at /opt/stack/data/nova/instances/ae596459-1e34-4a2a-9a33-69a02f50fd1c/disk.config Jun 11 23:14:14.822993 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-c6408d00-6828-43e9-8650-3e2a3fb2cff4 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/ae596459-1e34-4a2a-9a33-69a02f50fd1c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp6yy_9mln {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:14:14.904783 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-c6408d00-6828-43e9-8650-3e2a3fb2cff4 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/ae596459-1e34-4a2a-9a33-69a02f50fd1c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp6yy_9mln" returned: 0 in 0.081s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:14:14.909240 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-d5e1885a-7eec-4c2a-b886-1069d090fa54 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 2.707s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:14:15.512277 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:15.543305 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:15.632021 np0000002687 nova-compute[98431]: INFO nova.scheduler.client.report [None req-d5e1885a-7eec-4c2a-b886-1069d090fa54 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Deleted allocation for migration 89fc30bc-f302-4da8-8ae9-4f890f4d2fe2 Jun 11 23:14:15.686879 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:15.930674 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:15.933651 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:15.938970 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:15.967488 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:16.026221 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-4a24d29f-29ba-49c4-b257-8701d15dd6c6 req-80cb885a-91c8-4615-addd-303c65b04dda service nova] [instance: ae596459-1e34-4a2a-9a33-69a02f50fd1c] Received event network-vif-plugged-1f920031-116a-4009-be97-ea5f1389a374 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:14:16.026499 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-4a24d29f-29ba-49c4-b257-8701d15dd6c6 req-80cb885a-91c8-4615-addd-303c65b04dda service nova] Acquiring lock "ae596459-1e34-4a2a-9a33-69a02f50fd1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:14:16.026786 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-4a24d29f-29ba-49c4-b257-8701d15dd6c6 req-80cb885a-91c8-4615-addd-303c65b04dda service nova] Lock "ae596459-1e34-4a2a-9a33-69a02f50fd1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:14:16.027240 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-4a24d29f-29ba-49c4-b257-8701d15dd6c6 req-80cb885a-91c8-4615-addd-303c65b04dda service nova] Lock "ae596459-1e34-4a2a-9a33-69a02f50fd1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:14:16.027240 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-4a24d29f-29ba-49c4-b257-8701d15dd6c6 req-80cb885a-91c8-4615-addd-303c65b04dda service nova] [instance: ae596459-1e34-4a2a-9a33-69a02f50fd1c] Processing event network-vif-plugged-1f920031-116a-4009-be97-ea5f1389a374 {{(pid=98431) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 11 23:14:16.113140 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] Acquiring lock "010aa26e-fb15-47ee-a9b7-089dbfdfd1c7" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:14:16.113537 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] Lock "010aa26e-fb15-47ee-a9b7-089dbfdfd1c7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:14:16.147713 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-d5e1885a-7eec-4c2a-b886-1069d090fa54 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "64d7833a-82e8-43e9-83ed-2507197b69bf" "released" by "nova.compute.manager.ComputeManager.confirm_resize..do_confirm_resize" :: held 7.488s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:14:16.620340 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] [instance: 010aa26e-fb15-47ee-a9b7-089dbfdfd1c7] Starting instance... {{(pid=98431) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 11 23:14:16.639436 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Emitting event Started> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:14:16.640039 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: ae596459-1e34-4a2a-9a33-69a02f50fd1c] VM Started (Lifecycle Event) Jun 11 23:14:16.642002 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-c6408d00-6828-43e9-8650-3e2a3fb2cff4 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] [instance: ae596459-1e34-4a2a-9a33-69a02f50fd1c] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98431) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 11 23:14:16.644494 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-c6408d00-6828-43e9-8650-3e2a3fb2cff4 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] [instance: ae596459-1e34-4a2a-9a33-69a02f50fd1c] Guest created on hypervisor {{(pid=98431) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}} Jun 11 23:14:16.648886 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [-] [instance: ae596459-1e34-4a2a-9a33-69a02f50fd1c] Instance spawned successfully. Jun 11 23:14:16.649057 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-c6408d00-6828-43e9-8650-3e2a3fb2cff4 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] [instance: ae596459-1e34-4a2a-9a33-69a02f50fd1c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 11 23:14:17.143879 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: ae596459-1e34-4a2a-9a33-69a02f50fd1c] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:14:17.147216 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: ae596459-1e34-4a2a-9a33-69a02f50fd1c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98431) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 11 23:14:17.166874 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-c6408d00-6828-43e9-8650-3e2a3fb2cff4 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] [instance: ae596459-1e34-4a2a-9a33-69a02f50fd1c] Found default for hw_cdrom_bus of ide {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:14:17.166940 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-c6408d00-6828-43e9-8650-3e2a3fb2cff4 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] [instance: ae596459-1e34-4a2a-9a33-69a02f50fd1c] Found default for hw_disk_bus of virtio {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:14:17.167945 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-c6408d00-6828-43e9-8650-3e2a3fb2cff4 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] [instance: ae596459-1e34-4a2a-9a33-69a02f50fd1c] Found default for hw_input_bus of None {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:14:17.167945 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-c6408d00-6828-43e9-8650-3e2a3fb2cff4 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] [instance: ae596459-1e34-4a2a-9a33-69a02f50fd1c] Found default for hw_pointer_model of None {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:14:17.169272 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-c6408d00-6828-43e9-8650-3e2a3fb2cff4 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] [instance: ae596459-1e34-4a2a-9a33-69a02f50fd1c] Found default for hw_video_model of virtio {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:14:17.169661 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-c6408d00-6828-43e9-8650-3e2a3fb2cff4 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] [instance: ae596459-1e34-4a2a-9a33-69a02f50fd1c] Found default for hw_vif_model of virtio {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:14:17.224558 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:14:17.224558 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:14:17.233820 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98431) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 11 23:14:17.233820 np0000002687 nova-compute[98431]: INFO nova.compute.claims [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] [instance: 010aa26e-fb15-47ee-a9b7-089dbfdfd1c7] Claim successful on node np0000002687 Jun 11 23:14:17.489374 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:17.605906 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:17.651208 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: ae596459-1e34-4a2a-9a33-69a02f50fd1c] During sync_power_state the instance has a pending task (spawning). Skip. Jun 11 23:14:17.651725 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Emitting event Paused> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:14:17.651725 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: ae596459-1e34-4a2a-9a33-69a02f50fd1c] VM Paused (Lifecycle Event) Jun 11 23:14:17.687243 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-c6408d00-6828-43e9-8650-3e2a3fb2cff4 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] [instance: ae596459-1e34-4a2a-9a33-69a02f50fd1c] Took 8.74 seconds to spawn the instance on the hypervisor. Jun 11 23:14:17.687790 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-c6408d00-6828-43e9-8650-3e2a3fb2cff4 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] [instance: ae596459-1e34-4a2a-9a33-69a02f50fd1c] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:14:17.933083 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:18.126789 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-fd43f46a-c145-4324-a687-f1d9ccd9b55c req-5676801c-0648-43b8-817d-937b96ab888f service nova] [instance: ae596459-1e34-4a2a-9a33-69a02f50fd1c] Received event network-vif-plugged-1f920031-116a-4009-be97-ea5f1389a374 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:14:18.128260 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-fd43f46a-c145-4324-a687-f1d9ccd9b55c req-5676801c-0648-43b8-817d-937b96ab888f service nova] Acquiring lock "ae596459-1e34-4a2a-9a33-69a02f50fd1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:14:18.128441 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-fd43f46a-c145-4324-a687-f1d9ccd9b55c req-5676801c-0648-43b8-817d-937b96ab888f service nova] Lock "ae596459-1e34-4a2a-9a33-69a02f50fd1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:14:18.128608 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-fd43f46a-c145-4324-a687-f1d9ccd9b55c req-5676801c-0648-43b8-817d-937b96ab888f service nova] Lock "ae596459-1e34-4a2a-9a33-69a02f50fd1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:14:18.128775 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-fd43f46a-c145-4324-a687-f1d9ccd9b55c req-5676801c-0648-43b8-817d-937b96ab888f service nova] [instance: ae596459-1e34-4a2a-9a33-69a02f50fd1c] No waiting events found dispatching network-vif-plugged-1f920031-116a-4009-be97-ea5f1389a374 {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:14:18.128961 np0000002687 nova-compute[98431]: WARNING nova.compute.manager [req-fd43f46a-c145-4324-a687-f1d9ccd9b55c req-5676801c-0648-43b8-817d-937b96ab888f service nova] [instance: ae596459-1e34-4a2a-9a33-69a02f50fd1c] Received unexpected event network-vif-plugged-1f920031-116a-4009-be97-ea5f1389a374 for instance with vm_state active and task_state None. Jun 11 23:14:18.156726 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: ae596459-1e34-4a2a-9a33-69a02f50fd1c] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:14:18.159985 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Emitting event Resumed> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:14:18.160210 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: ae596459-1e34-4a2a-9a33-69a02f50fd1c] VM Resumed (Lifecycle Event) Jun 11 23:14:18.198914 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-c6408d00-6828-43e9-8650-3e2a3fb2cff4 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] [instance: ae596459-1e34-4a2a-9a33-69a02f50fd1c] Took 15.65 seconds to build instance. Jun 11 23:14:18.324545 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-9c8e003a-d778-449a-b875-43e7f1fa161f req-5e3f4184-59f2-4a0e-ac4c-3afbe6bdb7e4 service nova] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] Received event network-changed-3c04202e-5ce6-4249-ba31-be06996ca75d {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:14:18.324686 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-9c8e003a-d778-449a-b875-43e7f1fa161f req-5e3f4184-59f2-4a0e-ac4c-3afbe6bdb7e4 service nova] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] Refreshing instance network info cache due to event network-changed-3c04202e-5ce6-4249-ba31-be06996ca75d. {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 11 23:14:18.324915 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-9c8e003a-d778-449a-b875-43e7f1fa161f req-5e3f4184-59f2-4a0e-ac4c-3afbe6bdb7e4 service nova] Acquiring lock "refresh_cache-8a45e04f-3516-4c39-bea1-820104411f17" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 11 23:14:18.325026 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-9c8e003a-d778-449a-b875-43e7f1fa161f req-5e3f4184-59f2-4a0e-ac4c-3afbe6bdb7e4 service nova] Acquired lock "refresh_cache-8a45e04f-3516-4c39-bea1-820104411f17" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 11 23:14:18.325267 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-9c8e003a-d778-449a-b875-43e7f1fa161f req-5e3f4184-59f2-4a0e-ac4c-3afbe6bdb7e4 service nova] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] Refreshing network info cache for port 3c04202e-5ce6-4249-ba31-be06996ca75d {{(pid=98431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 11 23:14:18.333959 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:18.666567 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: ae596459-1e34-4a2a-9a33-69a02f50fd1c] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:14:18.673865 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: ae596459-1e34-4a2a-9a33-69a02f50fd1c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98431) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 11 23:14:18.702465 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-c6408d00-6828-43e9-8650-3e2a3fb2cff4 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Lock "ae596459-1e34-4a2a-9a33-69a02f50fd1c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 17.174s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:14:18.760291 np0000002687 nova-compute[98431]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98431) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jun 11 23:14:18.829529 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [req-9c8e003a-d778-449a-b875-43e7f1fa161f req-5e3f4184-59f2-4a0e-ac4c-3afbe6bdb7e4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:14:19.033320 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98431) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 11 23:14:19.034567 np0000002687 nova-compute[98431]: DEBUG nova.compute.provider_tree [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] Inventory has not changed in ProviderTree for provider: e3e65fe2-9de9-4821-8b4a-ccae37c66e25 {{(pid=98431) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 11 23:14:19.206590 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Acquiring lock "c9271160-14ef-4a59-8ac8-89efbe36c607" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:14:19.207144 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Lock "c9271160-14ef-4a59-8ac8-89efbe36c607" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:14:19.392414 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [req-9c8e003a-d778-449a-b875-43e7f1fa161f req-5e3f4184-59f2-4a0e-ac4c-3afbe6bdb7e4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:14:19.538852 np0000002687 nova-compute[98431]: DEBUG nova.scheduler.client.report [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] Inventory has not changed for provider e3e65fe2-9de9-4821-8b4a-ccae37c66e25 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98431) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 11 23:14:19.621963 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-9c8e003a-d778-449a-b875-43e7f1fa161f req-5e3f4184-59f2-4a0e-ac4c-3afbe6bdb7e4 service nova] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] Updated VIF entry in instance network info cache for port 3c04202e-5ce6-4249-ba31-be06996ca75d. {{(pid=98431) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 11 23:14:19.623063 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-9c8e003a-d778-449a-b875-43e7f1fa161f req-5e3f4184-59f2-4a0e-ac4c-3afbe6bdb7e4 service nova] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] Updating instance_info_cache with network_info: [{"id": "3c04202e-5ce6-4249-ba31-be06996ca75d", "address": "fa:16:3e:6f:42:42", "network": {"id": "17593db3-c22d-4354-ab29-933b1c6a5c3a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1094286565-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "81fd45f475a04e5c8e9bd9deb7ad4c1e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c04202e-5c", "ovs_interfaceid": "3c04202e-5ce6-4249-ba31-be06996ca75d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:14:19.709996 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: c9271160-14ef-4a59-8ac8-89efbe36c607] Starting instance... {{(pid=98431) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 11 23:14:20.058928 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.834s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:14:20.060777 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] [instance: 010aa26e-fb15-47ee-a9b7-089dbfdfd1c7] Start building networks asynchronously for instance. {{(pid=98431) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 11 23:14:20.125163 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-9c8e003a-d778-449a-b875-43e7f1fa161f req-5e3f4184-59f2-4a0e-ac4c-3afbe6bdb7e4 service nova] Releasing lock "refresh_cache-8a45e04f-3516-4c39-bea1-820104411f17" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 11 23:14:20.305826 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:14:20.305980 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:14:20.309857 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98431) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 11 23:14:20.310020 np0000002687 nova-compute[98431]: INFO nova.compute.claims [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: c9271160-14ef-4a59-8ac8-89efbe36c607] Claim successful on node np0000002687 Jun 11 23:14:20.441578 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-d7294f5d-f901-49c3-9c6a-1529f4d2405e req-a3ca44ec-976f-4d2f-8cb9-2c4df2a2d927 service nova] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] Received event network-changed-283962f2-faaf-4d85-8eda-9b77b55a5b0c {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:14:20.441639 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-d7294f5d-f901-49c3-9c6a-1529f4d2405e req-a3ca44ec-976f-4d2f-8cb9-2c4df2a2d927 service nova] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] Refreshing instance network info cache due to event network-changed-283962f2-faaf-4d85-8eda-9b77b55a5b0c. {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 11 23:14:20.442159 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-d7294f5d-f901-49c3-9c6a-1529f4d2405e req-a3ca44ec-976f-4d2f-8cb9-2c4df2a2d927 service nova] Acquiring lock "refresh_cache-64d7833a-82e8-43e9-83ed-2507197b69bf" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 11 23:14:20.442159 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-d7294f5d-f901-49c3-9c6a-1529f4d2405e req-a3ca44ec-976f-4d2f-8cb9-2c4df2a2d927 service nova] Acquired lock "refresh_cache-64d7833a-82e8-43e9-83ed-2507197b69bf" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 11 23:14:20.442159 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-d7294f5d-f901-49c3-9c6a-1529f4d2405e req-a3ca44ec-976f-4d2f-8cb9-2c4df2a2d927 service nova] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] Refreshing network info cache for port 283962f2-faaf-4d85-8eda-9b77b55a5b0c {{(pid=98431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 11 23:14:20.574157 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] [instance: 010aa26e-fb15-47ee-a9b7-089dbfdfd1c7] Allocating IP information in the background. {{(pid=98431) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 11 23:14:20.577281 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] [instance: 010aa26e-fb15-47ee-a9b7-089dbfdfd1c7] allocate_for_instance() {{(pid=98431) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 11 23:14:20.577281 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:14:20.577281 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:14:20.710025 np0000002687 nova-compute[98431]: DEBUG nova.policy [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6fa2c504358c4aa3bb219d75150b1bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbca65bf08474994b1c22f42047c7cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98431) authorize /opt/stack/nova/nova/policy.py:192}} Jun 11 23:14:20.944851 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [req-d7294f5d-f901-49c3-9c6a-1529f4d2405e req-a3ca44ec-976f-4d2f-8cb9-2c4df2a2d927 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:14:21.081076 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] [instance: 010aa26e-fb15-47ee-a9b7-089dbfdfd1c7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 11 23:14:21.452166 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:21.468201 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-bed5e74b-6c8e-4f15-bd93-cc8fd39a232d req-37024161-5314-4638-8e29-258e1d24a054 service nova] [instance: ae596459-1e34-4a2a-9a33-69a02f50fd1c] Received event network-changed-1f920031-116a-4009-be97-ea5f1389a374 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:14:21.469791 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-bed5e74b-6c8e-4f15-bd93-cc8fd39a232d req-37024161-5314-4638-8e29-258e1d24a054 service nova] [instance: ae596459-1e34-4a2a-9a33-69a02f50fd1c] Refreshing instance network info cache due to event network-changed-1f920031-116a-4009-be97-ea5f1389a374. {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 11 23:14:21.470074 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-bed5e74b-6c8e-4f15-bd93-cc8fd39a232d req-37024161-5314-4638-8e29-258e1d24a054 service nova] Acquiring lock "refresh_cache-ae596459-1e34-4a2a-9a33-69a02f50fd1c" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 11 23:14:21.471413 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-bed5e74b-6c8e-4f15-bd93-cc8fd39a232d req-37024161-5314-4638-8e29-258e1d24a054 service nova] Acquired lock "refresh_cache-ae596459-1e34-4a2a-9a33-69a02f50fd1c" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 11 23:14:21.471591 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-bed5e74b-6c8e-4f15-bd93-cc8fd39a232d req-37024161-5314-4638-8e29-258e1d24a054 service nova] [instance: ae596459-1e34-4a2a-9a33-69a02f50fd1c] Refreshing network info cache for port 1f920031-116a-4009-be97-ea5f1389a374 {{(pid=98431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 11 23:14:21.586009 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] [instance: 010aa26e-fb15-47ee-a9b7-089dbfdfd1c7] Start building block device mappings for instance. {{(pid=98431) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 11 23:14:21.645860 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] [instance: 010aa26e-fb15-47ee-a9b7-089dbfdfd1c7] Successfully created port: 75b6f9f6-6287-4fd3-ae85-5f0145c9ecca {{(pid=98431) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 11 23:14:21.882759 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [req-d7294f5d-f901-49c3-9c6a-1529f4d2405e req-a3ca44ec-976f-4d2f-8cb9-2c4df2a2d927 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:14:21.986912 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [req-bed5e74b-6c8e-4f15-bd93-cc8fd39a232d req-37024161-5314-4638-8e29-258e1d24a054 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:14:22.093929 np0000002687 nova-compute[98431]: INFO nova.virt.block_device [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] [instance: 010aa26e-fb15-47ee-a9b7-089dbfdfd1c7] Booting with volume 97bc8780-33f3-43fc-8005-01d53ccb1cd1 at /dev/vda Jun 11 23:14:22.148065 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-d7294f5d-f901-49c3-9c6a-1529f4d2405e req-a3ca44ec-976f-4d2f-8cb9-2c4df2a2d927 service nova] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] Updated VIF entry in instance network info cache for port 283962f2-faaf-4d85-8eda-9b77b55a5b0c. {{(pid=98431) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 11 23:14:22.149387 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-d7294f5d-f901-49c3-9c6a-1529f4d2405e req-a3ca44ec-976f-4d2f-8cb9-2c4df2a2d927 service nova] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] Updating instance_info_cache with network_info: [{"id": "283962f2-faaf-4d85-8eda-9b77b55a5b0c", "address": "fa:16:3e:4b:26:95", "network": {"id": "17593db3-c22d-4354-ab29-933b1c6a5c3a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1094286565-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "81fd45f475a04e5c8e9bd9deb7ad4c1e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap283962f2-fa", "ovs_interfaceid": "283962f2-faaf-4d85-8eda-9b77b55a5b0c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:14:22.168983 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.209', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000002687', 'execute': None}" {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 11 23:14:22.188340 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.scaleio [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98431) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 11 23:14:22.220616 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] Running cmd (subprocess): nvme version {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:14:22.275442 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] 'nvme version' failed. Not Retrying. {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 11 23:14:22.275858 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.nvmeof [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] nvme not present on system {{(pid=98431) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 11 23:14:22.285628 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.lightos [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98431) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 11 23:14:22.287461 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.lightos [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] Current host hostNQN and IP(s) are ['10.4.3.209', 'fe80::f816:3eff:fea3:3707', '192.168.40.6', 'fe80::f816:3eff:fe06:bdab', '192.168.50.6', 'fe80::f816:3eff:fe7a:46f2', '192.168.10.6', 'fe80::f816:3eff:fe13:793b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::38fa:21ff:fe6c:3746', 'fe80::fc16:3eff:fe77:488d', 'fe80::9469:f2ff:feae:5824', 'fe80::fc16:3eff:fec7:336a', 'fe80::fc16:3eff:fe61:b7fd', 'fe80::fc16:3eff:fe6f:4242', 'fe80::38dc:c1ff:fee9:4731', 'fe80::fc16:3eff:feb1:9e6a', 'fe80::fc16:3eff:feca:170a', 'fe80::38da:b9ff:fe6f:c47f', 'fe80::fc16:3eff:fe37:3568', 'fe80::fc16:3eff:fe12:f4f7', 'fe80::fc16:3eff:fe7e:140b', 'fe80::fc16:3eff:feee:d251', 'fe80::fc16:3eff:fe5d:12c5', 'fe80::f07e:ffff:fef1:a8c0', 'fe80::4c8e:e4ff:feff:6e14', 'fe80::fc16:3eff:fec2:8da4', 'fe80::fc16:3eff:fe4b:2695', 'fe80::fc16:3eff:fe2b:91a7', 'fe80::fc16:3eff:fe6c:78be', 'fe80::d82a:87ff:fe65:391e'] Jun 11 23:14:22.287461 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.lightos [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98431) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 11 23:14:22.287706 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.lightos [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] LIGHTOS: no hostnqn found. {{(pid=98431) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 11 23:14:22.287789 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.209', 'host': 'np0000002687', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:798b370f1cc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad465dfe-0ed1-4637-98c3-ddaebebd61a4', 'nvme_native_multipath': False} {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 11 23:14:22.288163 np0000002687 nova-compute[98431]: DEBUG nova.virt.block_device [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] [instance: 010aa26e-fb15-47ee-a9b7-089dbfdfd1c7] Updating existing volume attachment record: b2398a2c-d215-47a6-a48c-6e7ea8130ad6 {{(pid=98431) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 11 23:14:22.420332 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] [instance: 010aa26e-fb15-47ee-a9b7-089dbfdfd1c7] Successfully updated port: 75b6f9f6-6287-4fd3-ae85-5f0145c9ecca {{(pid=98431) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 11 23:14:22.425465 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98431) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 11 23:14:22.426430 np0000002687 nova-compute[98431]: DEBUG nova.compute.provider_tree [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Inventory has not changed in ProviderTree for provider: e3e65fe2-9de9-4821-8b4a-ccae37c66e25 {{(pid=98431) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 11 23:14:22.549077 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-8a198f6c-dd29-4884-90d7-1b8c617050e7 req-f381aec9-bfce-41d4-a25c-6881c8300f69 service nova] [instance: 010aa26e-fb15-47ee-a9b7-089dbfdfd1c7] Received event network-changed-75b6f9f6-6287-4fd3-ae85-5f0145c9ecca {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:14:22.549184 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-8a198f6c-dd29-4884-90d7-1b8c617050e7 req-f381aec9-bfce-41d4-a25c-6881c8300f69 service nova] [instance: 010aa26e-fb15-47ee-a9b7-089dbfdfd1c7] Refreshing instance network info cache due to event network-changed-75b6f9f6-6287-4fd3-ae85-5f0145c9ecca. {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 11 23:14:22.550039 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-8a198f6c-dd29-4884-90d7-1b8c617050e7 req-f381aec9-bfce-41d4-a25c-6881c8300f69 service nova] Acquiring lock "refresh_cache-010aa26e-fb15-47ee-a9b7-089dbfdfd1c7" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 11 23:14:22.550039 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-8a198f6c-dd29-4884-90d7-1b8c617050e7 req-f381aec9-bfce-41d4-a25c-6881c8300f69 service nova] Acquired lock "refresh_cache-010aa26e-fb15-47ee-a9b7-089dbfdfd1c7" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 11 23:14:22.550039 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-8a198f6c-dd29-4884-90d7-1b8c617050e7 req-f381aec9-bfce-41d4-a25c-6881c8300f69 service nova] [instance: 010aa26e-fb15-47ee-a9b7-089dbfdfd1c7] Refreshing network info cache for port 75b6f9f6-6287-4fd3-ae85-5f0145c9ecca {{(pid=98431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 11 23:14:22.561912 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [req-bed5e74b-6c8e-4f15-bd93-cc8fd39a232d req-37024161-5314-4638-8e29-258e1d24a054 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:14:22.606372 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:22.659665 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-d7294f5d-f901-49c3-9c6a-1529f4d2405e req-a3ca44ec-976f-4d2f-8cb9-2c4df2a2d927 service nova] Releasing lock "refresh_cache-64d7833a-82e8-43e9-83ed-2507197b69bf" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 11 23:14:22.755738 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-bed5e74b-6c8e-4f15-bd93-cc8fd39a232d req-37024161-5314-4638-8e29-258e1d24a054 service nova] [instance: ae596459-1e34-4a2a-9a33-69a02f50fd1c] Updated VIF entry in instance network info cache for port 1f920031-116a-4009-be97-ea5f1389a374. {{(pid=98431) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 11 23:14:22.756169 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-bed5e74b-6c8e-4f15-bd93-cc8fd39a232d req-37024161-5314-4638-8e29-258e1d24a054 service nova] [instance: ae596459-1e34-4a2a-9a33-69a02f50fd1c] Updating instance_info_cache with network_info: [{"id": "1f920031-116a-4009-be97-ea5f1389a374", "address": "fa:16:3e:6c:78:be", "network": {"id": "e7cf6fb9-33e8-4362-8236-472d2d07f60a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-749809800-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "03be033a975c41efba46c4d480df190f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f920031-11", "ovs_interfaceid": "1f920031-116a-4009-be97-ea5f1389a374", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:14:22.926349 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] Acquiring lock "refresh_cache-010aa26e-fb15-47ee-a9b7-089dbfdfd1c7" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 11 23:14:22.932063 np0000002687 nova-compute[98431]: DEBUG nova.scheduler.client.report [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Inventory has not changed for provider e3e65fe2-9de9-4821-8b4a-ccae37c66e25 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98431) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 11 23:14:22.937216 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:23.052197 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [req-8a198f6c-dd29-4884-90d7-1b8c617050e7 req-f381aec9-bfce-41d4-a25c-6881c8300f69 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:14:23.132752 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-8a198f6c-dd29-4884-90d7-1b8c617050e7 req-f381aec9-bfce-41d4-a25c-6881c8300f69 service nova] [instance: 010aa26e-fb15-47ee-a9b7-089dbfdfd1c7] Instance cache missing network info. {{(pid=98431) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 11 23:14:23.261633 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-bed5e74b-6c8e-4f15-bd93-cc8fd39a232d req-37024161-5314-4638-8e29-258e1d24a054 service nova] Releasing lock "refresh_cache-ae596459-1e34-4a2a-9a33-69a02f50fd1c" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 11 23:14:23.323648 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-8a198f6c-dd29-4884-90d7-1b8c617050e7 req-f381aec9-bfce-41d4-a25c-6881c8300f69 service nova] [instance: 010aa26e-fb15-47ee-a9b7-089dbfdfd1c7] Updating instance_info_cache with network_info: [] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:14:23.446657 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.140s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:14:23.447186 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: c9271160-14ef-4a59-8ac8-89efbe36c607] Start building networks asynchronously for instance. {{(pid=98431) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 11 23:14:23.827086 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-8a198f6c-dd29-4884-90d7-1b8c617050e7 req-f381aec9-bfce-41d4-a25c-6881c8300f69 service nova] Releasing lock "refresh_cache-010aa26e-fb15-47ee-a9b7-089dbfdfd1c7" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 11 23:14:23.827529 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] Acquired lock "refresh_cache-010aa26e-fb15-47ee-a9b7-089dbfdfd1c7" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 11 23:14:23.828124 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] [instance: 010aa26e-fb15-47ee-a9b7-089dbfdfd1c7] Building network info cache for instance {{(pid=98431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 11 23:14:23.959706 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: c9271160-14ef-4a59-8ac8-89efbe36c607] Allocating IP information in the background. {{(pid=98431) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 11 23:14:23.960308 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: c9271160-14ef-4a59-8ac8-89efbe36c607] allocate_for_instance() {{(pid=98431) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 11 23:14:23.963177 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:14:23.963177 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:14:24.084181 np0000002687 nova-compute[98431]: DEBUG nova.policy [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'eaecdd9c05b5485b9422171463cccf92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b9f55b231c455ca1a4579d7ed54888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98431) authorize /opt/stack/nova/nova/policy.py:192}} Jun 11 23:14:24.425707 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] [instance: 010aa26e-fb15-47ee-a9b7-089dbfdfd1c7] Start spawning the instance on the hypervisor. {{(pid=98431) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 11 23:14:24.427939 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] [instance: 010aa26e-fb15-47ee-a9b7-089dbfdfd1c7] Creating instance directory {{(pid=98431) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}} Jun 11 23:14:24.427939 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] [instance: 010aa26e-fb15-47ee-a9b7-089dbfdfd1c7] Creating image(s) Jun 11 23:14:24.427939 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] [instance: 010aa26e-fb15-47ee-a9b7-089dbfdfd1c7] Did not create local disks {{(pid=98431) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}} Jun 11 23:14:24.427939 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] [instance: 010aa26e-fb15-47ee-a9b7-089dbfdfd1c7] Ensure instance console log exists: /opt/stack/data/nova/instances/010aa26e-fb15-47ee-a9b7-089dbfdfd1c7/console.log {{(pid=98431) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}} Jun 11 23:14:24.428255 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:14:24.428452 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:14:24.428851 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:14:24.455394 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] [instance: 010aa26e-fb15-47ee-a9b7-089dbfdfd1c7] Instance cache missing network info. {{(pid=98431) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 11 23:14:24.464719 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: c9271160-14ef-4a59-8ac8-89efbe36c607] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 11 23:14:24.724179 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:14:24.869711 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: c9271160-14ef-4a59-8ac8-89efbe36c607] Successfully created port: 189a71e3-b1fd-4769-a6a6-4a9be0352962 {{(pid=98431) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 11 23:14:24.919585 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-906eaf40-a185-4ac7-8524-7ef2f96dda79 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Acquiring lock "14cc8d05-e33d-434f-b2b3-0dad3b613e73" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:14:24.921648 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-906eaf40-a185-4ac7-8524-7ef2f96dda79 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Lock "14cc8d05-e33d-434f-b2b3-0dad3b613e73" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:14:24.948735 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] Acquiring lock "cab1cc43-b433-4772-9f01-0197502c8b57" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:14:24.948735 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] Lock "cab1cc43-b433-4772-9f01-0197502c8b57" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:14:24.963874 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] [instance: 010aa26e-fb15-47ee-a9b7-089dbfdfd1c7] Updating instance_info_cache with network_info: [{"id": "75b6f9f6-6287-4fd3-ae85-5f0145c9ecca", "address": "fa:16:3e:03:1c:0a", "network": {"id": "05459848-a1d6-43f2-934a-5abedf048534", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-501623705-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dbca65bf08474994b1c22f42047c7cbc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap75b6f9f6-62", "ovs_interfaceid": "75b6f9f6-6287-4fd3-ae85-5f0145c9ecca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:14:24.971453 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: c9271160-14ef-4a59-8ac8-89efbe36c607] Start building block device mappings for instance. {{(pid=98431) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 11 23:14:25.425234 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-906eaf40-a185-4ac7-8524-7ef2f96dda79 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] [instance: 14cc8d05-e33d-434f-b2b3-0dad3b613e73] Starting instance... {{(pid=98431) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 11 23:14:25.450918 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] [instance: cab1cc43-b433-4772-9f01-0197502c8b57] Starting instance... {{(pid=98431) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 11 23:14:25.466408 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] Releasing lock "refresh_cache-010aa26e-fb15-47ee-a9b7-089dbfdfd1c7" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 11 23:14:25.471017 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] [instance: 010aa26e-fb15-47ee-a9b7-089dbfdfd1c7] Instance network_info: |[{"id": "75b6f9f6-6287-4fd3-ae85-5f0145c9ecca", "address": "fa:16:3e:03:1c:0a", "network": {"id": "05459848-a1d6-43f2-934a-5abedf048534", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-501623705-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dbca65bf08474994b1c22f42047c7cbc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap75b6f9f6-62", "ovs_interfaceid": "75b6f9f6-6287-4fd3-ae85-5f0145c9ecca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98431) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 11 23:14:25.471814 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] [instance: 010aa26e-fb15-47ee-a9b7-089dbfdfd1c7] Start _get_guest_xml network_info=[{"id": "75b6f9f6-6287-4fd3-ae85-5f0145c9ecca", "address": "fa:16:3e:03:1c:0a", "network": {"id": "05459848-a1d6-43f2-934a-5abedf048534", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-501623705-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dbca65bf08474994b1c22f42047c7cbc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap75b6f9f6-62", "ovs_interfaceid": "75b6f9f6-6287-4fd3-ae85-5f0145c9ecca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=,container_format=,created_at=,direct_url=,disk_format=,id=,min_disk=0,min_ram=0,name=,owner=,properties=ImageMetaProps,protected=,size=1073741824,status='active',tags=,updated_at=,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'mount_device': '/dev/vda', 'attachment_id': 'b2398a2c-d215-47a6-a48c-6e7ea8130ad6', 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1', 'iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '97bc8780-33f3-43fc-8005-01d53ccb1cd1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '010aa26e-fb15-47ee-a9b7-089dbfdfd1c7', 'attached_at': '', 'detached_at': '', 'volume_id': '97bc8780-33f3-43fc-8005-01d53ccb1cd1', 'serial': '97bc8780-33f3-43fc-8005-01d53ccb1cd1'}, 'disk_bus': 'virtio', 'delete_on_termination': True, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98431) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 11 23:14:25.484079 np0000002687 nova-compute[98431]: WARNING nova.virt.libvirt.driver [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 11 23:14:25.486781 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsV293TestJSON-server-1471414698', uuid='010aa26e-fb15-47ee-a9b7-089dbfdfd1c7'), owner=OwnerMeta(userid='6fa2c504358c4aa3bb219d75150b1bdf', username='tempest-ServerActionsV293TestJSON-748885515-project-member', projectid='dbca65bf08474994b1c22f42047c7cbc', projectname='tempest-ServerActionsV293TestJSON-748885515'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "75b6f9f6-6287-4fd3-ae85-5f0145c9ecca", "address": "fa:16:3e:03:1c:0a", "network": {"id": "05459848-a1d6-43f2-934a-5abedf048534", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-501623705-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dbca65bf08474994b1c22f42047c7cbc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap75b6f9f6-62", "ovs_interfaceid": "75b6f9f6-6287-4fd3-ae85-5f0145c9ecca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1781219665.4851654) {{(pid=98431) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 11 23:14:25.492727 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] Searching host: 'np0000002687' for CPU controller through CGroups V1... {{(pid=98431) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 11 23:14:25.493667 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] CPU controller missing on host. {{(pid=98431) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 11 23:14:25.496699 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] Searching host: 'np0000002687' for CPU controller through CGroups V2... {{(pid=98431) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 11 23:14:25.496699 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] CPU controller found on host. {{(pid=98431) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 11 23:14:25.499684 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98431) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 11 23:14:25.500181 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-11T23:08:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=,container_format=,created_at=,direct_url=,disk_format=,id=,min_disk=0,min_ram=0,name=,owner=,properties=ImageMetaProps,protected=,size=1073741824,status='active',tags=,updated_at=,virtual_size=,visibility=), allow threads: True {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 11 23:14:25.500410 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] Flavor limits 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 11 23:14:25.500574 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] Image limits 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 11 23:14:25.500737 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] Flavor pref 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 11 23:14:25.501900 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] Image pref 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 11 23:14:25.502318 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 11 23:14:25.502626 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 11 23:14:25.503225 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98431) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 11 23:14:25.503225 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] Got 1 possible topologies {{(pid=98431) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 11 23:14:25.503225 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 11 23:14:25.503860 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 11 23:14:25.539764 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.volume.iscsi [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] [instance: 010aa26e-fb15-47ee-a9b7-089dbfdfd1c7] Calling os-brick to attach iSCSI Volume {{(pid=98431) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 11 23:14:25.540248 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1', 'iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '97bc8780-33f3-43fc-8005-01d53ccb1cd1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 11 23:14:25.540248 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 11 23:14:25.540689 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 11 23:14:25.540992 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1', 'iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '97bc8780-33f3-43fc-8005-01d53ccb1cd1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98431) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 11 23:14:25.564999 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 11 23:14:25.566402 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 11 23:14:25.566402 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.iscsi [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 11 23:14:25.567598 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 11 23:14:25.568248 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 11 23:14:25.568248 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.iscsi [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 11 23:14:25.584995 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 11 23:14:25.584995 np0000002687 nova-compute[98431]: {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:14:25.593108 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 11 23:14:25.593108 np0000002687 nova-compute[98431]: {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:14:25.606428 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1] added Jun 11 23:14:25.606428 np0000002687 nova-compute[98431]: stderr=iscsiadm: Config file line 363 does not have value Jun 11 23:14:25.606428 np0000002687 nova-compute[98431]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 11 23:14:25.606428 np0000002687 nova-compute[98431]: iscsiadm: Config file line 363 does not have value Jun 11 23:14:25.606428 np0000002687 nova-compute[98431]: iscsiadm: Config file line 363 does not have value Jun 11 23:14:25.606428 np0000002687 nova-compute[98431]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 11 23:14:25.606428 np0000002687 nova-compute[98431]: {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:14:25.606734 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98431) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 11 23:14:25.606943 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0385(s), this was the 1st time calling it. {{(pid=98431) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 11 23:14:25.607006 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98431) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 11 23:14:25.608381 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1] added Jun 11 23:14:25.608381 np0000002687 nova-compute[98431]: stderr=iscsiadm: Config file line 363 does not have value Jun 11 23:14:25.608381 np0000002687 nova-compute[98431]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 11 23:14:25.608381 np0000002687 nova-compute[98431]: iscsiadm: Config file line 363 does not have value Jun 11 23:14:25.608381 np0000002687 nova-compute[98431]: iscsiadm: Config file line 363 does not have value Jun 11 23:14:25.608381 np0000002687 nova-compute[98431]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 11 23:14:25.608381 np0000002687 nova-compute[98431]: {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:14:25.608625 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98431) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 11 23:14:25.608845 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.043(s), this was the 1st time calling it. {{(pid=98431) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 11 23:14:25.609104 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98431) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 11 23:14:25.652071 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: c9271160-14ef-4a59-8ac8-89efbe36c607] Successfully updated port: 189a71e3-b1fd-4769-a6a6-4a9be0352962 {{(pid=98431) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 11 23:14:25.725607 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-1a262a4e-295c-4f08-9ca5-24a3bcc52301 req-7bf60276-f782-4580-a7b0-df18745ba0f3 service nova] [instance: c9271160-14ef-4a59-8ac8-89efbe36c607] Received event network-changed-189a71e3-b1fd-4769-a6a6-4a9be0352962 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:14:25.725607 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-1a262a4e-295c-4f08-9ca5-24a3bcc52301 req-7bf60276-f782-4580-a7b0-df18745ba0f3 service nova] [instance: c9271160-14ef-4a59-8ac8-89efbe36c607] Refreshing instance network info cache due to event network-changed-189a71e3-b1fd-4769-a6a6-4a9be0352962. {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 11 23:14:25.725749 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-1a262a4e-295c-4f08-9ca5-24a3bcc52301 req-7bf60276-f782-4580-a7b0-df18745ba0f3 service nova] Acquiring lock "refresh_cache-c9271160-14ef-4a59-8ac8-89efbe36c607" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 11 23:14:25.725787 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-1a262a4e-295c-4f08-9ca5-24a3bcc52301 req-7bf60276-f782-4580-a7b0-df18745ba0f3 service nova] Acquired lock "refresh_cache-c9271160-14ef-4a59-8ac8-89efbe36c607" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 11 23:14:25.726767 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-1a262a4e-295c-4f08-9ca5-24a3bcc52301 req-7bf60276-f782-4580-a7b0-df18745ba0f3 service nova] [instance: c9271160-14ef-4a59-8ac8-89efbe36c607] Refreshing network info cache for port 189a71e3-b1fd-4769-a6a6-4a9be0352962 {{(pid=98431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 11 23:14:25.990514 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: c9271160-14ef-4a59-8ac8-89efbe36c607] Start spawning the instance on the hypervisor. {{(pid=98431) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 11 23:14:25.992576 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: c9271160-14ef-4a59-8ac8-89efbe36c607] Creating instance directory {{(pid=98431) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}} Jun 11 23:14:25.992576 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: c9271160-14ef-4a59-8ac8-89efbe36c607] Creating image(s) Jun 11 23:14:25.993099 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Acquiring lock "/opt/stack/data/nova/instances/c9271160-14ef-4a59-8ac8-89efbe36c607/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:14:25.993099 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Lock "/opt/stack/data/nova/instances/c9271160-14ef-4a59-8ac8-89efbe36c607/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:14:25.996903 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Lock "/opt/stack/data/nova/instances/c9271160-14ef-4a59-8ac8-89efbe36c607/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:14:25.996903 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:14:25.998269 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:14:26.001996 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:14:26.027431 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-906eaf40-a185-4ac7-8524-7ef2f96dda79 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:14:26.028543 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-906eaf40-a185-4ac7-8524-7ef2f96dda79 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:14:26.040013 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-906eaf40-a185-4ac7-8524-7ef2f96dda79 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98431) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 11 23:14:26.040013 np0000002687 nova-compute[98431]: INFO nova.compute.claims [None req-906eaf40-a185-4ac7-8524-7ef2f96dda79 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] [instance: 14cc8d05-e33d-434f-b2b3-0dad3b613e73] Claim successful on node np0000002687 Jun 11 23:14:26.055127 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:14:26.096592 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json" returned: 0 in 0.095s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:14:26.097246 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Acquiring lock "d2c441059b2992961b5de03c05b32d04aff77cb1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:14:26.097753 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Lock "d2c441059b2992961b5de03c05b32d04aff77cb1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:14:26.098335 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:14:26.103289 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:14:26.103833 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:14:26.163120 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Acquiring lock "refresh_cache-c9271160-14ef-4a59-8ac8-89efbe36c607" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 11 23:14:26.228415 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json" returned: 0 in 0.124s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:14:26.229740 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1,backing_fmt=raw /opt/stack/data/nova/instances/c9271160-14ef-4a59-8ac8-89efbe36c607/disk 1073741824 {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:14:26.244868 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [req-1a262a4e-295c-4f08-9ca5-24a3bcc52301 req-7bf60276-f782-4580-a7b0-df18745ba0f3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:14:26.299073 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1,backing_fmt=raw /opt/stack/data/nova/instances/c9271160-14ef-4a59-8ac8-89efbe36c607/disk 1073741824" returned: 0 in 0.069s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:14:26.301578 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Lock "d2c441059b2992961b5de03c05b32d04aff77cb1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.202s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:14:26.301578 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:14:26.376763 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-1a262a4e-295c-4f08-9ca5-24a3bcc52301 req-7bf60276-f782-4580-a7b0-df18745ba0f3 service nova] [instance: c9271160-14ef-4a59-8ac8-89efbe36c607] Instance cache missing network info. {{(pid=98431) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 11 23:14:26.408098 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json" returned: 0 in 0.108s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:14:26.408737 np0000002687 nova-compute[98431]: DEBUG nova.virt.disk.api [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c9271160-14ef-4a59-8ac8-89efbe36c607/disk. size=1073741824 {{(pid=98431) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 11 23:14:26.409161 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9271160-14ef-4a59-8ac8-89efbe36c607/disk --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:14:26.498247 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9271160-14ef-4a59-8ac8-89efbe36c607/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:14:26.498720 np0000002687 nova-compute[98431]: DEBUG nova.virt.disk.api [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Cannot resize image /opt/stack/data/nova/instances/c9271160-14ef-4a59-8ac8-89efbe36c607/disk to a smaller size. {{(pid=98431) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 11 23:14:26.499270 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: c9271160-14ef-4a59-8ac8-89efbe36c607] Created local disks {{(pid=98431) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}} Jun 11 23:14:26.499500 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: c9271160-14ef-4a59-8ac8-89efbe36c607] Ensure instance console log exists: /opt/stack/data/nova/instances/c9271160-14ef-4a59-8ac8-89efbe36c607/console.log {{(pid=98431) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}} Jun 11 23:14:26.499867 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:14:26.500163 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:14:26.500357 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:14:26.589268 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-1a262a4e-295c-4f08-9ca5-24a3bcc52301 req-7bf60276-f782-4580-a7b0-df18745ba0f3 service nova] [instance: c9271160-14ef-4a59-8ac8-89efbe36c607] Updating instance_info_cache with network_info: [] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:14:26.607678 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.iscsi [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 11 23:14:26.610154 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.iscsi [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 11 23:14:26.625610 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 11 23:14:26.625610 np0000002687 nova-compute[98431]: node.name = iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1 Jun 11 23:14:26.625610 np0000002687 nova-compute[98431]: node.tpgt = -1 Jun 11 23:14:26.625610 np0000002687 nova-compute[98431]: node.startup = manual Jun 11 23:14:26.625610 np0000002687 nova-compute[98431]: node.leading_login = No Jun 11 23:14:26.625610 np0000002687 nova-compute[98431]: iface.iscsi_ifacename = default Jun 11 23:14:26.625610 np0000002687 nova-compute[98431]: iface.net_ifacename = Jun 11 23:14:26.625610 np0000002687 nova-compute[98431]: iface.ipaddress = Jun 11 23:14:26.625610 np0000002687 nova-compute[98431]: iface.prefix_len = 0 Jun 11 23:14:26.625610 np0000002687 nova-compute[98431]: iface.hwaddress = Jun 11 23:14:26.625610 np0000002687 nova-compute[98431]: iface.transport_name = tcp Jun 11 23:14:26.625610 np0000002687 nova-compute[98431]: iface.initiatorname = Jun 11 23:14:26.625610 np0000002687 nova-compute[98431]: iface.state = Jun 11 23:14:26.625610 np0000002687 nova-compute[98431]: iface.vlan_id = 0 Jun 11 23:14:26.625610 np0000002687 nova-compute[98431]: iface.vlan_priority = 0 Jun 11 23:14:26.625610 np0000002687 nova-compute[98431]: iface.vlan_state = Jun 11 23:14:26.625610 np0000002687 nova-compute[98431]: iface.iface_num = 0 Jun 11 23:14:26.625610 np0000002687 nova-compute[98431]: iface.mtu = 0 Jun 11 23:14:26.625610 np0000002687 nova-compute[98431]: iface.port = 0 Jun 11 23:14:26.625610 np0000002687 nova-compute[98431]: iface.bootproto = Jun 11 23:14:26.625610 np0000002687 nova-compute[98431]: iface.subnet_mask = Jun 11 23:14:26.625610 np0000002687 nova-compute[98431]: iface.gateway = Jun 11 23:14:26.625610 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id_state = Jun 11 23:14:26.625610 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id = Jun 11 23:14:26.625610 np0000002687 nova-compute[98431]: iface.dhcp_dns = Jun 11 23:14:26.625610 np0000002687 nova-compute[98431]: iface.dhcp_learn_iqn = Jun 11 23:14:26.625610 np0000002687 nova-compute[98431]: iface.dhcp_req_vendor_id_state = Jun 11 23:14:26.625610 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id_state = Jun 11 23:14:26.625610 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id = Jun 11 23:14:26.625610 np0000002687 nova-compute[98431]: iface.dhcp_slp_da = Jun 11 23:14:26.625610 np0000002687 nova-compute[98431]: iface.fragmentation = Jun 11 23:14:26.625610 np0000002687 nova-compute[98431]: iface.gratuitous_arp = Jun 11 23:14:26.625610 np0000002687 nova-compute[98431]: iface.incoming_forwarding = Jun 11 23:14:26.625610 np0000002687 nova-compute[98431]: iface.tos_state = Jun 11 23:14:26.625610 np0000002687 nova-compute[98431]: iface.tos = 0 Jun 11 23:14:26.625610 np0000002687 nova-compute[98431]: iface.ttl = 0 Jun 11 23:14:26.625610 np0000002687 nova-compute[98431]: iface.delayed_ack = Jun 11 23:14:26.625610 np0000002687 nova-compute[98431]: iface.tcp_nagle = Jun 11 23:14:26.625610 np0000002687 nova-compute[98431]: iface.tcp_wsf_state = Jun 11 23:14:26.625610 np0000002687 nova-compute[98431]: iface.tcp_wsf = 0 Jun 11 23:14:26.625610 np0000002687 nova-compute[98431]: iface.tcp_timer_scale = 0 Jun 11 23:14:26.625610 np0000002687 nova-compute[98431]: iface.tcp_timestamp = Jun 11 23:14:26.625610 np0000002687 nova-compute[98431]: iface.redirect = Jun 11 23:14:26.625610 np0000002687 nova-compute[98431]: iface.def_task_mgmt_timeout = 0 Jun 11 23:14:26.625610 np0000002687 nova-compute[98431]: iface.header_digest = Jun 11 23:14:26.625610 np0000002687 nova-compute[98431]: iface.data_digest = Jun 11 23:14:26.625610 np0000002687 nova-compute[98431]: iface.immediate_data = Jun 11 23:14:26.625610 np0000002687 nova-compute[98431]: iface.initial_r2t = Jun 11 23:14:26.625610 np0000002687 nova-compute[98431]: iface.data_seq_inorder = Jun 11 23:14:26.625610 np0000002687 nova-compute[98431]: iface.data_pdu_inorder = Jun 11 23:14:26.625610 np0000002687 nova-compute[98431]: iface.erl = 0 Jun 11 23:14:26.625610 np0000002687 nova-compute[98431]: iface.max_receive_data_len = 0 Jun 11 23:14:26.625610 np0000002687 nova-compute[98431]: iface.first_burst_len = 0 Jun 11 23:14:26.625610 np0000002687 nova-compute[98431]: iface.max_outstanding_r2t = 0 Jun 11 23:14:26.625610 np0000002687 nova-compute[98431]: iface.max_burst_len = 0 Jun 11 23:14:26.625610 np0000002687 nova-compute[98431]: iface.chap_auth = Jun 11 23:14:26.625610 np0000002687 nova-compute[98431]: iface.bidi_chap = Jun 11 23:14:26.625610 np0000002687 nova-compute[98431]: iface.strict_login_compliance = Jun 11 23:14:26.625610 np0000002687 nova-compute[98431]: iface.discovery_auth = Jun 11 23:14:26.625610 np0000002687 nova-compute[98431]: iface.discovery_logout = Jun 11 23:14:26.625610 np0000002687 nova-compute[98431]: node.discovery_address = Jun 11 23:14:26.625610 np0000002687 nova-compute[98431]: node.discovery_port = 0 Jun 11 23:14:26.625610 np0000002687 nova-compute[98431]: node.discovery_type = fw Jun 11 23:14:26.625610 np0000002687 nova-compute[98431]: node.session.initial_cmdsn = 0 Jun 11 23:14:26.625610 np0000002687 nova-compute[98431]: node.session.initial_login_retry_max = 8 Jun 11 23:14:26.625610 np0000002687 nova-compute[98431]: node.session.xmit_thread_priority = 0 Jun 11 23:14:26.625610 np0000002687 nova-compute[98431]: node.session.cmds_max = 128 Jun 11 23:14:26.625610 np0000002687 nova-compute[98431]: node.session.queue_depth = 32 Jun 11 23:14:26.625610 np0000002687 nova-compute[98431]: node.session.nr_sessions = 1 Jun 11 23:14:26.625610 np0000002687 nova-compute[98431]: node.session.auth.authmethod = None Jun 11 23:14:26.625610 np0000002687 nova-compute[98431]: node.session.auth.username = Jun 11 23:14:26.625610 np0000002687 nova-compute[98431]: node.session.auth.password = *** Jun 11 23:14:26.625610 np0000002687 nova-compute[98431]: node.session.auth.username_in = Jun 11 23:14:26.625610 np0000002687 nova-compute[98431]: node.session.auth.password_in = Jun 11 23:14:26.625610 np0000002687 nova-compute[98431]: node.session.auth.chap_algs = SHA256 Jun 11 23:14:26.625610 np0000002687 nova-compute[98431]: node.session.timeo.replacement_timeout = 120 Jun 11 23:14:26.625610 np0000002687 nova-compute[98431]: node.session.err_timeo.abort_timeout = 15 Jun 11 23:14:26.625610 np0000002687 nova-compute[98431]: node.session.err_timeo.lu_reset_timeout = 30 Jun 11 23:14:26.625610 np0000002687 nova-compute[98431]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 11 23:14:26.625610 np0000002687 nova-compute[98431]: node.session.err_timeo.host_reset_timeout = 60 Jun 11 23:14:26.625610 np0000002687 nova-compute[98431]: node.session.iscsi.FastAbort = Yes Jun 11 23:14:26.625610 np0000002687 nova-compute[98431]: node.session.iscsi.InitialR2T = No Jun 11 23:14:26.625610 np0000002687 nova-compute[98431]: node.session.iscsi.ImmediateData = Yes Jun 11 23:14:26.625610 np0000002687 nova-compute[98431]: node.session.iscsi.FirstBurstLength = 262144 Jun 11 23:14:26.625610 np0000002687 nova-compute[98431]: node.session.iscsi.MaxBurstLength = 16776192 Jun 11 23:14:26.625610 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Retain = 0 Jun 11 23:14:26.625610 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Wait = 2 Jun 11 23:14:26.625610 np0000002687 nova-compute[98431]: node.session.iscsi.MaxConnections = 1 Jun 11 23:14:26.625610 np0000002687 nova-compute[98431]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 11 23:14:26.625610 np0000002687 nova-compute[98431]: node.session.iscsi.ERL = 0 Jun 11 23:14:26.625610 np0000002687 nova-compute[98431]: node.session.scan = auto Jun 11 23:14:26.625610 np0000002687 nova-compute[98431]: node.session.reopen_max = 0 Jun 11 23:14:26.625610 np0000002687 nova-compute[98431]: node.conn[0].address = 192.168.50.100 Jun 11 23:14:26.625610 np0000002687 nova-compute[98431]: node.conn[0].port = 3260 Jun 11 23:14:26.625610 np0000002687 nova-compute[98431]: node.conn[0].startup = manual Jun 11 23:14:26.625610 np0000002687 nova-compute[98431]: node.conn[0].tcp.window_size = 524288 Jun 11 23:14:26.625610 np0000002687 nova-compute[98431]: node.conn[0].tcp.type_of_service = 0 Jun 11 23:14:26.625610 np0000002687 nova-compute[98431]: node.conn[0].timeo.logout_timeout = 15 Jun 11 23:14:26.625610 np0000002687 nova-compute[98431]: node.conn[0].timeo.login_timeout = 15 Jun 11 23:14:26.625610 np0000002687 nova-compute[98431]: node.conn[0].timeo.auth_timeout = 45 Jun 11 23:14:26.625610 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_interval = 5 Jun 11 23:14:26.625610 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_timeout = 5 Jun 11 23:14:26.625610 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 11 23:14:26.625610 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 11 23:14:26.625610 np0000002687 nova-compute[98431]: node.conn[0].iscsi.HeaderDigest = None Jun 11 23:14:26.625610 np0000002687 nova-compute[98431]: node.conn[0].iscsi.DataDigest = None Jun 11 23:14:26.625610 np0000002687 nova-compute[98431]: node.conn[0].iscsi.IFMarker = No Jun 11 23:14:26.625610 np0000002687 nova-compute[98431]: node.conn[0].iscsi.OFMarker = No Jun 11 23:14:26.625610 np0000002687 nova-compute[98431]: # END RECORD Jun 11 23:14:26.625610 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:14:26.636602 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 11 23:14:26.636602 np0000002687 nova-compute[98431]: node.name = iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1 Jun 11 23:14:26.636602 np0000002687 nova-compute[98431]: node.tpgt = -1 Jun 11 23:14:26.636602 np0000002687 nova-compute[98431]: node.startup = manual Jun 11 23:14:26.636602 np0000002687 nova-compute[98431]: node.leading_login = No Jun 11 23:14:26.636602 np0000002687 nova-compute[98431]: iface.iscsi_ifacename = default Jun 11 23:14:26.636602 np0000002687 nova-compute[98431]: iface.net_ifacename = Jun 11 23:14:26.636602 np0000002687 nova-compute[98431]: iface.ipaddress = Jun 11 23:14:26.636602 np0000002687 nova-compute[98431]: iface.prefix_len = 0 Jun 11 23:14:26.636602 np0000002687 nova-compute[98431]: iface.hwaddress = Jun 11 23:14:26.636602 np0000002687 nova-compute[98431]: iface.transport_name = tcp Jun 11 23:14:26.636602 np0000002687 nova-compute[98431]: iface.initiatorname = Jun 11 23:14:26.636602 np0000002687 nova-compute[98431]: iface.state = Jun 11 23:14:26.636602 np0000002687 nova-compute[98431]: iface.vlan_id = 0 Jun 11 23:14:26.636602 np0000002687 nova-compute[98431]: iface.vlan_priority = 0 Jun 11 23:14:26.636602 np0000002687 nova-compute[98431]: iface.vlan_state = Jun 11 23:14:26.636602 np0000002687 nova-compute[98431]: iface.iface_num = 0 Jun 11 23:14:26.636602 np0000002687 nova-compute[98431]: iface.mtu = 0 Jun 11 23:14:26.636602 np0000002687 nova-compute[98431]: iface.port = 0 Jun 11 23:14:26.636602 np0000002687 nova-compute[98431]: iface.bootproto = Jun 11 23:14:26.636602 np0000002687 nova-compute[98431]: iface.subnet_mask = Jun 11 23:14:26.636602 np0000002687 nova-compute[98431]: iface.gateway = Jun 11 23:14:26.636602 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id_state = Jun 11 23:14:26.636602 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id = Jun 11 23:14:26.636602 np0000002687 nova-compute[98431]: iface.dhcp_dns = Jun 11 23:14:26.636602 np0000002687 nova-compute[98431]: iface.dhcp_learn_iqn = Jun 11 23:14:26.636602 np0000002687 nova-compute[98431]: iface.dhcp_req_vendor_id_state = Jun 11 23:14:26.636602 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id_state = Jun 11 23:14:26.636602 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id = Jun 11 23:14:26.636602 np0000002687 nova-compute[98431]: iface.dhcp_slp_da = Jun 11 23:14:26.636602 np0000002687 nova-compute[98431]: iface.fragmentation = Jun 11 23:14:26.636602 np0000002687 nova-compute[98431]: iface.gratuitous_arp = Jun 11 23:14:26.636602 np0000002687 nova-compute[98431]: iface.incoming_forwarding = Jun 11 23:14:26.636602 np0000002687 nova-compute[98431]: iface.tos_state = Jun 11 23:14:26.636602 np0000002687 nova-compute[98431]: iface.tos = 0 Jun 11 23:14:26.636602 np0000002687 nova-compute[98431]: iface.ttl = 0 Jun 11 23:14:26.636602 np0000002687 nova-compute[98431]: iface.delayed_ack = Jun 11 23:14:26.636602 np0000002687 nova-compute[98431]: iface.tcp_nagle = Jun 11 23:14:26.636602 np0000002687 nova-compute[98431]: iface.tcp_wsf_state = Jun 11 23:14:26.636602 np0000002687 nova-compute[98431]: iface.tcp_wsf = 0 Jun 11 23:14:26.636602 np0000002687 nova-compute[98431]: iface.tcp_timer_scale = 0 Jun 11 23:14:26.636602 np0000002687 nova-compute[98431]: iface.tcp_timestamp = Jun 11 23:14:26.636602 np0000002687 nova-compute[98431]: iface.redirect = Jun 11 23:14:26.636602 np0000002687 nova-compute[98431]: iface.def_task_mgmt_timeout = 0 Jun 11 23:14:26.636602 np0000002687 nova-compute[98431]: iface.header_digest = Jun 11 23:14:26.636602 np0000002687 nova-compute[98431]: iface.data_digest = Jun 11 23:14:26.636602 np0000002687 nova-compute[98431]: iface.immediate_data = Jun 11 23:14:26.636602 np0000002687 nova-compute[98431]: iface.initial_r2t = Jun 11 23:14:26.636602 np0000002687 nova-compute[98431]: iface.data_seq_inorder = Jun 11 23:14:26.636602 np0000002687 nova-compute[98431]: iface.data_pdu_inorder = Jun 11 23:14:26.636602 np0000002687 nova-compute[98431]: iface.erl = 0 Jun 11 23:14:26.636602 np0000002687 nova-compute[98431]: iface.max_receive_data_len = 0 Jun 11 23:14:26.636602 np0000002687 nova-compute[98431]: iface.first_burst_len = 0 Jun 11 23:14:26.636602 np0000002687 nova-compute[98431]: iface.max_outstanding_r2t = 0 Jun 11 23:14:26.636602 np0000002687 nova-compute[98431]: iface.max_burst_len = 0 Jun 11 23:14:26.636602 np0000002687 nova-compute[98431]: iface.chap_auth = Jun 11 23:14:26.636602 np0000002687 nova-compute[98431]: iface.bidi_chap = Jun 11 23:14:26.636602 np0000002687 nova-compute[98431]: iface.strict_login_compliance = Jun 11 23:14:26.636602 np0000002687 nova-compute[98431]: iface.discovery_auth = Jun 11 23:14:26.636602 np0000002687 nova-compute[98431]: iface.discovery_logout = Jun 11 23:14:26.636602 np0000002687 nova-compute[98431]: node.discovery_address = Jun 11 23:14:26.636602 np0000002687 nova-compute[98431]: node.discovery_port = 0 Jun 11 23:14:26.636602 np0000002687 nova-compute[98431]: node.discovery_type = fw Jun 11 23:14:26.636602 np0000002687 nova-compute[98431]: node.session.initial_cmdsn = 0 Jun 11 23:14:26.636602 np0000002687 nova-compute[98431]: node.session.initial_login_retry_max = 8 Jun 11 23:14:26.636602 np0000002687 nova-compute[98431]: node.session.xmit_thread_priority = 0 Jun 11 23:14:26.636602 np0000002687 nova-compute[98431]: node.session.cmds_max = 128 Jun 11 23:14:26.636602 np0000002687 nova-compute[98431]: node.session.queue_depth = 32 Jun 11 23:14:26.636602 np0000002687 nova-compute[98431]: node.session.nr_sessions = 1 Jun 11 23:14:26.636602 np0000002687 nova-compute[98431]: node.session.auth.authmethod = None Jun 11 23:14:26.636602 np0000002687 nova-compute[98431]: node.session.auth.username = Jun 11 23:14:26.636602 np0000002687 nova-compute[98431]: node.session.auth.password = *** Jun 11 23:14:26.636602 np0000002687 nova-compute[98431]: node.session.auth.username_in = Jun 11 23:14:26.636602 np0000002687 nova-compute[98431]: node.session.auth.password_in = Jun 11 23:14:26.636602 np0000002687 nova-compute[98431]: node.session.auth.chap_algs = SHA256 Jun 11 23:14:26.636602 np0000002687 nova-compute[98431]: node.session.timeo.replacement_timeout = 120 Jun 11 23:14:26.636602 np0000002687 nova-compute[98431]: node.session.err_timeo.abort_timeout = 15 Jun 11 23:14:26.636602 np0000002687 nova-compute[98431]: node.session.err_timeo.lu_reset_timeout = 30 Jun 11 23:14:26.636602 np0000002687 nova-compute[98431]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 11 23:14:26.636602 np0000002687 nova-compute[98431]: node.session.err_timeo.host_reset_timeout = 60 Jun 11 23:14:26.636602 np0000002687 nova-compute[98431]: node.session.iscsi.FastAbort = Yes Jun 11 23:14:26.636602 np0000002687 nova-compute[98431]: node.session.iscsi.InitialR2T = No Jun 11 23:14:26.636602 np0000002687 nova-compute[98431]: node.session.iscsi.ImmediateData = Yes Jun 11 23:14:26.636602 np0000002687 nova-compute[98431]: node.session.iscsi.FirstBurstLength = 262144 Jun 11 23:14:26.636602 np0000002687 nova-compute[98431]: node.session.iscsi.MaxBurstLength = 16776192 Jun 11 23:14:26.636602 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Retain = 0 Jun 11 23:14:26.636602 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Wait = 2 Jun 11 23:14:26.636602 np0000002687 nova-compute[98431]: node.session.iscsi.MaxConnections = 1 Jun 11 23:14:26.636602 np0000002687 nova-compute[98431]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 11 23:14:26.636602 np0000002687 nova-compute[98431]: node.session.iscsi.ERL = 0 Jun 11 23:14:26.636602 np0000002687 nova-compute[98431]: node.session.scan = auto Jun 11 23:14:26.636602 np0000002687 nova-compute[98431]: node.session.reopen_max = 0 Jun 11 23:14:26.636602 np0000002687 nova-compute[98431]: node.conn[0].address = 192.168.40.100 Jun 11 23:14:26.636602 np0000002687 nova-compute[98431]: node.conn[0].port = 3260 Jun 11 23:14:26.636602 np0000002687 nova-compute[98431]: node.conn[0].startup = manual Jun 11 23:14:26.636602 np0000002687 nova-compute[98431]: node.conn[0].tcp.window_size = 524288 Jun 11 23:14:26.636602 np0000002687 nova-compute[98431]: node.conn[0].tcp.type_of_service = 0 Jun 11 23:14:26.636602 np0000002687 nova-compute[98431]: node.conn[0].timeo.logout_timeout = 15 Jun 11 23:14:26.636602 np0000002687 nova-compute[98431]: node.conn[0].timeo.login_timeout = 15 Jun 11 23:14:26.636602 np0000002687 nova-compute[98431]: node.conn[0].timeo.auth_timeout = 45 Jun 11 23:14:26.636602 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_interval = 5 Jun 11 23:14:26.636602 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_timeout = 5 Jun 11 23:14:26.636602 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 11 23:14:26.636602 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 11 23:14:26.636602 np0000002687 nova-compute[98431]: node.conn[0].iscsi.HeaderDigest = None Jun 11 23:14:26.636602 np0000002687 nova-compute[98431]: node.conn[0].iscsi.DataDigest = None Jun 11 23:14:26.636602 np0000002687 nova-compute[98431]: node.conn[0].iscsi.IFMarker = No Jun 11 23:14:26.636602 np0000002687 nova-compute[98431]: node.conn[0].iscsi.OFMarker = No Jun 11 23:14:26.636602 np0000002687 nova-compute[98431]: # END RECORD Jun 11 23:14:26.636602 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:14:26.646651 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:14:26.652914 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:14:26.667337 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:14:26.667337 np0000002687 nova-compute[98431]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:14:26.667337 np0000002687 nova-compute[98431]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:14:26.667337 np0000002687 nova-compute[98431]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:14:26.667337 np0000002687 nova-compute[98431]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:14:26.667337 np0000002687 nova-compute[98431]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8 (non-flash) Jun 11 23:14:26.667337 np0000002687 nova-compute[98431]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8 (non-flash) Jun 11 23:14:26.667337 np0000002687 nova-compute[98431]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13 (non-flash) Jun 11 23:14:26.667337 np0000002687 nova-compute[98431]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13 (non-flash) Jun 11 23:14:26.667337 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:14:26.667337 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:14:26.667656 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:14:26.667656 np0000002687 nova-compute[98431]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:14:26.667656 np0000002687 nova-compute[98431]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:14:26.667656 np0000002687 nova-compute[98431]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:14:26.667656 np0000002687 nova-compute[98431]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:14:26.667656 np0000002687 nova-compute[98431]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8 (non-flash) Jun 11 23:14:26.667656 np0000002687 nova-compute[98431]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8 (non-flash) Jun 11 23:14:26.667656 np0000002687 nova-compute[98431]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13 (non-flash) Jun 11 23:14:26.667656 np0000002687 nova-compute[98431]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13 (non-flash) Jun 11 23:14:26.667656 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:14:26.667656 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:14:26.674222 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:14:26.674222 np0000002687 nova-compute[98431]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:14:26.674222 np0000002687 nova-compute[98431]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:14:26.674222 np0000002687 nova-compute[98431]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:14:26.674222 np0000002687 nova-compute[98431]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:14:26.674222 np0000002687 nova-compute[98431]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8 (non-flash) Jun 11 23:14:26.674222 np0000002687 nova-compute[98431]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8 (non-flash) Jun 11 23:14:26.674222 np0000002687 nova-compute[98431]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13 (non-flash) Jun 11 23:14:26.674222 np0000002687 nova-compute[98431]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13 (non-flash) Jun 11 23:14:26.674222 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:14:26.674222 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:14:26.674673 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:14:26.674673 np0000002687 nova-compute[98431]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:14:26.674673 np0000002687 nova-compute[98431]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:14:26.674673 np0000002687 nova-compute[98431]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:14:26.674673 np0000002687 nova-compute[98431]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:14:26.674673 np0000002687 nova-compute[98431]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8 (non-flash) Jun 11 23:14:26.674673 np0000002687 nova-compute[98431]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8 (non-flash) Jun 11 23:14:26.674673 np0000002687 nova-compute[98431]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13 (non-flash) Jun 11 23:14:26.674673 np0000002687 nova-compute[98431]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13 (non-flash) Jun 11 23:14:26.674673 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:14:26.674673 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:14:26.718399 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1, portal: 192.168.50.100,3260] Jun 11 23:14:26.718399 np0000002687 nova-compute[98431]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1, portal: 192.168.50.100,3260] successful. Jun 11 23:14:26.718399 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:14:26.732436 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1, portal: 192.168.40.100,3260] Jun 11 23:14:26.732436 np0000002687 nova-compute[98431]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1, portal: 192.168.40.100,3260] successful. Jun 11 23:14:26.732436 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:14:26.733466 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:14:26.747108 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:14:26.761243 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:14:26.761243 np0000002687 nova-compute[98431]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:14:26.761243 np0000002687 nova-compute[98431]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:14:26.761243 np0000002687 nova-compute[98431]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:14:26.761243 np0000002687 nova-compute[98431]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:14:26.761243 np0000002687 nova-compute[98431]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8 (non-flash) Jun 11 23:14:26.761243 np0000002687 nova-compute[98431]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8 (non-flash) Jun 11 23:14:26.761243 np0000002687 nova-compute[98431]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13 (non-flash) Jun 11 23:14:26.761243 np0000002687 nova-compute[98431]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13 (non-flash) Jun 11 23:14:26.761243 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:14:26.761243 np0000002687 nova-compute[98431]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1 (non-flash) Jun 11 23:14:26.761243 np0000002687 nova-compute[98431]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1 (non-flash) Jun 11 23:14:26.761243 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:14:26.761716 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:14:26.761716 np0000002687 nova-compute[98431]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:14:26.761716 np0000002687 nova-compute[98431]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:14:26.761716 np0000002687 nova-compute[98431]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:14:26.761716 np0000002687 nova-compute[98431]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:14:26.761716 np0000002687 nova-compute[98431]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8 (non-flash) Jun 11 23:14:26.761716 np0000002687 nova-compute[98431]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8 (non-flash) Jun 11 23:14:26.761716 np0000002687 nova-compute[98431]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13 (non-flash) Jun 11 23:14:26.761716 np0000002687 nova-compute[98431]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13 (non-flash) Jun 11 23:14:26.761716 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:14:26.761716 np0000002687 nova-compute[98431]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1 (non-flash) Jun 11 23:14:26.761716 np0000002687 nova-compute[98431]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1 (non-flash) Jun 11 23:14:26.761716 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:14:26.762151 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.194s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 11 23:14:26.762151 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] Connected to 192.168.50.100:3260 {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 11 23:14:26.764396 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] HCTL ('11', '-', '-', 0) found on session 43 with lun 0 {{(pid=98431) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 11 23:14:26.764764 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98431) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 11 23:14:26.772440 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:14:26.772440 np0000002687 nova-compute[98431]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:14:26.772440 np0000002687 nova-compute[98431]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:14:26.772440 np0000002687 nova-compute[98431]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:14:26.772440 np0000002687 nova-compute[98431]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:14:26.772440 np0000002687 nova-compute[98431]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8 (non-flash) Jun 11 23:14:26.772440 np0000002687 nova-compute[98431]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8 (non-flash) Jun 11 23:14:26.772440 np0000002687 nova-compute[98431]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13 (non-flash) Jun 11 23:14:26.772440 np0000002687 nova-compute[98431]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13 (non-flash) Jun 11 23:14:26.772440 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:14:26.772440 np0000002687 nova-compute[98431]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1 (non-flash) Jun 11 23:14:26.772440 np0000002687 nova-compute[98431]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1 (non-flash) Jun 11 23:14:26.772440 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:14:26.772440 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:14:26.772440 np0000002687 nova-compute[98431]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:14:26.772440 np0000002687 nova-compute[98431]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:14:26.772440 np0000002687 nova-compute[98431]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:14:26.772440 np0000002687 nova-compute[98431]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:14:26.772440 np0000002687 nova-compute[98431]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8 (non-flash) Jun 11 23:14:26.772440 np0000002687 nova-compute[98431]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8 (non-flash) Jun 11 23:14:26.772440 np0000002687 nova-compute[98431]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13 (non-flash) Jun 11 23:14:26.772440 np0000002687 nova-compute[98431]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13 (non-flash) Jun 11 23:14:26.772440 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:14:26.772440 np0000002687 nova-compute[98431]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1 (non-flash) Jun 11 23:14:26.772440 np0000002687 nova-compute[98431]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1 (non-flash) Jun 11 23:14:26.772440 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:14:26.772440 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.207s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 11 23:14:26.772440 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] Connected to 192.168.40.100:3260 {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 11 23:14:26.774197 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] HCTL ('12', '-', '-', 0) found on session 44 with lun 0 {{(pid=98431) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 11 23:14:26.774197 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98431) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 11 23:14:26.798884 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] Searching for a device in session 44 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98431) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 11 23:14:26.798884 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '97bc8780-33f3-43fc-8005-01d53ccb1cd1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 11 23:14:26.798884 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] Searching for a device in session 43 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98431) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 11 23:14:26.798884 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '97bc8780-33f3-43fc-8005-01d53ccb1cd1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 11 23:14:27.091734 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-1a262a4e-295c-4f08-9ca5-24a3bcc52301 req-7bf60276-f782-4580-a7b0-df18745ba0f3 service nova] Releasing lock "refresh_cache-c9271160-14ef-4a59-8ac8-89efbe36c607" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 11 23:14:27.092279 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Acquired lock "refresh_cache-c9271160-14ef-4a59-8ac8-89efbe36c607" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 11 23:14:27.092488 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: c9271160-14ef-4a59-8ac8-89efbe36c607] Building network info cache for instance {{(pid=98431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 11 23:14:27.571210 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98431) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 11 23:14:27.609306 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:27.701370 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: c9271160-14ef-4a59-8ac8-89efbe36c607] Instance cache missing network info. {{(pid=98431) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 11 23:14:27.848714 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-906eaf40-a185-4ac7-8524-7ef2f96dda79 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98431) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 11 23:14:27.849020 np0000002687 nova-compute[98431]: DEBUG nova.compute.provider_tree [None req-906eaf40-a185-4ac7-8524-7ef2f96dda79 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Inventory has not changed in ProviderTree for provider: e3e65fe2-9de9-4821-8b4a-ccae37c66e25 {{(pid=98431) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 11 23:14:27.893565 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:14:27.936378 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:28.066403 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: c9271160-14ef-4a59-8ac8-89efbe36c607] Updating instance_info_cache with network_info: [{"id": "189a71e3-b1fd-4769-a6a6-4a9be0352962", "address": "fa:16:3e:f6:b5:ae", "network": {"id": "77fc4e10-1fed-4963-86b4-1fbb3a9c6f7f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1105404274-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b2b9f55b231c455ca1a4579d7ed54888", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap189a71e3-b1", "ovs_interfaceid": "189a71e3-b1fd-4769-a6a6-4a9be0352962", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:14:28.351967 np0000002687 nova-compute[98431]: DEBUG nova.scheduler.client.report [None req-906eaf40-a185-4ac7-8524-7ef2f96dda79 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Inventory has not changed for provider e3e65fe2-9de9-4821-8b4a-ccae37c66e25 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98431) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 11 23:14:28.569074 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Releasing lock "refresh_cache-c9271160-14ef-4a59-8ac8-89efbe36c607" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 11 23:14:28.569074 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: c9271160-14ef-4a59-8ac8-89efbe36c607] Instance network_info: |[{"id": "189a71e3-b1fd-4769-a6a6-4a9be0352962", "address": "fa:16:3e:f6:b5:ae", "network": {"id": "77fc4e10-1fed-4963-86b4-1fbb3a9c6f7f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1105404274-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b2b9f55b231c455ca1a4579d7ed54888", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap189a71e3-b1", "ovs_interfaceid": "189a71e3-b1fd-4769-a6a6-4a9be0352962", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98431) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 11 23:14:28.571490 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: c9271160-14ef-4a59-8ac8-89efbe36c607] Start _get_guest_xml network_info=[{"id": "189a71e3-b1fd-4769-a6a6-4a9be0352962", "address": "fa:16:3e:f6:b5:ae", "network": {"id": "77fc4e10-1fed-4963-86b4-1fbb3a9c6f7f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1105404274-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b2b9f55b231c455ca1a4579d7ed54888", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap189a71e3-b1", "ovs_interfaceid": "189a71e3-b1fd-4769-a6a6-4a9be0352962", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-11T23:08:20Z,direct_url=,disk_format='qcow2',id=f30640f8-7aca-4300-a085-4706a5209a79,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ce012f9fabdb4ee5a73e212437f59d97',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-11T23:08:23Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'image_id': 'f30640f8-7aca-4300-a085-4706a5209a79'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98431) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 11 23:14:28.577020 np0000002687 nova-compute[98431]: WARNING nova.virt.libvirt.driver [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 11 23:14:28.579694 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='f30640f8-7aca-4300-a085-4706a5209a79', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-1508221031', uuid='c9271160-14ef-4a59-8ac8-89efbe36c607'), owner=OwnerMeta(userid='eaecdd9c05b5485b9422171463cccf92', username='tempest-ServerRescueNegativeTestJSON-2027875711-project-member', projectid='b2b9f55b231c455ca1a4579d7ed54888', projectname='tempest-ServerRescueNegativeTestJSON-2027875711'), image=ImageMeta(id='f30640f8-7aca-4300-a085-4706a5209a79', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "189a71e3-b1fd-4769-a6a6-4a9be0352962", "address": "fa:16:3e:f6:b5:ae", "network": {"id": "77fc4e10-1fed-4963-86b4-1fbb3a9c6f7f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1105404274-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b2b9f55b231c455ca1a4579d7ed54888", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap189a71e3-b1", "ovs_interfaceid": "189a71e3-b1fd-4769-a6a6-4a9be0352962", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1781219668.5786057) {{(pid=98431) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 11 23:14:28.581594 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Searching host: 'np0000002687' for CPU controller through CGroups V1... {{(pid=98431) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 11 23:14:28.582159 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] CPU controller missing on host. {{(pid=98431) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 11 23:14:28.583699 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Searching host: 'np0000002687' for CPU controller through CGroups V2... {{(pid=98431) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 11 23:14:28.584013 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] CPU controller found on host. {{(pid=98431) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 11 23:14:28.586612 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98431) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 11 23:14:28.587388 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-11T23:08:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-11T23:08:20Z,direct_url=,disk_format='qcow2',id=f30640f8-7aca-4300-a085-4706a5209a79,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ce012f9fabdb4ee5a73e212437f59d97',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-11T23:08:23Z,virtual_size=,visibility=), allow threads: True {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 11 23:14:28.588029 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Flavor limits 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 11 23:14:28.588029 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Image limits 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 11 23:14:28.588029 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Flavor pref 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 11 23:14:28.588174 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Image pref 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 11 23:14:28.588278 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 11 23:14:28.588437 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 11 23:14:28.588779 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98431) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 11 23:14:28.588779 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Got 1 possible topologies {{(pid=98431) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 11 23:14:28.588970 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 11 23:14:28.589110 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 11 23:14:28.596222 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] Found WWN 3300000008c957fc3 for multipath device dm-4 {{(pid=98431) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 11 23:14:28.596694 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.056s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 11 23:14:28.597011 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] <== connect_volume: return (3056ms) {'type': 'block', 'scsi_wwn': '3300000008c957fc3', 'path': '/dev/dm-4', 'multipath_id': '3300000008c957fc3'} {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 11 23:14:28.597209 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.volume.iscsi [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] [instance: 010aa26e-fb15-47ee-a9b7-089dbfdfd1c7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000008c957fc3', 'path': '/dev/dm-4', 'multipath_id': '3300000008c957fc3'} {{(pid=98431) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 11 23:14:28.612607 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-11T23:14:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1508221031',display_name='tempest-ServerRescueNegativeTestJSON-server-1508221031',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='tempest-serverrescuenegativetestjson-server-1508221031',id=24,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO/GW5j2SU6GSEeLdWfCo7IXd6PpXeFe64lSeQWIlR9YmKEiFOzrsj5zIhPAL1RVn6SbEcp1raaKG6FKORhPqG5sIJOTVAY6jueEvvq0AYouiTu1iVZwksktvZVcQAyOqw==',key_name='tempest-keypair-809450316',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b2b9f55b231c455ca1a4579d7ed54888',ramdisk_id='',reservation_id='r-qqalnw08',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2027875711',owner_user_name='tempest-ServerRescueNegativeTestJSON-2027875711-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-11T23:14:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eaecdd9c05b5485b9422171463cccf92',uuid=c9271160-14ef-4a59-8ac8-89efbe36c607,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "189a71e3-b1fd-4769-a6a6-4a9be0352962", "address": "fa:16:3e:f6:b5:ae", "network": {"id": "77fc4e10-1fed-4963-86b4-1fbb3a9c6f7f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1105404274-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b2b9f55b231c455ca1a4579d7ed54888", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap189a71e3-b1", "ovs_interfaceid": "189a71e3-b1fd-4769-a6a6-4a9be0352962", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98431) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 11 23:14:28.614041 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Converting VIF {"id": "189a71e3-b1fd-4769-a6a6-4a9be0352962", "address": "fa:16:3e:f6:b5:ae", "network": {"id": "77fc4e10-1fed-4963-86b4-1fbb3a9c6f7f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1105404274-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b2b9f55b231c455ca1a4579d7ed54888", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap189a71e3-b1", "ovs_interfaceid": "189a71e3-b1fd-4769-a6a6-4a9be0352962", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:14:28.614986 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:b5:ae,bridge_name='br-int',has_traffic_filtering=True,id=189a71e3-b1fd-4769-a6a6-4a9be0352962,network=Network(77fc4e10-1fed-4963-86b4-1fbb3a9c6f7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap189a71e3-b1') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:14:28.615879 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Lazy-loading 'pci_devices' on Instance uuid c9271160-14ef-4a59-8ac8-89efbe36c607 {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:14:28.860861 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-906eaf40-a185-4ac7-8524-7ef2f96dda79 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.831s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:14:28.860861 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-906eaf40-a185-4ac7-8524-7ef2f96dda79 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] [instance: 14cc8d05-e33d-434f-b2b3-0dad3b613e73] Start building networks asynchronously for instance. {{(pid=98431) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 11 23:14:28.864862 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.809s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:14:28.869877 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98431) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 11 23:14:28.870077 np0000002687 nova-compute[98431]: INFO nova.compute.claims [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] [instance: cab1cc43-b433-4772-9f01-0197502c8b57] Claim successful on node np0000002687 Jun 11 23:14:29.120836 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-11T23:14:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1471414698',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='tempest-serveractionsv293testjson-server-1471414698',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKdUGoO9cuTXJZHu2h25q6vrckGgOLiWeRbl1vP84Rc3f1lHWmXgff8p6BaYIh4+tSsnr7LRQTn7Zdhe47kpCDz5cfnYlNWR8SMBDDSyTc1K7cQyl9CNKh4PSTwXCJAaHw==',key_name='tempest-keypair-1991391740',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dbca65bf08474994b1c22f42047c7cbc',ramdisk_id='',reservation_id='r-wck7um1h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-748885515',owner_user_name='tempest-ServerActionsV293TestJSON-748885515-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-11T23:14:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6fa2c504358c4aa3bb219d75150b1bdf',uuid=010aa26e-fb15-47ee-a9b7-089dbfdfd1c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "75b6f9f6-6287-4fd3-ae85-5f0145c9ecca", "address": "fa:16:3e:03:1c:0a", "network": {"id": "05459848-a1d6-43f2-934a-5abedf048534", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-501623705-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dbca65bf08474994b1c22f42047c7cbc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap75b6f9f6-62", "ovs_interfaceid": "75b6f9f6-6287-4fd3-ae85-5f0145c9ecca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98431) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 11 23:14:29.121346 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: c9271160-14ef-4a59-8ac8-89efbe36c607] End _get_guest_xml xml= Jun 11 23:14:29.121346 np0000002687 nova-compute[98431]: c9271160-14ef-4a59-8ac8-89efbe36c607 Jun 11 23:14:29.121346 np0000002687 nova-compute[98431]: instance-00000018 Jun 11 23:14:29.121346 np0000002687 nova-compute[98431]: 196608 Jun 11 23:14:29.121346 np0000002687 nova-compute[98431]: 1 Jun 11 23:14:29.121346 np0000002687 nova-compute[98431]: Jun 11 23:14:29.121346 np0000002687 nova-compute[98431]: Jun 11 23:14:29.121346 np0000002687 nova-compute[98431]: Jun 11 23:14:29.121346 np0000002687 nova-compute[98431]: tempest-ServerRescueNegativeTestJSON-server-1508221031 Jun 11 23:14:29.121346 np0000002687 nova-compute[98431]: 2026-06-11 23:14:28 Jun 11 23:14:29.121346 np0000002687 nova-compute[98431]: Jun 11 23:14:29.121346 np0000002687 nova-compute[98431]: 192 Jun 11 23:14:29.121346 np0000002687 nova-compute[98431]: 1 Jun 11 23:14:29.121346 np0000002687 nova-compute[98431]: 0 Jun 11 23:14:29.121346 np0000002687 nova-compute[98431]: 0 Jun 11 23:14:29.121346 np0000002687 nova-compute[98431]: 1 Jun 11 23:14:29.121346 np0000002687 nova-compute[98431]: Jun 11 23:14:29.121346 np0000002687 nova-compute[98431]: True Jun 11 23:14:29.121346 np0000002687 nova-compute[98431]: Jun 11 23:14:29.121346 np0000002687 nova-compute[98431]: Jun 11 23:14:29.121346 np0000002687 nova-compute[98431]: Jun 11 23:14:29.121346 np0000002687 nova-compute[98431]: bare Jun 11 23:14:29.121346 np0000002687 nova-compute[98431]: qcow2 Jun 11 23:14:29.121346 np0000002687 nova-compute[98431]: 1 Jun 11 23:14:29.121346 np0000002687 nova-compute[98431]: 0 Jun 11 23:14:29.121346 np0000002687 nova-compute[98431]: Jun 11 23:14:29.121346 np0000002687 nova-compute[98431]: virtio Jun 11 23:14:29.121346 np0000002687 nova-compute[98431]: Jun 11 23:14:29.121346 np0000002687 nova-compute[98431]: Jun 11 23:14:29.121346 np0000002687 nova-compute[98431]: Jun 11 23:14:29.121346 np0000002687 nova-compute[98431]: tempest-ServerRescueNegativeTestJSON-2027875711-project-member Jun 11 23:14:29.121346 np0000002687 nova-compute[98431]: tempest-ServerRescueNegativeTestJSON-2027875711 Jun 11 23:14:29.121346 np0000002687 nova-compute[98431]: Jun 11 23:14:29.121346 np0000002687 nova-compute[98431]: Jun 11 23:14:29.121346 np0000002687 nova-compute[98431]: Jun 11 23:14:29.121346 np0000002687 nova-compute[98431]: Jun 11 23:14:29.121346 np0000002687 nova-compute[98431]: Jun 11 23:14:29.121346 np0000002687 nova-compute[98431]: Jun 11 23:14:29.121346 np0000002687 nova-compute[98431]: Jun 11 23:14:29.121346 np0000002687 nova-compute[98431]: Jun 11 23:14:29.121346 np0000002687 nova-compute[98431]: Jun 11 23:14:29.121346 np0000002687 nova-compute[98431]: Jun 11 23:14:29.121346 np0000002687 nova-compute[98431]: Jun 11 23:14:29.121346 np0000002687 nova-compute[98431]: OpenStack Foundation Jun 11 23:14:29.121346 np0000002687 nova-compute[98431]: OpenStack Nova Jun 11 23:14:29.121346 np0000002687 nova-compute[98431]: 33.1.0 Jun 11 23:14:29.121346 np0000002687 nova-compute[98431]: c9271160-14ef-4a59-8ac8-89efbe36c607 Jun 11 23:14:29.121346 np0000002687 nova-compute[98431]: c9271160-14ef-4a59-8ac8-89efbe36c607 Jun 11 23:14:29.121346 np0000002687 nova-compute[98431]: Virtual Machine Jun 11 23:14:29.121346 np0000002687 nova-compute[98431]: Jun 11 23:14:29.121346 np0000002687 nova-compute[98431]: Jun 11 23:14:29.121346 np0000002687 nova-compute[98431]: Jun 11 23:14:29.121346 np0000002687 nova-compute[98431]: hvm Jun 11 23:14:29.121346 np0000002687 nova-compute[98431]: Jun 11 23:14:29.121346 np0000002687 nova-compute[98431]: Jun 11 23:14:29.121346 np0000002687 nova-compute[98431]: Jun 11 23:14:29.121346 np0000002687 nova-compute[98431]: Jun 11 23:14:29.121346 np0000002687 nova-compute[98431]: Jun 11 23:14:29.121346 np0000002687 nova-compute[98431]: Jun 11 23:14:29.121346 np0000002687 nova-compute[98431]: 128 Jun 11 23:14:29.121346 np0000002687 nova-compute[98431]: Jun 11 23:14:29.121346 np0000002687 nova-compute[98431]: Jun 11 23:14:29.121346 np0000002687 nova-compute[98431]: Jun 11 23:14:29.121346 np0000002687 nova-compute[98431]: 1 Jun 11 23:14:29.121346 np0000002687 nova-compute[98431]: Jun 11 23:14:29.121346 np0000002687 nova-compute[98431]: Jun 11 23:14:29.121346 np0000002687 nova-compute[98431]: Nehalem Jun 11 23:14:29.121346 np0000002687 nova-compute[98431]: Jun 11 23:14:29.121346 np0000002687 nova-compute[98431]: Jun 11 23:14:29.121346 np0000002687 nova-compute[98431]: Jun 11 23:14:29.121346 np0000002687 nova-compute[98431]: Jun 11 23:14:29.121346 np0000002687 nova-compute[98431]: Jun 11 23:14:29.121346 np0000002687 nova-compute[98431]: Jun 11 23:14:29.121346 np0000002687 nova-compute[98431]: Jun 11 23:14:29.121346 np0000002687 nova-compute[98431]: Jun 11 23:14:29.121346 np0000002687 nova-compute[98431]: Jun 11 23:14:29.121346 np0000002687 nova-compute[98431]: Jun 11 23:14:29.121346 np0000002687 nova-compute[98431]: Jun 11 23:14:29.121346 np0000002687 nova-compute[98431]: Jun 11 23:14:29.121346 np0000002687 nova-compute[98431]: Jun 11 23:14:29.121346 np0000002687 nova-compute[98431]: Jun 11 23:14:29.121346 np0000002687 nova-compute[98431]: Jun 11 23:14:29.121346 np0000002687 nova-compute[98431]: Jun 11 23:14:29.121346 np0000002687 nova-compute[98431]: Jun 11 23:14:29.121346 np0000002687 nova-compute[98431]: Jun 11 23:14:29.121346 np0000002687 nova-compute[98431]: Jun 11 23:14:29.121346 np0000002687 nova-compute[98431]: Jun 11 23:14:29.121346 np0000002687 nova-compute[98431]: Jun 11 23:14:29.121346 np0000002687 nova-compute[98431]: Jun 11 23:14:29.121346 np0000002687 nova-compute[98431]: Jun 11 23:14:29.121346 np0000002687 nova-compute[98431]: Jun 11 23:14:29.121346 np0000002687 nova-compute[98431]: Jun 11 23:14:29.121346 np0000002687 nova-compute[98431]: Jun 11 23:14:29.121346 np0000002687 nova-compute[98431]: /dev/urandom Jun 11 23:14:29.121346 np0000002687 nova-compute[98431]: Jun 11 23:14:29.121346 np0000002687 nova-compute[98431]: Jun 11 23:14:29.121346 np0000002687 nova-compute[98431]: Jun 11 23:14:29.121346 np0000002687 nova-compute[98431]: Jun 11 23:14:29.121346 np0000002687 nova-compute[98431]: Jun 11 23:14:29.121346 np0000002687 nova-compute[98431]: Jun 11 23:14:29.121346 np0000002687 nova-compute[98431]: Jun 11 23:14:29.121346 np0000002687 nova-compute[98431]: {{(pid=98431) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 11 23:14:29.124248 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] Converting VIF {"id": "75b6f9f6-6287-4fd3-ae85-5f0145c9ecca", "address": "fa:16:3e:03:1c:0a", "network": {"id": "05459848-a1d6-43f2-934a-5abedf048534", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-501623705-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dbca65bf08474994b1c22f42047c7cbc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap75b6f9f6-62", "ovs_interfaceid": "75b6f9f6-6287-4fd3-ae85-5f0145c9ecca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:14:29.124248 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: c9271160-14ef-4a59-8ac8-89efbe36c607] Preparing to wait for external event network-vif-plugged-189a71e3-b1fd-4769-a6a6-4a9be0352962 {{(pid=98431) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 11 23:14:29.124248 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:1c:0a,bridge_name='br-int',has_traffic_filtering=True,id=75b6f9f6-6287-4fd3-ae85-5f0145c9ecca,network=Network(05459848-a1d6-43f2-934a-5abedf048534),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75b6f9f6-62') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:14:29.124248 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Acquiring lock "c9271160-14ef-4a59-8ac8-89efbe36c607-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:14:29.124248 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] Lazy-loading 'pci_devices' on Instance uuid 010aa26e-fb15-47ee-a9b7-089dbfdfd1c7 {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:14:29.124248 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Lock "c9271160-14ef-4a59-8ac8-89efbe36c607-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:14:29.124565 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Lock "c9271160-14ef-4a59-8ac8-89efbe36c607-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:14:29.127067 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-11T23:14:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1508221031',display_name='tempest-ServerRescueNegativeTestJSON-server-1508221031',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='tempest-serverrescuenegativetestjson-server-1508221031',id=24,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO/GW5j2SU6GSEeLdWfCo7IXd6PpXeFe64lSeQWIlR9YmKEiFOzrsj5zIhPAL1RVn6SbEcp1raaKG6FKORhPqG5sIJOTVAY6jueEvvq0AYouiTu1iVZwksktvZVcQAyOqw==',key_name='tempest-keypair-809450316',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b2b9f55b231c455ca1a4579d7ed54888',ramdisk_id='',reservation_id='r-qqalnw08',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2027875711',owner_user_name='tempest-ServerRescueNegativeTestJSON-2027875711-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-11T23:14:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eaecdd9c05b5485b9422171463cccf92',uuid=c9271160-14ef-4a59-8ac8-89efbe36c607,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "189a71e3-b1fd-4769-a6a6-4a9be0352962", "address": "fa:16:3e:f6:b5:ae", "network": {"id": "77fc4e10-1fed-4963-86b4-1fbb3a9c6f7f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1105404274-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b2b9f55b231c455ca1a4579d7ed54888", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap189a71e3-b1", "ovs_interfaceid": "189a71e3-b1fd-4769-a6a6-4a9be0352962", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 11 23:14:29.127067 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Converting VIF {"id": "189a71e3-b1fd-4769-a6a6-4a9be0352962", "address": "fa:16:3e:f6:b5:ae", "network": {"id": "77fc4e10-1fed-4963-86b4-1fbb3a9c6f7f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1105404274-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b2b9f55b231c455ca1a4579d7ed54888", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap189a71e3-b1", "ovs_interfaceid": "189a71e3-b1fd-4769-a6a6-4a9be0352962", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:14:29.127067 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:b5:ae,bridge_name='br-int',has_traffic_filtering=True,id=189a71e3-b1fd-4769-a6a6-4a9be0352962,network=Network(77fc4e10-1fed-4963-86b4-1fbb3a9c6f7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap189a71e3-b1') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:14:29.127067 np0000002687 nova-compute[98431]: DEBUG os_vif [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:b5:ae,bridge_name='br-int',has_traffic_filtering=True,id=189a71e3-b1fd-4769-a6a6-4a9be0352962,network=Network(77fc4e10-1fed-4963-86b4-1fbb3a9c6f7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap189a71e3-b1') {{(pid=98431) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 11 23:14:29.127067 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:29.129009 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:14:29.129009 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 11 23:14:29.130575 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:29.131062 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b746d5d2-4062-502d-bb92-01d6bcae0092', '_type': 'linux-noop'}}, row=False) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:14:29.134648 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:14:29.137321 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:29.137321 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap189a71e3-b1, may_exist=True, interface_attrs={}) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:14:29.138003 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap189a71e3-b1, col_values=(('qos', UUID('5af5635e-3a09-4c79-81be-13a3acb37ad6')),), if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:14:29.140003 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap189a71e3-b1, col_values=(('external_ids', {'iface-id': '189a71e3-b1fd-4769-a6a6-4a9be0352962', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f6:b5:ae', 'vm-uuid': 'c9271160-14ef-4a59-8ac8-89efbe36c607'}),), if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:14:29.142252 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:14:29.146557 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:29.148117 np0000002687 nova-compute[98431]: INFO os_vif [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:b5:ae,bridge_name='br-int',has_traffic_filtering=True,id=189a71e3-b1fd-4769-a6a6-4a9be0352962,network=Network(77fc4e10-1fed-4963-86b4-1fbb3a9c6f7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap189a71e3-b1') Jun 11 23:14:29.368611 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-906eaf40-a185-4ac7-8524-7ef2f96dda79 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] [instance: 14cc8d05-e33d-434f-b2b3-0dad3b613e73] Allocating IP information in the background. {{(pid=98431) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 11 23:14:29.369104 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-906eaf40-a185-4ac7-8524-7ef2f96dda79 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] [instance: 14cc8d05-e33d-434f-b2b3-0dad3b613e73] allocate_for_instance() {{(pid=98431) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 11 23:14:29.369302 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-906eaf40-a185-4ac7-8524-7ef2f96dda79 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:14:29.369596 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-906eaf40-a185-4ac7-8524-7ef2f96dda79 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:14:29.464660 np0000002687 nova-compute[98431]: DEBUG nova.policy [None req-906eaf40-a185-4ac7-8524-7ef2f96dda79 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5b929fda768d45738790181d6b49a3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1922540076a94ee5ba369d79869aaa95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98431) authorize /opt/stack/nova/nova/policy.py:192}} Jun 11 23:14:29.634492 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] [instance: 010aa26e-fb15-47ee-a9b7-089dbfdfd1c7] End _get_guest_xml xml= Jun 11 23:14:29.634492 np0000002687 nova-compute[98431]: 010aa26e-fb15-47ee-a9b7-089dbfdfd1c7 Jun 11 23:14:29.634492 np0000002687 nova-compute[98431]: instance-00000017 Jun 11 23:14:29.634492 np0000002687 nova-compute[98431]: 196608 Jun 11 23:14:29.634492 np0000002687 nova-compute[98431]: 1 Jun 11 23:14:29.634492 np0000002687 nova-compute[98431]: Jun 11 23:14:29.634492 np0000002687 nova-compute[98431]: Jun 11 23:14:29.634492 np0000002687 nova-compute[98431]: Jun 11 23:14:29.634492 np0000002687 nova-compute[98431]: tempest-ServerActionsV293TestJSON-server-1471414698 Jun 11 23:14:29.634492 np0000002687 nova-compute[98431]: 2026-06-11 23:14:25 Jun 11 23:14:29.634492 np0000002687 nova-compute[98431]: Jun 11 23:14:29.634492 np0000002687 nova-compute[98431]: 192 Jun 11 23:14:29.634492 np0000002687 nova-compute[98431]: 1 Jun 11 23:14:29.634492 np0000002687 nova-compute[98431]: 0 Jun 11 23:14:29.634492 np0000002687 nova-compute[98431]: 0 Jun 11 23:14:29.634492 np0000002687 nova-compute[98431]: 1 Jun 11 23:14:29.634492 np0000002687 nova-compute[98431]: Jun 11 23:14:29.634492 np0000002687 nova-compute[98431]: True Jun 11 23:14:29.634492 np0000002687 nova-compute[98431]: Jun 11 23:14:29.634492 np0000002687 nova-compute[98431]: Jun 11 23:14:29.634492 np0000002687 nova-compute[98431]: Jun 11 23:14:29.634492 np0000002687 nova-compute[98431]: 1 Jun 11 23:14:29.634492 np0000002687 nova-compute[98431]: 0 Jun 11 23:14:29.634492 np0000002687 nova-compute[98431]: Jun 11 23:14:29.634492 np0000002687 nova-compute[98431]: virtio Jun 11 23:14:29.634492 np0000002687 nova-compute[98431]: Jun 11 23:14:29.634492 np0000002687 nova-compute[98431]: Jun 11 23:14:29.634492 np0000002687 nova-compute[98431]: Jun 11 23:14:29.634492 np0000002687 nova-compute[98431]: tempest-ServerActionsV293TestJSON-748885515-project-member Jun 11 23:14:29.634492 np0000002687 nova-compute[98431]: tempest-ServerActionsV293TestJSON-748885515 Jun 11 23:14:29.634492 np0000002687 nova-compute[98431]: Jun 11 23:14:29.634492 np0000002687 nova-compute[98431]: Jun 11 23:14:29.634492 np0000002687 nova-compute[98431]: Jun 11 23:14:29.634492 np0000002687 nova-compute[98431]: Jun 11 23:14:29.634492 np0000002687 nova-compute[98431]: Jun 11 23:14:29.634492 np0000002687 nova-compute[98431]: Jun 11 23:14:29.634492 np0000002687 nova-compute[98431]: Jun 11 23:14:29.634492 np0000002687 nova-compute[98431]: Jun 11 23:14:29.634492 np0000002687 nova-compute[98431]: Jun 11 23:14:29.634492 np0000002687 nova-compute[98431]: Jun 11 23:14:29.634492 np0000002687 nova-compute[98431]: Jun 11 23:14:29.634492 np0000002687 nova-compute[98431]: OpenStack Foundation Jun 11 23:14:29.634492 np0000002687 nova-compute[98431]: OpenStack Nova Jun 11 23:14:29.634492 np0000002687 nova-compute[98431]: 33.1.0 Jun 11 23:14:29.634492 np0000002687 nova-compute[98431]: 010aa26e-fb15-47ee-a9b7-089dbfdfd1c7 Jun 11 23:14:29.634492 np0000002687 nova-compute[98431]: 010aa26e-fb15-47ee-a9b7-089dbfdfd1c7 Jun 11 23:14:29.634492 np0000002687 nova-compute[98431]: Virtual Machine Jun 11 23:14:29.634492 np0000002687 nova-compute[98431]: Jun 11 23:14:29.634492 np0000002687 nova-compute[98431]: Jun 11 23:14:29.634492 np0000002687 nova-compute[98431]: Jun 11 23:14:29.634492 np0000002687 nova-compute[98431]: hvm Jun 11 23:14:29.634492 np0000002687 nova-compute[98431]: Jun 11 23:14:29.634492 np0000002687 nova-compute[98431]: Jun 11 23:14:29.634492 np0000002687 nova-compute[98431]: Jun 11 23:14:29.634492 np0000002687 nova-compute[98431]: Jun 11 23:14:29.634492 np0000002687 nova-compute[98431]: Jun 11 23:14:29.634492 np0000002687 nova-compute[98431]: Jun 11 23:14:29.634492 np0000002687 nova-compute[98431]: 128 Jun 11 23:14:29.634492 np0000002687 nova-compute[98431]: Jun 11 23:14:29.634492 np0000002687 nova-compute[98431]: Jun 11 23:14:29.634492 np0000002687 nova-compute[98431]: Jun 11 23:14:29.634492 np0000002687 nova-compute[98431]: 1 Jun 11 23:14:29.634492 np0000002687 nova-compute[98431]: Jun 11 23:14:29.634492 np0000002687 nova-compute[98431]: Jun 11 23:14:29.634492 np0000002687 nova-compute[98431]: Nehalem Jun 11 23:14:29.634492 np0000002687 nova-compute[98431]: Jun 11 23:14:29.634492 np0000002687 nova-compute[98431]: Jun 11 23:14:29.634492 np0000002687 nova-compute[98431]: Jun 11 23:14:29.634492 np0000002687 nova-compute[98431]: Jun 11 23:14:29.634492 np0000002687 nova-compute[98431]: Jun 11 23:14:29.634492 np0000002687 nova-compute[98431]: Jun 11 23:14:29.634492 np0000002687 nova-compute[98431]: Jun 11 23:14:29.634492 np0000002687 nova-compute[98431]: Jun 11 23:14:29.634492 np0000002687 nova-compute[98431]: Jun 11 23:14:29.634492 np0000002687 nova-compute[98431]: Jun 11 23:14:29.634492 np0000002687 nova-compute[98431]: Jun 11 23:14:29.634492 np0000002687 nova-compute[98431]: Jun 11 23:14:29.634492 np0000002687 nova-compute[98431]: Jun 11 23:14:29.634492 np0000002687 nova-compute[98431]: 97bc8780-33f3-43fc-8005-01d53ccb1cd1 Jun 11 23:14:29.634492 np0000002687 nova-compute[98431]: Jun 11 23:14:29.634492 np0000002687 nova-compute[98431]: Jun 11 23:14:29.634492 np0000002687 nova-compute[98431]: Jun 11 23:14:29.634492 np0000002687 nova-compute[98431]: Jun 11 23:14:29.634492 np0000002687 nova-compute[98431]: Jun 11 23:14:29.634492 np0000002687 nova-compute[98431]: Jun 11 23:14:29.634492 np0000002687 nova-compute[98431]: Jun 11 23:14:29.634492 np0000002687 nova-compute[98431]: Jun 11 23:14:29.634492 np0000002687 nova-compute[98431]: Jun 11 23:14:29.634492 np0000002687 nova-compute[98431]: Jun 11 23:14:29.634492 np0000002687 nova-compute[98431]: Jun 11 23:14:29.634492 np0000002687 nova-compute[98431]: Jun 11 23:14:29.634492 np0000002687 nova-compute[98431]: Jun 11 23:14:29.634492 np0000002687 nova-compute[98431]: Jun 11 23:14:29.634492 np0000002687 nova-compute[98431]: /dev/urandom Jun 11 23:14:29.634492 np0000002687 nova-compute[98431]: Jun 11 23:14:29.634492 np0000002687 nova-compute[98431]: Jun 11 23:14:29.634492 np0000002687 nova-compute[98431]: Jun 11 23:14:29.634492 np0000002687 nova-compute[98431]: Jun 11 23:14:29.634492 np0000002687 nova-compute[98431]: Jun 11 23:14:29.634492 np0000002687 nova-compute[98431]: Jun 11 23:14:29.634492 np0000002687 nova-compute[98431]: Jun 11 23:14:29.634492 np0000002687 nova-compute[98431]: {{(pid=98431) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 11 23:14:29.636878 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] [instance: 010aa26e-fb15-47ee-a9b7-089dbfdfd1c7] Preparing to wait for external event network-vif-plugged-75b6f9f6-6287-4fd3-ae85-5f0145c9ecca {{(pid=98431) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 11 23:14:29.636878 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] Acquiring lock "010aa26e-fb15-47ee-a9b7-089dbfdfd1c7-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:14:29.636878 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] Lock "010aa26e-fb15-47ee-a9b7-089dbfdfd1c7-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:14:29.636878 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] Lock "010aa26e-fb15-47ee-a9b7-089dbfdfd1c7-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:14:29.636878 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-11T23:14:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1471414698',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='tempest-serveractionsv293testjson-server-1471414698',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKdUGoO9cuTXJZHu2h25q6vrckGgOLiWeRbl1vP84Rc3f1lHWmXgff8p6BaYIh4+tSsnr7LRQTn7Zdhe47kpCDz5cfnYlNWR8SMBDDSyTc1K7cQyl9CNKh4PSTwXCJAaHw==',key_name='tempest-keypair-1991391740',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dbca65bf08474994b1c22f42047c7cbc',ramdisk_id='',reservation_id='r-wck7um1h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-748885515',owner_user_name='tempest-ServerActionsV293TestJSON-748885515-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-11T23:14:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6fa2c504358c4aa3bb219d75150b1bdf',uuid=010aa26e-fb15-47ee-a9b7-089dbfdfd1c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "75b6f9f6-6287-4fd3-ae85-5f0145c9ecca", "address": "fa:16:3e:03:1c:0a", "network": {"id": "05459848-a1d6-43f2-934a-5abedf048534", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-501623705-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dbca65bf08474994b1c22f42047c7cbc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap75b6f9f6-62", "ovs_interfaceid": "75b6f9f6-6287-4fd3-ae85-5f0145c9ecca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 11 23:14:29.636878 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] Converting VIF {"id": "75b6f9f6-6287-4fd3-ae85-5f0145c9ecca", "address": "fa:16:3e:03:1c:0a", "network": {"id": "05459848-a1d6-43f2-934a-5abedf048534", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-501623705-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dbca65bf08474994b1c22f42047c7cbc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap75b6f9f6-62", "ovs_interfaceid": "75b6f9f6-6287-4fd3-ae85-5f0145c9ecca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:14:29.636878 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:1c:0a,bridge_name='br-int',has_traffic_filtering=True,id=75b6f9f6-6287-4fd3-ae85-5f0145c9ecca,network=Network(05459848-a1d6-43f2-934a-5abedf048534),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75b6f9f6-62') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:14:29.636878 np0000002687 nova-compute[98431]: DEBUG os_vif [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:1c:0a,bridge_name='br-int',has_traffic_filtering=True,id=75b6f9f6-6287-4fd3-ae85-5f0145c9ecca,network=Network(05459848-a1d6-43f2-934a-5abedf048534),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75b6f9f6-62') {{(pid=98431) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 11 23:14:29.639118 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:29.639118 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:14:29.639118 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 11 23:14:29.641266 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:29.641266 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '49a490de-0f5c-536d-96b1-a80ec075ffbc', '_type': 'linux-noop'}}, row=False) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:14:29.642585 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:14:29.648775 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:29.652458 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:29.652458 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap75b6f9f6-62, may_exist=True, interface_attrs={}) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:14:29.653048 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap75b6f9f6-62, col_values=(('qos', UUID('f87dcfd9-9dee-4b8d-9a1f-a33c5a0433ef')),), if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:14:29.653393 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap75b6f9f6-62, col_values=(('external_ids', {'iface-id': '75b6f9f6-6287-4fd3-ae85-5f0145c9ecca', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:03:1c:0a', 'vm-uuid': '010aa26e-fb15-47ee-a9b7-089dbfdfd1c7'}),), if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:14:29.655820 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:29.656308 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:14:29.667519 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:29.669059 np0000002687 nova-compute[98431]: INFO os_vif [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:1c:0a,bridge_name='br-int',has_traffic_filtering=True,id=75b6f9f6-6287-4fd3-ae85-5f0145c9ecca,network=Network(05459848-a1d6-43f2-934a-5abedf048534),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75b6f9f6-62') Jun 11 23:14:29.872275 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-906eaf40-a185-4ac7-8524-7ef2f96dda79 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] [instance: 14cc8d05-e33d-434f-b2b3-0dad3b613e73] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 11 23:14:30.099896 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-906eaf40-a185-4ac7-8524-7ef2f96dda79 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] [instance: 14cc8d05-e33d-434f-b2b3-0dad3b613e73] Successfully created port: 64bb5344-fa8f-436b-8c25-3dd5df49e17f {{(pid=98431) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 11 23:14:30.377365 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-906eaf40-a185-4ac7-8524-7ef2f96dda79 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] [instance: 14cc8d05-e33d-434f-b2b3-0dad3b613e73] Start building block device mappings for instance. {{(pid=98431) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 11 23:14:30.665975 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] No BDM found with device name vda, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:14:30.665975 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] No BDM found with device name hda, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:14:30.665975 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] No VIF found with MAC fa:16:3e:f6:b5:ae, not building metadata {{(pid=98431) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13199}} Jun 11 23:14:30.665975 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: c9271160-14ef-4a59-8ac8-89efbe36c607] Using config drive Jun 11 23:14:30.742967 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98431) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 11 23:14:30.743237 np0000002687 nova-compute[98431]: DEBUG nova.compute.provider_tree [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] Inventory has not changed in ProviderTree for provider: e3e65fe2-9de9-4821-8b4a-ccae37c66e25 {{(pid=98431) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 11 23:14:30.807615 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-906eaf40-a185-4ac7-8524-7ef2f96dda79 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] [instance: 14cc8d05-e33d-434f-b2b3-0dad3b613e73] Successfully updated port: 64bb5344-fa8f-436b-8c25-3dd5df49e17f {{(pid=98431) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 11 23:14:30.853037 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-aa79bca2-4635-4e13-9239-121c5cbd7a91 req-a48d1d50-cd76-4243-a6a7-c7807d2f5b66 service nova] [instance: 14cc8d05-e33d-434f-b2b3-0dad3b613e73] Received event network-changed-64bb5344-fa8f-436b-8c25-3dd5df49e17f {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:14:30.853180 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-aa79bca2-4635-4e13-9239-121c5cbd7a91 req-a48d1d50-cd76-4243-a6a7-c7807d2f5b66 service nova] [instance: 14cc8d05-e33d-434f-b2b3-0dad3b613e73] Refreshing instance network info cache due to event network-changed-64bb5344-fa8f-436b-8c25-3dd5df49e17f. {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 11 23:14:30.853312 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-aa79bca2-4635-4e13-9239-121c5cbd7a91 req-a48d1d50-cd76-4243-a6a7-c7807d2f5b66 service nova] Acquiring lock "refresh_cache-14cc8d05-e33d-434f-b2b3-0dad3b613e73" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 11 23:14:30.853442 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-aa79bca2-4635-4e13-9239-121c5cbd7a91 req-a48d1d50-cd76-4243-a6a7-c7807d2f5b66 service nova] Acquired lock "refresh_cache-14cc8d05-e33d-434f-b2b3-0dad3b613e73" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 11 23:14:30.853552 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-aa79bca2-4635-4e13-9239-121c5cbd7a91 req-a48d1d50-cd76-4243-a6a7-c7807d2f5b66 service nova] [instance: 14cc8d05-e33d-434f-b2b3-0dad3b613e73] Refreshing network info cache for port 64bb5344-fa8f-436b-8c25-3dd5df49e17f {{(pid=98431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 11 23:14:31.174057 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:14:31.199652 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] No BDM found with device name hda, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:14:31.199856 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] No BDM found with device name vda, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:14:31.199988 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] No VIF found with MAC fa:16:3e:03:1c:0a, not building metadata {{(pid=98431) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13199}} Jun 11 23:14:31.200529 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] [instance: 010aa26e-fb15-47ee-a9b7-089dbfdfd1c7] Using config drive Jun 11 23:14:31.247987 np0000002687 nova-compute[98431]: DEBUG nova.scheduler.client.report [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] Inventory has not changed for provider e3e65fe2-9de9-4821-8b4a-ccae37c66e25 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98431) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 11 23:14:31.310363 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-906eaf40-a185-4ac7-8524-7ef2f96dda79 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Acquiring lock "refresh_cache-14cc8d05-e33d-434f-b2b3-0dad3b613e73" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 11 23:14:31.343311 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: c9271160-14ef-4a59-8ac8-89efbe36c607] Creating config drive at /opt/stack/data/nova/instances/c9271160-14ef-4a59-8ac8-89efbe36c607/disk.config Jun 11 23:14:31.346963 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/c9271160-14ef-4a59-8ac8-89efbe36c607/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpd771sxbh {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:14:31.360032 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [req-aa79bca2-4635-4e13-9239-121c5cbd7a91 req-a48d1d50-cd76-4243-a6a7-c7807d2f5b66 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:14:31.387921 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-906eaf40-a185-4ac7-8524-7ef2f96dda79 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] [instance: 14cc8d05-e33d-434f-b2b3-0dad3b613e73] Start spawning the instance on the hypervisor. {{(pid=98431) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 11 23:14:31.388836 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-906eaf40-a185-4ac7-8524-7ef2f96dda79 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] [instance: 14cc8d05-e33d-434f-b2b3-0dad3b613e73] Creating instance directory {{(pid=98431) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}} Jun 11 23:14:31.389508 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-906eaf40-a185-4ac7-8524-7ef2f96dda79 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] [instance: 14cc8d05-e33d-434f-b2b3-0dad3b613e73] Creating image(s) Jun 11 23:14:31.390213 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-906eaf40-a185-4ac7-8524-7ef2f96dda79 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Acquiring lock "/opt/stack/data/nova/instances/14cc8d05-e33d-434f-b2b3-0dad3b613e73/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:14:31.390467 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-906eaf40-a185-4ac7-8524-7ef2f96dda79 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Lock "/opt/stack/data/nova/instances/14cc8d05-e33d-434f-b2b3-0dad3b613e73/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:14:31.391067 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-906eaf40-a185-4ac7-8524-7ef2f96dda79 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Lock "/opt/stack/data/nova/instances/14cc8d05-e33d-434f-b2b3-0dad3b613e73/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:14:31.391889 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-906eaf40-a185-4ac7-8524-7ef2f96dda79 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:14:31.396365 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-906eaf40-a185-4ac7-8524-7ef2f96dda79 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:14:31.397506 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-906eaf40-a185-4ac7-8524-7ef2f96dda79 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:14:31.420820 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/c9271160-14ef-4a59-8ac8-89efbe36c607/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpd771sxbh" returned: 0 in 0.072s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:14:31.481590 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-aa79bca2-4635-4e13-9239-121c5cbd7a91 req-a48d1d50-cd76-4243-a6a7-c7807d2f5b66 service nova] [instance: 14cc8d05-e33d-434f-b2b3-0dad3b613e73] Instance cache missing network info. {{(pid=98431) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 11 23:14:31.495311 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-906eaf40-a185-4ac7-8524-7ef2f96dda79 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json" returned: 0 in 0.098s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:14:31.496007 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-906eaf40-a185-4ac7-8524-7ef2f96dda79 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Acquiring lock "d2c441059b2992961b5de03c05b32d04aff77cb1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:14:31.498063 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-906eaf40-a185-4ac7-8524-7ef2f96dda79 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Lock "d2c441059b2992961b5de03c05b32d04aff77cb1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.002s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:14:31.498714 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-906eaf40-a185-4ac7-8524-7ef2f96dda79 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:14:31.503030 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-906eaf40-a185-4ac7-8524-7ef2f96dda79 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:14:31.503350 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-906eaf40-a185-4ac7-8524-7ef2f96dda79 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:14:31.615977 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-906eaf40-a185-4ac7-8524-7ef2f96dda79 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json" returned: 0 in 0.111s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:14:31.615977 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-906eaf40-a185-4ac7-8524-7ef2f96dda79 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1,backing_fmt=raw /opt/stack/data/nova/instances/14cc8d05-e33d-434f-b2b3-0dad3b613e73/disk 1073741824 {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:14:31.683010 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-906eaf40-a185-4ac7-8524-7ef2f96dda79 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1,backing_fmt=raw /opt/stack/data/nova/instances/14cc8d05-e33d-434f-b2b3-0dad3b613e73/disk 1073741824" returned: 0 in 0.068s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:14:31.683453 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-906eaf40-a185-4ac7-8524-7ef2f96dda79 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Lock "d2c441059b2992961b5de03c05b32d04aff77cb1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.186s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:14:31.683867 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-906eaf40-a185-4ac7-8524-7ef2f96dda79 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:14:31.727697 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:14:31.732672 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-aa79bca2-4635-4e13-9239-121c5cbd7a91 req-a48d1d50-cd76-4243-a6a7-c7807d2f5b66 service nova] [instance: 14cc8d05-e33d-434f-b2b3-0dad3b613e73] Updating instance_info_cache with network_info: [] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:14:31.756286 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.893s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:14:31.756651 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] [instance: cab1cc43-b433-4772-9f01-0197502c8b57] Start building networks asynchronously for instance. {{(pid=98431) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 11 23:14:31.781843 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-906eaf40-a185-4ac7-8524-7ef2f96dda79 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json" returned: 0 in 0.095s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:14:31.781843 np0000002687 nova-compute[98431]: DEBUG nova.virt.disk.api [None req-906eaf40-a185-4ac7-8524-7ef2f96dda79 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Checking if we can resize image /opt/stack/data/nova/instances/14cc8d05-e33d-434f-b2b3-0dad3b613e73/disk. size=1073741824 {{(pid=98431) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 11 23:14:31.781843 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-906eaf40-a185-4ac7-8524-7ef2f96dda79 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14cc8d05-e33d-434f-b2b3-0dad3b613e73/disk --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:14:31.884731 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-906eaf40-a185-4ac7-8524-7ef2f96dda79 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14cc8d05-e33d-434f-b2b3-0dad3b613e73/disk --force-share --output=json" returned: 0 in 0.104s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:14:31.885250 np0000002687 nova-compute[98431]: DEBUG nova.virt.disk.api [None req-906eaf40-a185-4ac7-8524-7ef2f96dda79 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Cannot resize image /opt/stack/data/nova/instances/14cc8d05-e33d-434f-b2b3-0dad3b613e73/disk to a smaller size. {{(pid=98431) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 11 23:14:31.885792 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-906eaf40-a185-4ac7-8524-7ef2f96dda79 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] [instance: 14cc8d05-e33d-434f-b2b3-0dad3b613e73] Created local disks {{(pid=98431) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}} Jun 11 23:14:31.886081 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-906eaf40-a185-4ac7-8524-7ef2f96dda79 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] [instance: 14cc8d05-e33d-434f-b2b3-0dad3b613e73] Ensure instance console log exists: /opt/stack/data/nova/instances/14cc8d05-e33d-434f-b2b3-0dad3b613e73/console.log {{(pid=98431) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}} Jun 11 23:14:31.887920 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-906eaf40-a185-4ac7-8524-7ef2f96dda79 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:14:31.888247 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-906eaf40-a185-4ac7-8524-7ef2f96dda79 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:14:31.888768 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-906eaf40-a185-4ac7-8524-7ef2f96dda79 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:14:31.935717 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] [instance: 010aa26e-fb15-47ee-a9b7-089dbfdfd1c7] Creating config drive at /opt/stack/data/nova/instances/010aa26e-fb15-47ee-a9b7-089dbfdfd1c7/disk.config Jun 11 23:14:31.936893 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:31.942964 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/010aa26e-fb15-47ee-a9b7-089dbfdfd1c7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpgz7xyuba {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:14:31.978297 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:31.979185 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:32.005343 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/010aa26e-fb15-47ee-a9b7-089dbfdfd1c7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpgz7xyuba" returned: 0 in 0.062s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:14:32.068345 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:32.132756 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:32.138774 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:32.235997 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-aa79bca2-4635-4e13-9239-121c5cbd7a91 req-a48d1d50-cd76-4243-a6a7-c7807d2f5b66 service nova] Releasing lock "refresh_cache-14cc8d05-e33d-434f-b2b3-0dad3b613e73" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 11 23:14:32.237413 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-906eaf40-a185-4ac7-8524-7ef2f96dda79 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Acquired lock "refresh_cache-14cc8d05-e33d-434f-b2b3-0dad3b613e73" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 11 23:14:32.237612 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-906eaf40-a185-4ac7-8524-7ef2f96dda79 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] [instance: 14cc8d05-e33d-434f-b2b3-0dad3b613e73] Building network info cache for instance {{(pid=98431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 11 23:14:32.263269 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] [instance: cab1cc43-b433-4772-9f01-0197502c8b57] Allocating IP information in the background. {{(pid=98431) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 11 23:14:32.263538 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] [instance: cab1cc43-b433-4772-9f01-0197502c8b57] allocate_for_instance() {{(pid=98431) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 11 23:14:32.264088 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:14:32.266873 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:14:32.463758 np0000002687 nova-compute[98431]: DEBUG nova.policy [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd1bfc36c83e84cfbac05bd2daacaf580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4028976d11d4dfdb2a6f8637d28c73d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98431) authorize /opt/stack/nova/nova/policy.py:192}} Jun 11 23:14:32.569310 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:32.598296 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:32.724244 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:32.774157 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] [instance: cab1cc43-b433-4772-9f01-0197502c8b57] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 11 23:14:32.938933 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:33.022495 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-f919aefc-f757-48de-9ec8-416bef09bc9b req-6b896a4e-3a13-4d47-8ceb-1e5789bc5612 service nova] [instance: c9271160-14ef-4a59-8ac8-89efbe36c607] Received event network-vif-plugged-189a71e3-b1fd-4769-a6a6-4a9be0352962 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:14:33.022495 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-f919aefc-f757-48de-9ec8-416bef09bc9b req-6b896a4e-3a13-4d47-8ceb-1e5789bc5612 service nova] Acquiring lock "c9271160-14ef-4a59-8ac8-89efbe36c607-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:14:33.022495 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-f919aefc-f757-48de-9ec8-416bef09bc9b req-6b896a4e-3a13-4d47-8ceb-1e5789bc5612 service nova] Lock "c9271160-14ef-4a59-8ac8-89efbe36c607-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:14:33.022495 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-f919aefc-f757-48de-9ec8-416bef09bc9b req-6b896a4e-3a13-4d47-8ceb-1e5789bc5612 service nova] Lock "c9271160-14ef-4a59-8ac8-89efbe36c607-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:14:33.022495 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-f919aefc-f757-48de-9ec8-416bef09bc9b req-6b896a4e-3a13-4d47-8ceb-1e5789bc5612 service nova] [instance: c9271160-14ef-4a59-8ac8-89efbe36c607] Processing event network-vif-plugged-189a71e3-b1fd-4769-a6a6-4a9be0352962 {{(pid=98431) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 11 23:14:33.022495 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-f919aefc-f757-48de-9ec8-416bef09bc9b req-6b896a4e-3a13-4d47-8ceb-1e5789bc5612 service nova] [instance: c9271160-14ef-4a59-8ac8-89efbe36c607] Received event network-vif-plugged-189a71e3-b1fd-4769-a6a6-4a9be0352962 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:14:33.022495 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-f919aefc-f757-48de-9ec8-416bef09bc9b req-6b896a4e-3a13-4d47-8ceb-1e5789bc5612 service nova] Acquiring lock "c9271160-14ef-4a59-8ac8-89efbe36c607-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:14:33.023698 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-f919aefc-f757-48de-9ec8-416bef09bc9b req-6b896a4e-3a13-4d47-8ceb-1e5789bc5612 service nova] Lock "c9271160-14ef-4a59-8ac8-89efbe36c607-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:14:33.024195 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-f919aefc-f757-48de-9ec8-416bef09bc9b req-6b896a4e-3a13-4d47-8ceb-1e5789bc5612 service nova] Lock "c9271160-14ef-4a59-8ac8-89efbe36c607-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:14:33.024434 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-f919aefc-f757-48de-9ec8-416bef09bc9b req-6b896a4e-3a13-4d47-8ceb-1e5789bc5612 service nova] [instance: c9271160-14ef-4a59-8ac8-89efbe36c607] No waiting events found dispatching network-vif-plugged-189a71e3-b1fd-4769-a6a6-4a9be0352962 {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:14:33.024908 np0000002687 nova-compute[98431]: WARNING nova.compute.manager [req-f919aefc-f757-48de-9ec8-416bef09bc9b req-6b896a4e-3a13-4d47-8ceb-1e5789bc5612 service nova] [instance: c9271160-14ef-4a59-8ac8-89efbe36c607] Received unexpected event network-vif-plugged-189a71e3-b1fd-4769-a6a6-4a9be0352962 for instance with vm_state building and task_state spawning. Jun 11 23:14:33.042091 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-906eaf40-a185-4ac7-8524-7ef2f96dda79 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] [instance: 14cc8d05-e33d-434f-b2b3-0dad3b613e73] Instance cache missing network info. {{(pid=98431) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 11 23:14:33.099421 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:33.103135 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:33.106083 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:33.139845 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:33.278502 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] [instance: cab1cc43-b433-4772-9f01-0197502c8b57] Start building block device mappings for instance. {{(pid=98431) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 11 23:14:33.321906 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-906eaf40-a185-4ac7-8524-7ef2f96dda79 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:14:33.529554 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-906eaf40-a185-4ac7-8524-7ef2f96dda79 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] [instance: 14cc8d05-e33d-434f-b2b3-0dad3b613e73] Updating instance_info_cache with network_info: [{"id": "64bb5344-fa8f-436b-8c25-3dd5df49e17f", "address": "fa:16:3e:c5:71:0e", "network": {"id": "64de9d21-9a16-433f-b6db-fd642b6ec307", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1640869818-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1922540076a94ee5ba369d79869aaa95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap64bb5344-fa", "ovs_interfaceid": "64bb5344-fa8f-436b-8c25-3dd5df49e17f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:14:33.686652 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Emitting event Started> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:14:33.687504 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: c9271160-14ef-4a59-8ac8-89efbe36c607] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98431) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 11 23:14:33.688721 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: c9271160-14ef-4a59-8ac8-89efbe36c607] VM Started (Lifecycle Event) Jun 11 23:14:33.692186 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: c9271160-14ef-4a59-8ac8-89efbe36c607] Guest created on hypervisor {{(pid=98431) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}} Jun 11 23:14:33.694637 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [-] [instance: c9271160-14ef-4a59-8ac8-89efbe36c607] Instance spawned successfully. Jun 11 23:14:33.696341 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: c9271160-14ef-4a59-8ac8-89efbe36c607] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 11 23:14:33.786421 np0000002687 nova-compute[98431]: INFO nova.virt.block_device [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] [instance: cab1cc43-b433-4772-9f01-0197502c8b57] Booting with volume f7e59f73-fc24-4ce4-8dd2-08f2f6948647 at /dev/vda Jun 11 23:14:33.852280 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.209', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000002687', 'execute': None}" {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 11 23:14:33.862741 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] [instance: cab1cc43-b433-4772-9f01-0197502c8b57] Successfully created port: 807d693f-6c88-415d-8c16-1187f9dd28c2 {{(pid=98431) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 11 23:14:33.873131 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.scaleio [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98431) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 11 23:14:33.902008 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] Running cmd (subprocess): nvme version {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:14:33.945770 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] 'nvme version' failed. Not Retrying. {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 11 23:14:33.949707 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] nvme not present on system {{(pid=98431) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 11 23:14:33.962177 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.lightos [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98431) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 11 23:14:33.965863 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.lightos [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] Current host hostNQN and IP(s) are ['10.4.3.209', 'fe80::f816:3eff:fea3:3707', '192.168.40.6', 'fe80::f816:3eff:fe06:bdab', '192.168.50.6', 'fe80::f816:3eff:fe7a:46f2', '192.168.10.6', 'fe80::f816:3eff:fe13:793b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::38fa:21ff:fe6c:3746', 'fe80::fc16:3eff:fe77:488d', 'fe80::9469:f2ff:feae:5824', 'fe80::fc16:3eff:fec7:336a', 'fe80::fc16:3eff:fe61:b7fd', 'fe80::fc16:3eff:fe6f:4242', 'fe80::38dc:c1ff:fee9:4731', 'fe80::fc16:3eff:feb1:9e6a', 'fe80::fc16:3eff:feca:170a', 'fe80::38da:b9ff:fe6f:c47f', 'fe80::fc16:3eff:fe37:3568', 'fe80::fc16:3eff:fe12:f4f7', 'fe80::fc16:3eff:fe7e:140b', 'fe80::fc16:3eff:feee:d251', 'fe80::fc16:3eff:fe5d:12c5', 'fe80::f07e:ffff:fef1:a8c0', 'fe80::4c8e:e4ff:feff:6e14', 'fe80::fc16:3eff:fec2:8da4', 'fe80::fc16:3eff:fe4b:2695', 'fe80::fc16:3eff:fe2b:91a7', 'fe80::fc16:3eff:fe6c:78be', 'fe80::d82a:87ff:fe65:391e', 'fe80::fc16:3eff:fef6:b5ae', 'fe80::fc16:3eff:fe03:1c0a', 'fe80::f090:d9ff:fe35:5216'] Jun 11 23:14:33.966044 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.lightos [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98431) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 11 23:14:33.966169 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.lightos [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] LIGHTOS: no hostnqn found. {{(pid=98431) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 11 23:14:33.966416 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] <== get_connector_properties: return (104ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.209', 'host': 'np0000002687', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:798b370f1cc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad465dfe-0ed1-4637-98c3-ddaebebd61a4', 'nvme_native_multipath': False} {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 11 23:14:33.966652 np0000002687 nova-compute[98431]: DEBUG nova.virt.block_device [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] [instance: cab1cc43-b433-4772-9f01-0197502c8b57] Updating existing volume attachment record: 11288ed0-4b7a-4bd3-925e-f795d1bede6c {{(pid=98431) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 11 23:14:34.033083 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-906eaf40-a185-4ac7-8524-7ef2f96dda79 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Releasing lock "refresh_cache-14cc8d05-e33d-434f-b2b3-0dad3b613e73" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 11 23:14:34.034900 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-906eaf40-a185-4ac7-8524-7ef2f96dda79 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] [instance: 14cc8d05-e33d-434f-b2b3-0dad3b613e73] Instance network_info: |[{"id": "64bb5344-fa8f-436b-8c25-3dd5df49e17f", "address": "fa:16:3e:c5:71:0e", "network": {"id": "64de9d21-9a16-433f-b6db-fd642b6ec307", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1640869818-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1922540076a94ee5ba369d79869aaa95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap64bb5344-fa", "ovs_interfaceid": "64bb5344-fa8f-436b-8c25-3dd5df49e17f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98431) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 11 23:14:34.036147 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-906eaf40-a185-4ac7-8524-7ef2f96dda79 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] [instance: 14cc8d05-e33d-434f-b2b3-0dad3b613e73] Start _get_guest_xml network_info=[{"id": "64bb5344-fa8f-436b-8c25-3dd5df49e17f", "address": "fa:16:3e:c5:71:0e", "network": {"id": "64de9d21-9a16-433f-b6db-fd642b6ec307", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1640869818-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1922540076a94ee5ba369d79869aaa95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap64bb5344-fa", "ovs_interfaceid": "64bb5344-fa8f-436b-8c25-3dd5df49e17f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-11T23:08:20Z,direct_url=,disk_format='qcow2',id=f30640f8-7aca-4300-a085-4706a5209a79,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ce012f9fabdb4ee5a73e212437f59d97',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-11T23:08:23Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'image_id': 'f30640f8-7aca-4300-a085-4706a5209a79'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98431) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 11 23:14:34.040510 np0000002687 nova-compute[98431]: WARNING nova.virt.libvirt.driver [None req-906eaf40-a185-4ac7-8524-7ef2f96dda79 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 11 23:14:34.042751 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-906eaf40-a185-4ac7-8524-7ef2f96dda79 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='f30640f8-7aca-4300-a085-4706a5209a79', instance_meta=NovaInstanceMeta(name='tempest-VolumesActionsTest-instance-120229851', uuid='14cc8d05-e33d-434f-b2b3-0dad3b613e73'), owner=OwnerMeta(userid='5b929fda768d45738790181d6b49a3be', username='tempest-VolumesActionsTest-1703782237-project-member', projectid='1922540076a94ee5ba369d79869aaa95', projectname='tempest-VolumesActionsTest-1703782237'), image=ImageMeta(id='f30640f8-7aca-4300-a085-4706a5209a79', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "64bb5344-fa8f-436b-8c25-3dd5df49e17f", "address": "fa:16:3e:c5:71:0e", "network": {"id": "64de9d21-9a16-433f-b6db-fd642b6ec307", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1640869818-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1922540076a94ee5ba369d79869aaa95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap64bb5344-fa", "ovs_interfaceid": "64bb5344-fa8f-436b-8c25-3dd5df49e17f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1781219674.0418568) {{(pid=98431) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 11 23:14:34.044680 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-906eaf40-a185-4ac7-8524-7ef2f96dda79 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Searching host: 'np0000002687' for CPU controller through CGroups V1... {{(pid=98431) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 11 23:14:34.045237 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-906eaf40-a185-4ac7-8524-7ef2f96dda79 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] CPU controller missing on host. {{(pid=98431) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 11 23:14:34.046422 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-906eaf40-a185-4ac7-8524-7ef2f96dda79 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Searching host: 'np0000002687' for CPU controller through CGroups V2... {{(pid=98431) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 11 23:14:34.046684 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-906eaf40-a185-4ac7-8524-7ef2f96dda79 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] CPU controller found on host. {{(pid=98431) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 11 23:14:34.048691 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-906eaf40-a185-4ac7-8524-7ef2f96dda79 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98431) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 11 23:14:34.048691 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-906eaf40-a185-4ac7-8524-7ef2f96dda79 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-11T23:08:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-11T23:08:20Z,direct_url=,disk_format='qcow2',id=f30640f8-7aca-4300-a085-4706a5209a79,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ce012f9fabdb4ee5a73e212437f59d97',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-11T23:08:23Z,virtual_size=,visibility=), allow threads: True {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 11 23:14:34.048968 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-906eaf40-a185-4ac7-8524-7ef2f96dda79 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Flavor limits 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 11 23:14:34.049066 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-906eaf40-a185-4ac7-8524-7ef2f96dda79 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Image limits 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 11 23:14:34.049380 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-906eaf40-a185-4ac7-8524-7ef2f96dda79 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Flavor pref 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 11 23:14:34.049419 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-906eaf40-a185-4ac7-8524-7ef2f96dda79 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Image pref 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 11 23:14:34.049551 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-906eaf40-a185-4ac7-8524-7ef2f96dda79 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 11 23:14:34.050023 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-906eaf40-a185-4ac7-8524-7ef2f96dda79 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 11 23:14:34.050023 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-906eaf40-a185-4ac7-8524-7ef2f96dda79 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98431) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 11 23:14:34.050068 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-906eaf40-a185-4ac7-8524-7ef2f96dda79 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Got 1 possible topologies {{(pid=98431) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 11 23:14:34.050225 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-906eaf40-a185-4ac7-8524-7ef2f96dda79 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 11 23:14:34.050379 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-906eaf40-a185-4ac7-8524-7ef2f96dda79 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 11 23:14:34.069858 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-906eaf40-a185-4ac7-8524-7ef2f96dda79 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-11T23:14:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-120229851',display_name='tempest-VolumesActionsTest-instance-120229851',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='tempest-volumesactionstest-instance-120229851',id=25,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1922540076a94ee5ba369d79869aaa95',ramdisk_id='',reservation_id='r-64ukdjk6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1703782237',owner_user_name='tempest-VolumesActionsTest-1703782237-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-11T23:14:30Z,user_data=None,user_id='5b929fda768d45738790181d6b49a3be',uuid=14cc8d05-e33d-434f-b2b3-0dad3b613e73,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "64bb5344-fa8f-436b-8c25-3dd5df49e17f", "address": "fa:16:3e:c5:71:0e", "network": {"id": "64de9d21-9a16-433f-b6db-fd642b6ec307", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1640869818-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1922540076a94ee5ba369d79869aaa95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap64bb5344-fa", "ovs_interfaceid": "64bb5344-fa8f-436b-8c25-3dd5df49e17f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98431) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 11 23:14:34.070125 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-906eaf40-a185-4ac7-8524-7ef2f96dda79 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Converting VIF {"id": "64bb5344-fa8f-436b-8c25-3dd5df49e17f", "address": "fa:16:3e:c5:71:0e", "network": {"id": "64de9d21-9a16-433f-b6db-fd642b6ec307", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1640869818-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1922540076a94ee5ba369d79869aaa95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap64bb5344-fa", "ovs_interfaceid": "64bb5344-fa8f-436b-8c25-3dd5df49e17f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:14:34.070750 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-906eaf40-a185-4ac7-8524-7ef2f96dda79 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:71:0e,bridge_name='br-int',has_traffic_filtering=True,id=64bb5344-fa8f-436b-8c25-3dd5df49e17f,network=Network(64de9d21-9a16-433f-b6db-fd642b6ec307),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64bb5344-fa') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:14:34.072015 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-906eaf40-a185-4ac7-8524-7ef2f96dda79 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Lazy-loading 'pci_devices' on Instance uuid 14cc8d05-e33d-434f-b2b3-0dad3b613e73 {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:14:34.194198 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: c9271160-14ef-4a59-8ac8-89efbe36c607] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:14:34.202156 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: c9271160-14ef-4a59-8ac8-89efbe36c607] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98431) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 11 23:14:34.205198 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: c9271160-14ef-4a59-8ac8-89efbe36c607] Found default for hw_cdrom_bus of ide {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:14:34.205389 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: c9271160-14ef-4a59-8ac8-89efbe36c607] Found default for hw_disk_bus of virtio {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:14:34.207852 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: c9271160-14ef-4a59-8ac8-89efbe36c607] Found default for hw_input_bus of None {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:14:34.207852 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: c9271160-14ef-4a59-8ac8-89efbe36c607] Found default for hw_pointer_model of None {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:14:34.207852 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: c9271160-14ef-4a59-8ac8-89efbe36c607] Found default for hw_video_model of virtio {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:14:34.207852 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: c9271160-14ef-4a59-8ac8-89efbe36c607] Found default for hw_vif_model of virtio {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:14:34.529371 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] [instance: cab1cc43-b433-4772-9f01-0197502c8b57] Successfully updated port: 807d693f-6c88-415d-8c16-1187f9dd28c2 {{(pid=98431) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 11 23:14:34.575092 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-906eaf40-a185-4ac7-8524-7ef2f96dda79 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] [instance: 14cc8d05-e33d-434f-b2b3-0dad3b613e73] End _get_guest_xml xml= Jun 11 23:14:34.575092 np0000002687 nova-compute[98431]: 14cc8d05-e33d-434f-b2b3-0dad3b613e73 Jun 11 23:14:34.575092 np0000002687 nova-compute[98431]: instance-00000019 Jun 11 23:14:34.575092 np0000002687 nova-compute[98431]: 196608 Jun 11 23:14:34.575092 np0000002687 nova-compute[98431]: 1 Jun 11 23:14:34.575092 np0000002687 nova-compute[98431]: Jun 11 23:14:34.575092 np0000002687 nova-compute[98431]: Jun 11 23:14:34.575092 np0000002687 nova-compute[98431]: Jun 11 23:14:34.575092 np0000002687 nova-compute[98431]: tempest-VolumesActionsTest-instance-120229851 Jun 11 23:14:34.575092 np0000002687 nova-compute[98431]: 2026-06-11 23:14:34 Jun 11 23:14:34.575092 np0000002687 nova-compute[98431]: Jun 11 23:14:34.575092 np0000002687 nova-compute[98431]: 192 Jun 11 23:14:34.575092 np0000002687 nova-compute[98431]: 1 Jun 11 23:14:34.575092 np0000002687 nova-compute[98431]: 0 Jun 11 23:14:34.575092 np0000002687 nova-compute[98431]: 0 Jun 11 23:14:34.575092 np0000002687 nova-compute[98431]: 1 Jun 11 23:14:34.575092 np0000002687 nova-compute[98431]: Jun 11 23:14:34.575092 np0000002687 nova-compute[98431]: True Jun 11 23:14:34.575092 np0000002687 nova-compute[98431]: Jun 11 23:14:34.575092 np0000002687 nova-compute[98431]: Jun 11 23:14:34.575092 np0000002687 nova-compute[98431]: Jun 11 23:14:34.575092 np0000002687 nova-compute[98431]: bare Jun 11 23:14:34.575092 np0000002687 nova-compute[98431]: qcow2 Jun 11 23:14:34.575092 np0000002687 nova-compute[98431]: 1 Jun 11 23:14:34.575092 np0000002687 nova-compute[98431]: 0 Jun 11 23:14:34.575092 np0000002687 nova-compute[98431]: Jun 11 23:14:34.575092 np0000002687 nova-compute[98431]: virtio Jun 11 23:14:34.575092 np0000002687 nova-compute[98431]: Jun 11 23:14:34.575092 np0000002687 nova-compute[98431]: Jun 11 23:14:34.575092 np0000002687 nova-compute[98431]: Jun 11 23:14:34.575092 np0000002687 nova-compute[98431]: tempest-VolumesActionsTest-1703782237-project-member Jun 11 23:14:34.575092 np0000002687 nova-compute[98431]: tempest-VolumesActionsTest-1703782237 Jun 11 23:14:34.575092 np0000002687 nova-compute[98431]: Jun 11 23:14:34.575092 np0000002687 nova-compute[98431]: Jun 11 23:14:34.575092 np0000002687 nova-compute[98431]: Jun 11 23:14:34.575092 np0000002687 nova-compute[98431]: Jun 11 23:14:34.575092 np0000002687 nova-compute[98431]: Jun 11 23:14:34.575092 np0000002687 nova-compute[98431]: Jun 11 23:14:34.575092 np0000002687 nova-compute[98431]: Jun 11 23:14:34.575092 np0000002687 nova-compute[98431]: Jun 11 23:14:34.575092 np0000002687 nova-compute[98431]: Jun 11 23:14:34.575092 np0000002687 nova-compute[98431]: Jun 11 23:14:34.575092 np0000002687 nova-compute[98431]: Jun 11 23:14:34.575092 np0000002687 nova-compute[98431]: OpenStack Foundation Jun 11 23:14:34.575092 np0000002687 nova-compute[98431]: OpenStack Nova Jun 11 23:14:34.575092 np0000002687 nova-compute[98431]: 33.1.0 Jun 11 23:14:34.575092 np0000002687 nova-compute[98431]: 14cc8d05-e33d-434f-b2b3-0dad3b613e73 Jun 11 23:14:34.575092 np0000002687 nova-compute[98431]: 14cc8d05-e33d-434f-b2b3-0dad3b613e73 Jun 11 23:14:34.575092 np0000002687 nova-compute[98431]: Virtual Machine Jun 11 23:14:34.575092 np0000002687 nova-compute[98431]: Jun 11 23:14:34.575092 np0000002687 nova-compute[98431]: Jun 11 23:14:34.575092 np0000002687 nova-compute[98431]: Jun 11 23:14:34.575092 np0000002687 nova-compute[98431]: hvm Jun 11 23:14:34.575092 np0000002687 nova-compute[98431]: Jun 11 23:14:34.575092 np0000002687 nova-compute[98431]: Jun 11 23:14:34.575092 np0000002687 nova-compute[98431]: Jun 11 23:14:34.575092 np0000002687 nova-compute[98431]: Jun 11 23:14:34.575092 np0000002687 nova-compute[98431]: Jun 11 23:14:34.575092 np0000002687 nova-compute[98431]: Jun 11 23:14:34.575092 np0000002687 nova-compute[98431]: 128 Jun 11 23:14:34.575092 np0000002687 nova-compute[98431]: Jun 11 23:14:34.575092 np0000002687 nova-compute[98431]: Jun 11 23:14:34.575092 np0000002687 nova-compute[98431]: Jun 11 23:14:34.575092 np0000002687 nova-compute[98431]: 1 Jun 11 23:14:34.575092 np0000002687 nova-compute[98431]: Jun 11 23:14:34.575092 np0000002687 nova-compute[98431]: Jun 11 23:14:34.575092 np0000002687 nova-compute[98431]: Nehalem Jun 11 23:14:34.575092 np0000002687 nova-compute[98431]: Jun 11 23:14:34.575092 np0000002687 nova-compute[98431]: Jun 11 23:14:34.575092 np0000002687 nova-compute[98431]: Jun 11 23:14:34.575092 np0000002687 nova-compute[98431]: Jun 11 23:14:34.575092 np0000002687 nova-compute[98431]: Jun 11 23:14:34.575092 np0000002687 nova-compute[98431]: Jun 11 23:14:34.575092 np0000002687 nova-compute[98431]: Jun 11 23:14:34.575092 np0000002687 nova-compute[98431]: Jun 11 23:14:34.575092 np0000002687 nova-compute[98431]: Jun 11 23:14:34.575092 np0000002687 nova-compute[98431]: Jun 11 23:14:34.575092 np0000002687 nova-compute[98431]: Jun 11 23:14:34.575092 np0000002687 nova-compute[98431]: Jun 11 23:14:34.575092 np0000002687 nova-compute[98431]: Jun 11 23:14:34.575092 np0000002687 nova-compute[98431]: Jun 11 23:14:34.575092 np0000002687 nova-compute[98431]: Jun 11 23:14:34.575092 np0000002687 nova-compute[98431]: Jun 11 23:14:34.575092 np0000002687 nova-compute[98431]: Jun 11 23:14:34.575092 np0000002687 nova-compute[98431]: Jun 11 23:14:34.575092 np0000002687 nova-compute[98431]: Jun 11 23:14:34.575092 np0000002687 nova-compute[98431]: Jun 11 23:14:34.575092 np0000002687 nova-compute[98431]: Jun 11 23:14:34.575092 np0000002687 nova-compute[98431]: Jun 11 23:14:34.575092 np0000002687 nova-compute[98431]: Jun 11 23:14:34.575092 np0000002687 nova-compute[98431]: Jun 11 23:14:34.575092 np0000002687 nova-compute[98431]: Jun 11 23:14:34.575092 np0000002687 nova-compute[98431]: Jun 11 23:14:34.575092 np0000002687 nova-compute[98431]: /dev/urandom Jun 11 23:14:34.575092 np0000002687 nova-compute[98431]: Jun 11 23:14:34.575092 np0000002687 nova-compute[98431]: Jun 11 23:14:34.575092 np0000002687 nova-compute[98431]: Jun 11 23:14:34.575092 np0000002687 nova-compute[98431]: Jun 11 23:14:34.575092 np0000002687 nova-compute[98431]: Jun 11 23:14:34.575092 np0000002687 nova-compute[98431]: Jun 11 23:14:34.575092 np0000002687 nova-compute[98431]: Jun 11 23:14:34.575092 np0000002687 nova-compute[98431]: {{(pid=98431) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 11 23:14:34.580340 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-906eaf40-a185-4ac7-8524-7ef2f96dda79 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] [instance: 14cc8d05-e33d-434f-b2b3-0dad3b613e73] Preparing to wait for external event network-vif-plugged-64bb5344-fa8f-436b-8c25-3dd5df49e17f {{(pid=98431) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 11 23:14:34.580340 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-906eaf40-a185-4ac7-8524-7ef2f96dda79 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Acquiring lock "14cc8d05-e33d-434f-b2b3-0dad3b613e73-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:14:34.580340 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-906eaf40-a185-4ac7-8524-7ef2f96dda79 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Lock "14cc8d05-e33d-434f-b2b3-0dad3b613e73-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:14:34.580340 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-906eaf40-a185-4ac7-8524-7ef2f96dda79 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Lock "14cc8d05-e33d-434f-b2b3-0dad3b613e73-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:14:34.580340 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-906eaf40-a185-4ac7-8524-7ef2f96dda79 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-11T23:14:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-120229851',display_name='tempest-VolumesActionsTest-instance-120229851',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='tempest-volumesactionstest-instance-120229851',id=25,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1922540076a94ee5ba369d79869aaa95',ramdisk_id='',reservation_id='r-64ukdjk6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1703782237',owner_user_name='tempest-VolumesActionsTest-1703782237-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-11T23:14:30Z,user_data=None,user_id='5b929fda768d45738790181d6b49a3be',uuid=14cc8d05-e33d-434f-b2b3-0dad3b613e73,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "64bb5344-fa8f-436b-8c25-3dd5df49e17f", "address": "fa:16:3e:c5:71:0e", "network": {"id": "64de9d21-9a16-433f-b6db-fd642b6ec307", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1640869818-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1922540076a94ee5ba369d79869aaa95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap64bb5344-fa", "ovs_interfaceid": "64bb5344-fa8f-436b-8c25-3dd5df49e17f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 11 23:14:34.580340 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-906eaf40-a185-4ac7-8524-7ef2f96dda79 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Converting VIF {"id": "64bb5344-fa8f-436b-8c25-3dd5df49e17f", "address": "fa:16:3e:c5:71:0e", "network": {"id": "64de9d21-9a16-433f-b6db-fd642b6ec307", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1640869818-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1922540076a94ee5ba369d79869aaa95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap64bb5344-fa", "ovs_interfaceid": "64bb5344-fa8f-436b-8c25-3dd5df49e17f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:14:34.580340 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-906eaf40-a185-4ac7-8524-7ef2f96dda79 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:71:0e,bridge_name='br-int',has_traffic_filtering=True,id=64bb5344-fa8f-436b-8c25-3dd5df49e17f,network=Network(64de9d21-9a16-433f-b6db-fd642b6ec307),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64bb5344-fa') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:14:34.580340 np0000002687 nova-compute[98431]: DEBUG os_vif [None req-906eaf40-a185-4ac7-8524-7ef2f96dda79 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:71:0e,bridge_name='br-int',has_traffic_filtering=True,id=64bb5344-fa8f-436b-8c25-3dd5df49e17f,network=Network(64de9d21-9a16-433f-b6db-fd642b6ec307),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64bb5344-fa') {{(pid=98431) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 11 23:14:34.580340 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:34.580340 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:14:34.580958 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 11 23:14:34.584150 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:34.584150 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b499d3d3-4049-5960-b408-52f1b802a1d2', '_type': 'linux-noop'}}, row=False) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:14:34.585721 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:34.588288 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:14:34.592339 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:34.592658 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap64bb5344-fa, may_exist=True, interface_attrs={}) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:14:34.593259 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap64bb5344-fa, col_values=(('qos', UUID('30c9b39c-e218-403e-b9aa-5466a569befb')),), if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:14:34.593489 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap64bb5344-fa, col_values=(('external_ids', {'iface-id': '64bb5344-fa8f-436b-8c25-3dd5df49e17f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c5:71:0e', 'vm-uuid': '14cc8d05-e33d-434f-b2b3-0dad3b613e73'}),), if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:14:34.594889 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:34.596561 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:14:34.605549 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:34.607920 np0000002687 nova-compute[98431]: INFO os_vif [None req-906eaf40-a185-4ac7-8524-7ef2f96dda79 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:71:0e,bridge_name='br-int',has_traffic_filtering=True,id=64bb5344-fa8f-436b-8c25-3dd5df49e17f,network=Network(64de9d21-9a16-433f-b6db-fd642b6ec307),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64bb5344-fa') Jun 11 23:14:34.629045 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-a2b86a59-2b18-4aaa-916e-5e5fd9c491e1 req-9e853670-916f-4625-9916-80bcb6595be8 service nova] [instance: cab1cc43-b433-4772-9f01-0197502c8b57] Received event network-changed-807d693f-6c88-415d-8c16-1187f9dd28c2 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:14:34.629045 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-a2b86a59-2b18-4aaa-916e-5e5fd9c491e1 req-9e853670-916f-4625-9916-80bcb6595be8 service nova] [instance: cab1cc43-b433-4772-9f01-0197502c8b57] Refreshing instance network info cache due to event network-changed-807d693f-6c88-415d-8c16-1187f9dd28c2. {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 11 23:14:34.629045 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-a2b86a59-2b18-4aaa-916e-5e5fd9c491e1 req-9e853670-916f-4625-9916-80bcb6595be8 service nova] Acquiring lock "refresh_cache-cab1cc43-b433-4772-9f01-0197502c8b57" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 11 23:14:34.629045 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-a2b86a59-2b18-4aaa-916e-5e5fd9c491e1 req-9e853670-916f-4625-9916-80bcb6595be8 service nova] Acquired lock "refresh_cache-cab1cc43-b433-4772-9f01-0197502c8b57" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 11 23:14:34.629045 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-a2b86a59-2b18-4aaa-916e-5e5fd9c491e1 req-9e853670-916f-4625-9916-80bcb6595be8 service nova] [instance: cab1cc43-b433-4772-9f01-0197502c8b57] Refreshing network info cache for port 807d693f-6c88-415d-8c16-1187f9dd28c2 {{(pid=98431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 11 23:14:34.704586 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: c9271160-14ef-4a59-8ac8-89efbe36c607] During sync_power_state the instance has a pending task (spawning). Skip. Jun 11 23:14:34.705038 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Emitting event Paused> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:14:34.705394 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: c9271160-14ef-4a59-8ac8-89efbe36c607] VM Paused (Lifecycle Event) Jun 11 23:14:34.715675 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: c9271160-14ef-4a59-8ac8-89efbe36c607] Took 8.72 seconds to spawn the instance on the hypervisor. Jun 11 23:14:34.715948 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: c9271160-14ef-4a59-8ac8-89efbe36c607] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:14:35.034036 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] Acquiring lock "refresh_cache-cab1cc43-b433-4772-9f01-0197502c8b57" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 11 23:14:35.110083 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-76285bfd-3b40-4996-af54-47a52858b458 req-498805eb-6b3d-460a-9a53-da20b248b9ff service nova] [instance: 010aa26e-fb15-47ee-a9b7-089dbfdfd1c7] Received event network-vif-plugged-75b6f9f6-6287-4fd3-ae85-5f0145c9ecca {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:14:35.110211 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-76285bfd-3b40-4996-af54-47a52858b458 req-498805eb-6b3d-460a-9a53-da20b248b9ff service nova] Acquiring lock "010aa26e-fb15-47ee-a9b7-089dbfdfd1c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:14:35.110360 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-76285bfd-3b40-4996-af54-47a52858b458 req-498805eb-6b3d-460a-9a53-da20b248b9ff service nova] Lock "010aa26e-fb15-47ee-a9b7-089dbfdfd1c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:14:35.110476 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-76285bfd-3b40-4996-af54-47a52858b458 req-498805eb-6b3d-460a-9a53-da20b248b9ff service nova] Lock "010aa26e-fb15-47ee-a9b7-089dbfdfd1c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:14:35.110585 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-76285bfd-3b40-4996-af54-47a52858b458 req-498805eb-6b3d-460a-9a53-da20b248b9ff service nova] [instance: 010aa26e-fb15-47ee-a9b7-089dbfdfd1c7] Processing event network-vif-plugged-75b6f9f6-6287-4fd3-ae85-5f0145c9ecca {{(pid=98431) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 11 23:14:35.110708 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-76285bfd-3b40-4996-af54-47a52858b458 req-498805eb-6b3d-460a-9a53-da20b248b9ff service nova] [instance: 010aa26e-fb15-47ee-a9b7-089dbfdfd1c7] Received event network-vif-plugged-75b6f9f6-6287-4fd3-ae85-5f0145c9ecca {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:14:35.110929 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-76285bfd-3b40-4996-af54-47a52858b458 req-498805eb-6b3d-460a-9a53-da20b248b9ff service nova] Acquiring lock "010aa26e-fb15-47ee-a9b7-089dbfdfd1c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:14:35.111008 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-76285bfd-3b40-4996-af54-47a52858b458 req-498805eb-6b3d-460a-9a53-da20b248b9ff service nova] Lock "010aa26e-fb15-47ee-a9b7-089dbfdfd1c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:14:35.111103 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-76285bfd-3b40-4996-af54-47a52858b458 req-498805eb-6b3d-460a-9a53-da20b248b9ff service nova] Lock "010aa26e-fb15-47ee-a9b7-089dbfdfd1c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:14:35.111208 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-76285bfd-3b40-4996-af54-47a52858b458 req-498805eb-6b3d-460a-9a53-da20b248b9ff service nova] [instance: 010aa26e-fb15-47ee-a9b7-089dbfdfd1c7] No waiting events found dispatching network-vif-plugged-75b6f9f6-6287-4fd3-ae85-5f0145c9ecca {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:14:35.111326 np0000002687 nova-compute[98431]: WARNING nova.compute.manager [req-76285bfd-3b40-4996-af54-47a52858b458 req-498805eb-6b3d-460a-9a53-da20b248b9ff service nova] [instance: 010aa26e-fb15-47ee-a9b7-089dbfdfd1c7] Received unexpected event network-vif-plugged-75b6f9f6-6287-4fd3-ae85-5f0145c9ecca for instance with vm_state building and task_state spawning. Jun 11 23:14:35.112080 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] [instance: 010aa26e-fb15-47ee-a9b7-089dbfdfd1c7] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=98431) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 11 23:14:35.114613 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] [instance: 010aa26e-fb15-47ee-a9b7-089dbfdfd1c7] Guest created on hypervisor {{(pid=98431) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}} Jun 11 23:14:35.116278 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [-] [instance: 010aa26e-fb15-47ee-a9b7-089dbfdfd1c7] Instance spawned successfully. Jun 11 23:14:35.116727 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] [instance: 010aa26e-fb15-47ee-a9b7-089dbfdfd1c7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 11 23:14:35.130215 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [req-a2b86a59-2b18-4aaa-916e-5e5fd9c491e1 req-9e853670-916f-4625-9916-80bcb6595be8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:14:35.207909 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: c9271160-14ef-4a59-8ac8-89efbe36c607] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:14:35.209861 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Emitting event Resumed> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:14:35.210024 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: c9271160-14ef-4a59-8ac8-89efbe36c607] VM Resumed (Lifecycle Event) Jun 11 23:14:35.236258 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-a2b86a59-2b18-4aaa-916e-5e5fd9c491e1 req-9e853670-916f-4625-9916-80bcb6595be8 service nova] [instance: cab1cc43-b433-4772-9f01-0197502c8b57] Instance cache missing network info. {{(pid=98431) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 11 23:14:35.238837 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: c9271160-14ef-4a59-8ac8-89efbe36c607] Took 15.02 seconds to build instance. Jun 11 23:14:35.400391 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-a2b86a59-2b18-4aaa-916e-5e5fd9c491e1 req-9e853670-916f-4625-9916-80bcb6595be8 service nova] [instance: cab1cc43-b433-4772-9f01-0197502c8b57] Updating instance_info_cache with network_info: [] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:14:35.633150 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] [instance: 010aa26e-fb15-47ee-a9b7-089dbfdfd1c7] Found default for hw_cdrom_bus of ide {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:14:35.633651 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] [instance: 010aa26e-fb15-47ee-a9b7-089dbfdfd1c7] Found default for hw_disk_bus of virtio {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:14:35.633764 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] [instance: 010aa26e-fb15-47ee-a9b7-089dbfdfd1c7] Found default for hw_input_bus of None {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:14:35.634003 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] [instance: 010aa26e-fb15-47ee-a9b7-089dbfdfd1c7] Found default for hw_pointer_model of None {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:14:35.636130 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] [instance: 010aa26e-fb15-47ee-a9b7-089dbfdfd1c7] Found default for hw_video_model of virtio {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:14:35.636445 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] [instance: 010aa26e-fb15-47ee-a9b7-089dbfdfd1c7] Found default for hw_vif_model of virtio {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:14:35.712642 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: c9271160-14ef-4a59-8ac8-89efbe36c607] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:14:35.721335 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: c9271160-14ef-4a59-8ac8-89efbe36c607] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98431) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 11 23:14:35.741614 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Lock "c9271160-14ef-4a59-8ac8-89efbe36c607" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 16.534s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:14:35.902969 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-a2b86a59-2b18-4aaa-916e-5e5fd9c491e1 req-9e853670-916f-4625-9916-80bcb6595be8 service nova] Releasing lock "refresh_cache-cab1cc43-b433-4772-9f01-0197502c8b57" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 11 23:14:35.904828 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] Acquired lock "refresh_cache-cab1cc43-b433-4772-9f01-0197502c8b57" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 11 23:14:35.904919 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] [instance: cab1cc43-b433-4772-9f01-0197502c8b57] Building network info cache for instance {{(pid=98431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 11 23:14:36.134045 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-906eaf40-a185-4ac7-8524-7ef2f96dda79 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] No BDM found with device name vda, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:14:36.134045 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-906eaf40-a185-4ac7-8524-7ef2f96dda79 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] No BDM found with device name hda, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:14:36.134263 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-906eaf40-a185-4ac7-8524-7ef2f96dda79 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] No VIF found with MAC fa:16:3e:c5:71:0e, not building metadata {{(pid=98431) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13199}} Jun 11 23:14:36.135100 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-906eaf40-a185-4ac7-8524-7ef2f96dda79 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] [instance: 14cc8d05-e33d-434f-b2b3-0dad3b613e73] Using config drive Jun 11 23:14:36.153504 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] [instance: cab1cc43-b433-4772-9f01-0197502c8b57] Start spawning the instance on the hypervisor. {{(pid=98431) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 11 23:14:36.156775 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] [instance: 010aa26e-fb15-47ee-a9b7-089dbfdfd1c7] Took 11.73 seconds to spawn the instance on the hypervisor. Jun 11 23:14:36.156775 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] [instance: 010aa26e-fb15-47ee-a9b7-089dbfdfd1c7] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:14:36.160697 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] [instance: cab1cc43-b433-4772-9f01-0197502c8b57] Creating instance directory {{(pid=98431) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}} Jun 11 23:14:36.160697 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] [instance: cab1cc43-b433-4772-9f01-0197502c8b57] Creating image(s) Jun 11 23:14:36.162098 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] [instance: cab1cc43-b433-4772-9f01-0197502c8b57] Did not create local disks {{(pid=98431) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}} Jun 11 23:14:36.162098 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] [instance: cab1cc43-b433-4772-9f01-0197502c8b57] Ensure instance console log exists: /opt/stack/data/nova/instances/cab1cc43-b433-4772-9f01-0197502c8b57/console.log {{(pid=98431) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}} Jun 11 23:14:36.162098 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:14:36.162763 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:14:36.164238 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:14:36.225822 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Emitting event Started> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:14:36.225822 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 010aa26e-fb15-47ee-a9b7-089dbfdfd1c7] VM Started (Lifecycle Event) Jun 11 23:14:36.511845 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] [instance: cab1cc43-b433-4772-9f01-0197502c8b57] Instance cache missing network info. {{(pid=98431) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 11 23:14:36.642694 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-906eaf40-a185-4ac7-8524-7ef2f96dda79 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:14:36.680627 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] [instance: 010aa26e-fb15-47ee-a9b7-089dbfdfd1c7] Took 19.55 seconds to build instance. Jun 11 23:14:36.715311 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-74aafe31-83d2-436a-8cfc-c017b0cc1484 req-dcf1d07a-14d4-4bc6-871b-fca7d3e4581b service nova] [instance: c9271160-14ef-4a59-8ac8-89efbe36c607] Received event network-changed-189a71e3-b1fd-4769-a6a6-4a9be0352962 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:14:36.716528 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-74aafe31-83d2-436a-8cfc-c017b0cc1484 req-dcf1d07a-14d4-4bc6-871b-fca7d3e4581b service nova] [instance: c9271160-14ef-4a59-8ac8-89efbe36c607] Refreshing instance network info cache due to event network-changed-189a71e3-b1fd-4769-a6a6-4a9be0352962. {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 11 23:14:36.716791 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-74aafe31-83d2-436a-8cfc-c017b0cc1484 req-dcf1d07a-14d4-4bc6-871b-fca7d3e4581b service nova] Acquiring lock "refresh_cache-c9271160-14ef-4a59-8ac8-89efbe36c607" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 11 23:14:36.717870 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-74aafe31-83d2-436a-8cfc-c017b0cc1484 req-dcf1d07a-14d4-4bc6-871b-fca7d3e4581b service nova] Acquired lock "refresh_cache-c9271160-14ef-4a59-8ac8-89efbe36c607" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 11 23:14:36.717870 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-74aafe31-83d2-436a-8cfc-c017b0cc1484 req-dcf1d07a-14d4-4bc6-871b-fca7d3e4581b service nova] [instance: c9271160-14ef-4a59-8ac8-89efbe36c607] Refreshing network info cache for port 189a71e3-b1fd-4769-a6a6-4a9be0352962 {{(pid=98431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 11 23:14:36.732500 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:14:36.735591 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 010aa26e-fb15-47ee-a9b7-089dbfdfd1c7] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:14:36.739834 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 010aa26e-fb15-47ee-a9b7-089dbfdfd1c7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98431) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 11 23:14:36.853023 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-906eaf40-a185-4ac7-8524-7ef2f96dda79 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] [instance: 14cc8d05-e33d-434f-b2b3-0dad3b613e73] Creating config drive at /opt/stack/data/nova/instances/14cc8d05-e33d-434f-b2b3-0dad3b613e73/disk.config Jun 11 23:14:36.856937 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-906eaf40-a185-4ac7-8524-7ef2f96dda79 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/14cc8d05-e33d-434f-b2b3-0dad3b613e73/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpfzidacww {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:14:36.909834 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-906eaf40-a185-4ac7-8524-7ef2f96dda79 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/14cc8d05-e33d-434f-b2b3-0dad3b613e73/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpfzidacww" returned: 0 in 0.052s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:14:36.939468 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] [instance: cab1cc43-b433-4772-9f01-0197502c8b57] Updating instance_info_cache with network_info: [{"id": "807d693f-6c88-415d-8c16-1187f9dd28c2", "address": "fa:16:3e:17:0e:ab", "network": {"id": "e7f47484-d4a6-4304-95df-65b18550a507", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ce012f9fabdb4ee5a73e212437f59d97", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap807d693f-6c", "ovs_interfaceid": "807d693f-6c88-415d-8c16-1187f9dd28c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:14:37.184923 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-feef1008-d6da-4244-83b3-da27313707cb tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] Lock "010aa26e-fb15-47ee-a9b7-089dbfdfd1c7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 21.071s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:14:37.220902 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [req-74aafe31-83d2-436a-8cfc-c017b0cc1484 req-dcf1d07a-14d4-4bc6-871b-fca7d3e4581b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:14:37.243275 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Emitting event Paused> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:14:37.243467 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 010aa26e-fb15-47ee-a9b7-089dbfdfd1c7] VM Paused (Lifecycle Event) Jun 11 23:14:37.402215 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:37.446382 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:37.450215 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] Releasing lock "refresh_cache-cab1cc43-b433-4772-9f01-0197502c8b57" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 11 23:14:37.450555 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] [instance: cab1cc43-b433-4772-9f01-0197502c8b57] Instance network_info: |[{"id": "807d693f-6c88-415d-8c16-1187f9dd28c2", "address": "fa:16:3e:17:0e:ab", "network": {"id": "e7f47484-d4a6-4304-95df-65b18550a507", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ce012f9fabdb4ee5a73e212437f59d97", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap807d693f-6c", "ovs_interfaceid": "807d693f-6c88-415d-8c16-1187f9dd28c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98431) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 11 23:14:37.455156 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] [instance: cab1cc43-b433-4772-9f01-0197502c8b57] Start _get_guest_xml network_info=[{"id": "807d693f-6c88-415d-8c16-1187f9dd28c2", "address": "fa:16:3e:17:0e:ab", "network": {"id": "e7f47484-d4a6-4304-95df-65b18550a507", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ce012f9fabdb4ee5a73e212437f59d97", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap807d693f-6c", "ovs_interfaceid": "807d693f-6c88-415d-8c16-1187f9dd28c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=,container_format=,created_at=,direct_url=,disk_format=,id=,min_disk=0,min_ram=0,name=,owner=,properties=ImageMetaProps,protected=,size=1073741824,status='active',tags=,updated_at=,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'mount_device': '/dev/vda', 'attachment_id': '11288ed0-4b7a-4bd3-925e-f795d1bede6c', 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f7e59f73-fc24-4ce4-8dd2-08f2f6948647', 'iqn.2023-03.storpool.com:os--volume-f7e59f73-fc24-4ce4-8dd2-08f2f6948647'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f7e59f73-fc24-4ce4-8dd2-08f2f6948647', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f7e59f73-fc24-4ce4-8dd2-08f2f6948647', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'cab1cc43-b433-4772-9f01-0197502c8b57', 'attached_at': '', 'detached_at': '', 'volume_id': 'f7e59f73-fc24-4ce4-8dd2-08f2f6948647', 'serial': 'f7e59f73-fc24-4ce4-8dd2-08f2f6948647'}, 'disk_bus': 'virtio', 'delete_on_termination': True, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98431) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 11 23:14:37.467321 np0000002687 nova-compute[98431]: WARNING nova.virt.libvirt.driver [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 11 23:14:37.469026 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='instance-depend-image', uuid='cab1cc43-b433-4772-9f01-0197502c8b57'), owner=OwnerMeta(userid='d1bfc36c83e84cfbac05bd2daacaf580', username='tempest-ImageDependencyTests-1754620563-project-member', projectid='e4028976d11d4dfdb2a6f8637d28c73d', projectname='tempest-ImageDependencyTests-1754620563'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "807d693f-6c88-415d-8c16-1187f9dd28c2", "address": "fa:16:3e:17:0e:ab", "network": {"id": "e7f47484-d4a6-4304-95df-65b18550a507", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ce012f9fabdb4ee5a73e212437f59d97", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap807d693f-6c", "ovs_interfaceid": "807d693f-6c88-415d-8c16-1187f9dd28c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1781219677.468495) {{(pid=98431) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 11 23:14:37.475188 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] Searching host: 'np0000002687' for CPU controller through CGroups V1... {{(pid=98431) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 11 23:14:37.475554 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] CPU controller missing on host. {{(pid=98431) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 11 23:14:37.478965 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] Searching host: 'np0000002687' for CPU controller through CGroups V2... {{(pid=98431) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 11 23:14:37.479236 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] CPU controller found on host. {{(pid=98431) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 11 23:14:37.480950 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98431) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 11 23:14:37.481353 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-11T23:08:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=,container_format=,created_at=,direct_url=,disk_format=,id=,min_disk=0,min_ram=0,name=,owner=,properties=ImageMetaProps,protected=,size=1073741824,status='active',tags=,updated_at=,virtual_size=,visibility=), allow threads: True {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 11 23:14:37.481553 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] Flavor limits 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 11 23:14:37.481716 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] Image limits 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 11 23:14:37.481910 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] Flavor pref 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 11 23:14:37.482046 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] Image pref 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 11 23:14:37.482315 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 11 23:14:37.482396 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 11 23:14:37.482547 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98431) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 11 23:14:37.482732 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] Got 1 possible topologies {{(pid=98431) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 11 23:14:37.482922 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 11 23:14:37.483060 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 11 23:14:37.496631 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] [instance: cab1cc43-b433-4772-9f01-0197502c8b57] Calling os-brick to attach iSCSI Volume {{(pid=98431) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 11 23:14:37.497920 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f7e59f73-fc24-4ce4-8dd2-08f2f6948647', 'iqn.2023-03.storpool.com:os--volume-f7e59f73-fc24-4ce4-8dd2-08f2f6948647'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f7e59f73-fc24-4ce4-8dd2-08f2f6948647', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f7e59f73-fc24-4ce4-8dd2-08f2f6948647', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 11 23:14:37.497920 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 11 23:14:37.498338 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 11 23:14:37.498736 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f7e59f73-fc24-4ce4-8dd2-08f2f6948647', 'iqn.2023-03.storpool.com:os--volume-f7e59f73-fc24-4ce4-8dd2-08f2f6948647'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f7e59f73-fc24-4ce4-8dd2-08f2f6948647', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f7e59f73-fc24-4ce4-8dd2-08f2f6948647', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98431) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 11 23:14:37.515237 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f7e59f73-fc24-4ce4-8dd2-08f2f6948647" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 11 23:14:37.515237 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f7e59f73-fc24-4ce4-8dd2-08f2f6948647" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 11 23:14:37.515237 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.iscsi [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 11 23:14:37.520079 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f7e59f73-fc24-4ce4-8dd2-08f2f6948647" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 11 23:14:37.520508 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f7e59f73-fc24-4ce4-8dd2-08f2f6948647" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 11 23:14:37.521019 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.iscsi [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 11 23:14:37.553663 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 11 23:14:37.553663 np0000002687 nova-compute[98431]: {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:14:37.554773 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 11 23:14:37.554773 np0000002687 nova-compute[98431]: {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:14:37.570240 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f7e59f73-fc24-4ce4-8dd2-08f2f6948647] added Jun 11 23:14:37.570240 np0000002687 nova-compute[98431]: stderr=iscsiadm: Config file line 363 does not have value Jun 11 23:14:37.570240 np0000002687 nova-compute[98431]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 11 23:14:37.570240 np0000002687 nova-compute[98431]: iscsiadm: Config file line 363 does not have value Jun 11 23:14:37.570240 np0000002687 nova-compute[98431]: iscsiadm: Config file line 363 does not have value Jun 11 23:14:37.570240 np0000002687 nova-compute[98431]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 11 23:14:37.570240 np0000002687 nova-compute[98431]: {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:14:37.571505 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98431) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 11 23:14:37.571505 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0504(s), this was the 1st time calling it. {{(pid=98431) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 11 23:14:37.571505 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98431) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 11 23:14:37.575113 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f7e59f73-fc24-4ce4-8dd2-08f2f6948647] added Jun 11 23:14:37.575113 np0000002687 nova-compute[98431]: stderr=iscsiadm: Config file line 363 does not have value Jun 11 23:14:37.575113 np0000002687 nova-compute[98431]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 11 23:14:37.575113 np0000002687 nova-compute[98431]: iscsiadm: Config file line 363 does not have value Jun 11 23:14:37.575113 np0000002687 nova-compute[98431]: iscsiadm: Config file line 363 does not have value Jun 11 23:14:37.575113 np0000002687 nova-compute[98431]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 11 23:14:37.575113 np0000002687 nova-compute[98431]: {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:14:37.575113 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98431) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 11 23:14:37.575972 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0611(s), this was the 1st time calling it. {{(pid=98431) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 11 23:14:37.575972 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98431) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 11 23:14:37.587271 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:37.701652 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [req-74aafe31-83d2-436a-8cfc-c017b0cc1484 req-dcf1d07a-14d4-4bc6-871b-fca7d3e4581b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:14:37.758016 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 010aa26e-fb15-47ee-a9b7-089dbfdfd1c7] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:14:37.767311 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Emitting event Resumed> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:14:37.767568 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 010aa26e-fb15-47ee-a9b7-089dbfdfd1c7] VM Resumed (Lifecycle Event) Jun 11 23:14:37.841970 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-01419f77-20c6-4d17-af72-2652c334da7d req-4928b8e7-acfc-4e3c-a020-d1d765247881 service nova] [instance: 14cc8d05-e33d-434f-b2b3-0dad3b613e73] Received event network-vif-plugged-64bb5344-fa8f-436b-8c25-3dd5df49e17f {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:14:37.842287 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-01419f77-20c6-4d17-af72-2652c334da7d req-4928b8e7-acfc-4e3c-a020-d1d765247881 service nova] Acquiring lock "14cc8d05-e33d-434f-b2b3-0dad3b613e73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:14:37.843085 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-01419f77-20c6-4d17-af72-2652c334da7d req-4928b8e7-acfc-4e3c-a020-d1d765247881 service nova] Lock "14cc8d05-e33d-434f-b2b3-0dad3b613e73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:14:37.843085 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-01419f77-20c6-4d17-af72-2652c334da7d req-4928b8e7-acfc-4e3c-a020-d1d765247881 service nova] Lock "14cc8d05-e33d-434f-b2b3-0dad3b613e73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:14:37.845568 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-01419f77-20c6-4d17-af72-2652c334da7d req-4928b8e7-acfc-4e3c-a020-d1d765247881 service nova] [instance: 14cc8d05-e33d-434f-b2b3-0dad3b613e73] Processing event network-vif-plugged-64bb5344-fa8f-436b-8c25-3dd5df49e17f {{(pid=98431) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 11 23:14:37.896329 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:37.900517 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:37.905388 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:37.936206 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:37.946531 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-74aafe31-83d2-436a-8cfc-c017b0cc1484 req-dcf1d07a-14d4-4bc6-871b-fca7d3e4581b service nova] [instance: c9271160-14ef-4a59-8ac8-89efbe36c607] Updated VIF entry in instance network info cache for port 189a71e3-b1fd-4769-a6a6-4a9be0352962. {{(pid=98431) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 11 23:14:37.946531 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-74aafe31-83d2-436a-8cfc-c017b0cc1484 req-dcf1d07a-14d4-4bc6-871b-fca7d3e4581b service nova] [instance: c9271160-14ef-4a59-8ac8-89efbe36c607] Updating instance_info_cache with network_info: [{"id": "189a71e3-b1fd-4769-a6a6-4a9be0352962", "address": "fa:16:3e:f6:b5:ae", "network": {"id": "77fc4e10-1fed-4963-86b4-1fbb3a9c6f7f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1105404274-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b2b9f55b231c455ca1a4579d7ed54888", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap189a71e3-b1", "ovs_interfaceid": "189a71e3-b1fd-4769-a6a6-4a9be0352962", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:14:37.947567 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:38.274381 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 010aa26e-fb15-47ee-a9b7-089dbfdfd1c7] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:14:38.276863 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 010aa26e-fb15-47ee-a9b7-089dbfdfd1c7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98431) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 11 23:14:38.453596 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-74aafe31-83d2-436a-8cfc-c017b0cc1484 req-dcf1d07a-14d4-4bc6-871b-fca7d3e4581b service nova] Releasing lock "refresh_cache-c9271160-14ef-4a59-8ac8-89efbe36c607" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 11 23:14:38.572517 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.iscsi [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 11 23:14:38.577309 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.iscsi [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 11 23:14:38.578138 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-906eaf40-a185-4ac7-8524-7ef2f96dda79 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] [instance: 14cc8d05-e33d-434f-b2b3-0dad3b613e73] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98431) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 11 23:14:38.583511 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-906eaf40-a185-4ac7-8524-7ef2f96dda79 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] [instance: 14cc8d05-e33d-434f-b2b3-0dad3b613e73] Guest created on hypervisor {{(pid=98431) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}} Jun 11 23:14:38.586921 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [-] [instance: 14cc8d05-e33d-434f-b2b3-0dad3b613e73] Instance spawned successfully. Jun 11 23:14:38.588613 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-906eaf40-a185-4ac7-8524-7ef2f96dda79 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] [instance: 14cc8d05-e33d-434f-b2b3-0dad3b613e73] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 11 23:14:38.591095 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 11 23:14:38.591095 np0000002687 nova-compute[98431]: node.name = iqn.2023-03.storpool.com:os--volume-f7e59f73-fc24-4ce4-8dd2-08f2f6948647 Jun 11 23:14:38.591095 np0000002687 nova-compute[98431]: node.tpgt = -1 Jun 11 23:14:38.591095 np0000002687 nova-compute[98431]: node.startup = manual Jun 11 23:14:38.591095 np0000002687 nova-compute[98431]: node.leading_login = No Jun 11 23:14:38.591095 np0000002687 nova-compute[98431]: iface.iscsi_ifacename = default Jun 11 23:14:38.591095 np0000002687 nova-compute[98431]: iface.net_ifacename = Jun 11 23:14:38.591095 np0000002687 nova-compute[98431]: iface.ipaddress = Jun 11 23:14:38.591095 np0000002687 nova-compute[98431]: iface.prefix_len = 0 Jun 11 23:14:38.591095 np0000002687 nova-compute[98431]: iface.hwaddress = Jun 11 23:14:38.591095 np0000002687 nova-compute[98431]: iface.transport_name = tcp Jun 11 23:14:38.591095 np0000002687 nova-compute[98431]: iface.initiatorname = Jun 11 23:14:38.591095 np0000002687 nova-compute[98431]: iface.state = Jun 11 23:14:38.591095 np0000002687 nova-compute[98431]: iface.vlan_id = 0 Jun 11 23:14:38.591095 np0000002687 nova-compute[98431]: iface.vlan_priority = 0 Jun 11 23:14:38.591095 np0000002687 nova-compute[98431]: iface.vlan_state = Jun 11 23:14:38.591095 np0000002687 nova-compute[98431]: iface.iface_num = 0 Jun 11 23:14:38.591095 np0000002687 nova-compute[98431]: iface.mtu = 0 Jun 11 23:14:38.591095 np0000002687 nova-compute[98431]: iface.port = 0 Jun 11 23:14:38.591095 np0000002687 nova-compute[98431]: iface.bootproto = Jun 11 23:14:38.591095 np0000002687 nova-compute[98431]: iface.subnet_mask = Jun 11 23:14:38.591095 np0000002687 nova-compute[98431]: iface.gateway = Jun 11 23:14:38.591095 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id_state = Jun 11 23:14:38.591095 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id = Jun 11 23:14:38.591095 np0000002687 nova-compute[98431]: iface.dhcp_dns = Jun 11 23:14:38.591095 np0000002687 nova-compute[98431]: iface.dhcp_learn_iqn = Jun 11 23:14:38.591095 np0000002687 nova-compute[98431]: iface.dhcp_req_vendor_id_state = Jun 11 23:14:38.591095 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id_state = Jun 11 23:14:38.591095 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id = Jun 11 23:14:38.591095 np0000002687 nova-compute[98431]: iface.dhcp_slp_da = Jun 11 23:14:38.591095 np0000002687 nova-compute[98431]: iface.fragmentation = Jun 11 23:14:38.591095 np0000002687 nova-compute[98431]: iface.gratuitous_arp = Jun 11 23:14:38.591095 np0000002687 nova-compute[98431]: iface.incoming_forwarding = Jun 11 23:14:38.591095 np0000002687 nova-compute[98431]: iface.tos_state = Jun 11 23:14:38.591095 np0000002687 nova-compute[98431]: iface.tos = 0 Jun 11 23:14:38.591095 np0000002687 nova-compute[98431]: iface.ttl = 0 Jun 11 23:14:38.591095 np0000002687 nova-compute[98431]: iface.delayed_ack = Jun 11 23:14:38.591095 np0000002687 nova-compute[98431]: iface.tcp_nagle = Jun 11 23:14:38.591095 np0000002687 nova-compute[98431]: iface.tcp_wsf_state = Jun 11 23:14:38.591095 np0000002687 nova-compute[98431]: iface.tcp_wsf = 0 Jun 11 23:14:38.591095 np0000002687 nova-compute[98431]: iface.tcp_timer_scale = 0 Jun 11 23:14:38.591095 np0000002687 nova-compute[98431]: iface.tcp_timestamp = Jun 11 23:14:38.591095 np0000002687 nova-compute[98431]: iface.redirect = Jun 11 23:14:38.591095 np0000002687 nova-compute[98431]: iface.def_task_mgmt_timeout = 0 Jun 11 23:14:38.591095 np0000002687 nova-compute[98431]: iface.header_digest = Jun 11 23:14:38.591095 np0000002687 nova-compute[98431]: iface.data_digest = Jun 11 23:14:38.591095 np0000002687 nova-compute[98431]: iface.immediate_data = Jun 11 23:14:38.591095 np0000002687 nova-compute[98431]: iface.initial_r2t = Jun 11 23:14:38.591095 np0000002687 nova-compute[98431]: iface.data_seq_inorder = Jun 11 23:14:38.591095 np0000002687 nova-compute[98431]: iface.data_pdu_inorder = Jun 11 23:14:38.591095 np0000002687 nova-compute[98431]: iface.erl = 0 Jun 11 23:14:38.591095 np0000002687 nova-compute[98431]: iface.max_receive_data_len = 0 Jun 11 23:14:38.591095 np0000002687 nova-compute[98431]: iface.first_burst_len = 0 Jun 11 23:14:38.591095 np0000002687 nova-compute[98431]: iface.max_outstanding_r2t = 0 Jun 11 23:14:38.591095 np0000002687 nova-compute[98431]: iface.max_burst_len = 0 Jun 11 23:14:38.591095 np0000002687 nova-compute[98431]: iface.chap_auth = Jun 11 23:14:38.591095 np0000002687 nova-compute[98431]: iface.bidi_chap = Jun 11 23:14:38.591095 np0000002687 nova-compute[98431]: iface.strict_login_compliance = Jun 11 23:14:38.591095 np0000002687 nova-compute[98431]: iface.discovery_auth = Jun 11 23:14:38.591095 np0000002687 nova-compute[98431]: iface.discovery_logout = Jun 11 23:14:38.591095 np0000002687 nova-compute[98431]: node.discovery_address = Jun 11 23:14:38.591095 np0000002687 nova-compute[98431]: node.discovery_port = 0 Jun 11 23:14:38.591095 np0000002687 nova-compute[98431]: node.discovery_type = fw Jun 11 23:14:38.591095 np0000002687 nova-compute[98431]: node.session.initial_cmdsn = 0 Jun 11 23:14:38.591095 np0000002687 nova-compute[98431]: node.session.initial_login_retry_max = 8 Jun 11 23:14:38.591095 np0000002687 nova-compute[98431]: node.session.xmit_thread_priority = 0 Jun 11 23:14:38.591095 np0000002687 nova-compute[98431]: node.session.cmds_max = 128 Jun 11 23:14:38.591095 np0000002687 nova-compute[98431]: node.session.queue_depth = 32 Jun 11 23:14:38.591095 np0000002687 nova-compute[98431]: node.session.nr_sessions = 1 Jun 11 23:14:38.591095 np0000002687 nova-compute[98431]: node.session.auth.authmethod = None Jun 11 23:14:38.591095 np0000002687 nova-compute[98431]: node.session.auth.username = Jun 11 23:14:38.591095 np0000002687 nova-compute[98431]: node.session.auth.password = *** Jun 11 23:14:38.591095 np0000002687 nova-compute[98431]: node.session.auth.username_in = Jun 11 23:14:38.591095 np0000002687 nova-compute[98431]: node.session.auth.password_in = Jun 11 23:14:38.591095 np0000002687 nova-compute[98431]: node.session.auth.chap_algs = SHA256 Jun 11 23:14:38.591095 np0000002687 nova-compute[98431]: node.session.timeo.replacement_timeout = 120 Jun 11 23:14:38.591095 np0000002687 nova-compute[98431]: node.session.err_timeo.abort_timeout = 15 Jun 11 23:14:38.591095 np0000002687 nova-compute[98431]: node.session.err_timeo.lu_reset_timeout = 30 Jun 11 23:14:38.591095 np0000002687 nova-compute[98431]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 11 23:14:38.591095 np0000002687 nova-compute[98431]: node.session.err_timeo.host_reset_timeout = 60 Jun 11 23:14:38.591095 np0000002687 nova-compute[98431]: node.session.iscsi.FastAbort = Yes Jun 11 23:14:38.591095 np0000002687 nova-compute[98431]: node.session.iscsi.InitialR2T = No Jun 11 23:14:38.591095 np0000002687 nova-compute[98431]: node.session.iscsi.ImmediateData = Yes Jun 11 23:14:38.591095 np0000002687 nova-compute[98431]: node.session.iscsi.FirstBurstLength = 262144 Jun 11 23:14:38.591095 np0000002687 nova-compute[98431]: node.session.iscsi.MaxBurstLength = 16776192 Jun 11 23:14:38.591095 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Retain = 0 Jun 11 23:14:38.591095 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Wait = 2 Jun 11 23:14:38.591095 np0000002687 nova-compute[98431]: node.session.iscsi.MaxConnections = 1 Jun 11 23:14:38.591095 np0000002687 nova-compute[98431]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 11 23:14:38.591095 np0000002687 nova-compute[98431]: node.session.iscsi.ERL = 0 Jun 11 23:14:38.591095 np0000002687 nova-compute[98431]: node.session.scan = auto Jun 11 23:14:38.591095 np0000002687 nova-compute[98431]: node.session.reopen_max = 0 Jun 11 23:14:38.591095 np0000002687 nova-compute[98431]: node.conn[0].address = 192.168.50.100 Jun 11 23:14:38.591095 np0000002687 nova-compute[98431]: node.conn[0].port = 3260 Jun 11 23:14:38.591095 np0000002687 nova-compute[98431]: node.conn[0].startup = manual Jun 11 23:14:38.591095 np0000002687 nova-compute[98431]: node.conn[0].tcp.window_size = 524288 Jun 11 23:14:38.591095 np0000002687 nova-compute[98431]: node.conn[0].tcp.type_of_service = 0 Jun 11 23:14:38.591095 np0000002687 nova-compute[98431]: node.conn[0].timeo.logout_timeout = 15 Jun 11 23:14:38.591095 np0000002687 nova-compute[98431]: node.conn[0].timeo.login_timeout = 15 Jun 11 23:14:38.591095 np0000002687 nova-compute[98431]: node.conn[0].timeo.auth_timeout = 45 Jun 11 23:14:38.591095 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_interval = 5 Jun 11 23:14:38.591095 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_timeout = 5 Jun 11 23:14:38.591095 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 11 23:14:38.591095 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 11 23:14:38.591095 np0000002687 nova-compute[98431]: node.conn[0].iscsi.HeaderDigest = None Jun 11 23:14:38.591095 np0000002687 nova-compute[98431]: node.conn[0].iscsi.DataDigest = None Jun 11 23:14:38.591095 np0000002687 nova-compute[98431]: node.conn[0].iscsi.IFMarker = No Jun 11 23:14:38.591095 np0000002687 nova-compute[98431]: node.conn[0].iscsi.OFMarker = No Jun 11 23:14:38.591095 np0000002687 nova-compute[98431]: # END RECORD Jun 11 23:14:38.591095 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:14:38.596700 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 11 23:14:38.596700 np0000002687 nova-compute[98431]: node.name = iqn.2023-03.storpool.com:os--volume-f7e59f73-fc24-4ce4-8dd2-08f2f6948647 Jun 11 23:14:38.596700 np0000002687 nova-compute[98431]: node.tpgt = -1 Jun 11 23:14:38.596700 np0000002687 nova-compute[98431]: node.startup = manual Jun 11 23:14:38.596700 np0000002687 nova-compute[98431]: node.leading_login = No Jun 11 23:14:38.596700 np0000002687 nova-compute[98431]: iface.iscsi_ifacename = default Jun 11 23:14:38.596700 np0000002687 nova-compute[98431]: iface.net_ifacename = Jun 11 23:14:38.596700 np0000002687 nova-compute[98431]: iface.ipaddress = Jun 11 23:14:38.596700 np0000002687 nova-compute[98431]: iface.prefix_len = 0 Jun 11 23:14:38.596700 np0000002687 nova-compute[98431]: iface.hwaddress = Jun 11 23:14:38.596700 np0000002687 nova-compute[98431]: iface.transport_name = tcp Jun 11 23:14:38.596700 np0000002687 nova-compute[98431]: iface.initiatorname = Jun 11 23:14:38.596700 np0000002687 nova-compute[98431]: iface.state = Jun 11 23:14:38.596700 np0000002687 nova-compute[98431]: iface.vlan_id = 0 Jun 11 23:14:38.596700 np0000002687 nova-compute[98431]: iface.vlan_priority = 0 Jun 11 23:14:38.596700 np0000002687 nova-compute[98431]: iface.vlan_state = Jun 11 23:14:38.596700 np0000002687 nova-compute[98431]: iface.iface_num = 0 Jun 11 23:14:38.596700 np0000002687 nova-compute[98431]: iface.mtu = 0 Jun 11 23:14:38.596700 np0000002687 nova-compute[98431]: iface.port = 0 Jun 11 23:14:38.596700 np0000002687 nova-compute[98431]: iface.bootproto = Jun 11 23:14:38.596700 np0000002687 nova-compute[98431]: iface.subnet_mask = Jun 11 23:14:38.596700 np0000002687 nova-compute[98431]: iface.gateway = Jun 11 23:14:38.596700 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id_state = Jun 11 23:14:38.596700 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id = Jun 11 23:14:38.596700 np0000002687 nova-compute[98431]: iface.dhcp_dns = Jun 11 23:14:38.596700 np0000002687 nova-compute[98431]: iface.dhcp_learn_iqn = Jun 11 23:14:38.596700 np0000002687 nova-compute[98431]: iface.dhcp_req_vendor_id_state = Jun 11 23:14:38.596700 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id_state = Jun 11 23:14:38.596700 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id = Jun 11 23:14:38.596700 np0000002687 nova-compute[98431]: iface.dhcp_slp_da = Jun 11 23:14:38.596700 np0000002687 nova-compute[98431]: iface.fragmentation = Jun 11 23:14:38.596700 np0000002687 nova-compute[98431]: iface.gratuitous_arp = Jun 11 23:14:38.596700 np0000002687 nova-compute[98431]: iface.incoming_forwarding = Jun 11 23:14:38.596700 np0000002687 nova-compute[98431]: iface.tos_state = Jun 11 23:14:38.596700 np0000002687 nova-compute[98431]: iface.tos = 0 Jun 11 23:14:38.596700 np0000002687 nova-compute[98431]: iface.ttl = 0 Jun 11 23:14:38.596700 np0000002687 nova-compute[98431]: iface.delayed_ack = Jun 11 23:14:38.596700 np0000002687 nova-compute[98431]: iface.tcp_nagle = Jun 11 23:14:38.596700 np0000002687 nova-compute[98431]: iface.tcp_wsf_state = Jun 11 23:14:38.596700 np0000002687 nova-compute[98431]: iface.tcp_wsf = 0 Jun 11 23:14:38.596700 np0000002687 nova-compute[98431]: iface.tcp_timer_scale = 0 Jun 11 23:14:38.596700 np0000002687 nova-compute[98431]: iface.tcp_timestamp = Jun 11 23:14:38.596700 np0000002687 nova-compute[98431]: iface.redirect = Jun 11 23:14:38.596700 np0000002687 nova-compute[98431]: iface.def_task_mgmt_timeout = 0 Jun 11 23:14:38.596700 np0000002687 nova-compute[98431]: iface.header_digest = Jun 11 23:14:38.596700 np0000002687 nova-compute[98431]: iface.data_digest = Jun 11 23:14:38.596700 np0000002687 nova-compute[98431]: iface.immediate_data = Jun 11 23:14:38.596700 np0000002687 nova-compute[98431]: iface.initial_r2t = Jun 11 23:14:38.596700 np0000002687 nova-compute[98431]: iface.data_seq_inorder = Jun 11 23:14:38.596700 np0000002687 nova-compute[98431]: iface.data_pdu_inorder = Jun 11 23:14:38.596700 np0000002687 nova-compute[98431]: iface.erl = 0 Jun 11 23:14:38.596700 np0000002687 nova-compute[98431]: iface.max_receive_data_len = 0 Jun 11 23:14:38.596700 np0000002687 nova-compute[98431]: iface.first_burst_len = 0 Jun 11 23:14:38.596700 np0000002687 nova-compute[98431]: iface.max_outstanding_r2t = 0 Jun 11 23:14:38.596700 np0000002687 nova-compute[98431]: iface.max_burst_len = 0 Jun 11 23:14:38.596700 np0000002687 nova-compute[98431]: iface.chap_auth = Jun 11 23:14:38.596700 np0000002687 nova-compute[98431]: iface.bidi_chap = Jun 11 23:14:38.596700 np0000002687 nova-compute[98431]: iface.strict_login_compliance = Jun 11 23:14:38.596700 np0000002687 nova-compute[98431]: iface.discovery_auth = Jun 11 23:14:38.596700 np0000002687 nova-compute[98431]: iface.discovery_logout = Jun 11 23:14:38.596700 np0000002687 nova-compute[98431]: node.discovery_address = Jun 11 23:14:38.596700 np0000002687 nova-compute[98431]: node.discovery_port = 0 Jun 11 23:14:38.596700 np0000002687 nova-compute[98431]: node.discovery_type = fw Jun 11 23:14:38.596700 np0000002687 nova-compute[98431]: node.session.initial_cmdsn = 0 Jun 11 23:14:38.596700 np0000002687 nova-compute[98431]: node.session.initial_login_retry_max = 8 Jun 11 23:14:38.596700 np0000002687 nova-compute[98431]: node.session.xmit_thread_priority = 0 Jun 11 23:14:38.596700 np0000002687 nova-compute[98431]: node.session.cmds_max = 128 Jun 11 23:14:38.596700 np0000002687 nova-compute[98431]: node.session.queue_depth = 32 Jun 11 23:14:38.596700 np0000002687 nova-compute[98431]: node.session.nr_sessions = 1 Jun 11 23:14:38.596700 np0000002687 nova-compute[98431]: node.session.auth.authmethod = None Jun 11 23:14:38.596700 np0000002687 nova-compute[98431]: node.session.auth.username = Jun 11 23:14:38.596700 np0000002687 nova-compute[98431]: node.session.auth.password = *** Jun 11 23:14:38.596700 np0000002687 nova-compute[98431]: node.session.auth.username_in = Jun 11 23:14:38.596700 np0000002687 nova-compute[98431]: node.session.auth.password_in = Jun 11 23:14:38.596700 np0000002687 nova-compute[98431]: node.session.auth.chap_algs = SHA256 Jun 11 23:14:38.596700 np0000002687 nova-compute[98431]: node.session.timeo.replacement_timeout = 120 Jun 11 23:14:38.596700 np0000002687 nova-compute[98431]: node.session.err_timeo.abort_timeout = 15 Jun 11 23:14:38.596700 np0000002687 nova-compute[98431]: node.session.err_timeo.lu_reset_timeout = 30 Jun 11 23:14:38.596700 np0000002687 nova-compute[98431]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 11 23:14:38.596700 np0000002687 nova-compute[98431]: node.session.err_timeo.host_reset_timeout = 60 Jun 11 23:14:38.596700 np0000002687 nova-compute[98431]: node.session.iscsi.FastAbort = Yes Jun 11 23:14:38.596700 np0000002687 nova-compute[98431]: node.session.iscsi.InitialR2T = No Jun 11 23:14:38.596700 np0000002687 nova-compute[98431]: node.session.iscsi.ImmediateData = Yes Jun 11 23:14:38.596700 np0000002687 nova-compute[98431]: node.session.iscsi.FirstBurstLength = 262144 Jun 11 23:14:38.596700 np0000002687 nova-compute[98431]: node.session.iscsi.MaxBurstLength = 16776192 Jun 11 23:14:38.596700 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Retain = 0 Jun 11 23:14:38.596700 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Wait = 2 Jun 11 23:14:38.596700 np0000002687 nova-compute[98431]: node.session.iscsi.MaxConnections = 1 Jun 11 23:14:38.596700 np0000002687 nova-compute[98431]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 11 23:14:38.596700 np0000002687 nova-compute[98431]: node.session.iscsi.ERL = 0 Jun 11 23:14:38.596700 np0000002687 nova-compute[98431]: node.session.scan = auto Jun 11 23:14:38.596700 np0000002687 nova-compute[98431]: node.session.reopen_max = 0 Jun 11 23:14:38.596700 np0000002687 nova-compute[98431]: node.conn[0].address = 192.168.40.100 Jun 11 23:14:38.596700 np0000002687 nova-compute[98431]: node.conn[0].port = 3260 Jun 11 23:14:38.596700 np0000002687 nova-compute[98431]: node.conn[0].startup = manual Jun 11 23:14:38.596700 np0000002687 nova-compute[98431]: node.conn[0].tcp.window_size = 524288 Jun 11 23:14:38.596700 np0000002687 nova-compute[98431]: node.conn[0].tcp.type_of_service = 0 Jun 11 23:14:38.596700 np0000002687 nova-compute[98431]: node.conn[0].timeo.logout_timeout = 15 Jun 11 23:14:38.596700 np0000002687 nova-compute[98431]: node.conn[0].timeo.login_timeout = 15 Jun 11 23:14:38.596700 np0000002687 nova-compute[98431]: node.conn[0].timeo.auth_timeout = 45 Jun 11 23:14:38.596700 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_interval = 5 Jun 11 23:14:38.596700 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_timeout = 5 Jun 11 23:14:38.596700 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 11 23:14:38.596700 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 11 23:14:38.596700 np0000002687 nova-compute[98431]: node.conn[0].iscsi.HeaderDigest = None Jun 11 23:14:38.596700 np0000002687 nova-compute[98431]: node.conn[0].iscsi.DataDigest = None Jun 11 23:14:38.596700 np0000002687 nova-compute[98431]: node.conn[0].iscsi.IFMarker = No Jun 11 23:14:38.596700 np0000002687 nova-compute[98431]: node.conn[0].iscsi.OFMarker = No Jun 11 23:14:38.596700 np0000002687 nova-compute[98431]: # END RECORD Jun 11 23:14:38.596700 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:14:38.613251 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:14:38.622272 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:14:38.637345 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:14:38.637345 np0000002687 nova-compute[98431]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:14:38.637345 np0000002687 nova-compute[98431]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:14:38.637345 np0000002687 nova-compute[98431]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:14:38.637345 np0000002687 nova-compute[98431]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:14:38.637345 np0000002687 nova-compute[98431]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8 (non-flash) Jun 11 23:14:38.637345 np0000002687 nova-compute[98431]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8 (non-flash) Jun 11 23:14:38.637345 np0000002687 nova-compute[98431]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13 (non-flash) Jun 11 23:14:38.637345 np0000002687 nova-compute[98431]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13 (non-flash) Jun 11 23:14:38.637345 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:14:38.637345 np0000002687 nova-compute[98431]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1 (non-flash) Jun 11 23:14:38.637345 np0000002687 nova-compute[98431]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1 (non-flash) Jun 11 23:14:38.637345 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:14:38.637345 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:14:38.637345 np0000002687 nova-compute[98431]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:14:38.637345 np0000002687 nova-compute[98431]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:14:38.637345 np0000002687 nova-compute[98431]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:14:38.637345 np0000002687 nova-compute[98431]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:14:38.637345 np0000002687 nova-compute[98431]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8 (non-flash) Jun 11 23:14:38.637345 np0000002687 nova-compute[98431]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8 (non-flash) Jun 11 23:14:38.637345 np0000002687 nova-compute[98431]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13 (non-flash) Jun 11 23:14:38.637345 np0000002687 nova-compute[98431]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13 (non-flash) Jun 11 23:14:38.637345 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:14:38.637345 np0000002687 nova-compute[98431]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1 (non-flash) Jun 11 23:14:38.637345 np0000002687 nova-compute[98431]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1 (non-flash) Jun 11 23:14:38.637345 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:14:38.660037 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:14:38.660037 np0000002687 nova-compute[98431]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:14:38.660037 np0000002687 nova-compute[98431]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:14:38.660037 np0000002687 nova-compute[98431]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:14:38.660037 np0000002687 nova-compute[98431]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:14:38.660037 np0000002687 nova-compute[98431]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8 (non-flash) Jun 11 23:14:38.660037 np0000002687 nova-compute[98431]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8 (non-flash) Jun 11 23:14:38.660037 np0000002687 nova-compute[98431]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13 (non-flash) Jun 11 23:14:38.660037 np0000002687 nova-compute[98431]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13 (non-flash) Jun 11 23:14:38.660037 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:14:38.660037 np0000002687 nova-compute[98431]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1 (non-flash) Jun 11 23:14:38.660037 np0000002687 nova-compute[98431]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1 (non-flash) Jun 11 23:14:38.660037 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:14:38.660481 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:14:38.660481 np0000002687 nova-compute[98431]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:14:38.660481 np0000002687 nova-compute[98431]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:14:38.660481 np0000002687 nova-compute[98431]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:14:38.660481 np0000002687 nova-compute[98431]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:14:38.660481 np0000002687 nova-compute[98431]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8 (non-flash) Jun 11 23:14:38.660481 np0000002687 nova-compute[98431]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8 (non-flash) Jun 11 23:14:38.660481 np0000002687 nova-compute[98431]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13 (non-flash) Jun 11 23:14:38.660481 np0000002687 nova-compute[98431]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13 (non-flash) Jun 11 23:14:38.660481 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:14:38.660481 np0000002687 nova-compute[98431]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1 (non-flash) Jun 11 23:14:38.660481 np0000002687 nova-compute[98431]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1 (non-flash) Jun 11 23:14:38.660481 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:14:38.709782 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f7e59f73-fc24-4ce4-8dd2-08f2f6948647, portal: 192.168.50.100,3260] Jun 11 23:14:38.709782 np0000002687 nova-compute[98431]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f7e59f73-fc24-4ce4-8dd2-08f2f6948647, portal: 192.168.50.100,3260] successful. Jun 11 23:14:38.709782 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:14:38.730365 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:14:38.741901 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f7e59f73-fc24-4ce4-8dd2-08f2f6948647, portal: 192.168.40.100,3260] Jun 11 23:14:38.741901 np0000002687 nova-compute[98431]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f7e59f73-fc24-4ce4-8dd2-08f2f6948647, portal: 192.168.40.100,3260] successful. Jun 11 23:14:38.741901 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:14:38.755142 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:14:38.755142 np0000002687 nova-compute[98431]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:14:38.755142 np0000002687 nova-compute[98431]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:14:38.755142 np0000002687 nova-compute[98431]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:14:38.755142 np0000002687 nova-compute[98431]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:14:38.755142 np0000002687 nova-compute[98431]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8 (non-flash) Jun 11 23:14:38.755142 np0000002687 nova-compute[98431]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8 (non-flash) Jun 11 23:14:38.755142 np0000002687 nova-compute[98431]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13 (non-flash) Jun 11 23:14:38.755142 np0000002687 nova-compute[98431]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13 (non-flash) Jun 11 23:14:38.755142 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:14:38.755142 np0000002687 nova-compute[98431]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1 (non-flash) Jun 11 23:14:38.755142 np0000002687 nova-compute[98431]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1 (non-flash) Jun 11 23:14:38.755142 np0000002687 nova-compute[98431]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7e59f73-fc24-4ce4-8dd2-08f2f6948647 (non-flash) Jun 11 23:14:38.755142 np0000002687 nova-compute[98431]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7e59f73-fc24-4ce4-8dd2-08f2f6948647 (non-flash) Jun 11 23:14:38.755142 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:14:38.755516 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:14:38.755516 np0000002687 nova-compute[98431]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:14:38.755516 np0000002687 nova-compute[98431]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:14:38.755516 np0000002687 nova-compute[98431]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:14:38.755516 np0000002687 nova-compute[98431]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:14:38.755516 np0000002687 nova-compute[98431]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8 (non-flash) Jun 11 23:14:38.755516 np0000002687 nova-compute[98431]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8 (non-flash) Jun 11 23:14:38.755516 np0000002687 nova-compute[98431]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13 (non-flash) Jun 11 23:14:38.755516 np0000002687 nova-compute[98431]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13 (non-flash) Jun 11 23:14:38.755516 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:14:38.755516 np0000002687 nova-compute[98431]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1 (non-flash) Jun 11 23:14:38.755516 np0000002687 nova-compute[98431]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1 (non-flash) Jun 11 23:14:38.755516 np0000002687 nova-compute[98431]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7e59f73-fc24-4ce4-8dd2-08f2f6948647 (non-flash) Jun 11 23:14:38.755516 np0000002687 nova-compute[98431]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7e59f73-fc24-4ce4-8dd2-08f2f6948647 (non-flash) Jun 11 23:14:38.755516 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:14:38.755945 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f7e59f73-fc24-4ce4-8dd2-08f2f6948647" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.235s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 11 23:14:38.756090 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] Connected to 192.168.50.100:3260 {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 11 23:14:38.757443 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:14:38.758928 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] HCTL ('15', '-', '-', 0) found on session 45 with lun 0 {{(pid=98431) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 11 23:14:38.758928 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98431) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 11 23:14:38.781349 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Emitting event Started> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:14:38.781349 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 14cc8d05-e33d-434f-b2b3-0dad3b613e73] VM Started (Lifecycle Event) Jun 11 23:14:38.791311 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:14:38.791311 np0000002687 nova-compute[98431]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:14:38.791311 np0000002687 nova-compute[98431]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:14:38.791311 np0000002687 nova-compute[98431]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:14:38.791311 np0000002687 nova-compute[98431]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:14:38.791311 np0000002687 nova-compute[98431]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8 (non-flash) Jun 11 23:14:38.791311 np0000002687 nova-compute[98431]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8 (non-flash) Jun 11 23:14:38.791311 np0000002687 nova-compute[98431]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13 (non-flash) Jun 11 23:14:38.791311 np0000002687 nova-compute[98431]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13 (non-flash) Jun 11 23:14:38.791311 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:14:38.791311 np0000002687 nova-compute[98431]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1 (non-flash) Jun 11 23:14:38.791311 np0000002687 nova-compute[98431]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1 (non-flash) Jun 11 23:14:38.791311 np0000002687 nova-compute[98431]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7e59f73-fc24-4ce4-8dd2-08f2f6948647 (non-flash) Jun 11 23:14:38.791311 np0000002687 nova-compute[98431]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7e59f73-fc24-4ce4-8dd2-08f2f6948647 (non-flash) Jun 11 23:14:38.791311 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:14:38.791311 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:14:38.791311 np0000002687 nova-compute[98431]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:14:38.791311 np0000002687 nova-compute[98431]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:14:38.791311 np0000002687 nova-compute[98431]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:14:38.791311 np0000002687 nova-compute[98431]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:14:38.791311 np0000002687 nova-compute[98431]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8 (non-flash) Jun 11 23:14:38.791311 np0000002687 nova-compute[98431]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8 (non-flash) Jun 11 23:14:38.791311 np0000002687 nova-compute[98431]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13 (non-flash) Jun 11 23:14:38.791311 np0000002687 nova-compute[98431]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13 (non-flash) Jun 11 23:14:38.791311 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:14:38.791311 np0000002687 nova-compute[98431]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1 (non-flash) Jun 11 23:14:38.791311 np0000002687 nova-compute[98431]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1 (non-flash) Jun 11 23:14:38.791311 np0000002687 nova-compute[98431]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7e59f73-fc24-4ce4-8dd2-08f2f6948647 (non-flash) Jun 11 23:14:38.791311 np0000002687 nova-compute[98431]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7e59f73-fc24-4ce4-8dd2-08f2f6948647 (non-flash) Jun 11 23:14:38.791311 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:14:38.792691 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f7e59f73-fc24-4ce4-8dd2-08f2f6948647" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.278s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 11 23:14:38.792691 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] Connected to 192.168.40.100:3260 {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 11 23:14:38.796649 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] Searching for a device in session 45 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=98431) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 11 23:14:38.796649 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f7e59f73-fc24-4ce4-8dd2-08f2f6948647', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'f7e59f73-fc24-4ce4-8dd2-08f2f6948647', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 11 23:14:38.797207 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] HCTL ('16', '-', '-', 0) found on session 46 with lun 0 {{(pid=98431) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 11 23:14:38.797365 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98431) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 11 23:14:38.818399 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] Searching for a device in session 46 and hctl ['16', '*', '*', 0] yield: None {{(pid=98431) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 11 23:14:39.102884 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-906eaf40-a185-4ac7-8524-7ef2f96dda79 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] [instance: 14cc8d05-e33d-434f-b2b3-0dad3b613e73] Found default for hw_cdrom_bus of ide {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:14:39.102884 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-906eaf40-a185-4ac7-8524-7ef2f96dda79 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] [instance: 14cc8d05-e33d-434f-b2b3-0dad3b613e73] Found default for hw_disk_bus of virtio {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:14:39.102884 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-906eaf40-a185-4ac7-8524-7ef2f96dda79 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] [instance: 14cc8d05-e33d-434f-b2b3-0dad3b613e73] Found default for hw_input_bus of None {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:14:39.102884 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-906eaf40-a185-4ac7-8524-7ef2f96dda79 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] [instance: 14cc8d05-e33d-434f-b2b3-0dad3b613e73] Found default for hw_pointer_model of None {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:14:39.102884 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-906eaf40-a185-4ac7-8524-7ef2f96dda79 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] [instance: 14cc8d05-e33d-434f-b2b3-0dad3b613e73] Found default for hw_video_model of virtio {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:14:39.102884 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-906eaf40-a185-4ac7-8524-7ef2f96dda79 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] [instance: 14cc8d05-e33d-434f-b2b3-0dad3b613e73] Found default for hw_vif_model of virtio {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:14:39.283829 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 14cc8d05-e33d-434f-b2b3-0dad3b613e73] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:14:39.285661 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 14cc8d05-e33d-434f-b2b3-0dad3b613e73] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98431) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 11 23:14:39.594689 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:39.609056 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-906eaf40-a185-4ac7-8524-7ef2f96dda79 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] [instance: 14cc8d05-e33d-434f-b2b3-0dad3b613e73] Took 8.22 seconds to spawn the instance on the hypervisor. Jun 11 23:14:39.609331 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-906eaf40-a185-4ac7-8524-7ef2f96dda79 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] [instance: 14cc8d05-e33d-434f-b2b3-0dad3b613e73] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:14:39.789093 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 14cc8d05-e33d-434f-b2b3-0dad3b613e73] During sync_power_state the instance has a pending task (spawning). Skip. Jun 11 23:14:39.789510 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Emitting event Paused> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:14:39.789510 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 14cc8d05-e33d-434f-b2b3-0dad3b613e73] VM Paused (Lifecycle Event) Jun 11 23:14:39.818702 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] Searching for a device in session 46 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98431) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 11 23:14:39.818878 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f7e59f73-fc24-4ce4-8dd2-08f2f6948647', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f7e59f73-fc24-4ce4-8dd2-08f2f6948647', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 11 23:14:39.867038 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] Stashing vm_state: active {{(pid=98431) _prep_resize /opt/stack/nova/nova/compute/manager.py:6338}} Jun 11 23:14:39.929369 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-cabcdc7c-ca9f-4ad1-9530-9a9966b98f4c req-850a7366-ba75-46c9-acc1-ce8c4a0cd5e5 service nova] [instance: 14cc8d05-e33d-434f-b2b3-0dad3b613e73] Received event network-vif-plugged-64bb5344-fa8f-436b-8c25-3dd5df49e17f {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:14:39.930405 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-cabcdc7c-ca9f-4ad1-9530-9a9966b98f4c req-850a7366-ba75-46c9-acc1-ce8c4a0cd5e5 service nova] Acquiring lock "14cc8d05-e33d-434f-b2b3-0dad3b613e73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:14:39.930655 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-cabcdc7c-ca9f-4ad1-9530-9a9966b98f4c req-850a7366-ba75-46c9-acc1-ce8c4a0cd5e5 service nova] Lock "14cc8d05-e33d-434f-b2b3-0dad3b613e73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:14:39.930889 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-cabcdc7c-ca9f-4ad1-9530-9a9966b98f4c req-850a7366-ba75-46c9-acc1-ce8c4a0cd5e5 service nova] Lock "14cc8d05-e33d-434f-b2b3-0dad3b613e73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:14:39.931006 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-cabcdc7c-ca9f-4ad1-9530-9a9966b98f4c req-850a7366-ba75-46c9-acc1-ce8c4a0cd5e5 service nova] [instance: 14cc8d05-e33d-434f-b2b3-0dad3b613e73] No waiting events found dispatching network-vif-plugged-64bb5344-fa8f-436b-8c25-3dd5df49e17f {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:14:39.931180 np0000002687 nova-compute[98431]: WARNING nova.compute.manager [req-cabcdc7c-ca9f-4ad1-9530-9a9966b98f4c req-850a7366-ba75-46c9-acc1-ce8c4a0cd5e5 service nova] [instance: 14cc8d05-e33d-434f-b2b3-0dad3b613e73] Received unexpected event network-vif-plugged-64bb5344-fa8f-436b-8c25-3dd5df49e17f for instance with vm_state active and task_state None. Jun 11 23:14:39.931321 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-cabcdc7c-ca9f-4ad1-9530-9a9966b98f4c req-850a7366-ba75-46c9-acc1-ce8c4a0cd5e5 service nova] [instance: 010aa26e-fb15-47ee-a9b7-089dbfdfd1c7] Received event network-changed-75b6f9f6-6287-4fd3-ae85-5f0145c9ecca {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:14:39.931447 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-cabcdc7c-ca9f-4ad1-9530-9a9966b98f4c req-850a7366-ba75-46c9-acc1-ce8c4a0cd5e5 service nova] [instance: 010aa26e-fb15-47ee-a9b7-089dbfdfd1c7] Refreshing instance network info cache due to event network-changed-75b6f9f6-6287-4fd3-ae85-5f0145c9ecca. {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 11 23:14:39.932755 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-cabcdc7c-ca9f-4ad1-9530-9a9966b98f4c req-850a7366-ba75-46c9-acc1-ce8c4a0cd5e5 service nova] Acquiring lock "refresh_cache-010aa26e-fb15-47ee-a9b7-089dbfdfd1c7" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 11 23:14:39.932950 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-cabcdc7c-ca9f-4ad1-9530-9a9966b98f4c req-850a7366-ba75-46c9-acc1-ce8c4a0cd5e5 service nova] Acquired lock "refresh_cache-010aa26e-fb15-47ee-a9b7-089dbfdfd1c7" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 11 23:14:39.933201 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-cabcdc7c-ca9f-4ad1-9530-9a9966b98f4c req-850a7366-ba75-46c9-acc1-ce8c4a0cd5e5 service nova] [instance: 010aa26e-fb15-47ee-a9b7-089dbfdfd1c7] Refreshing network info cache for port 75b6f9f6-6287-4fd3-ae85-5f0145c9ecca {{(pid=98431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 11 23:14:40.119124 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-906eaf40-a185-4ac7-8524-7ef2f96dda79 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] [instance: 14cc8d05-e33d-434f-b2b3-0dad3b613e73] Took 14.19 seconds to build instance. Jun 11 23:14:40.292218 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 14cc8d05-e33d-434f-b2b3-0dad3b613e73] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:14:40.294958 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Emitting event Resumed> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:14:40.295219 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 14cc8d05-e33d-434f-b2b3-0dad3b613e73] VM Resumed (Lifecycle Event) Jun 11 23:14:40.436833 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:14:40.436833 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:14:40.439151 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [req-cabcdc7c-ca9f-4ad1-9530-9a9966b98f4c req-850a7366-ba75-46c9-acc1-ce8c4a0cd5e5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:14:40.541893 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] Found WWN 33000000063147393 for multipath device dm-8 {{(pid=98431) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 11 23:14:40.541893 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.041s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 11 23:14:40.541893 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] <== connect_volume: return (3041ms) {'type': 'block', 'scsi_wwn': '33000000063147393', 'path': '/dev/dm-8', 'multipath_id': '33000000063147393'} {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 11 23:14:40.541893 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] [instance: cab1cc43-b433-4772-9f01-0197502c8b57] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000063147393', 'path': '/dev/dm-8', 'multipath_id': '33000000063147393'} {{(pid=98431) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 11 23:14:40.620980 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-906eaf40-a185-4ac7-8524-7ef2f96dda79 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Lock "14cc8d05-e33d-434f-b2b3-0dad3b613e73" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 15.701s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:14:40.798068 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 14cc8d05-e33d-434f-b2b3-0dad3b613e73] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:14:40.801037 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 14cc8d05-e33d-434f-b2b3-0dad3b613e73] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98431) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 11 23:14:40.949727 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98431) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 11 23:14:40.950100 np0000002687 nova-compute[98431]: INFO nova.compute.claims [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] Claim successful on node np0000002687 Jun 11 23:14:41.047166 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-11T23:14:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='instance-depend-image',display_name='instance-depend-image',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='instance-depend-image',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e4028976d11d4dfdb2a6f8637d28c73d',ramdisk_id='',reservation_id='r-0a9ynk8w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ImageDependencyTests-1754620563',owner_user_name='tempest-ImageDependencyTests-1754620563-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-11T23:14:33Z,user_data=None,user_id='d1bfc36c83e84cfbac05bd2daacaf580',uuid=cab1cc43-b433-4772-9f01-0197502c8b57,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "807d693f-6c88-415d-8c16-1187f9dd28c2", "address": "fa:16:3e:17:0e:ab", "network": {"id": "e7f47484-d4a6-4304-95df-65b18550a507", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ce012f9fabdb4ee5a73e212437f59d97", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap807d693f-6c", "ovs_interfaceid": "807d693f-6c88-415d-8c16-1187f9dd28c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98431) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 11 23:14:41.047166 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] Converting VIF {"id": "807d693f-6c88-415d-8c16-1187f9dd28c2", "address": "fa:16:3e:17:0e:ab", "network": {"id": "e7f47484-d4a6-4304-95df-65b18550a507", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ce012f9fabdb4ee5a73e212437f59d97", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap807d693f-6c", "ovs_interfaceid": "807d693f-6c88-415d-8c16-1187f9dd28c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:14:41.047166 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:0e:ab,bridge_name='br-int',has_traffic_filtering=True,id=807d693f-6c88-415d-8c16-1187f9dd28c2,network=Network(e7f47484-d4a6-4304-95df-65b18550a507),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap807d693f-6c') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:14:41.047166 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] Lazy-loading 'pci_devices' on Instance uuid cab1cc43-b433-4772-9f01-0197502c8b57 {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:14:41.394501 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [req-cabcdc7c-ca9f-4ad1-9530-9a9966b98f4c req-850a7366-ba75-46c9-acc1-ce8c4a0cd5e5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:14:41.458012 np0000002687 nova-compute[98431]: INFO nova.compute.resource_tracker [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] Updating resource usage from migration 58e91fdb-feef-45c5-9524-61c903923259 Jun 11 23:14:41.552241 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] [instance: cab1cc43-b433-4772-9f01-0197502c8b57] End _get_guest_xml xml= Jun 11 23:14:41.552241 np0000002687 nova-compute[98431]: cab1cc43-b433-4772-9f01-0197502c8b57 Jun 11 23:14:41.552241 np0000002687 nova-compute[98431]: instance-0000001a Jun 11 23:14:41.552241 np0000002687 nova-compute[98431]: 196608 Jun 11 23:14:41.552241 np0000002687 nova-compute[98431]: 1 Jun 11 23:14:41.552241 np0000002687 nova-compute[98431]: Jun 11 23:14:41.552241 np0000002687 nova-compute[98431]: Jun 11 23:14:41.552241 np0000002687 nova-compute[98431]: Jun 11 23:14:41.552241 np0000002687 nova-compute[98431]: instance-depend-image Jun 11 23:14:41.552241 np0000002687 nova-compute[98431]: 2026-06-11 23:14:37 Jun 11 23:14:41.552241 np0000002687 nova-compute[98431]: Jun 11 23:14:41.552241 np0000002687 nova-compute[98431]: 192 Jun 11 23:14:41.552241 np0000002687 nova-compute[98431]: 1 Jun 11 23:14:41.552241 np0000002687 nova-compute[98431]: 0 Jun 11 23:14:41.552241 np0000002687 nova-compute[98431]: 0 Jun 11 23:14:41.552241 np0000002687 nova-compute[98431]: 1 Jun 11 23:14:41.552241 np0000002687 nova-compute[98431]: Jun 11 23:14:41.552241 np0000002687 nova-compute[98431]: True Jun 11 23:14:41.552241 np0000002687 nova-compute[98431]: Jun 11 23:14:41.552241 np0000002687 nova-compute[98431]: Jun 11 23:14:41.552241 np0000002687 nova-compute[98431]: Jun 11 23:14:41.552241 np0000002687 nova-compute[98431]: 1 Jun 11 23:14:41.552241 np0000002687 nova-compute[98431]: 0 Jun 11 23:14:41.552241 np0000002687 nova-compute[98431]: Jun 11 23:14:41.552241 np0000002687 nova-compute[98431]: Jun 11 23:14:41.552241 np0000002687 nova-compute[98431]: Jun 11 23:14:41.552241 np0000002687 nova-compute[98431]: tempest-ImageDependencyTests-1754620563-project-member Jun 11 23:14:41.552241 np0000002687 nova-compute[98431]: tempest-ImageDependencyTests-1754620563 Jun 11 23:14:41.552241 np0000002687 nova-compute[98431]: Jun 11 23:14:41.552241 np0000002687 nova-compute[98431]: Jun 11 23:14:41.552241 np0000002687 nova-compute[98431]: Jun 11 23:14:41.552241 np0000002687 nova-compute[98431]: Jun 11 23:14:41.552241 np0000002687 nova-compute[98431]: Jun 11 23:14:41.552241 np0000002687 nova-compute[98431]: Jun 11 23:14:41.552241 np0000002687 nova-compute[98431]: Jun 11 23:14:41.552241 np0000002687 nova-compute[98431]: Jun 11 23:14:41.552241 np0000002687 nova-compute[98431]: Jun 11 23:14:41.552241 np0000002687 nova-compute[98431]: Jun 11 23:14:41.552241 np0000002687 nova-compute[98431]: Jun 11 23:14:41.552241 np0000002687 nova-compute[98431]: OpenStack Foundation Jun 11 23:14:41.552241 np0000002687 nova-compute[98431]: OpenStack Nova Jun 11 23:14:41.552241 np0000002687 nova-compute[98431]: 33.1.0 Jun 11 23:14:41.552241 np0000002687 nova-compute[98431]: cab1cc43-b433-4772-9f01-0197502c8b57 Jun 11 23:14:41.552241 np0000002687 nova-compute[98431]: cab1cc43-b433-4772-9f01-0197502c8b57 Jun 11 23:14:41.552241 np0000002687 nova-compute[98431]: Virtual Machine Jun 11 23:14:41.552241 np0000002687 nova-compute[98431]: Jun 11 23:14:41.552241 np0000002687 nova-compute[98431]: Jun 11 23:14:41.552241 np0000002687 nova-compute[98431]: Jun 11 23:14:41.552241 np0000002687 nova-compute[98431]: hvm Jun 11 23:14:41.552241 np0000002687 nova-compute[98431]: Jun 11 23:14:41.552241 np0000002687 nova-compute[98431]: Jun 11 23:14:41.552241 np0000002687 nova-compute[98431]: Jun 11 23:14:41.552241 np0000002687 nova-compute[98431]: Jun 11 23:14:41.552241 np0000002687 nova-compute[98431]: Jun 11 23:14:41.552241 np0000002687 nova-compute[98431]: Jun 11 23:14:41.552241 np0000002687 nova-compute[98431]: 128 Jun 11 23:14:41.552241 np0000002687 nova-compute[98431]: Jun 11 23:14:41.552241 np0000002687 nova-compute[98431]: Jun 11 23:14:41.552241 np0000002687 nova-compute[98431]: Jun 11 23:14:41.552241 np0000002687 nova-compute[98431]: 1 Jun 11 23:14:41.552241 np0000002687 nova-compute[98431]: Jun 11 23:14:41.552241 np0000002687 nova-compute[98431]: Jun 11 23:14:41.552241 np0000002687 nova-compute[98431]: Nehalem Jun 11 23:14:41.552241 np0000002687 nova-compute[98431]: Jun 11 23:14:41.552241 np0000002687 nova-compute[98431]: Jun 11 23:14:41.552241 np0000002687 nova-compute[98431]: Jun 11 23:14:41.552241 np0000002687 nova-compute[98431]: Jun 11 23:14:41.552241 np0000002687 nova-compute[98431]: Jun 11 23:14:41.552241 np0000002687 nova-compute[98431]: Jun 11 23:14:41.552241 np0000002687 nova-compute[98431]: Jun 11 23:14:41.552241 np0000002687 nova-compute[98431]: Jun 11 23:14:41.552241 np0000002687 nova-compute[98431]: Jun 11 23:14:41.552241 np0000002687 nova-compute[98431]: Jun 11 23:14:41.552241 np0000002687 nova-compute[98431]: Jun 11 23:14:41.552241 np0000002687 nova-compute[98431]: Jun 11 23:14:41.552241 np0000002687 nova-compute[98431]: Jun 11 23:14:41.552241 np0000002687 nova-compute[98431]: f7e59f73-fc24-4ce4-8dd2-08f2f6948647 Jun 11 23:14:41.552241 np0000002687 nova-compute[98431]: Jun 11 23:14:41.552241 np0000002687 nova-compute[98431]: Jun 11 23:14:41.552241 np0000002687 nova-compute[98431]: Jun 11 23:14:41.552241 np0000002687 nova-compute[98431]: Jun 11 23:14:41.552241 np0000002687 nova-compute[98431]: Jun 11 23:14:41.552241 np0000002687 nova-compute[98431]: Jun 11 23:14:41.552241 np0000002687 nova-compute[98431]: Jun 11 23:14:41.552241 np0000002687 nova-compute[98431]: Jun 11 23:14:41.552241 np0000002687 nova-compute[98431]: Jun 11 23:14:41.552241 np0000002687 nova-compute[98431]: Jun 11 23:14:41.552241 np0000002687 nova-compute[98431]: Jun 11 23:14:41.552241 np0000002687 nova-compute[98431]: Jun 11 23:14:41.552241 np0000002687 nova-compute[98431]: Jun 11 23:14:41.552241 np0000002687 nova-compute[98431]: Jun 11 23:14:41.552241 np0000002687 nova-compute[98431]: /dev/urandom Jun 11 23:14:41.552241 np0000002687 nova-compute[98431]: Jun 11 23:14:41.552241 np0000002687 nova-compute[98431]: Jun 11 23:14:41.552241 np0000002687 nova-compute[98431]: Jun 11 23:14:41.552241 np0000002687 nova-compute[98431]: Jun 11 23:14:41.552241 np0000002687 nova-compute[98431]: Jun 11 23:14:41.552241 np0000002687 nova-compute[98431]: Jun 11 23:14:41.552241 np0000002687 nova-compute[98431]: Jun 11 23:14:41.552241 np0000002687 nova-compute[98431]: {{(pid=98431) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 11 23:14:41.554444 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] [instance: cab1cc43-b433-4772-9f01-0197502c8b57] Preparing to wait for external event network-vif-plugged-807d693f-6c88-415d-8c16-1187f9dd28c2 {{(pid=98431) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 11 23:14:41.554444 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] Acquiring lock "cab1cc43-b433-4772-9f01-0197502c8b57-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:14:41.554444 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] Lock "cab1cc43-b433-4772-9f01-0197502c8b57-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:14:41.554444 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] Lock "cab1cc43-b433-4772-9f01-0197502c8b57-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:14:41.554649 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-11T23:14:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='instance-depend-image',display_name='instance-depend-image',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='instance-depend-image',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e4028976d11d4dfdb2a6f8637d28c73d',ramdisk_id='',reservation_id='r-0a9ynk8w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ImageDependencyTests-1754620563',owner_user_name='tempest-ImageDependencyTests-1754620563-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-11T23:14:33Z,user_data=None,user_id='d1bfc36c83e84cfbac05bd2daacaf580',uuid=cab1cc43-b433-4772-9f01-0197502c8b57,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "807d693f-6c88-415d-8c16-1187f9dd28c2", "address": "fa:16:3e:17:0e:ab", "network": {"id": "e7f47484-d4a6-4304-95df-65b18550a507", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ce012f9fabdb4ee5a73e212437f59d97", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap807d693f-6c", "ovs_interfaceid": "807d693f-6c88-415d-8c16-1187f9dd28c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 11 23:14:41.554997 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] Converting VIF {"id": "807d693f-6c88-415d-8c16-1187f9dd28c2", "address": "fa:16:3e:17:0e:ab", "network": {"id": "e7f47484-d4a6-4304-95df-65b18550a507", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ce012f9fabdb4ee5a73e212437f59d97", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap807d693f-6c", "ovs_interfaceid": "807d693f-6c88-415d-8c16-1187f9dd28c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:14:41.556118 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:0e:ab,bridge_name='br-int',has_traffic_filtering=True,id=807d693f-6c88-415d-8c16-1187f9dd28c2,network=Network(e7f47484-d4a6-4304-95df-65b18550a507),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap807d693f-6c') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:14:41.556562 np0000002687 nova-compute[98431]: DEBUG os_vif [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:0e:ab,bridge_name='br-int',has_traffic_filtering=True,id=807d693f-6c88-415d-8c16-1187f9dd28c2,network=Network(e7f47484-d4a6-4304-95df-65b18550a507),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap807d693f-6c') {{(pid=98431) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 11 23:14:41.557027 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:41.558524 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:14:41.558702 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 11 23:14:41.561386 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:41.561657 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '492d16cc-9e66-5fcf-832d-fc4c1f11096e', '_type': 'linux-noop'}}, row=False) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:14:41.562448 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:41.564890 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:14:41.564890 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:41.568166 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:41.569187 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap807d693f-6c, may_exist=True, interface_attrs={}) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:14:41.569187 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap807d693f-6c, col_values=(('qos', UUID('cda7a68b-ce9a-4bb5-ab21-85e5ecf67745')),), if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:14:41.569955 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap807d693f-6c, col_values=(('external_ids', {'iface-id': '807d693f-6c88-415d-8c16-1187f9dd28c2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:17:0e:ab', 'vm-uuid': 'cab1cc43-b433-4772-9f01-0197502c8b57'}),), if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:14:41.572405 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:41.574275 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:14:41.579901 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:41.581136 np0000002687 nova-compute[98431]: INFO os_vif [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:0e:ab,bridge_name='br-int',has_traffic_filtering=True,id=807d693f-6c88-415d-8c16-1187f9dd28c2,network=Network(e7f47484-d4a6-4304-95df-65b18550a507),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap807d693f-6c') Jun 11 23:14:41.590764 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-cabcdc7c-ca9f-4ad1-9530-9a9966b98f4c req-850a7366-ba75-46c9-acc1-ce8c4a0cd5e5 service nova] [instance: 010aa26e-fb15-47ee-a9b7-089dbfdfd1c7] Updated VIF entry in instance network info cache for port 75b6f9f6-6287-4fd3-ae85-5f0145c9ecca. {{(pid=98431) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 11 23:14:41.591045 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-cabcdc7c-ca9f-4ad1-9530-9a9966b98f4c req-850a7366-ba75-46c9-acc1-ce8c4a0cd5e5 service nova] [instance: 010aa26e-fb15-47ee-a9b7-089dbfdfd1c7] Updating instance_info_cache with network_info: [{"id": "75b6f9f6-6287-4fd3-ae85-5f0145c9ecca", "address": "fa:16:3e:03:1c:0a", "network": {"id": "05459848-a1d6-43f2-934a-5abedf048534", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-501623705-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dbca65bf08474994b1c22f42047c7cbc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap75b6f9f6-62", "ovs_interfaceid": "75b6f9f6-6287-4fd3-ae85-5f0145c9ecca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:14:42.099376 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-cabcdc7c-ca9f-4ad1-9530-9a9966b98f4c req-850a7366-ba75-46c9-acc1-ce8c4a0cd5e5 service nova] Releasing lock "refresh_cache-010aa26e-fb15-47ee-a9b7-089dbfdfd1c7" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 11 23:14:42.299454 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98431) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 11 23:14:42.300101 np0000002687 nova-compute[98431]: DEBUG nova.compute.provider_tree [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Inventory has not changed in ProviderTree for provider: e3e65fe2-9de9-4821-8b4a-ccae37c66e25 {{(pid=98431) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 11 23:14:42.464446 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-5952d4cc-4958-4114-a91a-17d1d2959667 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Acquiring lock "14cc8d05-e33d-434f-b2b3-0dad3b613e73" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:14:42.464659 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-5952d4cc-4958-4114-a91a-17d1d2959667 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Lock "14cc8d05-e33d-434f-b2b3-0dad3b613e73" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:14:42.464827 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-5952d4cc-4958-4114-a91a-17d1d2959667 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Acquiring lock "14cc8d05-e33d-434f-b2b3-0dad3b613e73-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:14:42.465007 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-5952d4cc-4958-4114-a91a-17d1d2959667 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Lock "14cc8d05-e33d-434f-b2b3-0dad3b613e73-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:14:42.465920 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-5952d4cc-4958-4114-a91a-17d1d2959667 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Lock "14cc8d05-e33d-434f-b2b3-0dad3b613e73-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:14:42.467975 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-5952d4cc-4958-4114-a91a-17d1d2959667 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] [instance: 14cc8d05-e33d-434f-b2b3-0dad3b613e73] Terminating instance Jun 11 23:14:42.802458 np0000002687 nova-compute[98431]: DEBUG nova.scheduler.client.report [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Inventory has not changed for provider e3e65fe2-9de9-4821-8b4a-ccae37c66e25 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98431) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 11 23:14:42.944041 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:42.971845 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-5952d4cc-4958-4114-a91a-17d1d2959667 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] [instance: 14cc8d05-e33d-434f-b2b3-0dad3b613e73] Start destroying the instance on the hypervisor. {{(pid=98431) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}} Jun 11 23:14:43.011708 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:43.035568 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:43.042263 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:43.083243 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:43.106947 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] No BDM found with device name hda, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:14:43.106947 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] No BDM found with device name vda, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:14:43.107330 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] No VIF found with MAC fa:16:3e:17:0e:ab, not building metadata {{(pid=98431) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13199}} Jun 11 23:14:43.107485 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] [instance: cab1cc43-b433-4772-9f01-0197502c8b57] Using config drive Jun 11 23:14:43.170355 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-28550522-488c-4569-9857-5e4d9e5f526b req-6c5dfe02-a91c-4775-b54e-5292467de3bb service nova] [instance: 14cc8d05-e33d-434f-b2b3-0dad3b613e73] Received event network-vif-unplugged-64bb5344-fa8f-436b-8c25-3dd5df49e17f {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:14:43.170962 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-28550522-488c-4569-9857-5e4d9e5f526b req-6c5dfe02-a91c-4775-b54e-5292467de3bb service nova] Acquiring lock "14cc8d05-e33d-434f-b2b3-0dad3b613e73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:14:43.170962 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-28550522-488c-4569-9857-5e4d9e5f526b req-6c5dfe02-a91c-4775-b54e-5292467de3bb service nova] Lock "14cc8d05-e33d-434f-b2b3-0dad3b613e73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:14:43.170962 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-28550522-488c-4569-9857-5e4d9e5f526b req-6c5dfe02-a91c-4775-b54e-5292467de3bb service nova] Lock "14cc8d05-e33d-434f-b2b3-0dad3b613e73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:14:43.170962 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-28550522-488c-4569-9857-5e4d9e5f526b req-6c5dfe02-a91c-4775-b54e-5292467de3bb service nova] [instance: 14cc8d05-e33d-434f-b2b3-0dad3b613e73] No waiting events found dispatching network-vif-unplugged-64bb5344-fa8f-436b-8c25-3dd5df49e17f {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:14:43.171127 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-28550522-488c-4569-9857-5e4d9e5f526b req-6c5dfe02-a91c-4775-b54e-5292467de3bb service nova] [instance: 14cc8d05-e33d-434f-b2b3-0dad3b613e73] Received event network-vif-unplugged-64bb5344-fa8f-436b-8c25-3dd5df49e17f for instance with task_state deleting. {{(pid=98431) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 11 23:14:43.311718 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 2.875s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:14:43.311931 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] Migrating Jun 11 23:14:43.312063 np0000002687 nova-compute[98431]: DEBUG nova.compute.rpcapi [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98431) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}} Jun 11 23:14:43.341942 np0000002687 nova-compute[98431]: DEBUG nova.utils [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Queued Task(fn=>, remaining_delay=14.999639616999957 future=) {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:14:43.343857 np0000002687 nova-compute[98431]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=14.996745078000004 future=) {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:14:43.343857 np0000002687 nova-compute[98431]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=14.996589693000033 future=) {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:14:43.346256 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [-] [instance: 14cc8d05-e33d-434f-b2b3-0dad3b613e73] Instance destroyed successfully. Jun 11 23:14:43.346256 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-5952d4cc-4958-4114-a91a-17d1d2959667 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Lazy-loading 'resources' on Instance uuid 14cc8d05-e33d-434f-b2b3-0dad3b613e73 {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:14:43.617857 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:14:43.783394 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] [instance: cab1cc43-b433-4772-9f01-0197502c8b57] Creating config drive at /opt/stack/data/nova/instances/cab1cc43-b433-4772-9f01-0197502c8b57/disk.config Jun 11 23:14:43.787076 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/cab1cc43-b433-4772-9f01-0197502c8b57/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp0rbrvw1x {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:14:43.839310 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/cab1cc43-b433-4772-9f01-0197502c8b57/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp0rbrvw1x" returned: 0 in 0.052s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:14:43.841782 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Acquiring lock "refresh_cache-8a45e04f-3516-4c39-bea1-820104411f17" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 11 23:14:43.841984 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Acquired lock "refresh_cache-8a45e04f-3516-4c39-bea1-820104411f17" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 11 23:14:43.842245 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] Building network info cache for instance {{(pid=98431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 11 23:14:43.848901 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-5952d4cc-4958-4114-a91a-17d1d2959667 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-11T23:14:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-120229851',display_name='tempest-VolumesActionsTest-instance-120229851',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='tempest-volumesactionstest-instance-120229851',id=25,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-06-11T23:14:39Z,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='1922540076a94ee5ba369d79869aaa95',ramdisk_id='',reservation_id='r-64ukdjk6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1703782237',owner_user_name='tempest-VolumesActionsTest-1703782237-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-11T23:14:40Z,user_data=None,user_id='5b929fda768d45738790181d6b49a3be',uuid=14cc8d05-e33d-434f-b2b3-0dad3b613e73,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "64bb5344-fa8f-436b-8c25-3dd5df49e17f", "address": "fa:16:3e:c5:71:0e", "network": {"id": "64de9d21-9a16-433f-b6db-fd642b6ec307", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1640869818-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1922540076a94ee5ba369d79869aaa95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap64bb5344-fa", "ovs_interfaceid": "64bb5344-fa8f-436b-8c25-3dd5df49e17f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 11 23:14:43.849153 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-5952d4cc-4958-4114-a91a-17d1d2959667 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Converting VIF {"id": "64bb5344-fa8f-436b-8c25-3dd5df49e17f", "address": "fa:16:3e:c5:71:0e", "network": {"id": "64de9d21-9a16-433f-b6db-fd642b6ec307", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1640869818-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1922540076a94ee5ba369d79869aaa95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap64bb5344-fa", "ovs_interfaceid": "64bb5344-fa8f-436b-8c25-3dd5df49e17f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:14:43.850102 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-5952d4cc-4958-4114-a91a-17d1d2959667 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:71:0e,bridge_name='br-int',has_traffic_filtering=True,id=64bb5344-fa8f-436b-8c25-3dd5df49e17f,network=Network(64de9d21-9a16-433f-b6db-fd642b6ec307),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64bb5344-fa') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:14:43.850305 np0000002687 nova-compute[98431]: DEBUG os_vif [None req-5952d4cc-4958-4114-a91a-17d1d2959667 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:71:0e,bridge_name='br-int',has_traffic_filtering=True,id=64bb5344-fa8f-436b-8c25-3dd5df49e17f,network=Network(64de9d21-9a16-433f-b6db-fd642b6ec307),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64bb5344-fa') {{(pid=98431) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 11 23:14:43.857165 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:43.857583 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap64bb5344-fa, bridge=br-int, if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:14:43.862643 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:14:43.870887 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:43.870887 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:43.870887 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=30c9b39c-e218-403e-b9aa-5466a569befb) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:14:43.871096 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:43.871731 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:14:43.878734 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:43.882555 np0000002687 nova-compute[98431]: INFO os_vif [None req-5952d4cc-4958-4114-a91a-17d1d2959667 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:71:0e,bridge_name='br-int',has_traffic_filtering=True,id=64bb5344-fa8f-436b-8c25-3dd5df49e17f,network=Network(64de9d21-9a16-433f-b6db-fd642b6ec307),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64bb5344-fa') Jun 11 23:14:43.882948 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-5952d4cc-4958-4114-a91a-17d1d2959667 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] [instance: 14cc8d05-e33d-434f-b2b3-0dad3b613e73] Deleting instance files /opt/stack/data/nova/instances/14cc8d05-e33d-434f-b2b3-0dad3b613e73_del Jun 11 23:14:43.883658 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-5952d4cc-4958-4114-a91a-17d1d2959667 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] [instance: 14cc8d05-e33d-434f-b2b3-0dad3b613e73] Deletion of /opt/stack/data/nova/instances/14cc8d05-e33d-434f-b2b3-0dad3b613e73_del complete Jun 11 23:14:44.297752 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:44.349001 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:14:44.371653 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:44.377551 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:44.391267 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-5952d4cc-4958-4114-a91a-17d1d2959667 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] [instance: 14cc8d05-e33d-434f-b2b3-0dad3b613e73] Took 1.42 seconds to destroy the instance on the hypervisor. Jun 11 23:14:44.399336 np0000002687 nova-compute[98431]: DEBUG oslo.service.backend._common.loopingcall [None req-5952d4cc-4958-4114-a91a-17d1d2959667 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98431) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jun 11 23:14:44.402915 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [-] [instance: 14cc8d05-e33d-434f-b2b3-0dad3b613e73] Deallocating network for instance {{(pid=98431) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}} Jun 11 23:14:44.402915 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [-] [instance: 14cc8d05-e33d-434f-b2b3-0dad3b613e73] deallocate_for_instance() {{(pid=98431) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jun 11 23:14:44.402915 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:14:44.420495 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:44.550963 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:14:44.729770 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:44.734130 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:44.742306 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:44.767841 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:44.770146 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:44.845113 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:14:45.065828 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] Updating instance_info_cache with network_info: [{"id": "3c04202e-5ce6-4249-ba31-be06996ca75d", "address": "fa:16:3e:6f:42:42", "network": {"id": "17593db3-c22d-4354-ab29-933b1c6a5c3a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1094286565-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "81fd45f475a04e5c8e9bd9deb7ad4c1e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c04202e-5c", "ovs_interfaceid": "3c04202e-5ce6-4249-ba31-be06996ca75d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:14:45.254703 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-77aaf41e-8859-43d7-ad79-db1e24d819d2 req-d175e2c4-1bd6-4d7b-a98a-175666075c55 service nova] [instance: 14cc8d05-e33d-434f-b2b3-0dad3b613e73] Received event network-vif-unplugged-64bb5344-fa8f-436b-8c25-3dd5df49e17f {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:14:45.254942 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-77aaf41e-8859-43d7-ad79-db1e24d819d2 req-d175e2c4-1bd6-4d7b-a98a-175666075c55 service nova] Acquiring lock "14cc8d05-e33d-434f-b2b3-0dad3b613e73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:14:45.255010 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-77aaf41e-8859-43d7-ad79-db1e24d819d2 req-d175e2c4-1bd6-4d7b-a98a-175666075c55 service nova] Lock "14cc8d05-e33d-434f-b2b3-0dad3b613e73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:14:45.255123 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-77aaf41e-8859-43d7-ad79-db1e24d819d2 req-d175e2c4-1bd6-4d7b-a98a-175666075c55 service nova] Lock "14cc8d05-e33d-434f-b2b3-0dad3b613e73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:14:45.255207 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-77aaf41e-8859-43d7-ad79-db1e24d819d2 req-d175e2c4-1bd6-4d7b-a98a-175666075c55 service nova] [instance: 14cc8d05-e33d-434f-b2b3-0dad3b613e73] No waiting events found dispatching network-vif-unplugged-64bb5344-fa8f-436b-8c25-3dd5df49e17f {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:14:45.255344 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-77aaf41e-8859-43d7-ad79-db1e24d819d2 req-d175e2c4-1bd6-4d7b-a98a-175666075c55 service nova] [instance: 14cc8d05-e33d-434f-b2b3-0dad3b613e73] Received event network-vif-unplugged-64bb5344-fa8f-436b-8c25-3dd5df49e17f for instance with task_state deleting. {{(pid=98431) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 11 23:14:45.255512 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-77aaf41e-8859-43d7-ad79-db1e24d819d2 req-d175e2c4-1bd6-4d7b-a98a-175666075c55 service nova] [instance: cab1cc43-b433-4772-9f01-0197502c8b57] Received event network-vif-plugged-807d693f-6c88-415d-8c16-1187f9dd28c2 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:14:45.256033 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-77aaf41e-8859-43d7-ad79-db1e24d819d2 req-d175e2c4-1bd6-4d7b-a98a-175666075c55 service nova] Acquiring lock "cab1cc43-b433-4772-9f01-0197502c8b57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:14:45.256136 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-77aaf41e-8859-43d7-ad79-db1e24d819d2 req-d175e2c4-1bd6-4d7b-a98a-175666075c55 service nova] Lock "cab1cc43-b433-4772-9f01-0197502c8b57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:14:45.256459 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-77aaf41e-8859-43d7-ad79-db1e24d819d2 req-d175e2c4-1bd6-4d7b-a98a-175666075c55 service nova] Lock "cab1cc43-b433-4772-9f01-0197502c8b57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:14:45.256459 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-77aaf41e-8859-43d7-ad79-db1e24d819d2 req-d175e2c4-1bd6-4d7b-a98a-175666075c55 service nova] [instance: cab1cc43-b433-4772-9f01-0197502c8b57] Processing event network-vif-plugged-807d693f-6c88-415d-8c16-1187f9dd28c2 {{(pid=98431) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 11 23:14:45.256732 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-77aaf41e-8859-43d7-ad79-db1e24d819d2 req-d175e2c4-1bd6-4d7b-a98a-175666075c55 service nova] [instance: cab1cc43-b433-4772-9f01-0197502c8b57] Received event network-vif-plugged-807d693f-6c88-415d-8c16-1187f9dd28c2 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:14:45.256732 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-77aaf41e-8859-43d7-ad79-db1e24d819d2 req-d175e2c4-1bd6-4d7b-a98a-175666075c55 service nova] Acquiring lock "cab1cc43-b433-4772-9f01-0197502c8b57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:14:45.256869 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-77aaf41e-8859-43d7-ad79-db1e24d819d2 req-d175e2c4-1bd6-4d7b-a98a-175666075c55 service nova] Lock "cab1cc43-b433-4772-9f01-0197502c8b57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:14:45.256869 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-77aaf41e-8859-43d7-ad79-db1e24d819d2 req-d175e2c4-1bd6-4d7b-a98a-175666075c55 service nova] Lock "cab1cc43-b433-4772-9f01-0197502c8b57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:14:45.256998 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-77aaf41e-8859-43d7-ad79-db1e24d819d2 req-d175e2c4-1bd6-4d7b-a98a-175666075c55 service nova] [instance: cab1cc43-b433-4772-9f01-0197502c8b57] No waiting events found dispatching network-vif-plugged-807d693f-6c88-415d-8c16-1187f9dd28c2 {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:14:45.257074 np0000002687 nova-compute[98431]: WARNING nova.compute.manager [req-77aaf41e-8859-43d7-ad79-db1e24d819d2 req-d175e2c4-1bd6-4d7b-a98a-175666075c55 service nova] [instance: cab1cc43-b433-4772-9f01-0197502c8b57] Received unexpected event network-vif-plugged-807d693f-6c88-415d-8c16-1187f9dd28c2 for instance with vm_state building and task_state spawning. Jun 11 23:14:45.257139 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-77aaf41e-8859-43d7-ad79-db1e24d819d2 req-d175e2c4-1bd6-4d7b-a98a-175666075c55 service nova] [instance: 14cc8d05-e33d-434f-b2b3-0dad3b613e73] Received event network-vif-deleted-64bb5344-fa8f-436b-8c25-3dd5df49e17f {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:14:45.257267 np0000002687 nova-compute[98431]: INFO nova.compute.manager [req-77aaf41e-8859-43d7-ad79-db1e24d819d2 req-d175e2c4-1bd6-4d7b-a98a-175666075c55 service nova] [instance: 14cc8d05-e33d-434f-b2b3-0dad3b613e73] Neutron deleted interface 64bb5344-fa8f-436b-8c25-3dd5df49e17f; detaching it from the instance and deleting it from the info cache Jun 11 23:14:45.258952 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-77aaf41e-8859-43d7-ad79-db1e24d819d2 req-d175e2c4-1bd6-4d7b-a98a-175666075c55 service nova] [instance: 14cc8d05-e33d-434f-b2b3-0dad3b613e73] Detach interface failed, port_id=64bb5344-fa8f-436b-8c25-3dd5df49e17f, reason: Instance 14cc8d05-e33d-434f-b2b3-0dad3b613e73 could not be found. {{(pid=98431) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}} Jun 11 23:14:45.311873 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] [instance: cab1cc43-b433-4772-9f01-0197502c8b57] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98431) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 11 23:14:45.312609 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Emitting event Started> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:14:45.312780 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: cab1cc43-b433-4772-9f01-0197502c8b57] VM Started (Lifecycle Event) Jun 11 23:14:45.315538 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] [instance: cab1cc43-b433-4772-9f01-0197502c8b57] Guest created on hypervisor {{(pid=98431) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}} Jun 11 23:14:45.324774 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [-] [instance: cab1cc43-b433-4772-9f01-0197502c8b57] Instance spawned successfully. Jun 11 23:14:45.325350 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] [instance: cab1cc43-b433-4772-9f01-0197502c8b57] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 11 23:14:45.558902 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [-] [instance: 14cc8d05-e33d-434f-b2b3-0dad3b613e73] Updating instance_info_cache with network_info: [] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:14:45.568552 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Releasing lock "refresh_cache-8a45e04f-3516-4c39-bea1-820104411f17" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 11 23:14:45.821608 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: cab1cc43-b433-4772-9f01-0197502c8b57] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:14:45.823518 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: cab1cc43-b433-4772-9f01-0197502c8b57] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98431) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 11 23:14:45.835891 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] [instance: cab1cc43-b433-4772-9f01-0197502c8b57] Found default for hw_cdrom_bus of ide {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:14:45.836071 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] [instance: cab1cc43-b433-4772-9f01-0197502c8b57] Found default for hw_disk_bus of virtio {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:14:45.836312 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] [instance: cab1cc43-b433-4772-9f01-0197502c8b57] Found default for hw_input_bus of None {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:14:45.836526 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] [instance: cab1cc43-b433-4772-9f01-0197502c8b57] Found default for hw_pointer_model of None {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:14:45.836812 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] [instance: cab1cc43-b433-4772-9f01-0197502c8b57] Found default for hw_video_model of virtio {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:14:45.837078 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] [instance: cab1cc43-b433-4772-9f01-0197502c8b57] Found default for hw_vif_model of virtio {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:14:46.064975 np0000002687 nova-compute[98431]: INFO nova.compute.manager [-] [instance: 14cc8d05-e33d-434f-b2b3-0dad3b613e73] Took 1.66 seconds to deallocate network for instance. Jun 11 23:14:46.325414 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: cab1cc43-b433-4772-9f01-0197502c8b57] During sync_power_state the instance has a pending task (spawning). Skip. Jun 11 23:14:46.326597 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Emitting event Paused> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:14:46.326597 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: cab1cc43-b433-4772-9f01-0197502c8b57] VM Paused (Lifecycle Event) Jun 11 23:14:46.342695 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] [instance: cab1cc43-b433-4772-9f01-0197502c8b57] Took 10.19 seconds to spawn the instance on the hypervisor. Jun 11 23:14:46.344290 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] [instance: cab1cc43-b433-4772-9f01-0197502c8b57] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:14:46.583715 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-5952d4cc-4958-4114-a91a-17d1d2959667 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:14:46.584137 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-5952d4cc-4958-4114-a91a-17d1d2959667 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:14:46.828687 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: cab1cc43-b433-4772-9f01-0197502c8b57] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:14:46.833969 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Emitting event Resumed> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:14:46.834069 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: cab1cc43-b433-4772-9f01-0197502c8b57] VM Resumed (Lifecycle Event) Jun 11 23:14:46.856389 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] [instance: cab1cc43-b433-4772-9f01-0197502c8b57] Took 20.90 seconds to build instance. Jun 11 23:14:47.089720 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] Starting migrate_disk_and_power_off {{(pid=98431) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:12616}} Jun 11 23:14:47.118870 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:47.121511 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:47.154085 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:47.337098 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: cab1cc43-b433-4772-9f01-0197502c8b57] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:14:47.341652 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:47.344953 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: cab1cc43-b433-4772-9f01-0197502c8b57] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98431) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 11 23:14:47.351364 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:47.358445 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] Lock "cab1cc43-b433-4772-9f01-0197502c8b57" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 22.411s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:14:47.362544 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-a6098818-1137-435b-a8af-0fa264f7cbb5 req-528e9231-ad0e-426e-894f-48681a82e6ef service nova] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] Received event network-vif-unplugged-3c04202e-5ce6-4249-ba31-be06996ca75d {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:14:47.362544 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-a6098818-1137-435b-a8af-0fa264f7cbb5 req-528e9231-ad0e-426e-894f-48681a82e6ef service nova] Acquiring lock "8a45e04f-3516-4c39-bea1-820104411f17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:14:47.362544 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-a6098818-1137-435b-a8af-0fa264f7cbb5 req-528e9231-ad0e-426e-894f-48681a82e6ef service nova] Lock "8a45e04f-3516-4c39-bea1-820104411f17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:14:47.362544 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-a6098818-1137-435b-a8af-0fa264f7cbb5 req-528e9231-ad0e-426e-894f-48681a82e6ef service nova] Lock "8a45e04f-3516-4c39-bea1-820104411f17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:14:47.362544 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-a6098818-1137-435b-a8af-0fa264f7cbb5 req-528e9231-ad0e-426e-894f-48681a82e6ef service nova] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] No waiting events found dispatching network-vif-unplugged-3c04202e-5ce6-4249-ba31-be06996ca75d {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:14:47.362544 np0000002687 nova-compute[98431]: WARNING nova.compute.manager [req-a6098818-1137-435b-a8af-0fa264f7cbb5 req-528e9231-ad0e-426e-894f-48681a82e6ef service nova] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] Received unexpected event network-vif-unplugged-3c04202e-5ce6-4249-ba31-be06996ca75d for instance with vm_state active and task_state resize_migrating. Jun 11 23:14:47.411362 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:47.424942 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:47.458835 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [-] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] Instance destroyed successfully. Jun 11 23:14:47.459901 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-11T23:12:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='multiattach-server-1',id=17,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHngWA9S/0M7yAiCaKN7wJ0iqGBq18p6o1N91kfGTes8iMQtxmsCxH/Iqg51e2HEWFsjD10S17Kahb+vCzu07nJJQGe3fNUonThwHNf0exiWq4jZuXjSZtHJPO0dbow48A==',key_name='tempest-keypair-1974490716',keypairs=,launch_index=0,launched_at=2026-06-11T23:13:03Z,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='81fd45f475a04e5c8e9bd9deb7ad4c1e',ramdisk_id='',reservation_id='r-n8ohee78',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-1514006700',owner_user_name='tempest-AttachVolumeMultiAttachTest-1514006700-project-member'},tags=,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2026-06-11T23:14:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c17e84202f404c3c8e73292bb59d7b27',uuid=8a45e04f-3516-4c39-bea1-820104411f17,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3c04202e-5ce6-4249-ba31-be06996ca75d", "address": "fa:16:3e:6f:42:42", "network": {"id": "17593db3-c22d-4354-ab29-933b1c6a5c3a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1094286565-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1094286565-network", "vif_mac": "fa:16:3e:6f:42:42"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "81fd45f475a04e5c8e9bd9deb7ad4c1e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c04202e-5c", "ovs_interfaceid": "3c04202e-5ce6-4249-ba31-be06996ca75d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 11 23:14:47.460830 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Converting VIF {"id": "3c04202e-5ce6-4249-ba31-be06996ca75d", "address": "fa:16:3e:6f:42:42", "network": {"id": "17593db3-c22d-4354-ab29-933b1c6a5c3a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1094286565-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1094286565-network", "vif_mac": "fa:16:3e:6f:42:42"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "81fd45f475a04e5c8e9bd9deb7ad4c1e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c04202e-5c", "ovs_interfaceid": "3c04202e-5ce6-4249-ba31-be06996ca75d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:14:47.461075 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6f:42:42,bridge_name='br-int',has_traffic_filtering=True,id=3c04202e-5ce6-4249-ba31-be06996ca75d,network=Network(17593db3-c22d-4354-ab29-933b1c6a5c3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c04202e-5c') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:14:47.462561 np0000002687 nova-compute[98431]: DEBUG os_vif [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6f:42:42,bridge_name='br-int',has_traffic_filtering=True,id=3c04202e-5ce6-4249-ba31-be06996ca75d,network=Network(17593db3-c22d-4354-ab29-933b1c6a5c3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c04202e-5c') {{(pid=98431) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 11 23:14:47.462732 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:47.462848 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3c04202e-5c, bridge=br-int, if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:14:47.464843 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:47.465132 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:14:47.467272 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:47.468837 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:47.468837 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=eb961cb5-554a-4ab5-90ff-a7d42e4ca2c8) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:14:47.469762 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:47.470422 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:14:47.472286 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:47.474792 np0000002687 nova-compute[98431]: INFO os_vif [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6f:42:42,bridge_name='br-int',has_traffic_filtering=True,id=3c04202e-5ce6-4249-ba31-be06996ca75d,network=Network(17593db3-c22d-4354-ab29-933b1c6a5c3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c04202e-5c') Jun 11 23:14:47.633121 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-5952d4cc-4958-4114-a91a-17d1d2959667 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98431) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 11 23:14:47.633121 np0000002687 nova-compute[98431]: DEBUG nova.compute.provider_tree [None req-5952d4cc-4958-4114-a91a-17d1d2959667 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Inventory has not changed in ProviderTree for provider: e3e65fe2-9de9-4821-8b4a-ccae37c66e25 {{(pid=98431) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 11 23:14:47.851548 np0000002687 nova-compute[98431]: DEBUG nova.utils [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Queued Task(fn=>, remaining_delay=14.99967928000001 future=) {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:14:47.949421 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:48.038484 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Detected multiple connections on this host for volume: f535b91b-3bff-46ad-905e-644bd012b9ff, skipping target disconnect. Jun 11 23:14:48.047614 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a45e04f-3516-4c39-bea1-820104411f17/disk --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:14:48.137425 np0000002687 nova-compute[98431]: DEBUG nova.scheduler.client.report [None req-5952d4cc-4958-4114-a91a-17d1d2959667 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Inventory has not changed for provider e3e65fe2-9de9-4821-8b4a-ccae37c66e25 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98431) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 11 23:14:48.148916 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a45e04f-3516-4c39-bea1-820104411f17/disk --force-share --output=json" returned: 0 in 0.101s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:14:48.151756 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a45e04f-3516-4c39-bea1-820104411f17/disk --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:14:48.238466 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a45e04f-3516-4c39-bea1-820104411f17/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:14:48.239669 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] skipping disk /dev/dm-7 (vdb) as it is a volume {{(pid=98431) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12344}} Jun 11 23:14:48.239669 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/8a45e04f-3516-4c39-bea1-820104411f17_resize/disk /opt/stack/data/nova/instances/8a45e04f-3516-4c39-bea1-820104411f17/disk {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:14:48.343314 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] CMD "cp -r /opt/stack/data/nova/instances/8a45e04f-3516-4c39-bea1-820104411f17_resize/disk /opt/stack/data/nova/instances/8a45e04f-3516-4c39-bea1-820104411f17/disk" returned: 0 in 0.104s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:14:48.346272 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/8a45e04f-3516-4c39-bea1-820104411f17_resize/disk.config /opt/stack/data/nova/instances/8a45e04f-3516-4c39-bea1-820104411f17/disk.config {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:14:48.387426 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] CMD "cp -r /opt/stack/data/nova/instances/8a45e04f-3516-4c39-bea1-820104411f17_resize/disk.config /opt/stack/data/nova/instances/8a45e04f-3516-4c39-bea1-820104411f17/disk.config" returned: 0 in 0.043s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:14:48.388200 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/8a45e04f-3516-4c39-bea1-820104411f17_resize/disk.info /opt/stack/data/nova/instances/8a45e04f-3516-4c39-bea1-820104411f17/disk.info {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:14:48.426361 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] CMD "cp -r /opt/stack/data/nova/instances/8a45e04f-3516-4c39-bea1-820104411f17_resize/disk.info /opt/stack/data/nova/instances/8a45e04f-3516-4c39-bea1-820104411f17/disk.info" returned: 0 in 0.038s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:14:48.646271 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-5952d4cc-4958-4114-a91a-17d1d2959667 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 2.062s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:14:48.742151 np0000002687 nova-compute[98431]: INFO nova.scheduler.client.report [None req-5952d4cc-4958-4114-a91a-17d1d2959667 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Deleted allocations for instance 14cc8d05-e33d-434f-b2b3-0dad3b613e73 Jun 11 23:14:49.451174 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-c0b16bcf-c8d5-4eaf-a069-e20ef383dca2 req-d02c824d-eacd-4368-acc3-0c56283b7f79 service nova] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] Received event network-vif-unplugged-3c04202e-5ce6-4249-ba31-be06996ca75d {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:14:49.453100 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-c0b16bcf-c8d5-4eaf-a069-e20ef383dca2 req-d02c824d-eacd-4368-acc3-0c56283b7f79 service nova] Acquiring lock "8a45e04f-3516-4c39-bea1-820104411f17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:14:49.453431 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-c0b16bcf-c8d5-4eaf-a069-e20ef383dca2 req-d02c824d-eacd-4368-acc3-0c56283b7f79 service nova] Lock "8a45e04f-3516-4c39-bea1-820104411f17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:14:49.453892 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-c0b16bcf-c8d5-4eaf-a069-e20ef383dca2 req-d02c824d-eacd-4368-acc3-0c56283b7f79 service nova] Lock "8a45e04f-3516-4c39-bea1-820104411f17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:14:49.454169 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-c0b16bcf-c8d5-4eaf-a069-e20ef383dca2 req-d02c824d-eacd-4368-acc3-0c56283b7f79 service nova] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] No waiting events found dispatching network-vif-unplugged-3c04202e-5ce6-4249-ba31-be06996ca75d {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:14:49.454559 np0000002687 nova-compute[98431]: WARNING nova.compute.manager [req-c0b16bcf-c8d5-4eaf-a069-e20ef383dca2 req-d02c824d-eacd-4368-acc3-0c56283b7f79 service nova] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] Received unexpected event network-vif-unplugged-3c04202e-5ce6-4249-ba31-be06996ca75d for instance with vm_state active and task_state resize_migrating. Jun 11 23:14:49.593159 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:14:49.593481 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:14:49.656347 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] Port 3c04202e-5ce6-4249-ba31-be06996ca75d binding to destination host np0000002687 is already ACTIVE {{(pid=98431) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3210}} Jun 11 23:14:49.760992 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-5952d4cc-4958-4114-a91a-17d1d2959667 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Lock "14cc8d05-e33d-434f-b2b3-0dad3b613e73" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 7.296s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:14:50.667414 np0000002687 nova-compute[98431]: DEBUG nova.compute.rpcapi [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98431) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}} Jun 11 23:14:50.698610 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Acquiring lock "8a45e04f-3516-4c39-bea1-820104411f17-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:14:50.698610 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "8a45e04f-3516-4c39-bea1-820104411f17-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:14:50.698610 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "8a45e04f-3516-4c39-bea1-820104411f17-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:14:51.694115 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:14:51.843165 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Acquiring lock "refresh_cache-8a45e04f-3516-4c39-bea1-820104411f17" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 11 23:14:51.843578 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Acquired lock "refresh_cache-8a45e04f-3516-4c39-bea1-820104411f17" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 11 23:14:51.843952 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] Building network info cache for instance {{(pid=98431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 11 23:14:52.034130 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Acquiring lock "1d45c7ce-5760-4f59-9921-feb3e589da8a" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:14:52.034330 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Lock "1d45c7ce-5760-4f59-9921-feb3e589da8a" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:14:52.034518 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Acquiring lock "1d45c7ce-5760-4f59-9921-feb3e589da8a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:14:52.035136 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Lock "1d45c7ce-5760-4f59-9921-feb3e589da8a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:14:52.035313 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Lock "1d45c7ce-5760-4f59-9921-feb3e589da8a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:14:52.040540 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Terminating instance Jun 11 23:14:52.042475 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-10cf0c0e-d44c-4038-bfb1-748cdf202968 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Acquiring lock "f4f629ca-bf55-4dc5-ad80-9136da020657" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:14:52.042638 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-10cf0c0e-d44c-4038-bfb1-748cdf202968 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Lock "f4f629ca-bf55-4dc5-ad80-9136da020657" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:14:52.348888 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:14:52.470413 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:52.545729 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-10cf0c0e-d44c-4038-bfb1-748cdf202968 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] [instance: f4f629ca-bf55-4dc5-ad80-9136da020657] Starting instance... {{(pid=98431) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 11 23:14:52.551272 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Start destroying the instance on the hypervisor. {{(pid=98431) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}} Jun 11 23:14:52.615743 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:52.661283 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:52.675547 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:52.706008 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:52.803211 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:52.813828 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:52.823497 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:14:52.916392 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:52.946961 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-02822c7f-a243-406c-8996-7e36022cd966 req-f2992967-f558-4ec4-a53b-9ca1016dc732 service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Received event network-vif-unplugged-5f9094e3-a3c6-48ea-bfbe-4fa25d19bcf2 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:14:52.946961 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-02822c7f-a243-406c-8996-7e36022cd966 req-f2992967-f558-4ec4-a53b-9ca1016dc732 service nova] Acquiring lock "1d45c7ce-5760-4f59-9921-feb3e589da8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:14:52.946961 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-02822c7f-a243-406c-8996-7e36022cd966 req-f2992967-f558-4ec4-a53b-9ca1016dc732 service nova] Lock "1d45c7ce-5760-4f59-9921-feb3e589da8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:14:52.946961 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-02822c7f-a243-406c-8996-7e36022cd966 req-f2992967-f558-4ec4-a53b-9ca1016dc732 service nova] Lock "1d45c7ce-5760-4f59-9921-feb3e589da8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:14:52.946961 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-02822c7f-a243-406c-8996-7e36022cd966 req-f2992967-f558-4ec4-a53b-9ca1016dc732 service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] No waiting events found dispatching network-vif-unplugged-5f9094e3-a3c6-48ea-bfbe-4fa25d19bcf2 {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:14:52.946961 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-02822c7f-a243-406c-8996-7e36022cd966 req-f2992967-f558-4ec4-a53b-9ca1016dc732 service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Received event network-vif-unplugged-5f9094e3-a3c6-48ea-bfbe-4fa25d19bcf2 for instance with task_state deleting. {{(pid=98431) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 11 23:14:52.986317 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-0a6afd89-e471-48b9-a64b-e26498d15790 req-72ac9251-a53e-47cd-9c45-36da9dc4c81b service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Received event network-vif-unplugged-fe1430ca-d60b-47c4-9ac9-96ba7d61f101 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:14:52.986492 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-0a6afd89-e471-48b9-a64b-e26498d15790 req-72ac9251-a53e-47cd-9c45-36da9dc4c81b service nova] Acquiring lock "1d45c7ce-5760-4f59-9921-feb3e589da8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:14:52.986655 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-0a6afd89-e471-48b9-a64b-e26498d15790 req-72ac9251-a53e-47cd-9c45-36da9dc4c81b service nova] Lock "1d45c7ce-5760-4f59-9921-feb3e589da8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:14:52.986753 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-0a6afd89-e471-48b9-a64b-e26498d15790 req-72ac9251-a53e-47cd-9c45-36da9dc4c81b service nova] Lock "1d45c7ce-5760-4f59-9921-feb3e589da8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:14:52.986873 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-0a6afd89-e471-48b9-a64b-e26498d15790 req-72ac9251-a53e-47cd-9c45-36da9dc4c81b service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] No waiting events found dispatching network-vif-unplugged-fe1430ca-d60b-47c4-9ac9-96ba7d61f101 {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:14:52.987145 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-0a6afd89-e471-48b9-a64b-e26498d15790 req-72ac9251-a53e-47cd-9c45-36da9dc4c81b service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Received event network-vif-unplugged-fe1430ca-d60b-47c4-9ac9-96ba7d61f101 for instance with task_state deleting. {{(pid=98431) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 11 23:14:52.992298 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:53.035146 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:53.056022 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:53.067792 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:53.131141 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:53.167873 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-10cf0c0e-d44c-4038-bfb1-748cdf202968 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:14:53.169004 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-10cf0c0e-d44c-4038-bfb1-748cdf202968 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:14:53.181307 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-10cf0c0e-d44c-4038-bfb1-748cdf202968 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98431) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 11 23:14:53.181532 np0000002687 nova-compute[98431]: INFO nova.compute.claims [None req-10cf0c0e-d44c-4038-bfb1-748cdf202968 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] [instance: f4f629ca-bf55-4dc5-ad80-9136da020657] Claim successful on node np0000002687 Jun 11 23:14:53.201751 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:53.255814 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] Updating instance_info_cache with network_info: [{"id": "3c04202e-5ce6-4249-ba31-be06996ca75d", "address": "fa:16:3e:6f:42:42", "network": {"id": "17593db3-c22d-4354-ab29-933b1c6a5c3a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1094286565-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "81fd45f475a04e5c8e9bd9deb7ad4c1e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c04202e-5c", "ovs_interfaceid": "3c04202e-5ce6-4249-ba31-be06996ca75d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:14:53.269710 np0000002687 nova-compute[98431]: DEBUG nova.utils [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Queued Task(fn=>, remaining_delay=14.999673218999988 future=) {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:14:53.277712 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [-] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Instance destroyed successfully. Jun 11 23:14:53.278641 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Lazy-loading 'resources' on Instance uuid 1d45c7ce-5760-4f59-9921-feb3e589da8a {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:14:53.315817 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-c9aad855-6693-4dd3-a360-011c6f3352f2 req-3cff7752-eef0-4057-92bc-df3087298777 service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Received event network-vif-unplugged-37aa7cee-88a0-4428-9b2d-45700f1dcab6 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:14:53.317502 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-c9aad855-6693-4dd3-a360-011c6f3352f2 req-3cff7752-eef0-4057-92bc-df3087298777 service nova] Acquiring lock "1d45c7ce-5760-4f59-9921-feb3e589da8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:14:53.318079 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-c9aad855-6693-4dd3-a360-011c6f3352f2 req-3cff7752-eef0-4057-92bc-df3087298777 service nova] Lock "1d45c7ce-5760-4f59-9921-feb3e589da8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:14:53.324347 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-c9aad855-6693-4dd3-a360-011c6f3352f2 req-3cff7752-eef0-4057-92bc-df3087298777 service nova] Lock "1d45c7ce-5760-4f59-9921-feb3e589da8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.006s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:14:53.324347 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-c9aad855-6693-4dd3-a360-011c6f3352f2 req-3cff7752-eef0-4057-92bc-df3087298777 service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] No waiting events found dispatching network-vif-unplugged-37aa7cee-88a0-4428-9b2d-45700f1dcab6 {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:14:53.326711 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-c9aad855-6693-4dd3-a360-011c6f3352f2 req-3cff7752-eef0-4057-92bc-df3087298777 service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Received event network-vif-unplugged-37aa7cee-88a0-4428-9b2d-45700f1dcab6 for instance with task_state deleting. {{(pid=98431) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 11 23:14:53.761361 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Releasing lock "refresh_cache-8a45e04f-3516-4c39-bea1-820104411f17" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 11 23:14:53.785860 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-11T23:12:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1366771090',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='tempest-device-tagging-server-1366771090',id=19,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC5UXUrCEEA/0gxvD1NavMz6RwD8U++JuZnAB48UjQLmwHKU2knd70tRMd/ODZENnwRMpvr28/C2g9VTy2gQO0/t/l3FqY9lxY/3+5+G6z+bb25kWd7QXQRH7lbyZDsb8w==',key_name='tempest-keypair-965487513',keypairs=,launch_index=0,launched_at=2026-06-11T23:13:42Z,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='6c1e407a42f24b34baf3ee44be9fb337',ramdisk_id='',reservation_id='r-dqc2uc2r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-37151554',owner_user_name='tempest-TaggedBootDevicesTest_v242-37151554-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-11T23:13:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3dd7997e0762451ca159ee06bf3d9c44',uuid=1d45c7ce-5760-4f59-9921-feb3e589da8a,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5f9094e3-a3c6-48ea-bfbe-4fa25d19bcf2", "address": "fa:16:3e:b1:9e:6a", "network": {"id": "1cea4f00-aa2e-4d9d-8255-2e7ba484f3ec", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1566230580-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c1e407a42f24b34baf3ee44be9fb337", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f9094e3-a3", "ovs_interfaceid": "5f9094e3-a3c6-48ea-bfbe-4fa25d19bcf2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 11 23:14:53.785860 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Converting VIF {"id": "5f9094e3-a3c6-48ea-bfbe-4fa25d19bcf2", "address": "fa:16:3e:b1:9e:6a", "network": {"id": "1cea4f00-aa2e-4d9d-8255-2e7ba484f3ec", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1566230580-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c1e407a42f24b34baf3ee44be9fb337", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f9094e3-a3", "ovs_interfaceid": "5f9094e3-a3c6-48ea-bfbe-4fa25d19bcf2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:14:53.785860 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b1:9e:6a,bridge_name='br-int',has_traffic_filtering=True,id=5f9094e3-a3c6-48ea-bfbe-4fa25d19bcf2,network=Network(1cea4f00-aa2e-4d9d-8255-2e7ba484f3ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f9094e3-a3') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:14:53.785860 np0000002687 nova-compute[98431]: DEBUG os_vif [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b1:9e:6a,bridge_name='br-int',has_traffic_filtering=True,id=5f9094e3-a3c6-48ea-bfbe-4fa25d19bcf2,network=Network(1cea4f00-aa2e-4d9d-8255-2e7ba484f3ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f9094e3-a3') {{(pid=98431) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 11 23:14:53.785860 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:53.785860 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5f9094e3-a3, bridge=br-int, if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:14:53.788977 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:14:53.823073 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-ff08afe8-5e30-44c7-ad79-117974b8632a tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] Acquiring lock "cab1cc43-b433-4772-9f01-0197502c8b57" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:14:53.823283 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-ff08afe8-5e30-44c7-ad79-117974b8632a tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] Lock "cab1cc43-b433-4772-9f01-0197502c8b57" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:14:53.823534 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-ff08afe8-5e30-44c7-ad79-117974b8632a tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] Acquiring lock "cab1cc43-b433-4772-9f01-0197502c8b57-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:14:53.823723 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-ff08afe8-5e30-44c7-ad79-117974b8632a tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] Lock "cab1cc43-b433-4772-9f01-0197502c8b57-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:14:53.823927 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-ff08afe8-5e30-44c7-ad79-117974b8632a tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] Lock "cab1cc43-b433-4772-9f01-0197502c8b57-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:14:53.831599 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-ff08afe8-5e30-44c7-ad79-117974b8632a tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] [instance: cab1cc43-b433-4772-9f01-0197502c8b57] Terminating instance Jun 11 23:14:53.838057 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:53.841425 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:53.841656 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=593aec03-1f85-41f4-ae6e-89f60f15e605) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:14:53.847689 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:14:53.885421 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:53.889113 np0000002687 nova-compute[98431]: INFO os_vif [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b1:9e:6a,bridge_name='br-int',has_traffic_filtering=True,id=5f9094e3-a3c6-48ea-bfbe-4fa25d19bcf2,network=Network(1cea4f00-aa2e-4d9d-8255-2e7ba484f3ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f9094e3-a3') Jun 11 23:14:53.889741 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-11T23:12:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1366771090',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='tempest-device-tagging-server-1366771090',id=19,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC5UXUrCEEA/0gxvD1NavMz6RwD8U++JuZnAB48UjQLmwHKU2knd70tRMd/ODZENnwRMpvr28/C2g9VTy2gQO0/t/l3FqY9lxY/3+5+G6z+bb25kWd7QXQRH7lbyZDsb8w==',key_name='tempest-keypair-965487513',keypairs=,launch_index=0,launched_at=2026-06-11T23:13:42Z,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='6c1e407a42f24b34baf3ee44be9fb337',ramdisk_id='',reservation_id='r-dqc2uc2r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-37151554',owner_user_name='tempest-TaggedBootDevicesTest_v242-37151554-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-11T23:13:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3dd7997e0762451ca159ee06bf3d9c44',uuid=1d45c7ce-5760-4f59-9921-feb3e589da8a,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fe1430ca-d60b-47c4-9ac9-96ba7d61f101", "address": "fa:16:3e:ca:17:0a", "network": {"id": "d84f8615-2bee-4c03-b721-d597e25acb42", "bridge": "br-int", "label": "tempest-device-tagging-net1-1869260730", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c1e407a42f24b34baf3ee44be9fb337", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe1430ca-d6", "ovs_interfaceid": "fe1430ca-d60b-47c4-9ac9-96ba7d61f101", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98431) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 11 23:14:53.889946 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Converting VIF {"id": "fe1430ca-d60b-47c4-9ac9-96ba7d61f101", "address": "fa:16:3e:ca:17:0a", "network": {"id": "d84f8615-2bee-4c03-b721-d597e25acb42", "bridge": "br-int", "label": "tempest-device-tagging-net1-1869260730", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c1e407a42f24b34baf3ee44be9fb337", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe1430ca-d6", "ovs_interfaceid": "fe1430ca-d60b-47c4-9ac9-96ba7d61f101", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:14:53.891493 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:17:0a,bridge_name='br-int',has_traffic_filtering=True,id=fe1430ca-d60b-47c4-9ac9-96ba7d61f101,network=Network(d84f8615-2bee-4c03-b721-d597e25acb42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfe1430ca-d6') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:14:53.891734 np0000002687 nova-compute[98431]: DEBUG os_vif [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:17:0a,bridge_name='br-int',has_traffic_filtering=True,id=fe1430ca-d60b-47c4-9ac9-96ba7d61f101,network=Network(d84f8615-2bee-4c03-b721-d597e25acb42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfe1430ca-d6') {{(pid=98431) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 11 23:14:53.892564 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:53.892889 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfe1430ca-d6, bridge=br-int, if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:14:53.895478 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:14:53.924700 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:53.926426 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:53.926617 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d0bf72f5-4b2a-4325-8b1f-3e349f364afe) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:14:53.928599 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:14:53.961273 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:53.963873 np0000002687 nova-compute[98431]: INFO os_vif [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:17:0a,bridge_name='br-int',has_traffic_filtering=True,id=fe1430ca-d60b-47c4-9ac9-96ba7d61f101,network=Network(d84f8615-2bee-4c03-b721-d597e25acb42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfe1430ca-d6') Jun 11 23:14:53.964729 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-11T23:12:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1366771090',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='tempest-device-tagging-server-1366771090',id=19,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC5UXUrCEEA/0gxvD1NavMz6RwD8U++JuZnAB48UjQLmwHKU2knd70tRMd/ODZENnwRMpvr28/C2g9VTy2gQO0/t/l3FqY9lxY/3+5+G6z+bb25kWd7QXQRH7lbyZDsb8w==',key_name='tempest-keypair-965487513',keypairs=,launch_index=0,launched_at=2026-06-11T23:13:42Z,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='6c1e407a42f24b34baf3ee44be9fb337',ramdisk_id='',reservation_id='r-dqc2uc2r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-37151554',owner_user_name='tempest-TaggedBootDevicesTest_v242-37151554-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-11T23:13:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3dd7997e0762451ca159ee06bf3d9c44',uuid=1d45c7ce-5760-4f59-9921-feb3e589da8a,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a39a55c7-874a-4a19-a069-8383a5f0bc5a", "address": "fa:16:3e:37:35:68", "network": {"id": "d84f8615-2bee-4c03-b721-d597e25acb42", "bridge": "br-int", "label": "tempest-device-tagging-net1-1869260730", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c1e407a42f24b34baf3ee44be9fb337", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa39a55c7-87", "ovs_interfaceid": "a39a55c7-874a-4a19-a069-8383a5f0bc5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98431) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 11 23:14:53.964978 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Converting VIF {"id": "a39a55c7-874a-4a19-a069-8383a5f0bc5a", "address": "fa:16:3e:37:35:68", "network": {"id": "d84f8615-2bee-4c03-b721-d597e25acb42", "bridge": "br-int", "label": "tempest-device-tagging-net1-1869260730", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c1e407a42f24b34baf3ee44be9fb337", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa39a55c7-87", "ovs_interfaceid": "a39a55c7-874a-4a19-a069-8383a5f0bc5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:14:53.965889 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:35:68,bridge_name='br-int',has_traffic_filtering=True,id=a39a55c7-874a-4a19-a069-8383a5f0bc5a,network=Network(d84f8615-2bee-4c03-b721-d597e25acb42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa39a55c7-87') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:14:53.965889 np0000002687 nova-compute[98431]: DEBUG os_vif [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:35:68,bridge_name='br-int',has_traffic_filtering=True,id=a39a55c7-874a-4a19-a069-8383a5f0bc5a,network=Network(d84f8615-2bee-4c03-b721-d597e25acb42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa39a55c7-87') {{(pid=98431) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 11 23:14:53.966736 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:53.966909 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa39a55c7-87, bridge=br-int, if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:14:53.970090 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:53.971298 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:14:53.998087 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:53.998976 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:53.999180 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=49dbd637-d465-4290-9953-38179918395a) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:14:54.002662 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:54.002662 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:14:54.027497 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:54.031674 np0000002687 nova-compute[98431]: INFO os_vif [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:35:68,bridge_name='br-int',has_traffic_filtering=True,id=a39a55c7-874a-4a19-a069-8383a5f0bc5a,network=Network(d84f8615-2bee-4c03-b721-d597e25acb42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa39a55c7-87') Jun 11 23:14:54.032658 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-11T23:12:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1366771090',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='tempest-device-tagging-server-1366771090',id=19,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC5UXUrCEEA/0gxvD1NavMz6RwD8U++JuZnAB48UjQLmwHKU2knd70tRMd/ODZENnwRMpvr28/C2g9VTy2gQO0/t/l3FqY9lxY/3+5+G6z+bb25kWd7QXQRH7lbyZDsb8w==',key_name='tempest-keypair-965487513',keypairs=,launch_index=0,launched_at=2026-06-11T23:13:42Z,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='6c1e407a42f24b34baf3ee44be9fb337',ramdisk_id='',reservation_id='r-dqc2uc2r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-37151554',owner_user_name='tempest-TaggedBootDevicesTest_v242-37151554-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-11T23:13:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3dd7997e0762451ca159ee06bf3d9c44',uuid=1d45c7ce-5760-4f59-9921-feb3e589da8a,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "37aa7cee-88a0-4428-9b2d-45700f1dcab6", "address": "fa:16:3e:12:f4:f7", "network": {"id": "d84f8615-2bee-4c03-b721-d597e25acb42", "bridge": "br-int", "label": "tempest-device-tagging-net1-1869260730", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c1e407a42f24b34baf3ee44be9fb337", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap37aa7cee-88", "ovs_interfaceid": "37aa7cee-88a0-4428-9b2d-45700f1dcab6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 11 23:14:54.033003 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Converting VIF {"id": "37aa7cee-88a0-4428-9b2d-45700f1dcab6", "address": "fa:16:3e:12:f4:f7", "network": {"id": "d84f8615-2bee-4c03-b721-d597e25acb42", "bridge": "br-int", "label": "tempest-device-tagging-net1-1869260730", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c1e407a42f24b34baf3ee44be9fb337", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap37aa7cee-88", "ovs_interfaceid": "37aa7cee-88a0-4428-9b2d-45700f1dcab6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:14:54.033729 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:f4:f7,bridge_name='br-int',has_traffic_filtering=True,id=37aa7cee-88a0-4428-9b2d-45700f1dcab6,network=Network(d84f8615-2bee-4c03-b721-d597e25acb42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37aa7cee-88') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:14:54.034318 np0000002687 nova-compute[98431]: DEBUG os_vif [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:f4:f7,bridge_name='br-int',has_traffic_filtering=True,id=37aa7cee-88a0-4428-9b2d-45700f1dcab6,network=Network(d84f8615-2bee-4c03-b721-d597e25acb42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37aa7cee-88') {{(pid=98431) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 11 23:14:54.035345 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:54.035563 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap37aa7cee-88, bridge=br-int, if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:14:54.041266 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:14:54.058520 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:54.060746 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:54.060983 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1bd3c448-44ff-42e1-aafa-4bfae998fa22) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:14:54.064061 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:14:54.086711 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:54.091241 np0000002687 nova-compute[98431]: INFO os_vif [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:f4:f7,bridge_name='br-int',has_traffic_filtering=True,id=37aa7cee-88a0-4428-9b2d-45700f1dcab6,network=Network(d84f8615-2bee-4c03-b721-d597e25acb42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37aa7cee-88') Jun 11 23:14:54.092614 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-11T23:12:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1366771090',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='tempest-device-tagging-server-1366771090',id=19,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC5UXUrCEEA/0gxvD1NavMz6RwD8U++JuZnAB48UjQLmwHKU2knd70tRMd/ODZENnwRMpvr28/C2g9VTy2gQO0/t/l3FqY9lxY/3+5+G6z+bb25kWd7QXQRH7lbyZDsb8w==',key_name='tempest-keypair-965487513',keypairs=,launch_index=0,launched_at=2026-06-11T23:13:42Z,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='6c1e407a42f24b34baf3ee44be9fb337',ramdisk_id='',reservation_id='r-dqc2uc2r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-37151554',owner_user_name='tempest-TaggedBootDevicesTest_v242-37151554-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-11T23:13:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3dd7997e0762451ca159ee06bf3d9c44',uuid=1d45c7ce-5760-4f59-9921-feb3e589da8a,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e3269961-a3f1-42c8-a49e-37f728b2f3d8", "address": "fa:16:3e:7e:14:0b", "network": {"id": "d84f8615-2bee-4c03-b721-d597e25acb42", "bridge": "br-int", "label": "tempest-device-tagging-net1-1869260730", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c1e407a42f24b34baf3ee44be9fb337", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape3269961-a3", "ovs_interfaceid": "e3269961-a3f1-42c8-a49e-37f728b2f3d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 11 23:14:54.092955 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Converting VIF {"id": "e3269961-a3f1-42c8-a49e-37f728b2f3d8", "address": "fa:16:3e:7e:14:0b", "network": {"id": "d84f8615-2bee-4c03-b721-d597e25acb42", "bridge": "br-int", "label": "tempest-device-tagging-net1-1869260730", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c1e407a42f24b34baf3ee44be9fb337", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape3269961-a3", "ovs_interfaceid": "e3269961-a3f1-42c8-a49e-37f728b2f3d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:14:54.093468 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:14:0b,bridge_name='br-int',has_traffic_filtering=True,id=e3269961-a3f1-42c8-a49e-37f728b2f3d8,network=Network(d84f8615-2bee-4c03-b721-d597e25acb42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3269961-a3') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:14:54.093749 np0000002687 nova-compute[98431]: DEBUG os_vif [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:14:0b,bridge_name='br-int',has_traffic_filtering=True,id=e3269961-a3f1-42c8-a49e-37f728b2f3d8,network=Network(d84f8615-2bee-4c03-b721-d597e25acb42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3269961-a3') {{(pid=98431) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 11 23:14:54.094839 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:54.095155 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape3269961-a3, bridge=br-int, if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:14:54.099435 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:14:54.110779 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:54.112138 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:54.112428 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e80d3228-f5c6-4f65-a05a-dda8c34bb30a) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:14:54.113339 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:54.114933 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:54.116165 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:14:54.128609 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:54.129417 np0000002687 nova-compute[98431]: INFO os_vif [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:14:0b,bridge_name='br-int',has_traffic_filtering=True,id=e3269961-a3f1-42c8-a49e-37f728b2f3d8,network=Network(d84f8615-2bee-4c03-b721-d597e25acb42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3269961-a3') Jun 11 23:14:54.130419 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-11T23:12:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1366771090',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='tempest-device-tagging-server-1366771090',id=19,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC5UXUrCEEA/0gxvD1NavMz6RwD8U++JuZnAB48UjQLmwHKU2knd70tRMd/ODZENnwRMpvr28/C2g9VTy2gQO0/t/l3FqY9lxY/3+5+G6z+bb25kWd7QXQRH7lbyZDsb8w==',key_name='tempest-keypair-965487513',keypairs=,launch_index=0,launched_at=2026-06-11T23:13:42Z,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='6c1e407a42f24b34baf3ee44be9fb337',ramdisk_id='',reservation_id='r-dqc2uc2r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-37151554',owner_user_name='tempest-TaggedBootDevicesTest_v242-37151554-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-11T23:13:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3dd7997e0762451ca159ee06bf3d9c44',uuid=1d45c7ce-5760-4f59-9921-feb3e589da8a,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "351eaad5-bf70-43b4-8f79-5bc0027de663", "address": "fa:16:3e:ee:d2:51", "network": {"id": "b0d7ffe8-2fba-456a-8969-949ee402ce5b", "bridge": "br-int", "label": "tempest-device-tagging-net2-84998986", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c1e407a42f24b34baf3ee44be9fb337", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap351eaad5-bf", "ovs_interfaceid": "351eaad5-bf70-43b4-8f79-5bc0027de663", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 11 23:14:54.130860 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Converting VIF {"id": "351eaad5-bf70-43b4-8f79-5bc0027de663", "address": "fa:16:3e:ee:d2:51", "network": {"id": "b0d7ffe8-2fba-456a-8969-949ee402ce5b", "bridge": "br-int", "label": "tempest-device-tagging-net2-84998986", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c1e407a42f24b34baf3ee44be9fb337", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap351eaad5-bf", "ovs_interfaceid": "351eaad5-bf70-43b4-8f79-5bc0027de663", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:14:54.131284 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:d2:51,bridge_name='br-int',has_traffic_filtering=True,id=351eaad5-bf70-43b4-8f79-5bc0027de663,network=Network(b0d7ffe8-2fba-456a-8969-949ee402ce5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap351eaad5-bf') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:14:54.131568 np0000002687 nova-compute[98431]: DEBUG os_vif [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:d2:51,bridge_name='br-int',has_traffic_filtering=True,id=351eaad5-bf70-43b4-8f79-5bc0027de663,network=Network(b0d7ffe8-2fba-456a-8969-949ee402ce5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap351eaad5-bf') {{(pid=98431) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 11 23:14:54.133025 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:54.133343 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap351eaad5-bf, bridge=br-int, if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:14:54.137932 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:14:54.143482 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:54.146639 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:54.146639 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cc7acae8-013d-4002-b68f-d7f7ab624e4b) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:14:54.148669 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:54.149421 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:14:54.154918 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:54.157277 np0000002687 nova-compute[98431]: INFO os_vif [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:d2:51,bridge_name='br-int',has_traffic_filtering=True,id=351eaad5-bf70-43b4-8f79-5bc0027de663,network=Network(b0d7ffe8-2fba-456a-8969-949ee402ce5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap351eaad5-bf') Jun 11 23:14:54.158760 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-11T23:12:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1366771090',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='tempest-device-tagging-server-1366771090',id=19,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC5UXUrCEEA/0gxvD1NavMz6RwD8U++JuZnAB48UjQLmwHKU2knd70tRMd/ODZENnwRMpvr28/C2g9VTy2gQO0/t/l3FqY9lxY/3+5+G6z+bb25kWd7QXQRH7lbyZDsb8w==',key_name='tempest-keypair-965487513',keypairs=,launch_index=0,launched_at=2026-06-11T23:13:42Z,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='6c1e407a42f24b34baf3ee44be9fb337',ramdisk_id='',reservation_id='r-dqc2uc2r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-37151554',owner_user_name='tempest-TaggedBootDevicesTest_v242-37151554-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-11T23:13:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3dd7997e0762451ca159ee06bf3d9c44',uuid=1d45c7ce-5760-4f59-9921-feb3e589da8a,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "004fd6c0-58df-4ceb-9733-267396cae60c", "address": "fa:16:3e:5d:12:c5", "network": {"id": "b0d7ffe8-2fba-456a-8969-949ee402ce5b", "bridge": "br-int", "label": "tempest-device-tagging-net2-84998986", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c1e407a42f24b34baf3ee44be9fb337", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap004fd6c0-58", "ovs_interfaceid": "004fd6c0-58df-4ceb-9733-267396cae60c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 11 23:14:54.158760 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Converting VIF {"id": "004fd6c0-58df-4ceb-9733-267396cae60c", "address": "fa:16:3e:5d:12:c5", "network": {"id": "b0d7ffe8-2fba-456a-8969-949ee402ce5b", "bridge": "br-int", "label": "tempest-device-tagging-net2-84998986", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c1e407a42f24b34baf3ee44be9fb337", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap004fd6c0-58", "ovs_interfaceid": "004fd6c0-58df-4ceb-9733-267396cae60c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:14:54.159279 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:12:c5,bridge_name='br-int',has_traffic_filtering=True,id=004fd6c0-58df-4ceb-9733-267396cae60c,network=Network(b0d7ffe8-2fba-456a-8969-949ee402ce5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap004fd6c0-58') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:14:54.159531 np0000002687 nova-compute[98431]: DEBUG os_vif [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:12:c5,bridge_name='br-int',has_traffic_filtering=True,id=004fd6c0-58df-4ceb-9733-267396cae60c,network=Network(b0d7ffe8-2fba-456a-8969-949ee402ce5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap004fd6c0-58') {{(pid=98431) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 11 23:14:54.162911 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:54.163152 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap004fd6c0-58, bridge=br-int, if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:14:54.167407 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:54.168601 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:14:54.171021 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:54.171207 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a655233e-45a0-45bc-9589-e9290c5ce7e4) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:14:54.174202 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:14:54.177827 np0000002687 nova-compute[98431]: INFO os_vif [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:12:c5,bridge_name='br-int',has_traffic_filtering=True,id=004fd6c0-58df-4ceb-9733-267396cae60c,network=Network(b0d7ffe8-2fba-456a-8969-949ee402ce5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap004fd6c0-58') Jun 11 23:14:54.179816 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] calling os-brick to detach iSCSI Volume {{(pid=98431) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jun 11 23:14:54.180208 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8', 'iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0eeb4862-dd4f-442d-a749-c347a2ec29f8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-11'}, None), 'kwargs': {'force': True}}" {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 11 23:14:54.180391 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 11 23:14:54.180856 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 11 23:14:54.181256 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8', 'iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0eeb4862-dd4f-442d-a749-c347a2ec29f8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-11'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 11 23:14:54.181445 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8', 0)] {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 11 23:14:54.223513 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:14:54.223513 np0000002687 nova-compute[98431]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:14:54.223513 np0000002687 nova-compute[98431]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:14:54.223513 np0000002687 nova-compute[98431]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:14:54.223513 np0000002687 nova-compute[98431]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:14:54.223513 np0000002687 nova-compute[98431]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8 (non-flash) Jun 11 23:14:54.223513 np0000002687 nova-compute[98431]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8 (non-flash) Jun 11 23:14:54.223513 np0000002687 nova-compute[98431]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13 (non-flash) Jun 11 23:14:54.223513 np0000002687 nova-compute[98431]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13 (non-flash) Jun 11 23:14:54.223513 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:14:54.223513 np0000002687 nova-compute[98431]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1 (non-flash) Jun 11 23:14:54.223513 np0000002687 nova-compute[98431]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1 (non-flash) Jun 11 23:14:54.223513 np0000002687 nova-compute[98431]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7e59f73-fc24-4ce4-8dd2-08f2f6948647 (non-flash) Jun 11 23:14:54.223513 np0000002687 nova-compute[98431]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7e59f73-fc24-4ce4-8dd2-08f2f6948647 (non-flash) Jun 11 23:14:54.223513 np0000002687 nova-compute[98431]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04239224-1178-444c-8f4a-6ac0944eff2a (non-flash) Jun 11 23:14:54.223513 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:14:54.224032 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:14:54.224032 np0000002687 nova-compute[98431]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:14:54.224032 np0000002687 nova-compute[98431]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:14:54.224032 np0000002687 nova-compute[98431]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:14:54.224032 np0000002687 nova-compute[98431]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:14:54.224032 np0000002687 nova-compute[98431]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8 (non-flash) Jun 11 23:14:54.224032 np0000002687 nova-compute[98431]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8 (non-flash) Jun 11 23:14:54.224032 np0000002687 nova-compute[98431]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13 (non-flash) Jun 11 23:14:54.224032 np0000002687 nova-compute[98431]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13 (non-flash) Jun 11 23:14:54.224032 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:14:54.224032 np0000002687 nova-compute[98431]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1 (non-flash) Jun 11 23:14:54.224032 np0000002687 nova-compute[98431]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1 (non-flash) Jun 11 23:14:54.224032 np0000002687 nova-compute[98431]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7e59f73-fc24-4ce4-8dd2-08f2f6948647 (non-flash) Jun 11 23:14:54.224032 np0000002687 nova-compute[98431]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7e59f73-fc24-4ce4-8dd2-08f2f6948647 (non-flash) Jun 11 23:14:54.224032 np0000002687 nova-compute[98431]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04239224-1178-444c-8f4a-6ac0944eff2a (non-flash) Jun 11 23:14:54.224032 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:14:54.224378 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9', '3'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff', '31'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff', '32'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc', '33'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc', '34'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8', '35'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8', '36'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13', '37'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13', '38'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9', '4'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1', '43'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1', '44'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f7e59f73-fc24-4ce4-8dd2-08f2f6948647', '45'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f7e59f73-fc24-4ce4-8dd2-08f2f6948647', '46'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-04239224-1178-444c-8f4a-6ac0944eff2a', '47')] {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 11 23:14:54.224378 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8', '35')] {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 11 23:14:54.226076 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8', '36')] {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 11 23:14:54.227716 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Resulting device map defaultdict(. at 0x7e1e9419f420>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8'): ({'sdl'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8'): ({'sdm'}, set())}) {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 11 23:14:54.228083 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Removing multipathed devices sdm, sdl {{(pid=98431) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 11 23:14:54.228401 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Flush multipath device 330000000d835ecb1 {{(pid=98431) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jun 11 23:14:54.272495 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.209', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000002687', 'execute': None}" {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 11 23:14:54.273202 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=98431) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 11 23:14:54.298950 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.scaleio [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98431) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 11 23:14:54.324770 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=98431) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 11 23:14:54.331132 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Running cmd (subprocess): nvme version {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:14:54.347171 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-ff08afe8-5e30-44c7-ad79-117974b8632a tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] [instance: cab1cc43-b433-4772-9f01-0197502c8b57] Start destroying the instance on the hypervisor. {{(pid=98431) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}} Jun 11 23:14:54.366692 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Checking to see if SCSI volumes sdm, sdl have been removed. {{(pid=98431) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 11 23:14:54.367259 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] SCSI volumes sdm, sdl have been removed. {{(pid=98431) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 11 23:14:54.369716 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Checking to see if device paths {'sdm', 'sdl'} are still under multipathd monitoring {{(pid=98431) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 11 23:14:54.379037 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] 'nvme version' failed. Not Retrying. {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 11 23:14:54.381073 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] nvme not present on system {{(pid=98431) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 11 23:14:54.388624 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:54.393358 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Device paths {'sdm', 'sdl'} have been removed from multipathd monitoring. {{(pid=98431) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 11 23:14:54.393358 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8')] {{(pid=98431) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 11 23:14:54.399503 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.lightos [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98431) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 11 23:14:54.401555 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.lightos [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Current host hostNQN and IP(s) are ['10.4.3.209', 'fe80::f816:3eff:fea3:3707', '192.168.40.6', 'fe80::f816:3eff:fe06:bdab', '192.168.50.6', 'fe80::f816:3eff:fe7a:46f2', '192.168.10.6', 'fe80::f816:3eff:fe13:793b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::38fa:21ff:fe6c:3746', 'fe80::fc16:3eff:fe77:488d', 'fe80::9469:f2ff:feae:5824', 'fe80::fc16:3eff:fec7:336a', 'fe80::fc16:3eff:fe61:b7fd', 'fe80::38dc:c1ff:fee9:4731', 'fe80::fc16:3eff:fec2:8da4', 'fe80::fc16:3eff:fe4b:2695', 'fe80::fc16:3eff:fe2b:91a7', 'fe80::fc16:3eff:fe6c:78be', 'fe80::d82a:87ff:fe65:391e', 'fe80::fc16:3eff:fef6:b5ae', 'fe80::fc16:3eff:fe03:1c0a', 'fe80::f090:d9ff:fe35:5216', 'fe80::c401:79ff:fed8:51d5'] Jun 11 23:14:54.402129 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.lightos [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98431) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 11 23:14:54.402129 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.lightos [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] LIGHTOS: no hostnqn found. {{(pid=98431) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 11 23:14:54.402331 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.209', 'host': 'np0000002687', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:798b370f1cc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad465dfe-0ed1-4637-98c3-ddaebebd61a4', 'nvme_native_multipath': False} {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 11 23:14:54.415765 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:14:54.425518 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:54.454128 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:54.455465 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:54.466067 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8, portal: 192.168.40.100,3260] Jun 11 23:14:54.466067 np0000002687 nova-compute[98431]: Logout of [sid: 35, target: iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8, portal: 192.168.40.100,3260] successful. Jun 11 23:14:54.466067 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:14:54.502012 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:14:54.518028 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:14:54.580407 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8, portal: 192.168.50.100,3260] Jun 11 23:14:54.580407 np0000002687 nova-compute[98431]: Logout of [sid: 36, target: iqn.2023-03.storpool.com:os--volume-0eeb4862-dd4f-442d-a749-c347a2ec29f8, portal: 192.168.50.100,3260] successful. Jun 11 23:14:54.580407 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:14:54.611949 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:14:54.611949 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.430s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 11 23:14:54.611949 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] <== disconnect_volume: return (429ms) None {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 11 23:14:54.611949 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Disconnected iSCSI Volume {{(pid=98431) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jun 11 23:14:54.614699 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] calling os-brick to detach iSCSI Volume {{(pid=98431) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jun 11 23:14:54.615053 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc', 'iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1bc89aea-2378-4237-a440-71ea160649dc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': True}}" {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 11 23:14:54.615230 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 11 23:14:54.615655 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 11 23:14:54.615960 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc', 'iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1bc89aea-2378-4237-a440-71ea160649dc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 11 23:14:54.616166 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc', 0)] {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 11 23:14:54.664638 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:14:54.664638 np0000002687 nova-compute[98431]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:14:54.664638 np0000002687 nova-compute[98431]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:14:54.664638 np0000002687 nova-compute[98431]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:14:54.664638 np0000002687 nova-compute[98431]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:14:54.664638 np0000002687 nova-compute[98431]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13 (non-flash) Jun 11 23:14:54.664638 np0000002687 nova-compute[98431]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13 (non-flash) Jun 11 23:14:54.664638 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:14:54.664638 np0000002687 nova-compute[98431]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1 (non-flash) Jun 11 23:14:54.664638 np0000002687 nova-compute[98431]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1 (non-flash) Jun 11 23:14:54.664638 np0000002687 nova-compute[98431]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7e59f73-fc24-4ce4-8dd2-08f2f6948647 (non-flash) Jun 11 23:14:54.664638 np0000002687 nova-compute[98431]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7e59f73-fc24-4ce4-8dd2-08f2f6948647 (non-flash) Jun 11 23:14:54.664638 np0000002687 nova-compute[98431]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04239224-1178-444c-8f4a-6ac0944eff2a (non-flash) Jun 11 23:14:54.664638 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:14:54.664638 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:14:54.664638 np0000002687 nova-compute[98431]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:14:54.664638 np0000002687 nova-compute[98431]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:14:54.664638 np0000002687 nova-compute[98431]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:14:54.664638 np0000002687 nova-compute[98431]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc (non-flash) Jun 11 23:14:54.664638 np0000002687 nova-compute[98431]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13 (non-flash) Jun 11 23:14:54.664638 np0000002687 nova-compute[98431]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13 (non-flash) Jun 11 23:14:54.664638 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:14:54.664638 np0000002687 nova-compute[98431]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1 (non-flash) Jun 11 23:14:54.664638 np0000002687 nova-compute[98431]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1 (non-flash) Jun 11 23:14:54.664638 np0000002687 nova-compute[98431]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7e59f73-fc24-4ce4-8dd2-08f2f6948647 (non-flash) Jun 11 23:14:54.664638 np0000002687 nova-compute[98431]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7e59f73-fc24-4ce4-8dd2-08f2f6948647 (non-flash) Jun 11 23:14:54.664638 np0000002687 nova-compute[98431]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04239224-1178-444c-8f4a-6ac0944eff2a (non-flash) Jun 11 23:14:54.664638 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:14:54.665611 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9', '3'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff', '31'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff', '32'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc', '33'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc', '34'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13', '37'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13', '38'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9', '4'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1', '43'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1', '44'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f7e59f73-fc24-4ce4-8dd2-08f2f6948647', '45'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f7e59f73-fc24-4ce4-8dd2-08f2f6948647', '46'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-04239224-1178-444c-8f4a-6ac0944eff2a', '47')] {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 11 23:14:54.665611 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc', '34')] {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 11 23:14:54.666838 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc', '33')] {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 11 23:14:54.667915 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Resulting device map defaultdict(. at 0x7e1e9419ce00>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc'): ({'sdd'}, set())}) {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 11 23:14:54.669691 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Removing multipathed devices sdd, sde {{(pid=98431) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 11 23:14:54.669691 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Flush multipath device 33000000072808ee7 {{(pid=98431) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jun 11 23:14:54.705091 np0000002687 nova-compute[98431]: DEBUG nova.utils [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Queued Task(fn=>, remaining_delay=14.998934451999958 future=) {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:14:54.708664 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [-] [instance: cab1cc43-b433-4772-9f01-0197502c8b57] Instance destroyed successfully. Jun 11 23:14:54.710146 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-ff08afe8-5e30-44c7-ad79-117974b8632a tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] Lazy-loading 'resources' on Instance uuid cab1cc43-b433-4772-9f01-0197502c8b57 {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:14:54.727317 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98431) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 11 23:14:54.791251 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98431) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 11 23:14:54.845829 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Checking to see if SCSI volumes sdd, sde have been removed. {{(pid=98431) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 11 23:14:54.846197 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] SCSI volumes sdd, sde have been removed. {{(pid=98431) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 11 23:14:54.848690 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Checking to see if device paths {'sdd', 'sde'} are still under multipathd monitoring {{(pid=98431) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 11 23:14:54.866926 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Device paths {'sdd', 'sde'} have been removed from multipathd monitoring. {{(pid=98431) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 11 23:14:54.866926 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc')] {{(pid=98431) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 11 23:14:54.882730 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:14:54.930725 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc, portal: 192.168.40.100,3260] Jun 11 23:14:54.930725 np0000002687 nova-compute[98431]: Logout of [sid: 34, target: iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc, portal: 192.168.40.100,3260] successful. Jun 11 23:14:54.930725 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:14:54.959387 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:14:54.975847 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:14:55.024933 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc, portal: 192.168.50.100,3260] Jun 11 23:14:55.024933 np0000002687 nova-compute[98431]: Logout of [sid: 33, target: iqn.2023-03.storpool.com:os--volume-1bc89aea-2378-4237-a440-71ea160649dc, portal: 192.168.50.100,3260] successful. Jun 11 23:14:55.024933 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:14:55.051645 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:14:55.051978 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.436s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 11 23:14:55.052017 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] <== disconnect_volume: return (436ms) None {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 11 23:14:55.052158 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Disconnected iSCSI Volume {{(pid=98431) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jun 11 23:14:55.055433 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-3bc1450c-5151-475e-a591-109af6a655c4 req-bb2f076c-e0ef-4278-9c53-81a967be1492 service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Received event network-vif-unplugged-5f9094e3-a3c6-48ea-bfbe-4fa25d19bcf2 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:14:55.057750 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-3bc1450c-5151-475e-a591-109af6a655c4 req-bb2f076c-e0ef-4278-9c53-81a967be1492 service nova] Acquiring lock "1d45c7ce-5760-4f59-9921-feb3e589da8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:14:55.061034 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-3bc1450c-5151-475e-a591-109af6a655c4 req-bb2f076c-e0ef-4278-9c53-81a967be1492 service nova] Lock "1d45c7ce-5760-4f59-9921-feb3e589da8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.004s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:14:55.061350 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-3bc1450c-5151-475e-a591-109af6a655c4 req-bb2f076c-e0ef-4278-9c53-81a967be1492 service nova] Lock "1d45c7ce-5760-4f59-9921-feb3e589da8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:14:55.062491 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] calling os-brick to detach iSCSI Volume {{(pid=98431) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jun 11 23:14:55.063006 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-3bc1450c-5151-475e-a591-109af6a655c4 req-bb2f076c-e0ef-4278-9c53-81a967be1492 service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] No waiting events found dispatching network-vif-unplugged-5f9094e3-a3c6-48ea-bfbe-4fa25d19bcf2 {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:14:55.063498 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13', 'iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'cf81e3db-e34d-4a99-b4f7-a47ab33a8f13', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-12'}, None), 'kwargs': {'force': True}}" {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 11 23:14:55.064215 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-3bc1450c-5151-475e-a591-109af6a655c4 req-bb2f076c-e0ef-4278-9c53-81a967be1492 service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Received event network-vif-unplugged-5f9094e3-a3c6-48ea-bfbe-4fa25d19bcf2 for instance with task_state deleting. {{(pid=98431) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 11 23:14:55.064358 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-3bc1450c-5151-475e-a591-109af6a655c4 req-bb2f076c-e0ef-4278-9c53-81a967be1492 service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Received event network-vif-unplugged-004fd6c0-58df-4ceb-9733-267396cae60c {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:14:55.064521 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-3bc1450c-5151-475e-a591-109af6a655c4 req-bb2f076c-e0ef-4278-9c53-81a967be1492 service nova] Acquiring lock "1d45c7ce-5760-4f59-9921-feb3e589da8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:14:55.065089 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 11 23:14:55.065464 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-3bc1450c-5151-475e-a591-109af6a655c4 req-bb2f076c-e0ef-4278-9c53-81a967be1492 service nova] Lock "1d45c7ce-5760-4f59-9921-feb3e589da8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:14:55.065618 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-3bc1450c-5151-475e-a591-109af6a655c4 req-bb2f076c-e0ef-4278-9c53-81a967be1492 service nova] Lock "1d45c7ce-5760-4f59-9921-feb3e589da8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:14:55.065749 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-3bc1450c-5151-475e-a591-109af6a655c4 req-bb2f076c-e0ef-4278-9c53-81a967be1492 service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] No waiting events found dispatching network-vif-unplugged-004fd6c0-58df-4ceb-9733-267396cae60c {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:14:55.065900 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-3bc1450c-5151-475e-a591-109af6a655c4 req-bb2f076c-e0ef-4278-9c53-81a967be1492 service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Received event network-vif-unplugged-004fd6c0-58df-4ceb-9733-267396cae60c for instance with task_state deleting. {{(pid=98431) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 11 23:14:55.066014 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-3bc1450c-5151-475e-a591-109af6a655c4 req-bb2f076c-e0ef-4278-9c53-81a967be1492 service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Received event network-vif-unplugged-004fd6c0-58df-4ceb-9733-267396cae60c {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:14:55.066206 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-3bc1450c-5151-475e-a591-109af6a655c4 req-bb2f076c-e0ef-4278-9c53-81a967be1492 service nova] Acquiring lock "1d45c7ce-5760-4f59-9921-feb3e589da8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:14:55.066389 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-3bc1450c-5151-475e-a591-109af6a655c4 req-bb2f076c-e0ef-4278-9c53-81a967be1492 service nova] Lock "1d45c7ce-5760-4f59-9921-feb3e589da8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:14:55.066517 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-3bc1450c-5151-475e-a591-109af6a655c4 req-bb2f076c-e0ef-4278-9c53-81a967be1492 service nova] Lock "1d45c7ce-5760-4f59-9921-feb3e589da8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:14:55.066623 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-3bc1450c-5151-475e-a591-109af6a655c4 req-bb2f076c-e0ef-4278-9c53-81a967be1492 service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] No waiting events found dispatching network-vif-unplugged-004fd6c0-58df-4ceb-9733-267396cae60c {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:14:55.066734 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-3bc1450c-5151-475e-a591-109af6a655c4 req-bb2f076c-e0ef-4278-9c53-81a967be1492 service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Received event network-vif-unplugged-004fd6c0-58df-4ceb-9733-267396cae60c for instance with task_state deleting. {{(pid=98431) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 11 23:14:55.066890 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-3bc1450c-5151-475e-a591-109af6a655c4 req-bb2f076c-e0ef-4278-9c53-81a967be1492 service nova] [instance: cab1cc43-b433-4772-9f01-0197502c8b57] Received event network-vif-unplugged-807d693f-6c88-415d-8c16-1187f9dd28c2 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:14:55.067665 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-3bc1450c-5151-475e-a591-109af6a655c4 req-bb2f076c-e0ef-4278-9c53-81a967be1492 service nova] Acquiring lock "cab1cc43-b433-4772-9f01-0197502c8b57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:14:55.067945 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-3bc1450c-5151-475e-a591-109af6a655c4 req-bb2f076c-e0ef-4278-9c53-81a967be1492 service nova] Lock "cab1cc43-b433-4772-9f01-0197502c8b57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:14:55.068065 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-3bc1450c-5151-475e-a591-109af6a655c4 req-bb2f076c-e0ef-4278-9c53-81a967be1492 service nova] Lock "cab1cc43-b433-4772-9f01-0197502c8b57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:14:55.068458 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.004s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 11 23:14:55.068934 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-3bc1450c-5151-475e-a591-109af6a655c4 req-bb2f076c-e0ef-4278-9c53-81a967be1492 service nova] [instance: cab1cc43-b433-4772-9f01-0197502c8b57] No waiting events found dispatching network-vif-unplugged-807d693f-6c88-415d-8c16-1187f9dd28c2 {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:14:55.069056 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-3bc1450c-5151-475e-a591-109af6a655c4 req-bb2f076c-e0ef-4278-9c53-81a967be1492 service nova] [instance: cab1cc43-b433-4772-9f01-0197502c8b57] Received event network-vif-unplugged-807d693f-6c88-415d-8c16-1187f9dd28c2 for instance with task_state deleting. {{(pid=98431) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 11 23:14:55.069183 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-3bc1450c-5151-475e-a591-109af6a655c4 req-bb2f076c-e0ef-4278-9c53-81a967be1492 service nova] [instance: cab1cc43-b433-4772-9f01-0197502c8b57] Received event network-vif-unplugged-807d693f-6c88-415d-8c16-1187f9dd28c2 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:14:55.069313 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-3bc1450c-5151-475e-a591-109af6a655c4 req-bb2f076c-e0ef-4278-9c53-81a967be1492 service nova] Acquiring lock "cab1cc43-b433-4772-9f01-0197502c8b57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:14:55.069731 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-3bc1450c-5151-475e-a591-109af6a655c4 req-bb2f076c-e0ef-4278-9c53-81a967be1492 service nova] Lock "cab1cc43-b433-4772-9f01-0197502c8b57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:14:55.070059 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13', 'iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'cf81e3db-e34d-4a99-b4f7-a47ab33a8f13', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-12'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 11 23:14:55.071131 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-3bc1450c-5151-475e-a591-109af6a655c4 req-bb2f076c-e0ef-4278-9c53-81a967be1492 service nova] Lock "cab1cc43-b433-4772-9f01-0197502c8b57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:14:55.071782 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13', 0)] {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 11 23:14:55.072142 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-3bc1450c-5151-475e-a591-109af6a655c4 req-bb2f076c-e0ef-4278-9c53-81a967be1492 service nova] [instance: cab1cc43-b433-4772-9f01-0197502c8b57] No waiting events found dispatching network-vif-unplugged-807d693f-6c88-415d-8c16-1187f9dd28c2 {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:14:55.072142 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-3bc1450c-5151-475e-a591-109af6a655c4 req-bb2f076c-e0ef-4278-9c53-81a967be1492 service nova] [instance: cab1cc43-b433-4772-9f01-0197502c8b57] Received event network-vif-unplugged-807d693f-6c88-415d-8c16-1187f9dd28c2 for instance with task_state deleting. {{(pid=98431) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 11 23:14:55.086661 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-c125c7fe-2544-4e46-90d7-eb0d4045cf25 req-6637c107-a09e-423c-a486-73fff5bbf828 service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Received event network-vif-unplugged-fe1430ca-d60b-47c4-9ac9-96ba7d61f101 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:14:55.086820 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-c125c7fe-2544-4e46-90d7-eb0d4045cf25 req-6637c107-a09e-423c-a486-73fff5bbf828 service nova] Acquiring lock "1d45c7ce-5760-4f59-9921-feb3e589da8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:14:55.087016 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-c125c7fe-2544-4e46-90d7-eb0d4045cf25 req-6637c107-a09e-423c-a486-73fff5bbf828 service nova] Lock "1d45c7ce-5760-4f59-9921-feb3e589da8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:14:55.087231 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-c125c7fe-2544-4e46-90d7-eb0d4045cf25 req-6637c107-a09e-423c-a486-73fff5bbf828 service nova] Lock "1d45c7ce-5760-4f59-9921-feb3e589da8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:14:55.087422 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-c125c7fe-2544-4e46-90d7-eb0d4045cf25 req-6637c107-a09e-423c-a486-73fff5bbf828 service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] No waiting events found dispatching network-vif-unplugged-fe1430ca-d60b-47c4-9ac9-96ba7d61f101 {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:14:55.087537 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-c125c7fe-2544-4e46-90d7-eb0d4045cf25 req-6637c107-a09e-423c-a486-73fff5bbf828 service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Received event network-vif-unplugged-fe1430ca-d60b-47c4-9ac9-96ba7d61f101 for instance with task_state deleting. {{(pid=98431) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 11 23:14:55.091240 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-c125c7fe-2544-4e46-90d7-eb0d4045cf25 req-6637c107-a09e-423c-a486-73fff5bbf828 service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Received event network-vif-unplugged-a39a55c7-874a-4a19-a069-8383a5f0bc5a {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:14:55.091515 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-c125c7fe-2544-4e46-90d7-eb0d4045cf25 req-6637c107-a09e-423c-a486-73fff5bbf828 service nova] Acquiring lock "1d45c7ce-5760-4f59-9921-feb3e589da8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:14:55.091741 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-c125c7fe-2544-4e46-90d7-eb0d4045cf25 req-6637c107-a09e-423c-a486-73fff5bbf828 service nova] Lock "1d45c7ce-5760-4f59-9921-feb3e589da8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:14:55.091937 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-c125c7fe-2544-4e46-90d7-eb0d4045cf25 req-6637c107-a09e-423c-a486-73fff5bbf828 service nova] Lock "1d45c7ce-5760-4f59-9921-feb3e589da8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:14:55.092460 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-c125c7fe-2544-4e46-90d7-eb0d4045cf25 req-6637c107-a09e-423c-a486-73fff5bbf828 service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] No waiting events found dispatching network-vif-unplugged-a39a55c7-874a-4a19-a069-8383a5f0bc5a {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:14:55.092731 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-c125c7fe-2544-4e46-90d7-eb0d4045cf25 req-6637c107-a09e-423c-a486-73fff5bbf828 service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Received event network-vif-unplugged-a39a55c7-874a-4a19-a069-8383a5f0bc5a for instance with task_state deleting. {{(pid=98431) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 11 23:14:55.092911 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-c125c7fe-2544-4e46-90d7-eb0d4045cf25 req-6637c107-a09e-423c-a486-73fff5bbf828 service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Received event network-vif-unplugged-a39a55c7-874a-4a19-a069-8383a5f0bc5a {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:14:55.093505 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-c125c7fe-2544-4e46-90d7-eb0d4045cf25 req-6637c107-a09e-423c-a486-73fff5bbf828 service nova] Acquiring lock "1d45c7ce-5760-4f59-9921-feb3e589da8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:14:55.093667 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-c125c7fe-2544-4e46-90d7-eb0d4045cf25 req-6637c107-a09e-423c-a486-73fff5bbf828 service nova] Lock "1d45c7ce-5760-4f59-9921-feb3e589da8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:14:55.093829 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-c125c7fe-2544-4e46-90d7-eb0d4045cf25 req-6637c107-a09e-423c-a486-73fff5bbf828 service nova] Lock "1d45c7ce-5760-4f59-9921-feb3e589da8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:14:55.093981 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-c125c7fe-2544-4e46-90d7-eb0d4045cf25 req-6637c107-a09e-423c-a486-73fff5bbf828 service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] No waiting events found dispatching network-vif-unplugged-a39a55c7-874a-4a19-a069-8383a5f0bc5a {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:14:55.094115 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-c125c7fe-2544-4e46-90d7-eb0d4045cf25 req-6637c107-a09e-423c-a486-73fff5bbf828 service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Received event network-vif-unplugged-a39a55c7-874a-4a19-a069-8383a5f0bc5a for instance with task_state deleting. {{(pid=98431) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 11 23:14:55.119971 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:14:55.119971 np0000002687 nova-compute[98431]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:14:55.119971 np0000002687 nova-compute[98431]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:14:55.119971 np0000002687 nova-compute[98431]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13 (non-flash) Jun 11 23:14:55.119971 np0000002687 nova-compute[98431]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13 (non-flash) Jun 11 23:14:55.119971 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:14:55.119971 np0000002687 nova-compute[98431]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1 (non-flash) Jun 11 23:14:55.119971 np0000002687 nova-compute[98431]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1 (non-flash) Jun 11 23:14:55.119971 np0000002687 nova-compute[98431]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7e59f73-fc24-4ce4-8dd2-08f2f6948647 (non-flash) Jun 11 23:14:55.119971 np0000002687 nova-compute[98431]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7e59f73-fc24-4ce4-8dd2-08f2f6948647 (non-flash) Jun 11 23:14:55.119971 np0000002687 nova-compute[98431]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04239224-1178-444c-8f4a-6ac0944eff2a (non-flash) Jun 11 23:14:55.119971 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:14:55.119971 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:14:55.119971 np0000002687 nova-compute[98431]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:14:55.119971 np0000002687 nova-compute[98431]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:14:55.119971 np0000002687 nova-compute[98431]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13 (non-flash) Jun 11 23:14:55.119971 np0000002687 nova-compute[98431]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13 (non-flash) Jun 11 23:14:55.119971 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:14:55.119971 np0000002687 nova-compute[98431]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1 (non-flash) Jun 11 23:14:55.119971 np0000002687 nova-compute[98431]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1 (non-flash) Jun 11 23:14:55.119971 np0000002687 nova-compute[98431]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7e59f73-fc24-4ce4-8dd2-08f2f6948647 (non-flash) Jun 11 23:14:55.119971 np0000002687 nova-compute[98431]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7e59f73-fc24-4ce4-8dd2-08f2f6948647 (non-flash) Jun 11 23:14:55.119971 np0000002687 nova-compute[98431]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04239224-1178-444c-8f4a-6ac0944eff2a (non-flash) Jun 11 23:14:55.119971 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:14:55.119971 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9', '3'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff', '31'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff', '32'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13', '37'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13', '38'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9', '4'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1', '43'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1', '44'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f7e59f73-fc24-4ce4-8dd2-08f2f6948647', '45'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f7e59f73-fc24-4ce4-8dd2-08f2f6948647', '46'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-04239224-1178-444c-8f4a-6ac0944eff2a', '47')] {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 11 23:14:55.119971 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13', '37')] {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 11 23:14:55.119971 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13', '38')] {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 11 23:14:55.121608 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Resulting device map defaultdict(. at 0x7e1ea047cb80>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13'): ({'sdo'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13'): ({'sdn'}, set())}) {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 11 23:14:55.122126 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Removing multipathed devices sdo, sdn {{(pid=98431) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 11 23:14:55.122556 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Flush multipath device 330000000531b62bf {{(pid=98431) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jun 11 23:14:55.154530 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Remove SCSI device /dev/sdo with /sys/block/sdo/device/delete {{(pid=98431) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 11 23:14:55.196659 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Remove SCSI device /dev/sdn with /sys/block/sdn/device/delete {{(pid=98431) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 11 23:14:55.213971 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-ff08afe8-5e30-44c7-ad79-117974b8632a tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-11T23:14:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='instance-depend-image',display_name='instance-depend-image',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='instance-depend-image',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-06-11T23:14:46Z,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='e4028976d11d4dfdb2a6f8637d28c73d',ramdisk_id='',reservation_id='r-0a9ynk8w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_signature_verified='False',owner_project_name='tempest-ImageDependencyTests-1754620563',owner_user_name='tempest-ImageDependencyTests-1754620563-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-11T23:14:46Z,user_data=None,user_id='d1bfc36c83e84cfbac05bd2daacaf580',uuid=cab1cc43-b433-4772-9f01-0197502c8b57,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "807d693f-6c88-415d-8c16-1187f9dd28c2", "address": "fa:16:3e:17:0e:ab", "network": {"id": "e7f47484-d4a6-4304-95df-65b18550a507", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ce012f9fabdb4ee5a73e212437f59d97", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap807d693f-6c", "ovs_interfaceid": "807d693f-6c88-415d-8c16-1187f9dd28c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 11 23:14:55.214201 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-ff08afe8-5e30-44c7-ad79-117974b8632a tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] Converting VIF {"id": "807d693f-6c88-415d-8c16-1187f9dd28c2", "address": "fa:16:3e:17:0e:ab", "network": {"id": "e7f47484-d4a6-4304-95df-65b18550a507", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ce012f9fabdb4ee5a73e212437f59d97", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap807d693f-6c", "ovs_interfaceid": "807d693f-6c88-415d-8c16-1187f9dd28c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:14:55.215182 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-ff08afe8-5e30-44c7-ad79-117974b8632a tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:0e:ab,bridge_name='br-int',has_traffic_filtering=True,id=807d693f-6c88-415d-8c16-1187f9dd28c2,network=Network(e7f47484-d4a6-4304-95df-65b18550a507),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap807d693f-6c') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:14:55.215669 np0000002687 nova-compute[98431]: DEBUG os_vif [None req-ff08afe8-5e30-44c7-ad79-117974b8632a tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:0e:ab,bridge_name='br-int',has_traffic_filtering=True,id=807d693f-6c88-415d-8c16-1187f9dd28c2,network=Network(e7f47484-d4a6-4304-95df-65b18550a507),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap807d693f-6c') {{(pid=98431) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 11 23:14:55.217133 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:55.217467 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap807d693f-6c, bridge=br-int, if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:14:55.219554 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:14:55.220618 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:55.222210 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:55.222546 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cda7a68b-ce9a-4bb5-ab21-85e5ecf67745) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:14:55.223183 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:55.223901 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:14:55.226907 np0000002687 nova-compute[98431]: INFO os_vif [None req-ff08afe8-5e30-44c7-ad79-117974b8632a tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:0e:ab,bridge_name='br-int',has_traffic_filtering=True,id=807d693f-6c88-415d-8c16-1187f9dd28c2,network=Network(e7f47484-d4a6-4304-95df-65b18550a507),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap807d693f-6c') Jun 11 23:14:55.228398 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff08afe8-5e30-44c7-ad79-117974b8632a tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] [instance: cab1cc43-b433-4772-9f01-0197502c8b57] calling os-brick to detach iSCSI Volume {{(pid=98431) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jun 11 23:14:55.228814 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff08afe8-5e30-44c7-ad79-117974b8632a tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f7e59f73-fc24-4ce4-8dd2-08f2f6948647', 'iqn.2023-03.storpool.com:os--volume-f7e59f73-fc24-4ce4-8dd2-08f2f6948647'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f7e59f73-fc24-4ce4-8dd2-08f2f6948647', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f7e59f73-fc24-4ce4-8dd2-08f2f6948647', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, None), 'kwargs': {'force': True}}" {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 11 23:14:55.229019 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-ff08afe8-5e30-44c7-ad79-117974b8632a tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 11 23:14:55.241588 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Checking to see if SCSI volumes sdo, sdn have been removed. {{(pid=98431) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 11 23:14:55.243961 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] SCSI volumes sdo, sdn have been removed. {{(pid=98431) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 11 23:14:55.243961 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Checking to see if device paths {'sdo', 'sdn'} are still under multipathd monitoring {{(pid=98431) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 11 23:14:55.257783 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Device paths {'sdo', 'sdn'} have been removed from multipathd monitoring. {{(pid=98431) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 11 23:14:55.258567 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13')] {{(pid=98431) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 11 23:14:55.264050 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-10cf0c0e-d44c-4038-bfb1-748cdf202968 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98431) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 11 23:14:55.264334 np0000002687 nova-compute[98431]: DEBUG nova.compute.provider_tree [None req-10cf0c0e-d44c-4038-bfb1-748cdf202968 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Inventory has not changed in ProviderTree for provider: e3e65fe2-9de9-4821-8b4a-ccae37c66e25 {{(pid=98431) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 11 23:14:55.274061 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:14:55.314711 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13, portal: 192.168.40.100,3260] Jun 11 23:14:55.314711 np0000002687 nova-compute[98431]: Logout of [sid: 37, target: iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13, portal: 192.168.40.100,3260] successful. Jun 11 23:14:55.314711 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:14:55.336328 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:14:55.350477 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:14:55.394078 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13, portal: 192.168.50.100,3260] Jun 11 23:14:55.394078 np0000002687 nova-compute[98431]: Logout of [sid: 38, target: iqn.2023-03.storpool.com:os--volume-cf81e3db-e34d-4a99-b4f7-a47ab33a8f13, portal: 192.168.50.100,3260] successful. Jun 11 23:14:55.394078 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:14:55.419132 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-d4e97aa1-14e7-4408-8264-bef918d237a8 req-c35226a9-0c10-4ead-b6a1-f75e2120a296 service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Received event network-vif-unplugged-37aa7cee-88a0-4428-9b2d-45700f1dcab6 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:14:55.420095 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-d4e97aa1-14e7-4408-8264-bef918d237a8 req-c35226a9-0c10-4ead-b6a1-f75e2120a296 service nova] Acquiring lock "1d45c7ce-5760-4f59-9921-feb3e589da8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:14:55.420386 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-d4e97aa1-14e7-4408-8264-bef918d237a8 req-c35226a9-0c10-4ead-b6a1-f75e2120a296 service nova] Lock "1d45c7ce-5760-4f59-9921-feb3e589da8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:14:55.420458 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-d4e97aa1-14e7-4408-8264-bef918d237a8 req-c35226a9-0c10-4ead-b6a1-f75e2120a296 service nova] Lock "1d45c7ce-5760-4f59-9921-feb3e589da8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:14:55.420769 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-d4e97aa1-14e7-4408-8264-bef918d237a8 req-c35226a9-0c10-4ead-b6a1-f75e2120a296 service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] No waiting events found dispatching network-vif-unplugged-37aa7cee-88a0-4428-9b2d-45700f1dcab6 {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:14:55.420924 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-d4e97aa1-14e7-4408-8264-bef918d237a8 req-c35226a9-0c10-4ead-b6a1-f75e2120a296 service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Received event network-vif-unplugged-37aa7cee-88a0-4428-9b2d-45700f1dcab6 for instance with task_state deleting. {{(pid=98431) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 11 23:14:55.421063 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-d4e97aa1-14e7-4408-8264-bef918d237a8 req-c35226a9-0c10-4ead-b6a1-f75e2120a296 service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Received event network-vif-unplugged-e3269961-a3f1-42c8-a49e-37f728b2f3d8 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:14:55.422175 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:14:55.422384 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-d4e97aa1-14e7-4408-8264-bef918d237a8 req-c35226a9-0c10-4ead-b6a1-f75e2120a296 service nova] Acquiring lock "1d45c7ce-5760-4f59-9921-feb3e589da8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:14:55.422601 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-d4e97aa1-14e7-4408-8264-bef918d237a8 req-c35226a9-0c10-4ead-b6a1-f75e2120a296 service nova] Lock "1d45c7ce-5760-4f59-9921-feb3e589da8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:14:55.422757 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-d4e97aa1-14e7-4408-8264-bef918d237a8 req-c35226a9-0c10-4ead-b6a1-f75e2120a296 service nova] Lock "1d45c7ce-5760-4f59-9921-feb3e589da8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:14:55.422915 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-d4e97aa1-14e7-4408-8264-bef918d237a8 req-c35226a9-0c10-4ead-b6a1-f75e2120a296 service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] No waiting events found dispatching network-vif-unplugged-e3269961-a3f1-42c8-a49e-37f728b2f3d8 {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:14:55.423457 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-d4e97aa1-14e7-4408-8264-bef918d237a8 req-c35226a9-0c10-4ead-b6a1-f75e2120a296 service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Received event network-vif-unplugged-e3269961-a3f1-42c8-a49e-37f728b2f3d8 for instance with task_state deleting. {{(pid=98431) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 11 23:14:55.423595 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-d4e97aa1-14e7-4408-8264-bef918d237a8 req-c35226a9-0c10-4ead-b6a1-f75e2120a296 service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Received event network-vif-unplugged-e3269961-a3f1-42c8-a49e-37f728b2f3d8 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:14:55.423744 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-d4e97aa1-14e7-4408-8264-bef918d237a8 req-c35226a9-0c10-4ead-b6a1-f75e2120a296 service nova] Acquiring lock "1d45c7ce-5760-4f59-9921-feb3e589da8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:14:55.423909 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-d4e97aa1-14e7-4408-8264-bef918d237a8 req-c35226a9-0c10-4ead-b6a1-f75e2120a296 service nova] Lock "1d45c7ce-5760-4f59-9921-feb3e589da8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:14:55.424022 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-d4e97aa1-14e7-4408-8264-bef918d237a8 req-c35226a9-0c10-4ead-b6a1-f75e2120a296 service nova] Lock "1d45c7ce-5760-4f59-9921-feb3e589da8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:14:55.424152 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-d4e97aa1-14e7-4408-8264-bef918d237a8 req-c35226a9-0c10-4ead-b6a1-f75e2120a296 service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] No waiting events found dispatching network-vif-unplugged-e3269961-a3f1-42c8-a49e-37f728b2f3d8 {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:14:55.424700 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-d4e97aa1-14e7-4408-8264-bef918d237a8 req-c35226a9-0c10-4ead-b6a1-f75e2120a296 service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Received event network-vif-unplugged-e3269961-a3f1-42c8-a49e-37f728b2f3d8 for instance with task_state deleting. {{(pid=98431) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 11 23:14:55.424914 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-d4e97aa1-14e7-4408-8264-bef918d237a8 req-c35226a9-0c10-4ead-b6a1-f75e2120a296 service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Received event network-vif-unplugged-351eaad5-bf70-43b4-8f79-5bc0027de663 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:14:55.425069 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-d4e97aa1-14e7-4408-8264-bef918d237a8 req-c35226a9-0c10-4ead-b6a1-f75e2120a296 service nova] Acquiring lock "1d45c7ce-5760-4f59-9921-feb3e589da8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:14:55.425201 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-d4e97aa1-14e7-4408-8264-bef918d237a8 req-c35226a9-0c10-4ead-b6a1-f75e2120a296 service nova] Lock "1d45c7ce-5760-4f59-9921-feb3e589da8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:14:55.426354 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-d4e97aa1-14e7-4408-8264-bef918d237a8 req-c35226a9-0c10-4ead-b6a1-f75e2120a296 service nova] Lock "1d45c7ce-5760-4f59-9921-feb3e589da8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:14:55.426489 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-d4e97aa1-14e7-4408-8264-bef918d237a8 req-c35226a9-0c10-4ead-b6a1-f75e2120a296 service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] No waiting events found dispatching network-vif-unplugged-351eaad5-bf70-43b4-8f79-5bc0027de663 {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:14:55.426637 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-d4e97aa1-14e7-4408-8264-bef918d237a8 req-c35226a9-0c10-4ead-b6a1-f75e2120a296 service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Received event network-vif-unplugged-351eaad5-bf70-43b4-8f79-5bc0027de663 for instance with task_state deleting. {{(pid=98431) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 11 23:14:55.427354 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-d4e97aa1-14e7-4408-8264-bef918d237a8 req-c35226a9-0c10-4ead-b6a1-f75e2120a296 service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Received event network-vif-unplugged-351eaad5-bf70-43b4-8f79-5bc0027de663 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:14:55.427516 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-d4e97aa1-14e7-4408-8264-bef918d237a8 req-c35226a9-0c10-4ead-b6a1-f75e2120a296 service nova] Acquiring lock "1d45c7ce-5760-4f59-9921-feb3e589da8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:14:55.427656 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-d4e97aa1-14e7-4408-8264-bef918d237a8 req-c35226a9-0c10-4ead-b6a1-f75e2120a296 service nova] Lock "1d45c7ce-5760-4f59-9921-feb3e589da8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:14:55.427787 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-d4e97aa1-14e7-4408-8264-bef918d237a8 req-c35226a9-0c10-4ead-b6a1-f75e2120a296 service nova] Lock "1d45c7ce-5760-4f59-9921-feb3e589da8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:14:55.427955 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-d4e97aa1-14e7-4408-8264-bef918d237a8 req-c35226a9-0c10-4ead-b6a1-f75e2120a296 service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] No waiting events found dispatching network-vif-unplugged-351eaad5-bf70-43b4-8f79-5bc0027de663 {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:14:55.428456 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-d4e97aa1-14e7-4408-8264-bef918d237a8 req-c35226a9-0c10-4ead-b6a1-f75e2120a296 service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Received event network-vif-unplugged-351eaad5-bf70-43b4-8f79-5bc0027de663 for instance with task_state deleting. {{(pid=98431) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 11 23:14:55.429424 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.361s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 11 23:14:55.429424 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] <== disconnect_volume: return (365ms) None {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 11 23:14:55.429424 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Disconnected iSCSI Volume {{(pid=98431) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jun 11 23:14:55.430327 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-ff08afe8-5e30-44c7-ad79-117974b8632a tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.201s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 11 23:14:55.430984 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Deleting instance files /opt/stack/data/nova/instances/1d45c7ce-5760-4f59-9921-feb3e589da8a_del Jun 11 23:14:55.431309 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff08afe8-5e30-44c7-ad79-117974b8632a tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f7e59f73-fc24-4ce4-8dd2-08f2f6948647', 'iqn.2023-03.storpool.com:os--volume-f7e59f73-fc24-4ce4-8dd2-08f2f6948647'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f7e59f73-fc24-4ce4-8dd2-08f2f6948647', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f7e59f73-fc24-4ce4-8dd2-08f2f6948647', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 11 23:14:55.431681 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff08afe8-5e30-44c7-ad79-117974b8632a tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f7e59f73-fc24-4ce4-8dd2-08f2f6948647', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f7e59f73-fc24-4ce4-8dd2-08f2f6948647', 0)] {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 11 23:14:55.435033 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Deletion of /opt/stack/data/nova/instances/1d45c7ce-5760-4f59-9921-feb3e589da8a_del complete Jun 11 23:14:55.469305 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff08afe8-5e30-44c7-ad79-117974b8632a tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:14:55.469305 np0000002687 nova-compute[98431]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:14:55.469305 np0000002687 nova-compute[98431]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:14:55.469305 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:14:55.469305 np0000002687 nova-compute[98431]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1 (non-flash) Jun 11 23:14:55.469305 np0000002687 nova-compute[98431]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1 (non-flash) Jun 11 23:14:55.469305 np0000002687 nova-compute[98431]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7e59f73-fc24-4ce4-8dd2-08f2f6948647 (non-flash) Jun 11 23:14:55.469305 np0000002687 nova-compute[98431]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7e59f73-fc24-4ce4-8dd2-08f2f6948647 (non-flash) Jun 11 23:14:55.469305 np0000002687 nova-compute[98431]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04239224-1178-444c-8f4a-6ac0944eff2a (non-flash) Jun 11 23:14:55.469305 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:14:55.469654 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff08afe8-5e30-44c7-ad79-117974b8632a tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:14:55.469654 np0000002687 nova-compute[98431]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:14:55.469654 np0000002687 nova-compute[98431]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:14:55.469654 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:14:55.469654 np0000002687 nova-compute[98431]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1 (non-flash) Jun 11 23:14:55.469654 np0000002687 nova-compute[98431]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1 (non-flash) Jun 11 23:14:55.469654 np0000002687 nova-compute[98431]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7e59f73-fc24-4ce4-8dd2-08f2f6948647 (non-flash) Jun 11 23:14:55.469654 np0000002687 nova-compute[98431]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7e59f73-fc24-4ce4-8dd2-08f2f6948647 (non-flash) Jun 11 23:14:55.469654 np0000002687 nova-compute[98431]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04239224-1178-444c-8f4a-6ac0944eff2a (non-flash) Jun 11 23:14:55.469654 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:14:55.470000 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff08afe8-5e30-44c7-ad79-117974b8632a tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9', '3'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff', '31'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff', '32'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9', '4'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1', '43'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1', '44'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f7e59f73-fc24-4ce4-8dd2-08f2f6948647', '45'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f7e59f73-fc24-4ce4-8dd2-08f2f6948647', '46'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-04239224-1178-444c-8f4a-6ac0944eff2a', '47')] {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 11 23:14:55.470000 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff08afe8-5e30-44c7-ad79-117974b8632a tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-f7e59f73-fc24-4ce4-8dd2-08f2f6948647, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f7e59f73-fc24-4ce4-8dd2-08f2f6948647', '46')] {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 11 23:14:55.470994 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff08afe8-5e30-44c7-ad79-117974b8632a tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-f7e59f73-fc24-4ce4-8dd2-08f2f6948647, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f7e59f73-fc24-4ce4-8dd2-08f2f6948647', '45')] {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 11 23:14:55.475528 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff08afe8-5e30-44c7-ad79-117974b8632a tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] Resulting device map defaultdict(. at 0x7e1ea02934c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f7e59f73-fc24-4ce4-8dd2-08f2f6948647'): ({'sdk'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f7e59f73-fc24-4ce4-8dd2-08f2f6948647'): ({'sdj'}, set())}) {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 11 23:14:55.475678 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-ff08afe8-5e30-44c7-ad79-117974b8632a tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] Removing multipathed devices sdj, sdk {{(pid=98431) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 11 23:14:55.475955 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-ff08afe8-5e30-44c7-ad79-117974b8632a tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] Flush multipath device 33000000063147393 {{(pid=98431) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jun 11 23:14:55.510867 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-ff08afe8-5e30-44c7-ad79-117974b8632a tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=98431) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 11 23:14:55.560776 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-ff08afe8-5e30-44c7-ad79-117974b8632a tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98431) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 11 23:14:55.611339 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-ff08afe8-5e30-44c7-ad79-117974b8632a tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] Checking to see if SCSI volumes sdj, sdk have been removed. {{(pid=98431) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 11 23:14:55.611681 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-ff08afe8-5e30-44c7-ad79-117974b8632a tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] SCSI volumes sdj, sdk have been removed. {{(pid=98431) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 11 23:14:55.614300 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-ff08afe8-5e30-44c7-ad79-117974b8632a tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] Checking to see if device paths {'sdj', 'sdk'} are still under multipathd monitoring {{(pid=98431) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 11 23:14:55.629247 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-ff08afe8-5e30-44c7-ad79-117974b8632a tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] Device paths {'sdj', 'sdk'} have been removed from multipathd monitoring. {{(pid=98431) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 11 23:14:55.629389 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff08afe8-5e30-44c7-ad79-117974b8632a tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f7e59f73-fc24-4ce4-8dd2-08f2f6948647'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f7e59f73-fc24-4ce4-8dd2-08f2f6948647')] {{(pid=98431) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 11 23:14:55.643167 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff08afe8-5e30-44c7-ad79-117974b8632a tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:14:55.649980 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] Starting finish_migration {{(pid=98431) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12803}} Jun 11 23:14:55.651382 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] Instance directory exists: not creating {{(pid=98431) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5217}} Jun 11 23:14:55.652335 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] Creating image(s) Jun 11 23:14:55.652534 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:14:55.686397 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff08afe8-5e30-44c7-ad79-117974b8632a tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2023-03.storpool.com:os--volume-f7e59f73-fc24-4ce4-8dd2-08f2f6948647, portal: 192.168.40.100,3260] Jun 11 23:14:55.686397 np0000002687 nova-compute[98431]: Logout of [sid: 46, target: iqn.2023-03.storpool.com:os--volume-f7e59f73-fc24-4ce4-8dd2-08f2f6948647, portal: 192.168.40.100,3260] successful. Jun 11 23:14:55.686397 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:14:55.709823 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff08afe8-5e30-44c7-ad79-117974b8632a tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:14:55.723089 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff08afe8-5e30-44c7-ad79-117974b8632a tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:14:55.760868 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json" returned: 0 in 0.108s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:14:55.761318 np0000002687 nova-compute[98431]: DEBUG nova.virt.disk.api [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8a45e04f-3516-4c39-bea1-820104411f17/disk. size=1073741824 {{(pid=98431) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 11 23:14:55.761589 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a45e04f-3516-4c39-bea1-820104411f17/disk --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:14:55.774553 np0000002687 nova-compute[98431]: DEBUG nova.scheduler.client.report [None req-10cf0c0e-d44c-4038-bfb1-748cdf202968 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Inventory has not changed for provider e3e65fe2-9de9-4821-8b4a-ccae37c66e25 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98431) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 11 23:14:55.783552 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff08afe8-5e30-44c7-ad79-117974b8632a tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2023-03.storpool.com:os--volume-f7e59f73-fc24-4ce4-8dd2-08f2f6948647, portal: 192.168.50.100,3260] Jun 11 23:14:55.783552 np0000002687 nova-compute[98431]: Logout of [sid: 45, target: iqn.2023-03.storpool.com:os--volume-f7e59f73-fc24-4ce4-8dd2-08f2f6948647, portal: 192.168.50.100,3260] successful. Jun 11 23:14:55.783552 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:14:55.806293 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff08afe8-5e30-44c7-ad79-117974b8632a tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:14:55.806793 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-ff08afe8-5e30-44c7-ad79-117974b8632a tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.376s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 11 23:14:55.806920 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff08afe8-5e30-44c7-ad79-117974b8632a tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] <== disconnect_volume: return (578ms) None {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 11 23:14:55.807137 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff08afe8-5e30-44c7-ad79-117974b8632a tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] [instance: cab1cc43-b433-4772-9f01-0197502c8b57] Disconnected iSCSI Volume {{(pid=98431) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jun 11 23:14:55.808394 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-ff08afe8-5e30-44c7-ad79-117974b8632a tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] [instance: cab1cc43-b433-4772-9f01-0197502c8b57] Deleting instance files /opt/stack/data/nova/instances/cab1cc43-b433-4772-9f01-0197502c8b57_del Jun 11 23:14:55.809355 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-ff08afe8-5e30-44c7-ad79-117974b8632a tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] [instance: cab1cc43-b433-4772-9f01-0197502c8b57] Deletion of /opt/stack/data/nova/instances/cab1cc43-b433-4772-9f01-0197502c8b57_del complete Jun 11 23:14:55.855828 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a45e04f-3516-4c39-bea1-820104411f17/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:14:55.856331 np0000002687 nova-compute[98431]: DEBUG nova.virt.disk.api [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Cannot resize image /opt/stack/data/nova/instances/8a45e04f-3516-4c39-bea1-820104411f17/disk to a smaller size. {{(pid=98431) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 11 23:14:55.942787 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Took 3.39 seconds to destroy the instance on the hypervisor. Jun 11 23:14:55.943941 np0000002687 nova-compute[98431]: DEBUG oslo.service.backend._common.loopingcall [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98431) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jun 11 23:14:55.944203 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [-] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Deallocating network for instance {{(pid=98431) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}} Jun 11 23:14:55.944317 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [-] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] deallocate_for_instance() {{(pid=98431) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jun 11 23:14:55.944769 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:14:56.203281 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:14:56.287870 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-10cf0c0e-d44c-4038-bfb1-748cdf202968 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.120s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:14:56.288369 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-10cf0c0e-d44c-4038-bfb1-748cdf202968 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] [instance: f4f629ca-bf55-4dc5-ad80-9136da020657] Start building networks asynchronously for instance. {{(pid=98431) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 11 23:14:56.321165 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-ff08afe8-5e30-44c7-ad79-117974b8632a tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] [instance: cab1cc43-b433-4772-9f01-0197502c8b57] Took 1.97 seconds to destroy the instance on the hypervisor. Jun 11 23:14:56.324327 np0000002687 nova-compute[98431]: DEBUG oslo.service.backend._common.loopingcall [None req-ff08afe8-5e30-44c7-ad79-117974b8632a tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98431) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jun 11 23:14:56.324814 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [-] [instance: cab1cc43-b433-4772-9f01-0197502c8b57] Deallocating network for instance {{(pid=98431) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}} Jun 11 23:14:56.325411 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [-] [instance: cab1cc43-b433-4772-9f01-0197502c8b57] deallocate_for_instance() {{(pid=98431) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jun 11 23:14:56.325411 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:14:56.359750 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] Did not create local disks {{(pid=98431) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}} Jun 11 23:14:56.360222 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] Ensure instance console log exists: /opt/stack/data/nova/instances/8a45e04f-3516-4c39-bea1-820104411f17/console.log {{(pid=98431) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}} Jun 11 23:14:56.360732 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:14:56.360891 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:14:56.361042 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:14:56.364302 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] Start _get_guest_xml network_info=[{"id": "3c04202e-5ce6-4249-ba31-be06996ca75d", "address": "fa:16:3e:6f:42:42", "network": {"id": "17593db3-c22d-4354-ab29-933b1c6a5c3a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1094286565-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1094286565-network", "vif_mac": "fa:16:3e:6f:42:42"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "81fd45f475a04e5c8e9bd9deb7ad4c1e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c04202e-5c", "ovs_interfaceid": "3c04202e-5ce6-4249-ba31-be06996ca75d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-11T23:08:20Z,direct_url=,disk_format='qcow2',id=f30640f8-7aca-4300-a085-4706a5209a79,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ce012f9fabdb4ee5a73e212437f59d97',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-11T23:08:23Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'image_id': 'f30640f8-7aca-4300-a085-4706a5209a79'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'mount_device': '/dev/vdb', 'attachment_id': '801ed8e9-3c3f-498a-8cc6-3507e4db67b4', 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff', 'iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f535b91b-3bff-46ad-905e-644bd012b9ff', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': '8a45e04f-3516-4c39-bea1-820104411f17', 'attached_at': '2026-06-11T23:14:55.000000', 'detached_at': '', 'volume_id': 'f535b91b-3bff-46ad-905e-644bd012b9ff', 'multiattach': True, 'serial': 'f535b91b-3bff-46ad-905e-644bd012b9ff'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98431) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 11 23:14:56.371894 np0000002687 nova-compute[98431]: WARNING nova.virt.libvirt.driver [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 11 23:14:56.373160 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='f30640f8-7aca-4300-a085-4706a5209a79', instance_meta=NovaInstanceMeta(name='multiattach-server-1', uuid='8a45e04f-3516-4c39-bea1-820104411f17'), owner=OwnerMeta(userid='c17e84202f404c3c8e73292bb59d7b27', username='tempest-AttachVolumeMultiAttachTest-1514006700-project-member', projectid='81fd45f475a04e5c8e9bd9deb7ad4c1e', projectname='tempest-AttachVolumeMultiAttachTest-1514006700'), image=ImageMeta(id='f30640f8-7aca-4300-a085-4706a5209a79', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.micro', flavorid='84', memory_mb=256, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "3c04202e-5ce6-4249-ba31-be06996ca75d", "address": "fa:16:3e:6f:42:42", "network": {"id": "17593db3-c22d-4354-ab29-933b1c6a5c3a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1094286565-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1094286565-network", "vif_mac": "fa:16:3e:6f:42:42"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "81fd45f475a04e5c8e9bd9deb7ad4c1e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c04202e-5c", "ovs_interfaceid": "3c04202e-5ce6-4249-ba31-be06996ca75d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1781219696.372829) {{(pid=98431) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 11 23:14:56.374188 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Searching host: 'np0000002687' for CPU controller through CGroups V1... {{(pid=98431) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 11 23:14:56.374513 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] CPU controller missing on host. {{(pid=98431) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 11 23:14:56.375789 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Searching host: 'np0000002687' for CPU controller through CGroups V2... {{(pid=98431) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 11 23:14:56.375994 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] CPU controller found on host. {{(pid=98431) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 11 23:14:56.377187 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98431) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 11 23:14:56.377527 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-11T23:08:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=256,name='m1.micro',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-11T23:08:20Z,direct_url=,disk_format='qcow2',id=f30640f8-7aca-4300-a085-4706a5209a79,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ce012f9fabdb4ee5a73e212437f59d97',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-11T23:08:23Z,virtual_size=,visibility=), allow threads: True {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 11 23:14:56.377762 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Flavor limits 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 11 23:14:56.377867 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Image limits 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 11 23:14:56.377997 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Flavor pref 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 11 23:14:56.378089 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Image pref 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 11 23:14:56.378225 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 11 23:14:56.378397 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 11 23:14:56.378458 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98431) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 11 23:14:56.378559 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Got 1 possible topologies {{(pid=98431) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 11 23:14:56.378650 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 11 23:14:56.378757 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 11 23:14:56.388703 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a45e04f-3516-4c39-bea1-820104411f17/disk.config --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:14:56.413363 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:14:56.494496 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a45e04f-3516-4c39-bea1-820104411f17/disk.config --force-share --output=json" returned: 0 in 0.106s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:14:56.495107 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Acquiring lock "/opt/stack/data/nova/instances/8a45e04f-3516-4c39-bea1-820104411f17/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:14:56.495399 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "/opt/stack/data/nova/instances/8a45e04f-3516-4c39-bea1-820104411f17/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:14:56.495955 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "/opt/stack/data/nova/instances/8a45e04f-3516-4c39-bea1-820104411f17/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:14:56.496401 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] Calling os-brick to attach iSCSI Volume {{(pid=98431) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 11 23:14:56.496831 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff', 'iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f535b91b-3bff-46ad-905e-644bd012b9ff', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 11 23:14:56.497641 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 11 23:14:56.498078 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 11 23:14:56.498727 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff', 'iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f535b91b-3bff-46ad-905e-644bd012b9ff', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98431) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 11 23:14:56.513657 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 11 23:14:56.517910 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 11 23:14:56.517910 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 11 23:14:56.517910 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.iscsi [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 11 23:14:56.517910 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 11 23:14:56.517910 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.iscsi [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 11 23:14:56.536999 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 11 23:14:56.536999 np0000002687 nova-compute[98431]: node.name = iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff Jun 11 23:14:56.536999 np0000002687 nova-compute[98431]: node.tpgt = -1 Jun 11 23:14:56.536999 np0000002687 nova-compute[98431]: node.startup = automatic Jun 11 23:14:56.536999 np0000002687 nova-compute[98431]: node.leading_login = No Jun 11 23:14:56.536999 np0000002687 nova-compute[98431]: iface.iscsi_ifacename = default Jun 11 23:14:56.536999 np0000002687 nova-compute[98431]: iface.net_ifacename = Jun 11 23:14:56.536999 np0000002687 nova-compute[98431]: iface.ipaddress = Jun 11 23:14:56.536999 np0000002687 nova-compute[98431]: iface.prefix_len = 0 Jun 11 23:14:56.536999 np0000002687 nova-compute[98431]: iface.hwaddress = Jun 11 23:14:56.536999 np0000002687 nova-compute[98431]: iface.transport_name = tcp Jun 11 23:14:56.536999 np0000002687 nova-compute[98431]: iface.initiatorname = Jun 11 23:14:56.536999 np0000002687 nova-compute[98431]: iface.state = Jun 11 23:14:56.536999 np0000002687 nova-compute[98431]: iface.vlan_id = 0 Jun 11 23:14:56.536999 np0000002687 nova-compute[98431]: iface.vlan_priority = 0 Jun 11 23:14:56.536999 np0000002687 nova-compute[98431]: iface.vlan_state = Jun 11 23:14:56.536999 np0000002687 nova-compute[98431]: iface.iface_num = 0 Jun 11 23:14:56.536999 np0000002687 nova-compute[98431]: iface.mtu = 0 Jun 11 23:14:56.536999 np0000002687 nova-compute[98431]: iface.port = 0 Jun 11 23:14:56.536999 np0000002687 nova-compute[98431]: iface.bootproto = Jun 11 23:14:56.536999 np0000002687 nova-compute[98431]: iface.subnet_mask = Jun 11 23:14:56.536999 np0000002687 nova-compute[98431]: iface.gateway = Jun 11 23:14:56.536999 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id_state = Jun 11 23:14:56.536999 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id = Jun 11 23:14:56.536999 np0000002687 nova-compute[98431]: iface.dhcp_dns = Jun 11 23:14:56.536999 np0000002687 nova-compute[98431]: iface.dhcp_learn_iqn = Jun 11 23:14:56.536999 np0000002687 nova-compute[98431]: iface.dhcp_req_vendor_id_state = Jun 11 23:14:56.536999 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id_state = Jun 11 23:14:56.536999 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id = Jun 11 23:14:56.536999 np0000002687 nova-compute[98431]: iface.dhcp_slp_da = Jun 11 23:14:56.536999 np0000002687 nova-compute[98431]: iface.fragmentation = Jun 11 23:14:56.536999 np0000002687 nova-compute[98431]: iface.gratuitous_arp = Jun 11 23:14:56.536999 np0000002687 nova-compute[98431]: iface.incoming_forwarding = Jun 11 23:14:56.536999 np0000002687 nova-compute[98431]: iface.tos_state = Jun 11 23:14:56.536999 np0000002687 nova-compute[98431]: iface.tos = 0 Jun 11 23:14:56.536999 np0000002687 nova-compute[98431]: iface.ttl = 0 Jun 11 23:14:56.536999 np0000002687 nova-compute[98431]: iface.delayed_ack = Jun 11 23:14:56.536999 np0000002687 nova-compute[98431]: iface.tcp_nagle = Jun 11 23:14:56.536999 np0000002687 nova-compute[98431]: iface.tcp_wsf_state = Jun 11 23:14:56.536999 np0000002687 nova-compute[98431]: iface.tcp_wsf = 0 Jun 11 23:14:56.536999 np0000002687 nova-compute[98431]: iface.tcp_timer_scale = 0 Jun 11 23:14:56.536999 np0000002687 nova-compute[98431]: iface.tcp_timestamp = Jun 11 23:14:56.536999 np0000002687 nova-compute[98431]: iface.redirect = Jun 11 23:14:56.536999 np0000002687 nova-compute[98431]: iface.def_task_mgmt_timeout = 0 Jun 11 23:14:56.536999 np0000002687 nova-compute[98431]: iface.header_digest = Jun 11 23:14:56.536999 np0000002687 nova-compute[98431]: iface.data_digest = Jun 11 23:14:56.536999 np0000002687 nova-compute[98431]: iface.immediate_data = Jun 11 23:14:56.536999 np0000002687 nova-compute[98431]: iface.initial_r2t = Jun 11 23:14:56.536999 np0000002687 nova-compute[98431]: iface.data_seq_inorder = Jun 11 23:14:56.536999 np0000002687 nova-compute[98431]: iface.data_pdu_inorder = Jun 11 23:14:56.536999 np0000002687 nova-compute[98431]: iface.erl = 0 Jun 11 23:14:56.536999 np0000002687 nova-compute[98431]: iface.max_receive_data_len = 0 Jun 11 23:14:56.536999 np0000002687 nova-compute[98431]: iface.first_burst_len = 0 Jun 11 23:14:56.536999 np0000002687 nova-compute[98431]: iface.max_outstanding_r2t = 0 Jun 11 23:14:56.536999 np0000002687 nova-compute[98431]: iface.max_burst_len = 0 Jun 11 23:14:56.536999 np0000002687 nova-compute[98431]: iface.chap_auth = Jun 11 23:14:56.536999 np0000002687 nova-compute[98431]: iface.bidi_chap = Jun 11 23:14:56.536999 np0000002687 nova-compute[98431]: iface.strict_login_compliance = Jun 11 23:14:56.536999 np0000002687 nova-compute[98431]: iface.discovery_auth = Jun 11 23:14:56.536999 np0000002687 nova-compute[98431]: iface.discovery_logout = Jun 11 23:14:56.536999 np0000002687 nova-compute[98431]: node.discovery_address = Jun 11 23:14:56.536999 np0000002687 nova-compute[98431]: node.discovery_port = 0 Jun 11 23:14:56.536999 np0000002687 nova-compute[98431]: node.discovery_type = fw Jun 11 23:14:56.536999 np0000002687 nova-compute[98431]: node.session.initial_cmdsn = 0 Jun 11 23:14:56.536999 np0000002687 nova-compute[98431]: node.session.initial_login_retry_max = 8 Jun 11 23:14:56.536999 np0000002687 nova-compute[98431]: node.session.xmit_thread_priority = 0 Jun 11 23:14:56.536999 np0000002687 nova-compute[98431]: node.session.cmds_max = 128 Jun 11 23:14:56.536999 np0000002687 nova-compute[98431]: node.session.queue_depth = 32 Jun 11 23:14:56.536999 np0000002687 nova-compute[98431]: node.session.nr_sessions = 1 Jun 11 23:14:56.536999 np0000002687 nova-compute[98431]: node.session.auth.authmethod = None Jun 11 23:14:56.536999 np0000002687 nova-compute[98431]: node.session.auth.username = Jun 11 23:14:56.536999 np0000002687 nova-compute[98431]: node.session.auth.password = *** Jun 11 23:14:56.536999 np0000002687 nova-compute[98431]: node.session.auth.username_in = Jun 11 23:14:56.536999 np0000002687 nova-compute[98431]: node.session.auth.password_in = Jun 11 23:14:56.536999 np0000002687 nova-compute[98431]: node.session.auth.chap_algs = SHA256 Jun 11 23:14:56.536999 np0000002687 nova-compute[98431]: node.session.timeo.replacement_timeout = 120 Jun 11 23:14:56.536999 np0000002687 nova-compute[98431]: node.session.err_timeo.abort_timeout = 15 Jun 11 23:14:56.536999 np0000002687 nova-compute[98431]: node.session.err_timeo.lu_reset_timeout = 30 Jun 11 23:14:56.536999 np0000002687 nova-compute[98431]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 11 23:14:56.536999 np0000002687 nova-compute[98431]: node.session.err_timeo.host_reset_timeout = 60 Jun 11 23:14:56.536999 np0000002687 nova-compute[98431]: node.session.iscsi.FastAbort = Yes Jun 11 23:14:56.536999 np0000002687 nova-compute[98431]: node.session.iscsi.InitialR2T = No Jun 11 23:14:56.536999 np0000002687 nova-compute[98431]: node.session.iscsi.ImmediateData = Yes Jun 11 23:14:56.536999 np0000002687 nova-compute[98431]: node.session.iscsi.FirstBurstLength = 262144 Jun 11 23:14:56.536999 np0000002687 nova-compute[98431]: node.session.iscsi.MaxBurstLength = 16776192 Jun 11 23:14:56.536999 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Retain = 0 Jun 11 23:14:56.536999 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Wait = 2 Jun 11 23:14:56.536999 np0000002687 nova-compute[98431]: node.session.iscsi.MaxConnections = 1 Jun 11 23:14:56.536999 np0000002687 nova-compute[98431]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 11 23:14:56.536999 np0000002687 nova-compute[98431]: node.session.iscsi.ERL = 0 Jun 11 23:14:56.536999 np0000002687 nova-compute[98431]: node.session.scan = manual Jun 11 23:14:56.536999 np0000002687 nova-compute[98431]: node.session.reopen_max = 0 Jun 11 23:14:56.536999 np0000002687 nova-compute[98431]: node.conn[0].address = 192.168.40.100 Jun 11 23:14:56.536999 np0000002687 nova-compute[98431]: node.conn[0].port = 3260 Jun 11 23:14:56.536999 np0000002687 nova-compute[98431]: node.conn[0].startup = manual Jun 11 23:14:56.536999 np0000002687 nova-compute[98431]: node.conn[0].tcp.window_size = 524288 Jun 11 23:14:56.536999 np0000002687 nova-compute[98431]: node.conn[0].tcp.type_of_service = 0 Jun 11 23:14:56.536999 np0000002687 nova-compute[98431]: node.conn[0].timeo.logout_timeout = 15 Jun 11 23:14:56.536999 np0000002687 nova-compute[98431]: node.conn[0].timeo.login_timeout = 15 Jun 11 23:14:56.536999 np0000002687 nova-compute[98431]: node.conn[0].timeo.auth_timeout = 45 Jun 11 23:14:56.536999 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_interval = 5 Jun 11 23:14:56.536999 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_timeout = 5 Jun 11 23:14:56.536999 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 11 23:14:56.536999 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 11 23:14:56.536999 np0000002687 nova-compute[98431]: node.conn[0].iscsi.HeaderDigest = None Jun 11 23:14:56.536999 np0000002687 nova-compute[98431]: node.conn[0].iscsi.DataDigest = None Jun 11 23:14:56.536999 np0000002687 nova-compute[98431]: node.conn[0].iscsi.IFMarker = No Jun 11 23:14:56.536999 np0000002687 nova-compute[98431]: node.conn[0].iscsi.OFMarker = No Jun 11 23:14:56.536999 np0000002687 nova-compute[98431]: # END RECORD Jun 11 23:14:56.536999 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:14:56.539173 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 11 23:14:56.539173 np0000002687 nova-compute[98431]: node.name = iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff Jun 11 23:14:56.539173 np0000002687 nova-compute[98431]: node.tpgt = -1 Jun 11 23:14:56.539173 np0000002687 nova-compute[98431]: node.startup = automatic Jun 11 23:14:56.539173 np0000002687 nova-compute[98431]: node.leading_login = No Jun 11 23:14:56.539173 np0000002687 nova-compute[98431]: iface.iscsi_ifacename = default Jun 11 23:14:56.539173 np0000002687 nova-compute[98431]: iface.net_ifacename = Jun 11 23:14:56.539173 np0000002687 nova-compute[98431]: iface.ipaddress = Jun 11 23:14:56.539173 np0000002687 nova-compute[98431]: iface.prefix_len = 0 Jun 11 23:14:56.539173 np0000002687 nova-compute[98431]: iface.hwaddress = Jun 11 23:14:56.539173 np0000002687 nova-compute[98431]: iface.transport_name = tcp Jun 11 23:14:56.539173 np0000002687 nova-compute[98431]: iface.initiatorname = Jun 11 23:14:56.539173 np0000002687 nova-compute[98431]: iface.state = Jun 11 23:14:56.539173 np0000002687 nova-compute[98431]: iface.vlan_id = 0 Jun 11 23:14:56.539173 np0000002687 nova-compute[98431]: iface.vlan_priority = 0 Jun 11 23:14:56.539173 np0000002687 nova-compute[98431]: iface.vlan_state = Jun 11 23:14:56.539173 np0000002687 nova-compute[98431]: iface.iface_num = 0 Jun 11 23:14:56.539173 np0000002687 nova-compute[98431]: iface.mtu = 0 Jun 11 23:14:56.539173 np0000002687 nova-compute[98431]: iface.port = 0 Jun 11 23:14:56.539173 np0000002687 nova-compute[98431]: iface.bootproto = Jun 11 23:14:56.539173 np0000002687 nova-compute[98431]: iface.subnet_mask = Jun 11 23:14:56.539173 np0000002687 nova-compute[98431]: iface.gateway = Jun 11 23:14:56.539173 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id_state = Jun 11 23:14:56.539173 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id = Jun 11 23:14:56.539173 np0000002687 nova-compute[98431]: iface.dhcp_dns = Jun 11 23:14:56.539173 np0000002687 nova-compute[98431]: iface.dhcp_learn_iqn = Jun 11 23:14:56.539173 np0000002687 nova-compute[98431]: iface.dhcp_req_vendor_id_state = Jun 11 23:14:56.539173 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id_state = Jun 11 23:14:56.539173 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id = Jun 11 23:14:56.539173 np0000002687 nova-compute[98431]: iface.dhcp_slp_da = Jun 11 23:14:56.539173 np0000002687 nova-compute[98431]: iface.fragmentation = Jun 11 23:14:56.539173 np0000002687 nova-compute[98431]: iface.gratuitous_arp = Jun 11 23:14:56.539173 np0000002687 nova-compute[98431]: iface.incoming_forwarding = Jun 11 23:14:56.539173 np0000002687 nova-compute[98431]: iface.tos_state = Jun 11 23:14:56.539173 np0000002687 nova-compute[98431]: iface.tos = 0 Jun 11 23:14:56.539173 np0000002687 nova-compute[98431]: iface.ttl = 0 Jun 11 23:14:56.539173 np0000002687 nova-compute[98431]: iface.delayed_ack = Jun 11 23:14:56.539173 np0000002687 nova-compute[98431]: iface.tcp_nagle = Jun 11 23:14:56.539173 np0000002687 nova-compute[98431]: iface.tcp_wsf_state = Jun 11 23:14:56.539173 np0000002687 nova-compute[98431]: iface.tcp_wsf = 0 Jun 11 23:14:56.539173 np0000002687 nova-compute[98431]: iface.tcp_timer_scale = 0 Jun 11 23:14:56.539173 np0000002687 nova-compute[98431]: iface.tcp_timestamp = Jun 11 23:14:56.539173 np0000002687 nova-compute[98431]: iface.redirect = Jun 11 23:14:56.539173 np0000002687 nova-compute[98431]: iface.def_task_mgmt_timeout = 0 Jun 11 23:14:56.539173 np0000002687 nova-compute[98431]: iface.header_digest = Jun 11 23:14:56.539173 np0000002687 nova-compute[98431]: iface.data_digest = Jun 11 23:14:56.539173 np0000002687 nova-compute[98431]: iface.immediate_data = Jun 11 23:14:56.539173 np0000002687 nova-compute[98431]: iface.initial_r2t = Jun 11 23:14:56.539173 np0000002687 nova-compute[98431]: iface.data_seq_inorder = Jun 11 23:14:56.539173 np0000002687 nova-compute[98431]: iface.data_pdu_inorder = Jun 11 23:14:56.539173 np0000002687 nova-compute[98431]: iface.erl = 0 Jun 11 23:14:56.539173 np0000002687 nova-compute[98431]: iface.max_receive_data_len = 0 Jun 11 23:14:56.539173 np0000002687 nova-compute[98431]: iface.first_burst_len = 0 Jun 11 23:14:56.539173 np0000002687 nova-compute[98431]: iface.max_outstanding_r2t = 0 Jun 11 23:14:56.539173 np0000002687 nova-compute[98431]: iface.max_burst_len = 0 Jun 11 23:14:56.539173 np0000002687 nova-compute[98431]: iface.chap_auth = Jun 11 23:14:56.539173 np0000002687 nova-compute[98431]: iface.bidi_chap = Jun 11 23:14:56.539173 np0000002687 nova-compute[98431]: iface.strict_login_compliance = Jun 11 23:14:56.539173 np0000002687 nova-compute[98431]: iface.discovery_auth = Jun 11 23:14:56.539173 np0000002687 nova-compute[98431]: iface.discovery_logout = Jun 11 23:14:56.539173 np0000002687 nova-compute[98431]: node.discovery_address = Jun 11 23:14:56.539173 np0000002687 nova-compute[98431]: node.discovery_port = 0 Jun 11 23:14:56.539173 np0000002687 nova-compute[98431]: node.discovery_type = fw Jun 11 23:14:56.539173 np0000002687 nova-compute[98431]: node.session.initial_cmdsn = 0 Jun 11 23:14:56.539173 np0000002687 nova-compute[98431]: node.session.initial_login_retry_max = 8 Jun 11 23:14:56.539173 np0000002687 nova-compute[98431]: node.session.xmit_thread_priority = 0 Jun 11 23:14:56.539173 np0000002687 nova-compute[98431]: node.session.cmds_max = 128 Jun 11 23:14:56.539173 np0000002687 nova-compute[98431]: node.session.queue_depth = 32 Jun 11 23:14:56.539173 np0000002687 nova-compute[98431]: node.session.nr_sessions = 1 Jun 11 23:14:56.539173 np0000002687 nova-compute[98431]: node.session.auth.authmethod = None Jun 11 23:14:56.539173 np0000002687 nova-compute[98431]: node.session.auth.username = Jun 11 23:14:56.539173 np0000002687 nova-compute[98431]: node.session.auth.password = *** Jun 11 23:14:56.539173 np0000002687 nova-compute[98431]: node.session.auth.username_in = Jun 11 23:14:56.539173 np0000002687 nova-compute[98431]: node.session.auth.password_in = Jun 11 23:14:56.539173 np0000002687 nova-compute[98431]: node.session.auth.chap_algs = SHA256 Jun 11 23:14:56.539173 np0000002687 nova-compute[98431]: node.session.timeo.replacement_timeout = 120 Jun 11 23:14:56.539173 np0000002687 nova-compute[98431]: node.session.err_timeo.abort_timeout = 15 Jun 11 23:14:56.539173 np0000002687 nova-compute[98431]: node.session.err_timeo.lu_reset_timeout = 30 Jun 11 23:14:56.539173 np0000002687 nova-compute[98431]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 11 23:14:56.539173 np0000002687 nova-compute[98431]: node.session.err_timeo.host_reset_timeout = 60 Jun 11 23:14:56.539173 np0000002687 nova-compute[98431]: node.session.iscsi.FastAbort = Yes Jun 11 23:14:56.539173 np0000002687 nova-compute[98431]: node.session.iscsi.InitialR2T = No Jun 11 23:14:56.539173 np0000002687 nova-compute[98431]: node.session.iscsi.ImmediateData = Yes Jun 11 23:14:56.539173 np0000002687 nova-compute[98431]: node.session.iscsi.FirstBurstLength = 262144 Jun 11 23:14:56.539173 np0000002687 nova-compute[98431]: node.session.iscsi.MaxBurstLength = 16776192 Jun 11 23:14:56.539173 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Retain = 0 Jun 11 23:14:56.539173 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Wait = 2 Jun 11 23:14:56.539173 np0000002687 nova-compute[98431]: node.session.iscsi.MaxConnections = 1 Jun 11 23:14:56.539173 np0000002687 nova-compute[98431]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 11 23:14:56.539173 np0000002687 nova-compute[98431]: node.session.iscsi.ERL = 0 Jun 11 23:14:56.539173 np0000002687 nova-compute[98431]: node.session.scan = manual Jun 11 23:14:56.539173 np0000002687 nova-compute[98431]: node.session.reopen_max = 0 Jun 11 23:14:56.539173 np0000002687 nova-compute[98431]: node.conn[0].address = 192.168.50.100 Jun 11 23:14:56.539173 np0000002687 nova-compute[98431]: node.conn[0].port = 3260 Jun 11 23:14:56.539173 np0000002687 nova-compute[98431]: node.conn[0].startup = manual Jun 11 23:14:56.539173 np0000002687 nova-compute[98431]: node.conn[0].tcp.window_size = 524288 Jun 11 23:14:56.539173 np0000002687 nova-compute[98431]: node.conn[0].tcp.type_of_service = 0 Jun 11 23:14:56.539173 np0000002687 nova-compute[98431]: node.conn[0].timeo.logout_timeout = 15 Jun 11 23:14:56.539173 np0000002687 nova-compute[98431]: node.conn[0].timeo.login_timeout = 15 Jun 11 23:14:56.539173 np0000002687 nova-compute[98431]: node.conn[0].timeo.auth_timeout = 45 Jun 11 23:14:56.539173 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_interval = 5 Jun 11 23:14:56.539173 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_timeout = 5 Jun 11 23:14:56.539173 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 11 23:14:56.539173 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 11 23:14:56.539173 np0000002687 nova-compute[98431]: node.conn[0].iscsi.HeaderDigest = None Jun 11 23:14:56.539173 np0000002687 nova-compute[98431]: node.conn[0].iscsi.DataDigest = None Jun 11 23:14:56.539173 np0000002687 nova-compute[98431]: node.conn[0].iscsi.IFMarker = No Jun 11 23:14:56.539173 np0000002687 nova-compute[98431]: node.conn[0].iscsi.OFMarker = No Jun 11 23:14:56.539173 np0000002687 nova-compute[98431]: # END RECORD Jun 11 23:14:56.539173 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:14:56.551011 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:14:56.557453 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:14:56.570995 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:14:56.570995 np0000002687 nova-compute[98431]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:14:56.570995 np0000002687 nova-compute[98431]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:14:56.570995 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:14:56.570995 np0000002687 nova-compute[98431]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1 (non-flash) Jun 11 23:14:56.570995 np0000002687 nova-compute[98431]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1 (non-flash) Jun 11 23:14:56.570995 np0000002687 nova-compute[98431]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04239224-1178-444c-8f4a-6ac0944eff2a (non-flash) Jun 11 23:14:56.570995 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:14:56.570995 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:14:56.570995 np0000002687 nova-compute[98431]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:14:56.570995 np0000002687 nova-compute[98431]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:14:56.570995 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:14:56.570995 np0000002687 nova-compute[98431]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1 (non-flash) Jun 11 23:14:56.570995 np0000002687 nova-compute[98431]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1 (non-flash) Jun 11 23:14:56.570995 np0000002687 nova-compute[98431]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04239224-1178-444c-8f4a-6ac0944eff2a (non-flash) Jun 11 23:14:56.570995 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:14:56.570995 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.053s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 11 23:14:56.570995 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Connected to 192.168.40.100:3260 {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 11 23:14:56.570995 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] HCTL ('13', '0', '0', 0) found on session 31 with lun 0 {{(pid=98431) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 11 23:14:56.570995 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Scanning host 13 c: 0, t: 0, l: 0) {{(pid=98431) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 11 23:14:56.580301 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:14:56.580301 np0000002687 nova-compute[98431]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:14:56.580301 np0000002687 nova-compute[98431]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:14:56.580301 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:14:56.580301 np0000002687 nova-compute[98431]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1 (non-flash) Jun 11 23:14:56.580301 np0000002687 nova-compute[98431]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1 (non-flash) Jun 11 23:14:56.580301 np0000002687 nova-compute[98431]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04239224-1178-444c-8f4a-6ac0944eff2a (non-flash) Jun 11 23:14:56.580301 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:14:56.580776 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:14:56.580776 np0000002687 nova-compute[98431]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:14:56.580776 np0000002687 nova-compute[98431]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:14:56.580776 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:14:56.580776 np0000002687 nova-compute[98431]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1 (non-flash) Jun 11 23:14:56.580776 np0000002687 nova-compute[98431]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1 (non-flash) Jun 11 23:14:56.580776 np0000002687 nova-compute[98431]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04239224-1178-444c-8f4a-6ac0944eff2a (non-flash) Jun 11 23:14:56.580776 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:14:56.580776 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.064s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 11 23:14:56.581216 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Connected to 192.168.50.100:3260 {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 11 23:14:56.581463 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] HCTL ('14', '0', '0', 0) found on session 32 with lun 0 {{(pid=98431) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 11 23:14:56.581587 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Scanning host 14 c: 0, t: 0, l: 0) {{(pid=98431) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 11 23:14:56.587620 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Searching for a device in session 31 and hctl ('13', '0', '0', 0) yield: sdh {{(pid=98431) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 11 23:14:56.588008 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f535b91b-3bff-46ad-905e-644bd012b9ff', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 11 23:14:56.591727 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Searching for a device in session 32 and hctl ('14', '0', '0', 0) yield: sdi {{(pid=98431) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 11 23:14:56.591899 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'f535b91b-3bff-46ad-905e-644bd012b9ff', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 11 23:14:56.797078 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-10cf0c0e-d44c-4038-bfb1-748cdf202968 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] [instance: f4f629ca-bf55-4dc5-ad80-9136da020657] Allocating IP information in the background. {{(pid=98431) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 11 23:14:56.797272 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-10cf0c0e-d44c-4038-bfb1-748cdf202968 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] [instance: f4f629ca-bf55-4dc5-ad80-9136da020657] allocate_for_instance() {{(pid=98431) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 11 23:14:56.797560 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-10cf0c0e-d44c-4038-bfb1-748cdf202968 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:14:56.797948 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-10cf0c0e-d44c-4038-bfb1-748cdf202968 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:14:56.873094 np0000002687 nova-compute[98431]: DEBUG nova.policy [None req-10cf0c0e-d44c-4038-bfb1-748cdf202968 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5b929fda768d45738790181d6b49a3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1922540076a94ee5ba369d79869aaa95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98431) authorize /opt/stack/nova/nova/policy.py:192}} Jun 11 23:14:57.165694 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-1072a7dc-402a-405d-b351-34bad9f9616b req-8fb6510d-8852-41ae-ba03-bbbcf7c14845 service nova] [instance: cab1cc43-b433-4772-9f01-0197502c8b57] Received event network-vif-deleted-807d693f-6c88-415d-8c16-1187f9dd28c2 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:14:57.165968 np0000002687 nova-compute[98431]: INFO nova.compute.manager [req-1072a7dc-402a-405d-b351-34bad9f9616b req-8fb6510d-8852-41ae-ba03-bbbcf7c14845 service nova] [instance: cab1cc43-b433-4772-9f01-0197502c8b57] Neutron deleted interface 807d693f-6c88-415d-8c16-1187f9dd28c2; detaching it from the instance and deleting it from the info cache Jun 11 23:14:57.172834 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-1072a7dc-402a-405d-b351-34bad9f9616b req-8fb6510d-8852-41ae-ba03-bbbcf7c14845 service nova] [instance: cab1cc43-b433-4772-9f01-0197502c8b57] Detach interface failed, port_id=807d693f-6c88-415d-8c16-1187f9dd28c2, reason: Instance cab1cc43-b433-4772-9f01-0197502c8b57 could not be found. {{(pid=98431) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}} Jun 11 23:14:57.234840 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [-] [instance: cab1cc43-b433-4772-9f01-0197502c8b57] Updating instance_info_cache with network_info: [] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:14:57.298772 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-10cf0c0e-d44c-4038-bfb1-748cdf202968 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] [instance: f4f629ca-bf55-4dc5-ad80-9136da020657] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 11 23:14:57.412787 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-10cf0c0e-d44c-4038-bfb1-748cdf202968 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] [instance: f4f629ca-bf55-4dc5-ad80-9136da020657] Successfully created port: ed253e02-f0d4-4a82-a7bc-4d4558e9d645 {{(pid=98431) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 11 23:14:57.518755 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98431) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 11 23:14:57.736654 np0000002687 nova-compute[98431]: INFO nova.compute.manager [-] [instance: cab1cc43-b433-4772-9f01-0197502c8b57] Took 1.41 seconds to deallocate network for instance. Jun 11 23:14:57.807070 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-10cf0c0e-d44c-4038-bfb1-748cdf202968 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] [instance: f4f629ca-bf55-4dc5-ad80-9136da020657] Start building block device mappings for instance. {{(pid=98431) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 11 23:14:57.847667 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-dd793eaf-0aeb-4da3-9878-1b24caba2f14 req-7f499a47-f2ac-44a7-a9f6-53e39ff8fe66 service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Received event network-vif-deleted-e3269961-a3f1-42c8-a49e-37f728b2f3d8 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:14:57.847824 np0000002687 nova-compute[98431]: INFO nova.compute.manager [req-dd793eaf-0aeb-4da3-9878-1b24caba2f14 req-7f499a47-f2ac-44a7-a9f6-53e39ff8fe66 service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Neutron deleted interface e3269961-a3f1-42c8-a49e-37f728b2f3d8; detaching it from the instance and deleting it from the info cache Jun 11 23:14:57.853075 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-dd793eaf-0aeb-4da3-9878-1b24caba2f14 req-7f499a47-f2ac-44a7-a9f6-53e39ff8fe66 service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Detach interface failed, port_id=e3269961-a3f1-42c8-a49e-37f728b2f3d8, reason: Instance 1d45c7ce-5760-4f59-9921-feb3e589da8a could not be found. {{(pid=98431) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}} Jun 11 23:14:58.056889 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:14:58.077982 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-10cf0c0e-d44c-4038-bfb1-748cdf202968 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] [instance: f4f629ca-bf55-4dc5-ad80-9136da020657] Successfully updated port: ed253e02-f0d4-4a82-a7bc-4d4558e9d645 {{(pid=98431) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 11 23:14:58.301543 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-ff08afe8-5e30-44c7-ad79-117974b8632a tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] [instance: cab1cc43-b433-4772-9f01-0197502c8b57] Took 0.56 seconds to detach 1 volumes for instance. Jun 11 23:14:58.303487 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-ff08afe8-5e30-44c7-ad79-117974b8632a tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] [instance: cab1cc43-b433-4772-9f01-0197502c8b57] Deleting volume: f7e59f73-fc24-4ce4-8dd2-08f2f6948647 {{(pid=98431) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}} Jun 11 23:14:58.341196 np0000002687 nova-compute[98431]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0007284299999810173 future=) submitted to {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:14:58.341309 np0000002687 nova-compute[98431]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:14:58.342501 np0000002687 nova-compute[98431]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=4.509611478000124 future=) {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:14:58.342501 np0000002687 nova-compute[98431]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=4.509518027000013 future=) {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:14:58.345108 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] Emitting event Stopped> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:14:58.345255 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] [instance: 14cc8d05-e33d-434f-b2b3-0dad3b613e73] VM Stopped (Lifecycle Event) Jun 11 23:14:58.372948 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-ed168774-86ef-437c-8f8e-01c7a79fbb9a tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Acquiring lock "interface-ae596459-1e34-4a2a-9a33-69a02f50fd1c-None" by "nova.compute.manager.ComputeManager.attach_interface..do_attach_interface" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:14:58.373091 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-ed168774-86ef-437c-8f8e-01c7a79fbb9a tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Lock "interface-ae596459-1e34-4a2a-9a33-69a02f50fd1c-None" acquired by "nova.compute.manager.ComputeManager.attach_interface..do_attach_interface" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:14:58.373366 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-ed168774-86ef-437c-8f8e-01c7a79fbb9a tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Lazy-loading 'flavor' on Instance uuid ae596459-1e34-4a2a-9a33-69a02f50fd1c {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:14:58.470393 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-6339b6ac-5e68-4f49-be72-6191485770b0 req-6275dd35-dc4f-41a5-b05a-04e967d7150e service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Received event network-vif-deleted-004fd6c0-58df-4ceb-9733-267396cae60c {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:14:58.470562 np0000002687 nova-compute[98431]: INFO nova.compute.manager [req-6339b6ac-5e68-4f49-be72-6191485770b0 req-6275dd35-dc4f-41a5-b05a-04e967d7150e service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Neutron deleted interface 004fd6c0-58df-4ceb-9733-267396cae60c; detaching it from the instance and deleting it from the info cache Jun 11 23:14:58.471721 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-6339b6ac-5e68-4f49-be72-6191485770b0 req-6275dd35-dc4f-41a5-b05a-04e967d7150e service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Detach interface failed, port_id=004fd6c0-58df-4ceb-9733-267396cae60c, reason: Instance 1d45c7ce-5760-4f59-9921-feb3e589da8a could not be found. {{(pid=98431) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}} Jun 11 23:14:58.581512 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-10cf0c0e-d44c-4038-bfb1-748cdf202968 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Acquiring lock "refresh_cache-f4f629ca-bf55-4dc5-ad80-9136da020657" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 11 23:14:58.581636 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-10cf0c0e-d44c-4038-bfb1-748cdf202968 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Acquired lock "refresh_cache-f4f629ca-bf55-4dc5-ad80-9136da020657" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 11 23:14:58.581825 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-10cf0c0e-d44c-4038-bfb1-748cdf202968 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] [instance: f4f629ca-bf55-4dc5-ad80-9136da020657] Building network info cache for instance {{(pid=98431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 11 23:14:58.814009 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-10cf0c0e-d44c-4038-bfb1-748cdf202968 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] [instance: f4f629ca-bf55-4dc5-ad80-9136da020657] Start spawning the instance on the hypervisor. {{(pid=98431) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 11 23:14:58.815026 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-10cf0c0e-d44c-4038-bfb1-748cdf202968 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] [instance: f4f629ca-bf55-4dc5-ad80-9136da020657] Creating instance directory {{(pid=98431) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}} Jun 11 23:14:58.815256 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-10cf0c0e-d44c-4038-bfb1-748cdf202968 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] [instance: f4f629ca-bf55-4dc5-ad80-9136da020657] Creating image(s) Jun 11 23:14:58.815656 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-10cf0c0e-d44c-4038-bfb1-748cdf202968 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Acquiring lock "/opt/stack/data/nova/instances/f4f629ca-bf55-4dc5-ad80-9136da020657/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:14:58.815790 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-10cf0c0e-d44c-4038-bfb1-748cdf202968 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Lock "/opt/stack/data/nova/instances/f4f629ca-bf55-4dc5-ad80-9136da020657/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:14:58.816246 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-10cf0c0e-d44c-4038-bfb1-748cdf202968 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Lock "/opt/stack/data/nova/instances/f4f629ca-bf55-4dc5-ad80-9136da020657/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:14:58.816687 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-10cf0c0e-d44c-4038-bfb1-748cdf202968 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:14:58.819315 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-10cf0c0e-d44c-4038-bfb1-748cdf202968 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:14:58.820583 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-10cf0c0e-d44c-4038-bfb1-748cdf202968 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:14:58.852963 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-ff08afe8-5e30-44c7-ad79-117974b8632a tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:14:58.854551 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-ff08afe8-5e30-44c7-ad79-117974b8632a tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:14:58.856052 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] [instance: 14cc8d05-e33d-434f-b2b3-0dad3b613e73] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:14:58.877659 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-ed168774-86ef-437c-8f8e-01c7a79fbb9a tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:14:58.913852 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-10cf0c0e-d44c-4038-bfb1-748cdf202968 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json" returned: 0 in 0.093s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:14:58.914232 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-10cf0c0e-d44c-4038-bfb1-748cdf202968 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Acquiring lock "d2c441059b2992961b5de03c05b32d04aff77cb1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:14:58.914772 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-10cf0c0e-d44c-4038-bfb1-748cdf202968 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Lock "d2c441059b2992961b5de03c05b32d04aff77cb1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:14:58.915196 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-10cf0c0e-d44c-4038-bfb1-748cdf202968 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:14:58.918669 np0000002687 nova-compute[98431]: DEBUG oslo_utils.imageutils.format_inspector [None req-10cf0c0e-d44c-4038-bfb1-748cdf202968 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98431) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 11 23:14:58.919105 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-10cf0c0e-d44c-4038-bfb1-748cdf202968 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:14:59.006268 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-10cf0c0e-d44c-4038-bfb1-748cdf202968 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json" returned: 0 in 0.087s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:14:59.007000 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-10cf0c0e-d44c-4038-bfb1-748cdf202968 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1,backing_fmt=raw /opt/stack/data/nova/instances/f4f629ca-bf55-4dc5-ad80-9136da020657/disk 1073741824 {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:14:59.055697 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-10cf0c0e-d44c-4038-bfb1-748cdf202968 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1,backing_fmt=raw /opt/stack/data/nova/instances/f4f629ca-bf55-4dc5-ad80-9136da020657/disk 1073741824" returned: 0 in 0.049s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:14:59.056128 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-10cf0c0e-d44c-4038-bfb1-748cdf202968 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Lock "d2c441059b2992961b5de03c05b32d04aff77cb1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.141s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:14:59.056440 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-10cf0c0e-d44c-4038-bfb1-748cdf202968 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:14:59.085642 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-ed168774-86ef-437c-8f8e-01c7a79fbb9a tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Lazy-loading 'pci_requests' on Instance uuid ae596459-1e34-4a2a-9a33-69a02f50fd1c {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:14:59.156495 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-10cf0c0e-d44c-4038-bfb1-748cdf202968 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c441059b2992961b5de03c05b32d04aff77cb1 --force-share --output=json" returned: 0 in 0.100s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:14:59.156971 np0000002687 nova-compute[98431]: DEBUG nova.virt.disk.api [None req-10cf0c0e-d44c-4038-bfb1-748cdf202968 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f4f629ca-bf55-4dc5-ad80-9136da020657/disk. size=1073741824 {{(pid=98431) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 11 23:14:59.157337 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-10cf0c0e-d44c-4038-bfb1-748cdf202968 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f629ca-bf55-4dc5-ad80-9136da020657/disk --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:14:59.184556 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-10cf0c0e-d44c-4038-bfb1-748cdf202968 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] [instance: f4f629ca-bf55-4dc5-ad80-9136da020657] Instance cache missing network info. {{(pid=98431) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 11 23:14:59.230986 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-acfe6e5c-fdad-4b02-bbe6-85b6c0310ebb req-ed6093f2-7b64-453e-b70c-1cf7824f2f27 service nova] [instance: f4f629ca-bf55-4dc5-ad80-9136da020657] Received event network-changed-ed253e02-f0d4-4a82-a7bc-4d4558e9d645 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:14:59.231731 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-acfe6e5c-fdad-4b02-bbe6-85b6c0310ebb req-ed6093f2-7b64-453e-b70c-1cf7824f2f27 service nova] [instance: f4f629ca-bf55-4dc5-ad80-9136da020657] Refreshing instance network info cache due to event network-changed-ed253e02-f0d4-4a82-a7bc-4d4558e9d645. {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 11 23:14:59.231961 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-acfe6e5c-fdad-4b02-bbe6-85b6c0310ebb req-ed6093f2-7b64-453e-b70c-1cf7824f2f27 service nova] Acquiring lock "refresh_cache-f4f629ca-bf55-4dc5-ad80-9136da020657" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 11 23:14:59.260056 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-10cf0c0e-d44c-4038-bfb1-748cdf202968 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f629ca-bf55-4dc5-ad80-9136da020657/disk --force-share --output=json" returned: 0 in 0.103s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:14:59.260577 np0000002687 nova-compute[98431]: DEBUG nova.virt.disk.api [None req-10cf0c0e-d44c-4038-bfb1-748cdf202968 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Cannot resize image /opt/stack/data/nova/instances/f4f629ca-bf55-4dc5-ad80-9136da020657/disk to a smaller size. {{(pid=98431) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 11 23:14:59.261623 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-10cf0c0e-d44c-4038-bfb1-748cdf202968 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] [instance: f4f629ca-bf55-4dc5-ad80-9136da020657] Created local disks {{(pid=98431) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}} Jun 11 23:14:59.261844 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-10cf0c0e-d44c-4038-bfb1-748cdf202968 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] [instance: f4f629ca-bf55-4dc5-ad80-9136da020657] Ensure instance console log exists: /opt/stack/data/nova/instances/f4f629ca-bf55-4dc5-ad80-9136da020657/console.log {{(pid=98431) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}} Jun 11 23:14:59.269271 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-10cf0c0e-d44c-4038-bfb1-748cdf202968 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:14:59.269732 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-10cf0c0e-d44c-4038-bfb1-748cdf202968 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:14:59.270100 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-10cf0c0e-d44c-4038-bfb1-748cdf202968 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:14:59.399932 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-10cf0c0e-d44c-4038-bfb1-748cdf202968 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:14:59.415183 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [-] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Updating instance_info_cache with network_info: [] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:14:59.569527 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-10cf0c0e-d44c-4038-bfb1-748cdf202968 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] [instance: f4f629ca-bf55-4dc5-ad80-9136da020657] Updating instance_info_cache with network_info: [{"id": "ed253e02-f0d4-4a82-a7bc-4d4558e9d645", "address": "fa:16:3e:f4:bb:9a", "network": {"id": "64de9d21-9a16-433f-b6db-fd642b6ec307", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1640869818-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1922540076a94ee5ba369d79869aaa95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "taped253e02-f0", "ovs_interfaceid": "ed253e02-f0d4-4a82-a7bc-4d4558e9d645", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:14:59.592470 np0000002687 nova-compute[98431]: DEBUG nova.objects.base [None req-ed168774-86ef-437c-8f8e-01c7a79fbb9a tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Object Instance lazy-loaded attributes: flavor,pci_requests {{(pid=98431) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 11 23:14:59.593297 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-ed168774-86ef-437c-8f8e-01c7a79fbb9a tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] [instance: ae596459-1e34-4a2a-9a33-69a02f50fd1c] allocate_for_instance() {{(pid=98431) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 11 23:14:59.593297 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-ed168774-86ef-437c-8f8e-01c7a79fbb9a tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:14:59.593589 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-ed168774-86ef-437c-8f8e-01c7a79fbb9a tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:14:59.685609 np0000002687 nova-compute[98431]: DEBUG nova.policy [None req-ed168774-86ef-437c-8f8e-01c7a79fbb9a tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '56116a7118a54aa6b259414512446b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03be033a975c41efba46c4d480df190f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98431) authorize /opt/stack/nova/nova/policy.py:192}} Jun 11 23:14:59.754296 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-ff08afe8-5e30-44c7-ad79-117974b8632a tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98431) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 11 23:14:59.754510 np0000002687 nova-compute[98431]: DEBUG nova.compute.provider_tree [None req-ff08afe8-5e30-44c7-ad79-117974b8632a tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] Inventory has not changed in ProviderTree for provider: e3e65fe2-9de9-4821-8b4a-ccae37c66e25 {{(pid=98431) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 11 23:14:59.918486 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-5119ee07-758d-4cf3-a093-e942925940da req-d024728e-9d0b-4143-bdba-0b5505be1e98 service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Received event network-vif-deleted-5f9094e3-a3c6-48ea-bfbe-4fa25d19bcf2 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:14:59.919870 np0000002687 nova-compute[98431]: INFO nova.compute.manager [-] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Took 3.97 seconds to deallocate network for instance. Jun 11 23:15:00.071409 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-10cf0c0e-d44c-4038-bfb1-748cdf202968 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Releasing lock "refresh_cache-f4f629ca-bf55-4dc5-ad80-9136da020657" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 11 23:15:00.071690 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-10cf0c0e-d44c-4038-bfb1-748cdf202968 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] [instance: f4f629ca-bf55-4dc5-ad80-9136da020657] Instance network_info: |[{"id": "ed253e02-f0d4-4a82-a7bc-4d4558e9d645", "address": "fa:16:3e:f4:bb:9a", "network": {"id": "64de9d21-9a16-433f-b6db-fd642b6ec307", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1640869818-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1922540076a94ee5ba369d79869aaa95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "taped253e02-f0", "ovs_interfaceid": "ed253e02-f0d4-4a82-a7bc-4d4558e9d645", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98431) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 11 23:15:00.072124 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-acfe6e5c-fdad-4b02-bbe6-85b6c0310ebb req-ed6093f2-7b64-453e-b70c-1cf7824f2f27 service nova] Acquired lock "refresh_cache-f4f629ca-bf55-4dc5-ad80-9136da020657" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 11 23:15:00.072309 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-acfe6e5c-fdad-4b02-bbe6-85b6c0310ebb req-ed6093f2-7b64-453e-b70c-1cf7824f2f27 service nova] [instance: f4f629ca-bf55-4dc5-ad80-9136da020657] Refreshing network info cache for port ed253e02-f0d4-4a82-a7bc-4d4558e9d645 {{(pid=98431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 11 23:15:00.075293 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-10cf0c0e-d44c-4038-bfb1-748cdf202968 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] [instance: f4f629ca-bf55-4dc5-ad80-9136da020657] Start _get_guest_xml network_info=[{"id": "ed253e02-f0d4-4a82-a7bc-4d4558e9d645", "address": "fa:16:3e:f4:bb:9a", "network": {"id": "64de9d21-9a16-433f-b6db-fd642b6ec307", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1640869818-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1922540076a94ee5ba369d79869aaa95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "taped253e02-f0", "ovs_interfaceid": "ed253e02-f0d4-4a82-a7bc-4d4558e9d645", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-11T23:08:20Z,direct_url=,disk_format='qcow2',id=f30640f8-7aca-4300-a085-4706a5209a79,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ce012f9fabdb4ee5a73e212437f59d97',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-11T23:08:23Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'image_id': 'f30640f8-7aca-4300-a085-4706a5209a79'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98431) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 11 23:15:00.078691 np0000002687 nova-compute[98431]: WARNING nova.virt.libvirt.driver [None req-10cf0c0e-d44c-4038-bfb1-748cdf202968 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 11 23:15:00.079912 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-10cf0c0e-d44c-4038-bfb1-748cdf202968 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='f30640f8-7aca-4300-a085-4706a5209a79', instance_meta=NovaInstanceMeta(name='tempest-VolumesActionsTest-instance-1957852829', uuid='f4f629ca-bf55-4dc5-ad80-9136da020657'), owner=OwnerMeta(userid='5b929fda768d45738790181d6b49a3be', username='tempest-VolumesActionsTest-1703782237-project-member', projectid='1922540076a94ee5ba369d79869aaa95', projectname='tempest-VolumesActionsTest-1703782237'), image=ImageMeta(id='f30640f8-7aca-4300-a085-4706a5209a79', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "ed253e02-f0d4-4a82-a7bc-4d4558e9d645", "address": "fa:16:3e:f4:bb:9a", "network": {"id": "64de9d21-9a16-433f-b6db-fd642b6ec307", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1640869818-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1922540076a94ee5ba369d79869aaa95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "taped253e02-f0", "ovs_interfaceid": "ed253e02-f0d4-4a82-a7bc-4d4558e9d645", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1781219700.0795267) {{(pid=98431) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 11 23:15:00.080944 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-10cf0c0e-d44c-4038-bfb1-748cdf202968 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Searching host: 'np0000002687' for CPU controller through CGroups V1... {{(pid=98431) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 11 23:15:00.081387 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-10cf0c0e-d44c-4038-bfb1-748cdf202968 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] CPU controller missing on host. {{(pid=98431) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 11 23:15:00.082289 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-10cf0c0e-d44c-4038-bfb1-748cdf202968 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Searching host: 'np0000002687' for CPU controller through CGroups V2... {{(pid=98431) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 11 23:15:00.082700 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.host [None req-10cf0c0e-d44c-4038-bfb1-748cdf202968 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] CPU controller found on host. {{(pid=98431) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 11 23:15:00.083712 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-10cf0c0e-d44c-4038-bfb1-748cdf202968 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98431) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 11 23:15:00.084231 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-10cf0c0e-d44c-4038-bfb1-748cdf202968 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-11T23:08:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-11T23:08:20Z,direct_url=,disk_format='qcow2',id=f30640f8-7aca-4300-a085-4706a5209a79,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ce012f9fabdb4ee5a73e212437f59d97',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-11T23:08:23Z,virtual_size=,visibility=), allow threads: True {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 11 23:15:00.084381 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-10cf0c0e-d44c-4038-bfb1-748cdf202968 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Flavor limits 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 11 23:15:00.084513 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-10cf0c0e-d44c-4038-bfb1-748cdf202968 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Image limits 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 11 23:15:00.084631 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-10cf0c0e-d44c-4038-bfb1-748cdf202968 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Flavor pref 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 11 23:15:00.084720 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-10cf0c0e-d44c-4038-bfb1-748cdf202968 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Image pref 0:0:0 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 11 23:15:00.084820 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-10cf0c0e-d44c-4038-bfb1-748cdf202968 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 11 23:15:00.085010 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-10cf0c0e-d44c-4038-bfb1-748cdf202968 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 11 23:15:00.085133 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-10cf0c0e-d44c-4038-bfb1-748cdf202968 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98431) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 11 23:15:00.085309 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-10cf0c0e-d44c-4038-bfb1-748cdf202968 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Got 1 possible topologies {{(pid=98431) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 11 23:15:00.085446 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-10cf0c0e-d44c-4038-bfb1-748cdf202968 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 11 23:15:00.085601 np0000002687 nova-compute[98431]: DEBUG nova.virt.hardware [None req-10cf0c0e-d44c-4038-bfb1-748cdf202968 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98431) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 11 23:15:00.097577 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-10cf0c0e-d44c-4038-bfb1-748cdf202968 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-11T23:14:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1957852829',display_name='tempest-VolumesActionsTest-instance-1957852829',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='tempest-volumesactionstest-instance-1957852829',id=27,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1922540076a94ee5ba369d79869aaa95',ramdisk_id='',reservation_id='r-tvgzfab6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1703782237',owner_user_name='tempest-VolumesActionsTest-1703782237-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-11T23:14:58Z,user_data=None,user_id='5b929fda768d45738790181d6b49a3be',uuid=f4f629ca-bf55-4dc5-ad80-9136da020657,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed253e02-f0d4-4a82-a7bc-4d4558e9d645", "address": "fa:16:3e:f4:bb:9a", "network": {"id": "64de9d21-9a16-433f-b6db-fd642b6ec307", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1640869818-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1922540076a94ee5ba369d79869aaa95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "taped253e02-f0", "ovs_interfaceid": "ed253e02-f0d4-4a82-a7bc-4d4558e9d645", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98431) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 11 23:15:00.098530 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-10cf0c0e-d44c-4038-bfb1-748cdf202968 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Converting VIF {"id": "ed253e02-f0d4-4a82-a7bc-4d4558e9d645", "address": "fa:16:3e:f4:bb:9a", "network": {"id": "64de9d21-9a16-433f-b6db-fd642b6ec307", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1640869818-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1922540076a94ee5ba369d79869aaa95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "taped253e02-f0", "ovs_interfaceid": "ed253e02-f0d4-4a82-a7bc-4d4558e9d645", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:15:00.099266 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-10cf0c0e-d44c-4038-bfb1-748cdf202968 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:bb:9a,bridge_name='br-int',has_traffic_filtering=True,id=ed253e02-f0d4-4a82-a7bc-4d4558e9d645,network=Network(64de9d21-9a16-433f-b6db-fd642b6ec307),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped253e02-f0') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:15:00.100040 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-10cf0c0e-d44c-4038-bfb1-748cdf202968 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Lazy-loading 'pci_devices' on Instance uuid f4f629ca-bf55-4dc5-ad80-9136da020657 {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:15:00.103258 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-ed168774-86ef-437c-8f8e-01c7a79fbb9a tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] [instance: ae596459-1e34-4a2a-9a33-69a02f50fd1c] Successfully created port: 3bee781d-e603-4cbb-9d42-63fb3e55dcd6 {{(pid=98431) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 11 23:15:00.223365 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:15:00.257417 np0000002687 nova-compute[98431]: DEBUG nova.scheduler.client.report [None req-ff08afe8-5e30-44c7-ad79-117974b8632a tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] Inventory has not changed for provider e3e65fe2-9de9-4821-8b4a-ccae37c66e25 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98431) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 11 23:15:00.538066 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-6daec667-12b5-48a3-ab06-3d4645253264 req-8fa8bdb7-4ca9-4495-b625-ded0c16a963e service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Received event network-vif-deleted-351eaad5-bf70-43b4-8f79-5bc0027de663 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:15:00.576553 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [req-acfe6e5c-fdad-4b02-bbe6-85b6c0310ebb req-ed6093f2-7b64-453e-b70c-1cf7824f2f27 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:15:00.607783 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-10cf0c0e-d44c-4038-bfb1-748cdf202968 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] [instance: f4f629ca-bf55-4dc5-ad80-9136da020657] End _get_guest_xml xml= Jun 11 23:15:00.607783 np0000002687 nova-compute[98431]: f4f629ca-bf55-4dc5-ad80-9136da020657 Jun 11 23:15:00.607783 np0000002687 nova-compute[98431]: instance-0000001b Jun 11 23:15:00.607783 np0000002687 nova-compute[98431]: 196608 Jun 11 23:15:00.607783 np0000002687 nova-compute[98431]: 1 Jun 11 23:15:00.607783 np0000002687 nova-compute[98431]: Jun 11 23:15:00.607783 np0000002687 nova-compute[98431]: Jun 11 23:15:00.607783 np0000002687 nova-compute[98431]: Jun 11 23:15:00.607783 np0000002687 nova-compute[98431]: tempest-VolumesActionsTest-instance-1957852829 Jun 11 23:15:00.607783 np0000002687 nova-compute[98431]: 2026-06-11 23:15:00 Jun 11 23:15:00.607783 np0000002687 nova-compute[98431]: Jun 11 23:15:00.607783 np0000002687 nova-compute[98431]: 192 Jun 11 23:15:00.607783 np0000002687 nova-compute[98431]: 1 Jun 11 23:15:00.607783 np0000002687 nova-compute[98431]: 0 Jun 11 23:15:00.607783 np0000002687 nova-compute[98431]: 0 Jun 11 23:15:00.607783 np0000002687 nova-compute[98431]: 1 Jun 11 23:15:00.607783 np0000002687 nova-compute[98431]: Jun 11 23:15:00.607783 np0000002687 nova-compute[98431]: True Jun 11 23:15:00.607783 np0000002687 nova-compute[98431]: Jun 11 23:15:00.607783 np0000002687 nova-compute[98431]: Jun 11 23:15:00.607783 np0000002687 nova-compute[98431]: Jun 11 23:15:00.607783 np0000002687 nova-compute[98431]: bare Jun 11 23:15:00.607783 np0000002687 nova-compute[98431]: qcow2 Jun 11 23:15:00.607783 np0000002687 nova-compute[98431]: 1 Jun 11 23:15:00.607783 np0000002687 nova-compute[98431]: 0 Jun 11 23:15:00.607783 np0000002687 nova-compute[98431]: Jun 11 23:15:00.607783 np0000002687 nova-compute[98431]: virtio Jun 11 23:15:00.607783 np0000002687 nova-compute[98431]: Jun 11 23:15:00.607783 np0000002687 nova-compute[98431]: Jun 11 23:15:00.607783 np0000002687 nova-compute[98431]: Jun 11 23:15:00.607783 np0000002687 nova-compute[98431]: tempest-VolumesActionsTest-1703782237-project-member Jun 11 23:15:00.607783 np0000002687 nova-compute[98431]: tempest-VolumesActionsTest-1703782237 Jun 11 23:15:00.607783 np0000002687 nova-compute[98431]: Jun 11 23:15:00.607783 np0000002687 nova-compute[98431]: Jun 11 23:15:00.607783 np0000002687 nova-compute[98431]: Jun 11 23:15:00.607783 np0000002687 nova-compute[98431]: Jun 11 23:15:00.607783 np0000002687 nova-compute[98431]: Jun 11 23:15:00.607783 np0000002687 nova-compute[98431]: Jun 11 23:15:00.607783 np0000002687 nova-compute[98431]: Jun 11 23:15:00.607783 np0000002687 nova-compute[98431]: Jun 11 23:15:00.607783 np0000002687 nova-compute[98431]: Jun 11 23:15:00.607783 np0000002687 nova-compute[98431]: Jun 11 23:15:00.607783 np0000002687 nova-compute[98431]: Jun 11 23:15:00.607783 np0000002687 nova-compute[98431]: OpenStack Foundation Jun 11 23:15:00.607783 np0000002687 nova-compute[98431]: OpenStack Nova Jun 11 23:15:00.607783 np0000002687 nova-compute[98431]: 33.1.0 Jun 11 23:15:00.607783 np0000002687 nova-compute[98431]: f4f629ca-bf55-4dc5-ad80-9136da020657 Jun 11 23:15:00.607783 np0000002687 nova-compute[98431]: f4f629ca-bf55-4dc5-ad80-9136da020657 Jun 11 23:15:00.607783 np0000002687 nova-compute[98431]: Virtual Machine Jun 11 23:15:00.607783 np0000002687 nova-compute[98431]: Jun 11 23:15:00.607783 np0000002687 nova-compute[98431]: Jun 11 23:15:00.607783 np0000002687 nova-compute[98431]: Jun 11 23:15:00.607783 np0000002687 nova-compute[98431]: hvm Jun 11 23:15:00.607783 np0000002687 nova-compute[98431]: Jun 11 23:15:00.607783 np0000002687 nova-compute[98431]: Jun 11 23:15:00.607783 np0000002687 nova-compute[98431]: Jun 11 23:15:00.607783 np0000002687 nova-compute[98431]: Jun 11 23:15:00.607783 np0000002687 nova-compute[98431]: Jun 11 23:15:00.607783 np0000002687 nova-compute[98431]: Jun 11 23:15:00.607783 np0000002687 nova-compute[98431]: 128 Jun 11 23:15:00.607783 np0000002687 nova-compute[98431]: Jun 11 23:15:00.607783 np0000002687 nova-compute[98431]: Jun 11 23:15:00.607783 np0000002687 nova-compute[98431]: Jun 11 23:15:00.607783 np0000002687 nova-compute[98431]: 1 Jun 11 23:15:00.607783 np0000002687 nova-compute[98431]: Jun 11 23:15:00.607783 np0000002687 nova-compute[98431]: Jun 11 23:15:00.607783 np0000002687 nova-compute[98431]: Nehalem Jun 11 23:15:00.607783 np0000002687 nova-compute[98431]: Jun 11 23:15:00.607783 np0000002687 nova-compute[98431]: Jun 11 23:15:00.607783 np0000002687 nova-compute[98431]: Jun 11 23:15:00.607783 np0000002687 nova-compute[98431]: Jun 11 23:15:00.607783 np0000002687 nova-compute[98431]: Jun 11 23:15:00.607783 np0000002687 nova-compute[98431]: Jun 11 23:15:00.607783 np0000002687 nova-compute[98431]: Jun 11 23:15:00.607783 np0000002687 nova-compute[98431]: Jun 11 23:15:00.607783 np0000002687 nova-compute[98431]: Jun 11 23:15:00.607783 np0000002687 nova-compute[98431]: Jun 11 23:15:00.607783 np0000002687 nova-compute[98431]: Jun 11 23:15:00.607783 np0000002687 nova-compute[98431]: Jun 11 23:15:00.607783 np0000002687 nova-compute[98431]: Jun 11 23:15:00.607783 np0000002687 nova-compute[98431]: Jun 11 23:15:00.607783 np0000002687 nova-compute[98431]: Jun 11 23:15:00.607783 np0000002687 nova-compute[98431]: Jun 11 23:15:00.607783 np0000002687 nova-compute[98431]: Jun 11 23:15:00.607783 np0000002687 nova-compute[98431]: Jun 11 23:15:00.607783 np0000002687 nova-compute[98431]: Jun 11 23:15:00.607783 np0000002687 nova-compute[98431]: Jun 11 23:15:00.607783 np0000002687 nova-compute[98431]: Jun 11 23:15:00.607783 np0000002687 nova-compute[98431]: Jun 11 23:15:00.607783 np0000002687 nova-compute[98431]: Jun 11 23:15:00.607783 np0000002687 nova-compute[98431]: Jun 11 23:15:00.607783 np0000002687 nova-compute[98431]: Jun 11 23:15:00.607783 np0000002687 nova-compute[98431]: Jun 11 23:15:00.607783 np0000002687 nova-compute[98431]: /dev/urandom Jun 11 23:15:00.607783 np0000002687 nova-compute[98431]: Jun 11 23:15:00.607783 np0000002687 nova-compute[98431]: Jun 11 23:15:00.607783 np0000002687 nova-compute[98431]: Jun 11 23:15:00.607783 np0000002687 nova-compute[98431]: Jun 11 23:15:00.607783 np0000002687 nova-compute[98431]: Jun 11 23:15:00.607783 np0000002687 nova-compute[98431]: Jun 11 23:15:00.607783 np0000002687 nova-compute[98431]: Jun 11 23:15:00.607783 np0000002687 nova-compute[98431]: {{(pid=98431) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 11 23:15:00.613568 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-ed168774-86ef-437c-8f8e-01c7a79fbb9a tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] [instance: ae596459-1e34-4a2a-9a33-69a02f50fd1c] Successfully updated port: 3bee781d-e603-4cbb-9d42-63fb3e55dcd6 {{(pid=98431) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 11 23:15:00.614741 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-10cf0c0e-d44c-4038-bfb1-748cdf202968 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] [instance: f4f629ca-bf55-4dc5-ad80-9136da020657] Preparing to wait for external event network-vif-plugged-ed253e02-f0d4-4a82-a7bc-4d4558e9d645 {{(pid=98431) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 11 23:15:00.615118 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-10cf0c0e-d44c-4038-bfb1-748cdf202968 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Acquiring lock "f4f629ca-bf55-4dc5-ad80-9136da020657-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:15:00.615371 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-10cf0c0e-d44c-4038-bfb1-748cdf202968 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Lock "f4f629ca-bf55-4dc5-ad80-9136da020657-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:15:00.615546 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-10cf0c0e-d44c-4038-bfb1-748cdf202968 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Lock "f4f629ca-bf55-4dc5-ad80-9136da020657-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:15:00.616268 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-10cf0c0e-d44c-4038-bfb1-748cdf202968 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-11T23:14:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1957852829',display_name='tempest-VolumesActionsTest-instance-1957852829',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='tempest-volumesactionstest-instance-1957852829',id=27,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1922540076a94ee5ba369d79869aaa95',ramdisk_id='',reservation_id='r-tvgzfab6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1703782237',owner_user_name='tempest-VolumesActionsTest-1703782237-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-11T23:14:58Z,user_data=None,user_id='5b929fda768d45738790181d6b49a3be',uuid=f4f629ca-bf55-4dc5-ad80-9136da020657,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed253e02-f0d4-4a82-a7bc-4d4558e9d645", "address": "fa:16:3e:f4:bb:9a", "network": {"id": "64de9d21-9a16-433f-b6db-fd642b6ec307", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1640869818-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1922540076a94ee5ba369d79869aaa95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "taped253e02-f0", "ovs_interfaceid": "ed253e02-f0d4-4a82-a7bc-4d4558e9d645", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 11 23:15:00.616453 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-10cf0c0e-d44c-4038-bfb1-748cdf202968 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Converting VIF {"id": "ed253e02-f0d4-4a82-a7bc-4d4558e9d645", "address": "fa:16:3e:f4:bb:9a", "network": {"id": "64de9d21-9a16-433f-b6db-fd642b6ec307", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1640869818-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1922540076a94ee5ba369d79869aaa95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "taped253e02-f0", "ovs_interfaceid": "ed253e02-f0d4-4a82-a7bc-4d4558e9d645", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:15:00.616987 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-10cf0c0e-d44c-4038-bfb1-748cdf202968 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:bb:9a,bridge_name='br-int',has_traffic_filtering=True,id=ed253e02-f0d4-4a82-a7bc-4d4558e9d645,network=Network(64de9d21-9a16-433f-b6db-fd642b6ec307),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped253e02-f0') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:15:00.617278 np0000002687 nova-compute[98431]: DEBUG os_vif [None req-10cf0c0e-d44c-4038-bfb1-748cdf202968 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:bb:9a,bridge_name='br-int',has_traffic_filtering=True,id=ed253e02-f0d4-4a82-a7bc-4d4558e9d645,network=Network(64de9d21-9a16-433f-b6db-fd642b6ec307),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped253e02-f0') {{(pid=98431) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 11 23:15:00.617556 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:15:00.618219 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:15:00.618219 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 11 23:15:00.619163 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:15:00.619536 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b6f58f50-a082-57a1-ba20-84e886dbaaa0', '_type': 'linux-noop'}}, row=False) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:15:00.621525 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:15:00.622544 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:15:00.625109 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:15:00.625885 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=taped253e02-f0, may_exist=True, interface_attrs={}) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:15:00.625885 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=taped253e02-f0, col_values=(('qos', UUID('7997c571-89c1-4f52-bc86-36332ea6a8fc')),), if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:15:00.626048 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=taped253e02-f0, col_values=(('external_ids', {'iface-id': 'ed253e02-f0d4-4a82-a7bc-4d4558e9d645', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f4:bb:9a', 'vm-uuid': 'f4f629ca-bf55-4dc5-ad80-9136da020657'}),), if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:15:00.627064 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:15:00.628364 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:15:00.634086 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:15:00.635105 np0000002687 nova-compute[98431]: INFO os_vif [None req-10cf0c0e-d44c-4038-bfb1-748cdf202968 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:bb:9a,bridge_name='br-int',has_traffic_filtering=True,id=ed253e02-f0d4-4a82-a7bc-4d4558e9d645,network=Network(64de9d21-9a16-433f-b6db-fd642b6ec307),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped253e02-f0') Jun 11 23:15:00.763551 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-ff08afe8-5e30-44c7-ad79-117974b8632a tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.909s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:15:00.816069 np0000002687 nova-compute[98431]: INFO nova.scheduler.client.report [None req-ff08afe8-5e30-44c7-ad79-117974b8632a tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] Deleted allocations for instance cab1cc43-b433-4772-9f01-0197502c8b57 Jun 11 23:15:00.886602 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [req-acfe6e5c-fdad-4b02-bbe6-85b6c0310ebb req-ed6093f2-7b64-453e-b70c-1cf7824f2f27 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:15:01.042524 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-acfe6e5c-fdad-4b02-bbe6-85b6c0310ebb req-ed6093f2-7b64-453e-b70c-1cf7824f2f27 service nova] [instance: f4f629ca-bf55-4dc5-ad80-9136da020657] Updated VIF entry in instance network info cache for port ed253e02-f0d4-4a82-a7bc-4d4558e9d645. {{(pid=98431) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 11 23:15:01.042835 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-acfe6e5c-fdad-4b02-bbe6-85b6c0310ebb req-ed6093f2-7b64-453e-b70c-1cf7824f2f27 service nova] [instance: f4f629ca-bf55-4dc5-ad80-9136da020657] Updating instance_info_cache with network_info: [{"id": "ed253e02-f0d4-4a82-a7bc-4d4558e9d645", "address": "fa:16:3e:f4:bb:9a", "network": {"id": "64de9d21-9a16-433f-b6db-fd642b6ec307", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1640869818-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1922540076a94ee5ba369d79869aaa95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "taped253e02-f0", "ovs_interfaceid": "ed253e02-f0d4-4a82-a7bc-4d4558e9d645", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:15:01.119013 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-ed168774-86ef-437c-8f8e-01c7a79fbb9a tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Acquiring lock "refresh_cache-ae596459-1e34-4a2a-9a33-69a02f50fd1c" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 11 23:15:01.119013 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-ed168774-86ef-437c-8f8e-01c7a79fbb9a tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Acquired lock "refresh_cache-ae596459-1e34-4a2a-9a33-69a02f50fd1c" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 11 23:15:01.119013 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-ed168774-86ef-437c-8f8e-01c7a79fbb9a tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] [instance: ae596459-1e34-4a2a-9a33-69a02f50fd1c] Building network info cache for instance {{(pid=98431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 11 23:15:01.544943 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-acfe6e5c-fdad-4b02-bbe6-85b6c0310ebb req-ed6093f2-7b64-453e-b70c-1cf7824f2f27 service nova] Releasing lock "refresh_cache-f4f629ca-bf55-4dc5-ad80-9136da020657" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 11 23:15:01.545089 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-acfe6e5c-fdad-4b02-bbe6-85b6c0310ebb req-ed6093f2-7b64-453e-b70c-1cf7824f2f27 service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Received event network-vif-deleted-37aa7cee-88a0-4428-9b2d-45700f1dcab6 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:15:01.545264 np0000002687 nova-compute[98431]: INFO nova.compute.manager [req-acfe6e5c-fdad-4b02-bbe6-85b6c0310ebb req-ed6093f2-7b64-453e-b70c-1cf7824f2f27 service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Neutron deleted interface 37aa7cee-88a0-4428-9b2d-45700f1dcab6; detaching it from the instance and deleting it from the info cache Jun 11 23:15:01.546531 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-acfe6e5c-fdad-4b02-bbe6-85b6c0310ebb req-ed6093f2-7b64-453e-b70c-1cf7824f2f27 service nova] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Detach interface failed, port_id=37aa7cee-88a0-4428-9b2d-45700f1dcab6, reason: Instance 1d45c7ce-5760-4f59-9921-feb3e589da8a could not be found. {{(pid=98431) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}} Jun 11 23:15:01.583347 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Took 1.66 seconds to detach 3 volumes for instance. Jun 11 23:15:01.825267 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-ff08afe8-5e30-44c7-ad79-117974b8632a tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] Lock "cab1cc43-b433-4772-9f01-0197502c8b57" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 8.002s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:15:01.884271 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-ed168774-86ef-437c-8f8e-01c7a79fbb9a tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:15:02.000016 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-9621d0e2-23d5-41ad-8b05-54c67f2d2e1c req-97c23b9d-1b8e-47b1-bf21-2bb9e2eb2d70 service nova] [instance: ae596459-1e34-4a2a-9a33-69a02f50fd1c] Received event network-changed-3bee781d-e603-4cbb-9d42-63fb3e55dcd6 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:15:02.000226 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-9621d0e2-23d5-41ad-8b05-54c67f2d2e1c req-97c23b9d-1b8e-47b1-bf21-2bb9e2eb2d70 service nova] [instance: ae596459-1e34-4a2a-9a33-69a02f50fd1c] Refreshing instance network info cache due to event network-changed-3bee781d-e603-4cbb-9d42-63fb3e55dcd6. {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 11 23:15:02.000525 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-9621d0e2-23d5-41ad-8b05-54c67f2d2e1c req-97c23b9d-1b8e-47b1-bf21-2bb9e2eb2d70 service nova] Acquiring lock "refresh_cache-ae596459-1e34-4a2a-9a33-69a02f50fd1c" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 11 23:15:02.089254 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:15:02.089450 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:15:02.157727 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-10cf0c0e-d44c-4038-bfb1-748cdf202968 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] No BDM found with device name vda, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:15:02.159671 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-10cf0c0e-d44c-4038-bfb1-748cdf202968 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] No BDM found with device name hda, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:15:02.159671 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-10cf0c0e-d44c-4038-bfb1-748cdf202968 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] No VIF found with MAC fa:16:3e:f4:bb:9a, not building metadata {{(pid=98431) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13199}} Jun 11 23:15:02.159671 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-10cf0c0e-d44c-4038-bfb1-748cdf202968 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] [instance: f4f629ca-bf55-4dc5-ad80-9136da020657] Using config drive Jun 11 23:15:02.259141 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-ed168774-86ef-437c-8f8e-01c7a79fbb9a tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:15:02.435997 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-ed168774-86ef-437c-8f8e-01c7a79fbb9a tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] [instance: ae596459-1e34-4a2a-9a33-69a02f50fd1c] Updating instance_info_cache with network_info: [{"id": "1f920031-116a-4009-be97-ea5f1389a374", "address": "fa:16:3e:6c:78:be", "network": {"id": "e7cf6fb9-33e8-4362-8236-472d2d07f60a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-749809800-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "03be033a975c41efba46c4d480df190f", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f920031-11", "ovs_interfaceid": "1f920031-116a-4009-be97-ea5f1389a374", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3bee781d-e603-4cbb-9d42-63fb3e55dcd6", "address": "fa:16:3e:ae:c2:83", "network": {"id": "18029db1-b49f-4422-8aa6-a6432a3c4135", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1440361664", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.94", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "03be033a975c41efba46c4d480df190f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bee781d-e6", "ovs_interfaceid": "3bee781d-e603-4cbb-9d42-63fb3e55dcd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:15:02.665221 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-10cf0c0e-d44c-4038-bfb1-748cdf202968 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:15:02.851653 np0000002687 nova-compute[98431]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0005501189998540212 future=) submitted to {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:15:02.852275 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] Emitting event Stopped> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:15:02.852525 np0000002687 nova-compute[98431]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:15:02.852779 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] VM Stopped (Lifecycle Event) Jun 11 23:15:02.853460 np0000002687 nova-compute[98431]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=5.415618779999932 future=) {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:15:02.853536 np0000002687 nova-compute[98431]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=5.415475174999983 future=) {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:15:02.883834 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-10cf0c0e-d44c-4038-bfb1-748cdf202968 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] [instance: f4f629ca-bf55-4dc5-ad80-9136da020657] Creating config drive at /opt/stack/data/nova/instances/f4f629ca-bf55-4dc5-ad80-9136da020657/disk.config Jun 11 23:15:02.887077 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-10cf0c0e-d44c-4038-bfb1-748cdf202968 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f4f629ca-bf55-4dc5-ad80-9136da020657/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpkz0kxcu2 {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:15:02.934317 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98431) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 11 23:15:02.934597 np0000002687 nova-compute[98431]: DEBUG nova.compute.provider_tree [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Inventory has not changed in ProviderTree for provider: e3e65fe2-9de9-4821-8b4a-ccae37c66e25 {{(pid=98431) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 11 23:15:02.939259 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-ed168774-86ef-437c-8f8e-01c7a79fbb9a tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Releasing lock "refresh_cache-ae596459-1e34-4a2a-9a33-69a02f50fd1c" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 11 23:15:02.941498 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-9621d0e2-23d5-41ad-8b05-54c67f2d2e1c req-97c23b9d-1b8e-47b1-bf21-2bb9e2eb2d70 service nova] Acquired lock "refresh_cache-ae596459-1e34-4a2a-9a33-69a02f50fd1c" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 11 23:15:02.941498 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-9621d0e2-23d5-41ad-8b05-54c67f2d2e1c req-97c23b9d-1b8e-47b1-bf21-2bb9e2eb2d70 service nova] [instance: ae596459-1e34-4a2a-9a33-69a02f50fd1c] Refreshing network info cache for port 3bee781d-e603-4cbb-9d42-63fb3e55dcd6 {{(pid=98431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 11 23:15:02.943315 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-ed168774-86ef-437c-8f8e-01c7a79fbb9a tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-11T23:14:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1094546666',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='tempest-device-tagging-server-1094546666',id=22,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBL2B+Qi+I3pgfpGsUuP1N6pjhXiP01lrt0dza1VGJ8kct4NaxOPSJEfUBZOLcAcvGFp3NUiLtr1bJ6t1i7htNBE4tCeF5rEUWrutMgZ/N9MVsridCRaWUxTp0gQnqFN3A==',key_name='tempest-keypair-1726377568',keypairs=,launch_index=0,launched_at=2026-06-11T23:14:17Z,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000002687',numa_topology=,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='03be033a975c41efba46c4d480df190f',ramdisk_id='',reservation_id='r-irju1qds',resources=,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1378608456',owner_user_name='tempest-TaggedAttachmentsTest-1378608456-project-member'},tags=,task_state=None,terminated_at=None,trusted_certs=,updated_at=2026-06-11T23:14:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='56116a7118a54aa6b259414512446b40',uuid=ae596459-1e34-4a2a-9a33-69a02f50fd1c,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3bee781d-e603-4cbb-9d42-63fb3e55dcd6", "address": "fa:16:3e:ae:c2:83", "network": {"id": "18029db1-b49f-4422-8aa6-a6432a3c4135", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1440361664", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.94", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "03be033a975c41efba46c4d480df190f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bee781d-e6", "ovs_interfaceid": "3bee781d-e603-4cbb-9d42-63fb3e55dcd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 11 23:15:02.943542 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-ed168774-86ef-437c-8f8e-01c7a79fbb9a tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Converting VIF {"id": "3bee781d-e603-4cbb-9d42-63fb3e55dcd6", "address": "fa:16:3e:ae:c2:83", "network": {"id": "18029db1-b49f-4422-8aa6-a6432a3c4135", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1440361664", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.94", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "03be033a975c41efba46c4d480df190f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bee781d-e6", "ovs_interfaceid": "3bee781d-e603-4cbb-9d42-63fb3e55dcd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:15:02.944264 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-ed168774-86ef-437c-8f8e-01c7a79fbb9a tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:c2:83,bridge_name='br-int',has_traffic_filtering=True,id=3bee781d-e603-4cbb-9d42-63fb3e55dcd6,network=Network(18029db1-b49f-4422-8aa6-a6432a3c4135),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bee781d-e6') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:15:02.944560 np0000002687 nova-compute[98431]: DEBUG os_vif [None req-ed168774-86ef-437c-8f8e-01c7a79fbb9a tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:c2:83,bridge_name='br-int',has_traffic_filtering=True,id=3bee781d-e603-4cbb-9d42-63fb3e55dcd6,network=Network(18029db1-b49f-4422-8aa6-a6432a3c4135),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bee781d-e6') {{(pid=98431) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 11 23:15:02.947206 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:15:02.951396 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:15:02.952225 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 11 23:15:02.954040 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:15:02.954313 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f41bc72a-3816-5b59-a485-d736d49d97fe', '_type': 'linux-noop'}}, row=False) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:15:02.954892 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-10cf0c0e-d44c-4038-bfb1-748cdf202968 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f4f629ca-bf55-4dc5-ad80-9136da020657/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpkz0kxcu2" returned: 0 in 0.068s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:15:02.957200 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:15:02.964539 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:15:02.967053 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:15:02.967311 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3bee781d-e6, may_exist=True, interface_attrs={}) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:15:02.969331 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3bee781d-e6, col_values=(('qos', UUID('7c0461ed-2885-4bce-86ce-d41ebcf7b056')),), if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:15:02.969331 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3bee781d-e6, col_values=(('external_ids', {'iface-id': '3bee781d-e603-4cbb-9d42-63fb3e55dcd6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ae:c2:83', 'vm-uuid': 'ae596459-1e34-4a2a-9a33-69a02f50fd1c'}),), if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:15:02.969489 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:15:02.971464 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:15:02.980953 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:15:02.982141 np0000002687 nova-compute[98431]: INFO os_vif [None req-ed168774-86ef-437c-8f8e-01c7a79fbb9a tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:c2:83,bridge_name='br-int',has_traffic_filtering=True,id=3bee781d-e603-4cbb-9d42-63fb3e55dcd6,network=Network(18029db1-b49f-4422-8aa6-a6432a3c4135),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bee781d-e6') Jun 11 23:15:02.982923 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-ed168774-86ef-437c-8f8e-01c7a79fbb9a tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-11T23:14:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1094546666',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='tempest-device-tagging-server-1094546666',id=22,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBL2B+Qi+I3pgfpGsUuP1N6pjhXiP01lrt0dza1VGJ8kct4NaxOPSJEfUBZOLcAcvGFp3NUiLtr1bJ6t1i7htNBE4tCeF5rEUWrutMgZ/N9MVsridCRaWUxTp0gQnqFN3A==',key_name='tempest-keypair-1726377568',keypairs=,launch_index=0,launched_at=2026-06-11T23:14:17Z,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000002687',numa_topology=,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='03be033a975c41efba46c4d480df190f',ramdisk_id='',reservation_id='r-irju1qds',resources=,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1378608456',owner_user_name='tempest-TaggedAttachmentsTest-1378608456-project-member'},tags=,task_state=None,terminated_at=None,trusted_certs=,updated_at=2026-06-11T23:14:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='56116a7118a54aa6b259414512446b40',uuid=ae596459-1e34-4a2a-9a33-69a02f50fd1c,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3bee781d-e603-4cbb-9d42-63fb3e55dcd6", "address": "fa:16:3e:ae:c2:83", "network": {"id": "18029db1-b49f-4422-8aa6-a6432a3c4135", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1440361664", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.94", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "03be033a975c41efba46c4d480df190f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bee781d-e6", "ovs_interfaceid": "3bee781d-e603-4cbb-9d42-63fb3e55dcd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98431) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 11 23:15:02.983075 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-ed168774-86ef-437c-8f8e-01c7a79fbb9a tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Converting VIF {"id": "3bee781d-e603-4cbb-9d42-63fb3e55dcd6", "address": "fa:16:3e:ae:c2:83", "network": {"id": "18029db1-b49f-4422-8aa6-a6432a3c4135", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1440361664", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.94", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "03be033a975c41efba46c4d480df190f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bee781d-e6", "ovs_interfaceid": "3bee781d-e603-4cbb-9d42-63fb3e55dcd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:15:02.983547 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-ed168774-86ef-437c-8f8e-01c7a79fbb9a tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:c2:83,bridge_name='br-int',has_traffic_filtering=True,id=3bee781d-e603-4cbb-9d42-63fb3e55dcd6,network=Network(18029db1-b49f-4422-8aa6-a6432a3c4135),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bee781d-e6') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:15:02.985768 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.guest [None req-ed168774-86ef-437c-8f8e-01c7a79fbb9a tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] attach device xml: Jun 11 23:15:02.985768 np0000002687 nova-compute[98431]: Jun 11 23:15:02.985768 np0000002687 nova-compute[98431]: Jun 11 23:15:02.985768 np0000002687 nova-compute[98431]: Jun 11 23:15:02.985768 np0000002687 nova-compute[98431]: Jun 11 23:15:02.985768 np0000002687 nova-compute[98431]: Jun 11 23:15:02.985768 np0000002687 nova-compute[98431]: Jun 11 23:15:02.985768 np0000002687 nova-compute[98431]: {{(pid=98431) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} Jun 11 23:15:03.006267 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:15:03.084261 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:15:03.088466 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:15:03.088466 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:15:03.216549 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:15:03.355665 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:15:03.359623 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=98431) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 11 23:15:03.407673 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:15:03.416548 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:15:03.423859 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:15:03.442169 np0000002687 nova-compute[98431]: DEBUG nova.scheduler.client.report [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Inventory has not changed for provider e3e65fe2-9de9-4821-8b4a-ccae37c66e25 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98431) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 11 23:15:03.453975 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:15:03.459978 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [req-9621d0e2-23d5-41ad-8b05-54c67f2d2e1c req-97c23b9d-1b8e-47b1-bf21-2bb9e2eb2d70 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:15:03.467842 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:15:03.571955 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:15:03.603549 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:15:03.698545 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:15:03.851526 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-07edd1d7-1c11-4b7b-ad4c-6dad47509322 req-31ec3b9f-b7a7-4132-895f-3736a8ac7365 service nova] [instance: f4f629ca-bf55-4dc5-ad80-9136da020657] Received event network-vif-plugged-ed253e02-f0d4-4a82-a7bc-4d4558e9d645 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:15:03.852266 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-07edd1d7-1c11-4b7b-ad4c-6dad47509322 req-31ec3b9f-b7a7-4132-895f-3736a8ac7365 service nova] Acquiring lock "f4f629ca-bf55-4dc5-ad80-9136da020657-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:15:03.852512 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-07edd1d7-1c11-4b7b-ad4c-6dad47509322 req-31ec3b9f-b7a7-4132-895f-3736a8ac7365 service nova] Lock "f4f629ca-bf55-4dc5-ad80-9136da020657-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:15:03.853482 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-07edd1d7-1c11-4b7b-ad4c-6dad47509322 req-31ec3b9f-b7a7-4132-895f-3736a8ac7365 service nova] Lock "f4f629ca-bf55-4dc5-ad80-9136da020657-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:15:03.853482 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-07edd1d7-1c11-4b7b-ad4c-6dad47509322 req-31ec3b9f-b7a7-4132-895f-3736a8ac7365 service nova] [instance: f4f629ca-bf55-4dc5-ad80-9136da020657] Processing event network-vif-plugged-ed253e02-f0d4-4a82-a7bc-4d4558e9d645 {{(pid=98431) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 11 23:15:03.865265 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-2c91b307-f425-4c22-ae2e-6e1e17c5567e tempest-ImageDependencyTests-1754620563 tempest-ImageDependencyTests-1754620563-project-member] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] During sync_power_state the instance has a pending task (resize_finish). Skip. Jun 11 23:15:03.915086 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [req-9621d0e2-23d5-41ad-8b05-54c67f2d2e1c req-97c23b9d-1b8e-47b1-bf21-2bb9e2eb2d70 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:15:03.965523 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.876s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:15:03.989732 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:15:04.002890 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:15:04.018413 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:15:04.057419 np0000002687 nova-compute[98431]: INFO nova.scheduler.client.report [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Deleted allocations for instance 1d45c7ce-5760-4f59-9921-feb3e589da8a Jun 11 23:15:04.096569 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-60ab024e-1648-467d-a3d0-6e7e8c09b32b req-8d135c1f-50b5-4eb6-ba8e-735bd3ed8632 service nova] [instance: ae596459-1e34-4a2a-9a33-69a02f50fd1c] Received event network-vif-plugged-3bee781d-e603-4cbb-9d42-63fb3e55dcd6 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:15:04.096865 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-60ab024e-1648-467d-a3d0-6e7e8c09b32b req-8d135c1f-50b5-4eb6-ba8e-735bd3ed8632 service nova] Acquiring lock "ae596459-1e34-4a2a-9a33-69a02f50fd1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:15:04.097025 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-60ab024e-1648-467d-a3d0-6e7e8c09b32b req-8d135c1f-50b5-4eb6-ba8e-735bd3ed8632 service nova] Lock "ae596459-1e34-4a2a-9a33-69a02f50fd1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:15:04.097368 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-60ab024e-1648-467d-a3d0-6e7e8c09b32b req-8d135c1f-50b5-4eb6-ba8e-735bd3ed8632 service nova] Lock "ae596459-1e34-4a2a-9a33-69a02f50fd1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:15:04.097368 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-60ab024e-1648-467d-a3d0-6e7e8c09b32b req-8d135c1f-50b5-4eb6-ba8e-735bd3ed8632 service nova] [instance: ae596459-1e34-4a2a-9a33-69a02f50fd1c] No waiting events found dispatching network-vif-plugged-3bee781d-e603-4cbb-9d42-63fb3e55dcd6 {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:15:04.097469 np0000002687 nova-compute[98431]: WARNING nova.compute.manager [req-60ab024e-1648-467d-a3d0-6e7e8c09b32b req-8d135c1f-50b5-4eb6-ba8e-735bd3ed8632 service nova] [instance: ae596459-1e34-4a2a-9a33-69a02f50fd1c] Received unexpected event network-vif-plugged-3bee781d-e603-4cbb-9d42-63fb3e55dcd6 for instance with vm_state active and task_state None. Jun 11 23:15:04.097574 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-60ab024e-1648-467d-a3d0-6e7e8c09b32b req-8d135c1f-50b5-4eb6-ba8e-735bd3ed8632 service nova] [instance: ae596459-1e34-4a2a-9a33-69a02f50fd1c] Received event network-vif-plugged-3bee781d-e603-4cbb-9d42-63fb3e55dcd6 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:15:04.097613 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-60ab024e-1648-467d-a3d0-6e7e8c09b32b req-8d135c1f-50b5-4eb6-ba8e-735bd3ed8632 service nova] Acquiring lock "ae596459-1e34-4a2a-9a33-69a02f50fd1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:15:04.098270 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-60ab024e-1648-467d-a3d0-6e7e8c09b32b req-8d135c1f-50b5-4eb6-ba8e-735bd3ed8632 service nova] Lock "ae596459-1e34-4a2a-9a33-69a02f50fd1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:15:04.098843 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-60ab024e-1648-467d-a3d0-6e7e8c09b32b req-8d135c1f-50b5-4eb6-ba8e-735bd3ed8632 service nova] Lock "ae596459-1e34-4a2a-9a33-69a02f50fd1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:15:04.099174 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-60ab024e-1648-467d-a3d0-6e7e8c09b32b req-8d135c1f-50b5-4eb6-ba8e-735bd3ed8632 service nova] [instance: ae596459-1e34-4a2a-9a33-69a02f50fd1c] No waiting events found dispatching network-vif-plugged-3bee781d-e603-4cbb-9d42-63fb3e55dcd6 {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:15:04.099174 np0000002687 nova-compute[98431]: WARNING nova.compute.manager [req-60ab024e-1648-467d-a3d0-6e7e8c09b32b req-8d135c1f-50b5-4eb6-ba8e-735bd3ed8632 service nova] [instance: ae596459-1e34-4a2a-9a33-69a02f50fd1c] Received unexpected event network-vif-plugged-3bee781d-e603-4cbb-9d42-63fb3e55dcd6 for instance with vm_state active and task_state None. Jun 11 23:15:04.107590 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-9621d0e2-23d5-41ad-8b05-54c67f2d2e1c req-97c23b9d-1b8e-47b1-bf21-2bb9e2eb2d70 service nova] [instance: ae596459-1e34-4a2a-9a33-69a02f50fd1c] Updated VIF entry in instance network info cache for port 3bee781d-e603-4cbb-9d42-63fb3e55dcd6. {{(pid=98431) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 11 23:15:04.107916 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-9621d0e2-23d5-41ad-8b05-54c67f2d2e1c req-97c23b9d-1b8e-47b1-bf21-2bb9e2eb2d70 service nova] [instance: ae596459-1e34-4a2a-9a33-69a02f50fd1c] Updating instance_info_cache with network_info: [{"id": "1f920031-116a-4009-be97-ea5f1389a374", "address": "fa:16:3e:6c:78:be", "network": {"id": "e7cf6fb9-33e8-4362-8236-472d2d07f60a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-749809800-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "03be033a975c41efba46c4d480df190f", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f920031-11", "ovs_interfaceid": "1f920031-116a-4009-be97-ea5f1389a374", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3bee781d-e603-4cbb-9d42-63fb3e55dcd6", "address": "fa:16:3e:ae:c2:83", "network": {"id": "18029db1-b49f-4422-8aa6-a6432a3c4135", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1440361664", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.94", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "03be033a975c41efba46c4d480df190f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bee781d-e6", "ovs_interfaceid": "3bee781d-e603-4cbb-9d42-63fb3e55dcd6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:15:04.535527 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Emitting event Started> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:15:04.536113 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: f4f629ca-bf55-4dc5-ad80-9136da020657] VM Started (Lifecycle Event) Jun 11 23:15:04.537074 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-10cf0c0e-d44c-4038-bfb1-748cdf202968 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] [instance: f4f629ca-bf55-4dc5-ad80-9136da020657] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98431) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 11 23:15:04.541831 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-10cf0c0e-d44c-4038-bfb1-748cdf202968 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] [instance: f4f629ca-bf55-4dc5-ad80-9136da020657] Guest created on hypervisor {{(pid=98431) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}} Jun 11 23:15:04.546357 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [-] [instance: f4f629ca-bf55-4dc5-ad80-9136da020657] Instance spawned successfully. Jun 11 23:15:04.546599 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-10cf0c0e-d44c-4038-bfb1-748cdf202968 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] [instance: f4f629ca-bf55-4dc5-ad80-9136da020657] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 11 23:15:04.561911 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Found WWN 33000000000dc7ddd for multipath device dm-7 {{(pid=98431) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 11 23:15:04.564700 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 8.066s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 11 23:15:04.567575 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] <== connect_volume: return (8069ms) {'type': 'block', 'scsi_wwn': '33000000000dc7ddd', 'path': '/dev/dm-7', 'multipath_id': '33000000000dc7ddd'} {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 11 23:15:04.571386 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000000dc7ddd', 'path': '/dev/dm-7', 'multipath_id': '33000000000dc7ddd'} {{(pid=98431) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 11 23:15:04.610123 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-9621d0e2-23d5-41ad-8b05-54c67f2d2e1c req-97c23b9d-1b8e-47b1-bf21-2bb9e2eb2d70 service nova] Releasing lock "refresh_cache-ae596459-1e34-4a2a-9a33-69a02f50fd1c" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 11 23:15:04.749831 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-ed168774-86ef-437c-8f8e-01c7a79fbb9a tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] No BDM found with device name vda, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:15:04.749831 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-ed168774-86ef-437c-8f8e-01c7a79fbb9a tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] No BDM found with device name hda, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:15:04.749831 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-ed168774-86ef-437c-8f8e-01c7a79fbb9a tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] No VIF found with MAC fa:16:3e:6c:78:be, not building metadata {{(pid=98431) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13199}} Jun 11 23:15:05.038313 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: f4f629ca-bf55-4dc5-ad80-9136da020657] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:15:05.040891 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: f4f629ca-bf55-4dc5-ad80-9136da020657] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98431) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 11 23:15:05.056938 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-10cf0c0e-d44c-4038-bfb1-748cdf202968 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] [instance: f4f629ca-bf55-4dc5-ad80-9136da020657] Found default for hw_cdrom_bus of ide {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:15:05.057097 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-10cf0c0e-d44c-4038-bfb1-748cdf202968 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] [instance: f4f629ca-bf55-4dc5-ad80-9136da020657] Found default for hw_disk_bus of virtio {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:15:05.057388 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-10cf0c0e-d44c-4038-bfb1-748cdf202968 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] [instance: f4f629ca-bf55-4dc5-ad80-9136da020657] Found default for hw_input_bus of None {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:15:05.057595 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-10cf0c0e-d44c-4038-bfb1-748cdf202968 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] [instance: f4f629ca-bf55-4dc5-ad80-9136da020657] Found default for hw_pointer_model of None {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:15:05.057876 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-10cf0c0e-d44c-4038-bfb1-748cdf202968 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] [instance: f4f629ca-bf55-4dc5-ad80-9136da020657] Found default for hw_video_model of virtio {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:15:05.058129 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-10cf0c0e-d44c-4038-bfb1-748cdf202968 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] [instance: f4f629ca-bf55-4dc5-ad80-9136da020657] Found default for hw_vif_model of virtio {{(pid=98431) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 11 23:15:05.069652 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-cd272eb0-ebf5-499e-b508-0ea6c09761a0 tempest-TaggedBootDevicesTest_v242-37151554 tempest-TaggedBootDevicesTest_v242-37151554-project-member] Lock "1d45c7ce-5760-4f59-9921-feb3e589da8a" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 13.035s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:15:05.085115 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-11T23:12:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(12),hidden=False,host='np0000002687',hostname='multiattach-server-1',id=17,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHngWA9S/0M7yAiCaKN7wJ0iqGBq18p6o1N91kfGTes8iMQtxmsCxH/Iqg51e2HEWFsjD10S17Kahb+vCzu07nJJQGe3fNUonThwHNf0exiWq4jZuXjSZtHJPO0dbow48A==',key_name='tempest-keypair-1974490716',keypairs=,launch_index=0,launched_at=2026-06-11T23:13:03Z,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000002687',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='81fd45f475a04e5c8e9bd9deb7ad4c1e',ramdisk_id='',reservation_id='r-n8ohee78',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-1514006700',owner_user_name='tempest-AttachVolumeMultiAttachTest-1514006700-project-member'},tags=,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-06-11T23:14:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c17e84202f404c3c8e73292bb59d7b27',uuid=8a45e04f-3516-4c39-bea1-820104411f17,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3c04202e-5ce6-4249-ba31-be06996ca75d", "address": "fa:16:3e:6f:42:42", "network": {"id": "17593db3-c22d-4354-ab29-933b1c6a5c3a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1094286565-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1094286565-network", "vif_mac": "fa:16:3e:6f:42:42"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "81fd45f475a04e5c8e9bd9deb7ad4c1e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c04202e-5c", "ovs_interfaceid": "3c04202e-5ce6-4249-ba31-be06996ca75d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98431) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 11 23:15:05.085380 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Converting VIF {"id": "3c04202e-5ce6-4249-ba31-be06996ca75d", "address": "fa:16:3e:6f:42:42", "network": {"id": "17593db3-c22d-4354-ab29-933b1c6a5c3a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1094286565-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1094286565-network", "vif_mac": "fa:16:3e:6f:42:42"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "81fd45f475a04e5c8e9bd9deb7ad4c1e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c04202e-5c", "ovs_interfaceid": "3c04202e-5ce6-4249-ba31-be06996ca75d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:15:05.085990 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:42:42,bridge_name='br-int',has_traffic_filtering=True,id=3c04202e-5ce6-4249-ba31-be06996ca75d,network=Network(17593db3-c22d-4354-ab29-933b1c6a5c3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c04202e-5c') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:15:05.090453 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] End _get_guest_xml xml= Jun 11 23:15:05.090453 np0000002687 nova-compute[98431]: 8a45e04f-3516-4c39-bea1-820104411f17 Jun 11 23:15:05.090453 np0000002687 nova-compute[98431]: instance-00000011 Jun 11 23:15:05.090453 np0000002687 nova-compute[98431]: 262144 Jun 11 23:15:05.090453 np0000002687 nova-compute[98431]: 1 Jun 11 23:15:05.090453 np0000002687 nova-compute[98431]: Jun 11 23:15:05.090453 np0000002687 nova-compute[98431]: Jun 11 23:15:05.090453 np0000002687 nova-compute[98431]: Jun 11 23:15:05.090453 np0000002687 nova-compute[98431]: multiattach-server-1 Jun 11 23:15:05.090453 np0000002687 nova-compute[98431]: 2026-06-11 23:14:56 Jun 11 23:15:05.090453 np0000002687 nova-compute[98431]: Jun 11 23:15:05.090453 np0000002687 nova-compute[98431]: 256 Jun 11 23:15:05.090453 np0000002687 nova-compute[98431]: 1 Jun 11 23:15:05.090453 np0000002687 nova-compute[98431]: 0 Jun 11 23:15:05.090453 np0000002687 nova-compute[98431]: 0 Jun 11 23:15:05.090453 np0000002687 nova-compute[98431]: 1 Jun 11 23:15:05.090453 np0000002687 nova-compute[98431]: Jun 11 23:15:05.090453 np0000002687 nova-compute[98431]: True Jun 11 23:15:05.090453 np0000002687 nova-compute[98431]: Jun 11 23:15:05.090453 np0000002687 nova-compute[98431]: Jun 11 23:15:05.090453 np0000002687 nova-compute[98431]: Jun 11 23:15:05.090453 np0000002687 nova-compute[98431]: bare Jun 11 23:15:05.090453 np0000002687 nova-compute[98431]: qcow2 Jun 11 23:15:05.090453 np0000002687 nova-compute[98431]: 1 Jun 11 23:15:05.090453 np0000002687 nova-compute[98431]: 0 Jun 11 23:15:05.090453 np0000002687 nova-compute[98431]: Jun 11 23:15:05.090453 np0000002687 nova-compute[98431]: ide Jun 11 23:15:05.090453 np0000002687 nova-compute[98431]: virtio Jun 11 23:15:05.090453 np0000002687 nova-compute[98431]: pc Jun 11 23:15:05.090453 np0000002687 nova-compute[98431]: virtio Jun 11 23:15:05.090453 np0000002687 nova-compute[98431]: virtio Jun 11 23:15:05.090453 np0000002687 nova-compute[98431]: virtio Jun 11 23:15:05.090453 np0000002687 nova-compute[98431]: Jun 11 23:15:05.090453 np0000002687 nova-compute[98431]: Jun 11 23:15:05.090453 np0000002687 nova-compute[98431]: Jun 11 23:15:05.090453 np0000002687 nova-compute[98431]: tempest-AttachVolumeMultiAttachTest-1514006700-project-member Jun 11 23:15:05.090453 np0000002687 nova-compute[98431]: tempest-AttachVolumeMultiAttachTest-1514006700 Jun 11 23:15:05.090453 np0000002687 nova-compute[98431]: Jun 11 23:15:05.090453 np0000002687 nova-compute[98431]: Jun 11 23:15:05.090453 np0000002687 nova-compute[98431]: Jun 11 23:15:05.090453 np0000002687 nova-compute[98431]: Jun 11 23:15:05.090453 np0000002687 nova-compute[98431]: Jun 11 23:15:05.090453 np0000002687 nova-compute[98431]: Jun 11 23:15:05.090453 np0000002687 nova-compute[98431]: Jun 11 23:15:05.090453 np0000002687 nova-compute[98431]: Jun 11 23:15:05.090453 np0000002687 nova-compute[98431]: Jun 11 23:15:05.090453 np0000002687 nova-compute[98431]: Jun 11 23:15:05.090453 np0000002687 nova-compute[98431]: Jun 11 23:15:05.090453 np0000002687 nova-compute[98431]: OpenStack Foundation Jun 11 23:15:05.090453 np0000002687 nova-compute[98431]: OpenStack Nova Jun 11 23:15:05.090453 np0000002687 nova-compute[98431]: 33.1.0 Jun 11 23:15:05.090453 np0000002687 nova-compute[98431]: 8a45e04f-3516-4c39-bea1-820104411f17 Jun 11 23:15:05.090453 np0000002687 nova-compute[98431]: 8a45e04f-3516-4c39-bea1-820104411f17 Jun 11 23:15:05.090453 np0000002687 nova-compute[98431]: Virtual Machine Jun 11 23:15:05.090453 np0000002687 nova-compute[98431]: Jun 11 23:15:05.090453 np0000002687 nova-compute[98431]: Jun 11 23:15:05.090453 np0000002687 nova-compute[98431]: Jun 11 23:15:05.090453 np0000002687 nova-compute[98431]: hvm Jun 11 23:15:05.090453 np0000002687 nova-compute[98431]: Jun 11 23:15:05.090453 np0000002687 nova-compute[98431]: Jun 11 23:15:05.090453 np0000002687 nova-compute[98431]: Jun 11 23:15:05.090453 np0000002687 nova-compute[98431]: Jun 11 23:15:05.090453 np0000002687 nova-compute[98431]: Jun 11 23:15:05.090453 np0000002687 nova-compute[98431]: Jun 11 23:15:05.090453 np0000002687 nova-compute[98431]: 128 Jun 11 23:15:05.090453 np0000002687 nova-compute[98431]: Jun 11 23:15:05.090453 np0000002687 nova-compute[98431]: Jun 11 23:15:05.090453 np0000002687 nova-compute[98431]: Jun 11 23:15:05.090453 np0000002687 nova-compute[98431]: 1 Jun 11 23:15:05.090453 np0000002687 nova-compute[98431]: Jun 11 23:15:05.090453 np0000002687 nova-compute[98431]: Jun 11 23:15:05.090453 np0000002687 nova-compute[98431]: Nehalem Jun 11 23:15:05.090453 np0000002687 nova-compute[98431]: Jun 11 23:15:05.090453 np0000002687 nova-compute[98431]: Jun 11 23:15:05.090453 np0000002687 nova-compute[98431]: Jun 11 23:15:05.090453 np0000002687 nova-compute[98431]: Jun 11 23:15:05.090453 np0000002687 nova-compute[98431]: Jun 11 23:15:05.090453 np0000002687 nova-compute[98431]: Jun 11 23:15:05.090453 np0000002687 nova-compute[98431]: Jun 11 23:15:05.090453 np0000002687 nova-compute[98431]: Jun 11 23:15:05.090453 np0000002687 nova-compute[98431]: Jun 11 23:15:05.090453 np0000002687 nova-compute[98431]: Jun 11 23:15:05.090453 np0000002687 nova-compute[98431]: Jun 11 23:15:05.090453 np0000002687 nova-compute[98431]: Jun 11 23:15:05.090453 np0000002687 nova-compute[98431]: Jun 11 23:15:05.090453 np0000002687 nova-compute[98431]: Jun 11 23:15:05.090453 np0000002687 nova-compute[98431]: Jun 11 23:15:05.090453 np0000002687 nova-compute[98431]: Jun 11 23:15:05.090453 np0000002687 nova-compute[98431]: Jun 11 23:15:05.090453 np0000002687 nova-compute[98431]: Jun 11 23:15:05.090453 np0000002687 nova-compute[98431]: f535b91b-3bff-46ad-905e-644bd012b9ff Jun 11 23:15:05.090453 np0000002687 nova-compute[98431]: Jun 11 23:15:05.090453 np0000002687 nova-compute[98431]: Jun 11 23:15:05.090453 np0000002687 nova-compute[98431]: Jun 11 23:15:05.090453 np0000002687 nova-compute[98431]: Jun 11 23:15:05.090453 np0000002687 nova-compute[98431]: Jun 11 23:15:05.090453 np0000002687 nova-compute[98431]: Jun 11 23:15:05.090453 np0000002687 nova-compute[98431]: Jun 11 23:15:05.090453 np0000002687 nova-compute[98431]: Jun 11 23:15:05.090453 np0000002687 nova-compute[98431]: Jun 11 23:15:05.090453 np0000002687 nova-compute[98431]: Jun 11 23:15:05.090453 np0000002687 nova-compute[98431]: Jun 11 23:15:05.090453 np0000002687 nova-compute[98431]: Jun 11 23:15:05.090453 np0000002687 nova-compute[98431]: Jun 11 23:15:05.090453 np0000002687 nova-compute[98431]: Jun 11 23:15:05.090453 np0000002687 nova-compute[98431]: Jun 11 23:15:05.090453 np0000002687 nova-compute[98431]: /dev/urandom Jun 11 23:15:05.090453 np0000002687 nova-compute[98431]: Jun 11 23:15:05.090453 np0000002687 nova-compute[98431]: Jun 11 23:15:05.090453 np0000002687 nova-compute[98431]: Jun 11 23:15:05.090453 np0000002687 nova-compute[98431]: Jun 11 23:15:05.090453 np0000002687 nova-compute[98431]: Jun 11 23:15:05.090453 np0000002687 nova-compute[98431]: Jun 11 23:15:05.090453 np0000002687 nova-compute[98431]: Jun 11 23:15:05.090453 np0000002687 nova-compute[98431]: {{(pid=98431) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 11 23:15:05.094069 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-11T23:12:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(12),hidden=False,host='np0000002687',hostname='multiattach-server-1',id=17,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHngWA9S/0M7yAiCaKN7wJ0iqGBq18p6o1N91kfGTes8iMQtxmsCxH/Iqg51e2HEWFsjD10S17Kahb+vCzu07nJJQGe3fNUonThwHNf0exiWq4jZuXjSZtHJPO0dbow48A==',key_name='tempest-keypair-1974490716',keypairs=,launch_index=0,launched_at=2026-06-11T23:13:03Z,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000002687',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='81fd45f475a04e5c8e9bd9deb7ad4c1e',ramdisk_id='',reservation_id='r-n8ohee78',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-1514006700',owner_user_name='tempest-AttachVolumeMultiAttachTest-1514006700-project-member'},tags=,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-06-11T23:14:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c17e84202f404c3c8e73292bb59d7b27',uuid=8a45e04f-3516-4c39-bea1-820104411f17,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3c04202e-5ce6-4249-ba31-be06996ca75d", "address": "fa:16:3e:6f:42:42", "network": {"id": "17593db3-c22d-4354-ab29-933b1c6a5c3a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1094286565-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1094286565-network", "vif_mac": "fa:16:3e:6f:42:42"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "81fd45f475a04e5c8e9bd9deb7ad4c1e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c04202e-5c", "ovs_interfaceid": "3c04202e-5ce6-4249-ba31-be06996ca75d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 11 23:15:05.094069 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Converting VIF {"id": "3c04202e-5ce6-4249-ba31-be06996ca75d", "address": "fa:16:3e:6f:42:42", "network": {"id": "17593db3-c22d-4354-ab29-933b1c6a5c3a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1094286565-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1094286565-network", "vif_mac": "fa:16:3e:6f:42:42"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "81fd45f475a04e5c8e9bd9deb7ad4c1e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c04202e-5c", "ovs_interfaceid": "3c04202e-5ce6-4249-ba31-be06996ca75d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:15:05.094069 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:42:42,bridge_name='br-int',has_traffic_filtering=True,id=3c04202e-5ce6-4249-ba31-be06996ca75d,network=Network(17593db3-c22d-4354-ab29-933b1c6a5c3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c04202e-5c') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:15:05.094069 np0000002687 nova-compute[98431]: DEBUG os_vif [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:42:42,bridge_name='br-int',has_traffic_filtering=True,id=3c04202e-5ce6-4249-ba31-be06996ca75d,network=Network(17593db3-c22d-4354-ab29-933b1c6a5c3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c04202e-5c') {{(pid=98431) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 11 23:15:05.094069 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:15:05.094069 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:15:05.094069 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 11 23:15:05.097438 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:15:05.097438 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '427b0bac-fbf0-55a8-afea-48cbb4504a4d', '_type': 'linux-noop'}}, row=False) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:15:05.097925 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:15:05.098667 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:15:05.100846 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:15:05.103272 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:15:05.103498 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3c04202e-5c, may_exist=True, interface_attrs={}) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:15:05.103887 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3c04202e-5c, col_values=(('qos', UUID('c03248bd-ebc7-4dcd-b24b-6497c28c9f45')),), if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:15:05.104078 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3c04202e-5c, col_values=(('external_ids', {'iface-id': '3c04202e-5ce6-4249-ba31-be06996ca75d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6f:42:42', 'vm-uuid': '8a45e04f-3516-4c39-bea1-820104411f17'}),), if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:15:05.107824 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:15:05.107824 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:15:05.111226 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:15:05.112118 np0000002687 nova-compute[98431]: INFO os_vif [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:42:42,bridge_name='br-int',has_traffic_filtering=True,id=3c04202e-5ce6-4249-ba31-be06996ca75d,network=Network(17593db3-c22d-4354-ab29-933b1c6a5c3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c04202e-5c') Jun 11 23:15:05.257692 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-ed168774-86ef-437c-8f8e-01c7a79fbb9a tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='f30640f8-7aca-4300-a085-4706a5209a79', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-1094546666', uuid='ae596459-1e34-4a2a-9a33-69a02f50fd1c'), owner=OwnerMeta(userid='56116a7118a54aa6b259414512446b40', username='tempest-TaggedAttachmentsTest-1378608456-project-member', projectid='03be033a975c41efba46c4d480df190f', projectname='tempest-TaggedAttachmentsTest-1378608456'), image=ImageMeta(id='f30640f8-7aca-4300-a085-4706a5209a79', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "1f920031-116a-4009-be97-ea5f1389a374", "address": "fa:16:3e:6c:78:be", "network": {"id": "e7cf6fb9-33e8-4362-8236-472d2d07f60a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-749809800-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "03be033a975c41efba46c4d480df190f", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f920031-11", "ovs_interfaceid": "1f920031-116a-4009-be97-ea5f1389a374", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3bee781d-e603-4cbb-9d42-63fb3e55dcd6", "address": "fa:16:3e:ae:c2:83", "network": {"id": "18029db1-b49f-4422-8aa6-a6432a3c4135", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1440361664", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.94", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "03be033a975c41efba46c4d480df190f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bee781d-e6", "ovs_interfaceid": "3bee781d-e603-4cbb-9d42-63fb3e55dcd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1781219705.2570708) {{(pid=98431) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 11 23:15:05.257980 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.guest [None req-ed168774-86ef-437c-8f8e-01c7a79fbb9a tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] set metadata xml: Jun 11 23:15:05.257980 np0000002687 nova-compute[98431]: Jun 11 23:15:05.257980 np0000002687 nova-compute[98431]: tempest-device-tagging-server-1094546666 Jun 11 23:15:05.257980 np0000002687 nova-compute[98431]: 2026-06-11 23:15:05 Jun 11 23:15:05.257980 np0000002687 nova-compute[98431]: Jun 11 23:15:05.257980 np0000002687 nova-compute[98431]: 192 Jun 11 23:15:05.257980 np0000002687 nova-compute[98431]: 1 Jun 11 23:15:05.257980 np0000002687 nova-compute[98431]: 0 Jun 11 23:15:05.257980 np0000002687 nova-compute[98431]: 0 Jun 11 23:15:05.257980 np0000002687 nova-compute[98431]: 1 Jun 11 23:15:05.257980 np0000002687 nova-compute[98431]: Jun 11 23:15:05.257980 np0000002687 nova-compute[98431]: True Jun 11 23:15:05.257980 np0000002687 nova-compute[98431]: Jun 11 23:15:05.257980 np0000002687 nova-compute[98431]: Jun 11 23:15:05.257980 np0000002687 nova-compute[98431]: Jun 11 23:15:05.257980 np0000002687 nova-compute[98431]: bare Jun 11 23:15:05.257980 np0000002687 nova-compute[98431]: qcow2 Jun 11 23:15:05.257980 np0000002687 nova-compute[98431]: 1 Jun 11 23:15:05.257980 np0000002687 nova-compute[98431]: 0 Jun 11 23:15:05.257980 np0000002687 nova-compute[98431]: Jun 11 23:15:05.257980 np0000002687 nova-compute[98431]: ide Jun 11 23:15:05.257980 np0000002687 nova-compute[98431]: virtio Jun 11 23:15:05.257980 np0000002687 nova-compute[98431]: pc Jun 11 23:15:05.257980 np0000002687 nova-compute[98431]: virtio Jun 11 23:15:05.257980 np0000002687 nova-compute[98431]: virtio Jun 11 23:15:05.257980 np0000002687 nova-compute[98431]: virtio Jun 11 23:15:05.257980 np0000002687 nova-compute[98431]: Jun 11 23:15:05.257980 np0000002687 nova-compute[98431]: Jun 11 23:15:05.257980 np0000002687 nova-compute[98431]: Jun 11 23:15:05.257980 np0000002687 nova-compute[98431]: tempest-TaggedAttachmentsTest-1378608456-project-member Jun 11 23:15:05.257980 np0000002687 nova-compute[98431]: tempest-TaggedAttachmentsTest-1378608456 Jun 11 23:15:05.257980 np0000002687 nova-compute[98431]: Jun 11 23:15:05.257980 np0000002687 nova-compute[98431]: Jun 11 23:15:05.257980 np0000002687 nova-compute[98431]: Jun 11 23:15:05.257980 np0000002687 nova-compute[98431]: Jun 11 23:15:05.257980 np0000002687 nova-compute[98431]: Jun 11 23:15:05.257980 np0000002687 nova-compute[98431]: Jun 11 23:15:05.257980 np0000002687 nova-compute[98431]: Jun 11 23:15:05.257980 np0000002687 nova-compute[98431]: Jun 11 23:15:05.257980 np0000002687 nova-compute[98431]: Jun 11 23:15:05.257980 np0000002687 nova-compute[98431]: Jun 11 23:15:05.257980 np0000002687 nova-compute[98431]: Jun 11 23:15:05.257980 np0000002687 nova-compute[98431]: {{(pid=98431) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:371}} Jun 11 23:15:05.544564 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: f4f629ca-bf55-4dc5-ad80-9136da020657] During sync_power_state the instance has a pending task (spawning). Skip. Jun 11 23:15:05.546682 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Emitting event Paused> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:15:05.546682 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: f4f629ca-bf55-4dc5-ad80-9136da020657] VM Paused (Lifecycle Event) Jun 11 23:15:05.562206 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-10cf0c0e-d44c-4038-bfb1-748cdf202968 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] [instance: f4f629ca-bf55-4dc5-ad80-9136da020657] Took 6.75 seconds to spawn the instance on the hypervisor. Jun 11 23:15:05.562369 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-10cf0c0e-d44c-4038-bfb1-748cdf202968 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] [instance: f4f629ca-bf55-4dc5-ad80-9136da020657] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:15:05.763796 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-ed168774-86ef-437c-8f8e-01c7a79fbb9a tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Lock "interface-ae596459-1e34-4a2a-9a33-69a02f50fd1c-None" "released" by "nova.compute.manager.ComputeManager.attach_interface..do_attach_interface" :: held 7.391s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:15:05.942070 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-d48883a1-3585-474e-894f-d07d4ebdb236 req-2a76efda-07d0-4079-8e6e-7074996c1936 service nova] [instance: f4f629ca-bf55-4dc5-ad80-9136da020657] Received event network-vif-plugged-ed253e02-f0d4-4a82-a7bc-4d4558e9d645 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:15:05.942070 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-d48883a1-3585-474e-894f-d07d4ebdb236 req-2a76efda-07d0-4079-8e6e-7074996c1936 service nova] Acquiring lock "f4f629ca-bf55-4dc5-ad80-9136da020657-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:15:05.942070 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-d48883a1-3585-474e-894f-d07d4ebdb236 req-2a76efda-07d0-4079-8e6e-7074996c1936 service nova] Lock "f4f629ca-bf55-4dc5-ad80-9136da020657-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:15:05.942206 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-d48883a1-3585-474e-894f-d07d4ebdb236 req-2a76efda-07d0-4079-8e6e-7074996c1936 service nova] Lock "f4f629ca-bf55-4dc5-ad80-9136da020657-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:15:05.942252 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-d48883a1-3585-474e-894f-d07d4ebdb236 req-2a76efda-07d0-4079-8e6e-7074996c1936 service nova] [instance: f4f629ca-bf55-4dc5-ad80-9136da020657] No waiting events found dispatching network-vif-plugged-ed253e02-f0d4-4a82-a7bc-4d4558e9d645 {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:15:05.942402 np0000002687 nova-compute[98431]: WARNING nova.compute.manager [req-d48883a1-3585-474e-894f-d07d4ebdb236 req-2a76efda-07d0-4079-8e6e-7074996c1936 service nova] [instance: f4f629ca-bf55-4dc5-ad80-9136da020657] Received unexpected event network-vif-plugged-ed253e02-f0d4-4a82-a7bc-4d4558e9d645 for instance with vm_state active and task_state None. Jun 11 23:15:06.048292 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: f4f629ca-bf55-4dc5-ad80-9136da020657] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:15:06.054224 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Emitting event Resumed> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:15:06.054224 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: f4f629ca-bf55-4dc5-ad80-9136da020657] VM Resumed (Lifecycle Event) Jun 11 23:15:06.071939 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-10cf0c0e-d44c-4038-bfb1-748cdf202968 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] [instance: f4f629ca-bf55-4dc5-ad80-9136da020657] Took 13.01 seconds to build instance. Jun 11 23:15:06.556630 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: f4f629ca-bf55-4dc5-ad80-9136da020657] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:15:06.558510 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: f4f629ca-bf55-4dc5-ad80-9136da020657] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98431) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 11 23:15:06.576150 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-10cf0c0e-d44c-4038-bfb1-748cdf202968 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Lock "f4f629ca-bf55-4dc5-ad80-9136da020657" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 14.533s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:15:06.633241 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] No BDM found with device name vda, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:15:06.633406 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:15:06.633406 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] No BDM found with device name hda, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:15:06.633813 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] No VIF found with MAC fa:16:3e:6f:42:42, not building metadata {{(pid=98431) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13199}} Jun 11 23:15:06.633976 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] Using config drive Jun 11 23:15:06.790156 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-fe1623e9-3353-4681-bc87-42f4f797c4b6 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Acquiring lock "ae596459-1e34-4a2a-9a33-69a02f50fd1c" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:15:06.790694 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-fe1623e9-3353-4681-bc87-42f4f797c4b6 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Lock "ae596459-1e34-4a2a-9a33-69a02f50fd1c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:15:07.140354 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:15:07.171113 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:15:07.263841 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:15:07.297793 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-fe1623e9-3353-4681-bc87-42f4f797c4b6 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Lazy-loading 'flavor' on Instance uuid ae596459-1e34-4a2a-9a33-69a02f50fd1c {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:15:07.330611 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:15:07.336759 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:15:07.399428 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-7ab932de-2b7f-4445-a035-e3365e41f8c2 req-b6222428-60c9-4a52-b8a6-593d8d04bb46 service nova] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] Received event network-vif-plugged-3c04202e-5ce6-4249-ba31-be06996ca75d {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:15:07.399717 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-7ab932de-2b7f-4445-a035-e3365e41f8c2 req-b6222428-60c9-4a52-b8a6-593d8d04bb46 service nova] Acquiring lock "8a45e04f-3516-4c39-bea1-820104411f17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:15:07.400003 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-7ab932de-2b7f-4445-a035-e3365e41f8c2 req-b6222428-60c9-4a52-b8a6-593d8d04bb46 service nova] Lock "8a45e04f-3516-4c39-bea1-820104411f17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:15:07.400267 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-7ab932de-2b7f-4445-a035-e3365e41f8c2 req-b6222428-60c9-4a52-b8a6-593d8d04bb46 service nova] Lock "8a45e04f-3516-4c39-bea1-820104411f17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:15:07.400386 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-7ab932de-2b7f-4445-a035-e3365e41f8c2 req-b6222428-60c9-4a52-b8a6-593d8d04bb46 service nova] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] No waiting events found dispatching network-vif-plugged-3c04202e-5ce6-4249-ba31-be06996ca75d {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:15:07.400532 np0000002687 nova-compute[98431]: WARNING nova.compute.manager [req-7ab932de-2b7f-4445-a035-e3365e41f8c2 req-b6222428-60c9-4a52-b8a6-593d8d04bb46 service nova] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] Received unexpected event network-vif-plugged-3c04202e-5ce6-4249-ba31-be06996ca75d for instance with vm_state active and task_state resize_finish. Jun 11 23:15:07.634628 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:15:08.030928 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-7b53294f-4e73-4abb-988d-cfd2f172e425 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Acquiring lock "f4f629ca-bf55-4dc5-ad80-9136da020657" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:15:08.030928 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-7b53294f-4e73-4abb-988d-cfd2f172e425 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Lock "f4f629ca-bf55-4dc5-ad80-9136da020657" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:15:08.031896 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-7b53294f-4e73-4abb-988d-cfd2f172e425 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Acquiring lock "f4f629ca-bf55-4dc5-ad80-9136da020657-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:15:08.031896 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-7b53294f-4e73-4abb-988d-cfd2f172e425 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Lock "f4f629ca-bf55-4dc5-ad80-9136da020657-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:15:08.032166 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-7b53294f-4e73-4abb-988d-cfd2f172e425 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Lock "f4f629ca-bf55-4dc5-ad80-9136da020657-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:15:08.036171 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-7b53294f-4e73-4abb-988d-cfd2f172e425 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] [instance: f4f629ca-bf55-4dc5-ad80-9136da020657] Terminating instance Jun 11 23:15:08.091302 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:15:08.252792 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Emitting event Resumed> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:15:08.253041 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] VM Resumed (Lifecycle Event) Jun 11 23:15:08.254388 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] Instance event wait completed in 0 seconds for {{(pid=98431) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 11 23:15:08.260456 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [-] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] Instance running successfully. Jun 11 23:15:08.261814 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.guest [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] Failed to set time: agent not configured {{(pid=98431) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:194}} Jun 11 23:15:08.262313 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-3d4b1f74-cc31-4fcf-9a7e-5c161f5bcaed tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] finish_migration finished successfully. {{(pid=98431) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12898}} Jun 11 23:15:08.269769 np0000002687 nova-compute[98431]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.00047675499990873504 future=) submitted to {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:15:08.269769 np0000002687 nova-compute[98431]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:15:08.270003 np0000002687 nova-compute[98431]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=1.4340620580001087 future=) {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:15:08.271610 np0000002687 nova-compute[98431]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=1.4339364070001466 future=) {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:15:08.281035 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Emitting event Stopped> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:15:08.281733 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] VM Stopped (Lifecycle Event) Jun 11 23:15:08.310496 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-fe1623e9-3353-4681-bc87-42f4f797c4b6 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Lock "ae596459-1e34-4a2a-9a33-69a02f50fd1c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.520s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:15:08.540707 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-7b53294f-4e73-4abb-988d-cfd2f172e425 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] [instance: f4f629ca-bf55-4dc5-ad80-9136da020657] Start destroying the instance on the hypervisor. {{(pid=98431) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}} Jun 11 23:15:08.563533 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:15:08.570938 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:15:08.595284 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:15:08.620430 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:15:08.622542 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:15:08.744607 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-795b33a8-0abb-4f32-8eeb-e25cb26f023b req-02baf7d3-46e3-44f1-89fc-2a48eb92422b service nova] [instance: f4f629ca-bf55-4dc5-ad80-9136da020657] Received event network-vif-unplugged-ed253e02-f0d4-4a82-a7bc-4d4558e9d645 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:15:08.745443 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-795b33a8-0abb-4f32-8eeb-e25cb26f023b req-02baf7d3-46e3-44f1-89fc-2a48eb92422b service nova] Acquiring lock "f4f629ca-bf55-4dc5-ad80-9136da020657-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:15:08.745603 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-795b33a8-0abb-4f32-8eeb-e25cb26f023b req-02baf7d3-46e3-44f1-89fc-2a48eb92422b service nova] Lock "f4f629ca-bf55-4dc5-ad80-9136da020657-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:15:08.745954 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-795b33a8-0abb-4f32-8eeb-e25cb26f023b req-02baf7d3-46e3-44f1-89fc-2a48eb92422b service nova] Lock "f4f629ca-bf55-4dc5-ad80-9136da020657-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:15:08.745954 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-795b33a8-0abb-4f32-8eeb-e25cb26f023b req-02baf7d3-46e3-44f1-89fc-2a48eb92422b service nova] [instance: f4f629ca-bf55-4dc5-ad80-9136da020657] No waiting events found dispatching network-vif-unplugged-ed253e02-f0d4-4a82-a7bc-4d4558e9d645 {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:15:08.746168 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-795b33a8-0abb-4f32-8eeb-e25cb26f023b req-02baf7d3-46e3-44f1-89fc-2a48eb92422b service nova] [instance: f4f629ca-bf55-4dc5-ad80-9136da020657] Received event network-vif-unplugged-ed253e02-f0d4-4a82-a7bc-4d4558e9d645 for instance with task_state deleting. {{(pid=98431) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 11 23:15:08.757218 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:15:08.762841 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=98431) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 11 23:15:08.790299 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-02711062-9dce-4424-a19d-7974748bd45f tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: 1d45c7ce-5760-4f59-9921-feb3e589da8a] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:15:08.888152 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [-] [instance: f4f629ca-bf55-4dc5-ad80-9136da020657] Instance destroyed successfully. Jun 11 23:15:08.889114 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-7b53294f-4e73-4abb-988d-cfd2f172e425 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Lazy-loading 'resources' on Instance uuid f4f629ca-bf55-4dc5-ad80-9136da020657 {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:15:09.266089 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] During sync_power_state the instance has a pending task (resize_finish). Skip. Jun 11 23:15:09.266341 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Emitting event Started> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:15:09.266484 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] VM Started (Lifecycle Event) Jun 11 23:15:09.376497 np0000002687 nova-compute[98431]: DEBUG oslo_service.periodic_task [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 11 23:15:09.376884 np0000002687 nova-compute[98431]: DEBUG oslo_service.periodic_task [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 11 23:15:09.377521 np0000002687 nova-compute[98431]: DEBUG oslo_service.periodic_task [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 11 23:15:09.377771 np0000002687 nova-compute[98431]: DEBUG oslo_service.periodic_task [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 11 23:15:09.378054 np0000002687 nova-compute[98431]: DEBUG oslo_service.periodic_task [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 11 23:15:09.378271 np0000002687 nova-compute[98431]: DEBUG oslo_service.periodic_task [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 11 23:15:09.378496 np0000002687 nova-compute[98431]: DEBUG oslo_service.periodic_task [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 11 23:15:09.378648 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98431) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}} Jun 11 23:15:09.378861 np0000002687 nova-compute[98431]: DEBUG oslo_service.periodic_task [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running periodic task ComputeManager.update_available_resource {{(pid=98431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 11 23:15:09.394341 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-7b53294f-4e73-4abb-988d-cfd2f172e425 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-11T23:14:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1957852829',display_name='tempest-VolumesActionsTest-instance-1957852829',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='tempest-volumesactionstest-instance-1957852829',id=27,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-06-11T23:15:05Z,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='1922540076a94ee5ba369d79869aaa95',ramdisk_id='',reservation_id='r-tvgzfab6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1703782237',owner_user_name='tempest-VolumesActionsTest-1703782237-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-11T23:15:06Z,user_data=None,user_id='5b929fda768d45738790181d6b49a3be',uuid=f4f629ca-bf55-4dc5-ad80-9136da020657,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ed253e02-f0d4-4a82-a7bc-4d4558e9d645", "address": "fa:16:3e:f4:bb:9a", "network": {"id": "64de9d21-9a16-433f-b6db-fd642b6ec307", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1640869818-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1922540076a94ee5ba369d79869aaa95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "taped253e02-f0", "ovs_interfaceid": "ed253e02-f0d4-4a82-a7bc-4d4558e9d645", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 11 23:15:09.394341 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-7b53294f-4e73-4abb-988d-cfd2f172e425 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Converting VIF {"id": "ed253e02-f0d4-4a82-a7bc-4d4558e9d645", "address": "fa:16:3e:f4:bb:9a", "network": {"id": "64de9d21-9a16-433f-b6db-fd642b6ec307", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1640869818-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1922540076a94ee5ba369d79869aaa95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "taped253e02-f0", "ovs_interfaceid": "ed253e02-f0d4-4a82-a7bc-4d4558e9d645", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:15:09.395077 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-7b53294f-4e73-4abb-988d-cfd2f172e425 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:bb:9a,bridge_name='br-int',has_traffic_filtering=True,id=ed253e02-f0d4-4a82-a7bc-4d4558e9d645,network=Network(64de9d21-9a16-433f-b6db-fd642b6ec307),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped253e02-f0') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:15:09.395318 np0000002687 nova-compute[98431]: DEBUG os_vif [None req-7b53294f-4e73-4abb-988d-cfd2f172e425 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:bb:9a,bridge_name='br-int',has_traffic_filtering=True,id=ed253e02-f0d4-4a82-a7bc-4d4558e9d645,network=Network(64de9d21-9a16-433f-b6db-fd642b6ec307),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped253e02-f0') {{(pid=98431) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 11 23:15:09.397594 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:15:09.397817 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=taped253e02-f0, bridge=br-int, if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:15:09.401177 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:15:09.406935 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:15:09.407161 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7997c571-89c1-4f52-bc86-36332ea6a8fc) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:15:09.407780 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:15:09.408413 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:15:09.409712 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:15:09.410964 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-fe1623e9-3353-4681-bc87-42f4f797c4b6 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Acquiring lock "ae596459-1e34-4a2a-9a33-69a02f50fd1c" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:15:09.411142 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-fe1623e9-3353-4681-bc87-42f4f797c4b6 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Lock "ae596459-1e34-4a2a-9a33-69a02f50fd1c" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:15:09.411338 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-fe1623e9-3353-4681-bc87-42f4f797c4b6 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] [instance: ae596459-1e34-4a2a-9a33-69a02f50fd1c] Attaching volume 084b8049-147b-4db4-87aa-de243dbb50fb to /dev/vdb Jun 11 23:15:09.413047 np0000002687 nova-compute[98431]: INFO os_vif [None req-7b53294f-4e73-4abb-988d-cfd2f172e425 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:bb:9a,bridge_name='br-int',has_traffic_filtering=True,id=ed253e02-f0d4-4a82-a7bc-4d4558e9d645,network=Network(64de9d21-9a16-433f-b6db-fd642b6ec307),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped253e02-f0') Jun 11 23:15:09.413972 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-7b53294f-4e73-4abb-988d-cfd2f172e425 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] [instance: f4f629ca-bf55-4dc5-ad80-9136da020657] Deleting instance files /opt/stack/data/nova/instances/f4f629ca-bf55-4dc5-ad80-9136da020657_del Jun 11 23:15:09.414058 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-7b53294f-4e73-4abb-988d-cfd2f172e425 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] [instance: f4f629ca-bf55-4dc5-ad80-9136da020657] Deletion of /opt/stack/data/nova/instances/f4f629ca-bf55-4dc5-ad80-9136da020657_del complete Jun 11 23:15:09.473047 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-fe1623e9-3353-4681-bc87-42f4f797c4b6 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.209', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000002687', 'execute': None}" {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 11 23:15:09.486458 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.scaleio [None req-fe1623e9-3353-4681-bc87-42f4f797c4b6 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98431) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 11 23:15:09.498993 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-bf7d9aa2-d778-41f9-875c-3f9ef0487503 req-bdbb1ccd-ce72-404b-9602-d9eda445d1ba service nova] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] Received event network-vif-plugged-3c04202e-5ce6-4249-ba31-be06996ca75d {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:15:09.501329 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-bf7d9aa2-d778-41f9-875c-3f9ef0487503 req-bdbb1ccd-ce72-404b-9602-d9eda445d1ba service nova] Acquiring lock "8a45e04f-3516-4c39-bea1-820104411f17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:15:09.501532 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-bf7d9aa2-d778-41f9-875c-3f9ef0487503 req-bdbb1ccd-ce72-404b-9602-d9eda445d1ba service nova] Lock "8a45e04f-3516-4c39-bea1-820104411f17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:15:09.501734 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-bf7d9aa2-d778-41f9-875c-3f9ef0487503 req-bdbb1ccd-ce72-404b-9602-d9eda445d1ba service nova] Lock "8a45e04f-3516-4c39-bea1-820104411f17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:15:09.502269 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-bf7d9aa2-d778-41f9-875c-3f9ef0487503 req-bdbb1ccd-ce72-404b-9602-d9eda445d1ba service nova] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] No waiting events found dispatching network-vif-plugged-3c04202e-5ce6-4249-ba31-be06996ca75d {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:15:09.502394 np0000002687 nova-compute[98431]: WARNING nova.compute.manager [req-bf7d9aa2-d778-41f9-875c-3f9ef0487503 req-bdbb1ccd-ce72-404b-9602-d9eda445d1ba service nova] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] Received unexpected event network-vif-plugged-3c04202e-5ce6-4249-ba31-be06996ca75d for instance with vm_state resized and task_state None. Jun 11 23:15:09.514378 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-fe1623e9-3353-4681-bc87-42f4f797c4b6 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Running cmd (subprocess): nvme version {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:15:09.568199 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-fe1623e9-3353-4681-bc87-42f4f797c4b6 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] 'nvme version' failed. Not Retrying. {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 11 23:15:09.568849 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fe1623e9-3353-4681-bc87-42f4f797c4b6 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] nvme not present on system {{(pid=98431) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 11 23:15:09.585969 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.lightos [None req-fe1623e9-3353-4681-bc87-42f4f797c4b6 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98431) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 11 23:15:09.585969 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.lightos [None req-fe1623e9-3353-4681-bc87-42f4f797c4b6 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Current host hostNQN and IP(s) are ['10.4.3.209', 'fe80::f816:3eff:fea3:3707', '192.168.40.6', 'fe80::f816:3eff:fe06:bdab', '192.168.50.6', 'fe80::f816:3eff:fe7a:46f2', '192.168.10.6', 'fe80::f816:3eff:fe13:793b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::38fa:21ff:fe6c:3746', 'fe80::fc16:3eff:fe77:488d', 'fe80::9469:f2ff:feae:5824', 'fe80::fc16:3eff:fec7:336a', 'fe80::fc16:3eff:fe61:b7fd', 'fe80::38dc:c1ff:fee9:4731', 'fe80::fc16:3eff:fec2:8da4', 'fe80::fc16:3eff:fe4b:2695', 'fe80::fc16:3eff:fe2b:91a7', 'fe80::fc16:3eff:fe6c:78be', 'fe80::d82a:87ff:fe65:391e', 'fe80::fc16:3eff:fef6:b5ae', 'fe80::fc16:3eff:fe03:1c0a', 'fe80::f090:d9ff:fe35:5216', 'fe80::fc16:3eff:feae:c283', 'fe80::e4:9eff:fed3:41d', 'fe80::fc16:3eff:fe6f:4242'] Jun 11 23:15:09.585969 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.lightos [None req-fe1623e9-3353-4681-bc87-42f4f797c4b6 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98431) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 11 23:15:09.585969 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.lightos [None req-fe1623e9-3353-4681-bc87-42f4f797c4b6 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] LIGHTOS: no hostnqn found. {{(pid=98431) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 11 23:15:09.585969 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-fe1623e9-3353-4681-bc87-42f4f797c4b6 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.209', 'host': 'np0000002687', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:798b370f1cc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad465dfe-0ed1-4637-98c3-ddaebebd61a4', 'nvme_native_multipath': False} {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 11 23:15:09.585969 np0000002687 nova-compute[98431]: DEBUG nova.virt.block_device [None req-fe1623e9-3353-4681-bc87-42f4f797c4b6 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] [instance: ae596459-1e34-4a2a-9a33-69a02f50fd1c] Updating existing volume attachment record: 85ec9e3e-8490-4ea2-b35b-13e0e705e4fb {{(pid=98431) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 11 23:15:09.705192 np0000002687 nova-compute[98431]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0011711919999015663 future=) submitted to {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:15:09.705346 np0000002687 nova-compute[98431]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:15:09.706416 np0000002687 nova-compute[98431]: DEBUG nova.virt.driver [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Emitting event Stopped> {{(pid=98431) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 11 23:15:09.706641 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: cab1cc43-b433-4772-9f01-0197502c8b57] VM Stopped (Lifecycle Event) Jun 11 23:15:09.771461 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:15:09.774101 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98431) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 11 23:15:09.835703 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-de917596-6da7-4867-88d0-9e80471c5217 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Acquiring lock "8a45e04f-3516-4c39-bea1-820104411f17" by "nova.compute.manager.ComputeManager.confirm_resize..do_confirm_resize" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:15:09.835703 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-de917596-6da7-4867-88d0-9e80471c5217 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "8a45e04f-3516-4c39-bea1-820104411f17" acquired by "nova.compute.manager.ComputeManager.confirm_resize..do_confirm_resize" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:15:09.835703 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-de917596-6da7-4867-88d0-9e80471c5217 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] Going to confirm migration 3 {{(pid=98431) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:5452}} Jun 11 23:15:09.885337 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:15:09.886085 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:15:09.886231 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:15:09.886400 np0000002687 nova-compute[98431]: DEBUG nova.compute.resource_tracker [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Auditing locally available compute resources for np0000002687 (node: np0000002687) {{(pid=98431) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}} Jun 11 23:15:09.923651 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-7b53294f-4e73-4abb-988d-cfd2f172e425 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] [instance: f4f629ca-bf55-4dc5-ad80-9136da020657] Took 1.38 seconds to destroy the instance on the hypervisor. Jun 11 23:15:09.924159 np0000002687 nova-compute[98431]: DEBUG oslo.service.backend._common.loopingcall [None req-7b53294f-4e73-4abb-988d-cfd2f172e425 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98431) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jun 11 23:15:09.927891 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [-] [instance: f4f629ca-bf55-4dc5-ad80-9136da020657] Deallocating network for instance {{(pid=98431) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}} Jun 11 23:15:09.927891 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [-] [instance: f4f629ca-bf55-4dc5-ad80-9136da020657] deallocate_for_instance() {{(pid=98431) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jun 11 23:15:09.927891 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:15:09.998342 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:15:10.153171 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe1623e9-3353-4681-bc87-42f4f797c4b6 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] [instance: ae596459-1e34-4a2a-9a33-69a02f50fd1c] Calling os-brick to attach iSCSI Volume {{(pid=98431) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 11 23:15:10.153171 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe1623e9-3353-4681-bc87-42f4f797c4b6 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-084b8049-147b-4db4-87aa-de243dbb50fb', 'iqn.2023-03.storpool.com:os--volume-084b8049-147b-4db4-87aa-de243dbb50fb'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-084b8049-147b-4db4-87aa-de243dbb50fb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '084b8049-147b-4db4-87aa-de243dbb50fb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 11 23:15:10.153171 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-fe1623e9-3353-4681-bc87-42f4f797c4b6 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 11 23:15:10.153171 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-fe1623e9-3353-4681-bc87-42f4f797c4b6 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 11 23:15:10.153171 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-fe1623e9-3353-4681-bc87-42f4f797c4b6 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-084b8049-147b-4db4-87aa-de243dbb50fb', 'iqn.2023-03.storpool.com:os--volume-084b8049-147b-4db4-87aa-de243dbb50fb'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-084b8049-147b-4db4-87aa-de243dbb50fb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '084b8049-147b-4db4-87aa-de243dbb50fb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98431) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 11 23:15:10.169102 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-fe1623e9-3353-4681-bc87-42f4f797c4b6 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-084b8049-147b-4db4-87aa-de243dbb50fb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 11 23:15:10.171302 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-fe1623e9-3353-4681-bc87-42f4f797c4b6 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-084b8049-147b-4db4-87aa-de243dbb50fb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 11 23:15:10.171302 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-fe1623e9-3353-4681-bc87-42f4f797c4b6 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-084b8049-147b-4db4-87aa-de243dbb50fb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 11 23:15:10.171302 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.iscsi [None req-fe1623e9-3353-4681-bc87-42f4f797c4b6 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 11 23:15:10.171302 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-fe1623e9-3353-4681-bc87-42f4f797c4b6 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-084b8049-147b-4db4-87aa-de243dbb50fb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 11 23:15:10.171810 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.iscsi [None req-fe1623e9-3353-4681-bc87-42f4f797c4b6 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 11 23:15:10.186290 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe1623e9-3353-4681-bc87-42f4f797c4b6 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 11 23:15:10.186290 np0000002687 nova-compute[98431]: {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:15:10.193533 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe1623e9-3353-4681-bc87-42f4f797c4b6 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 11 23:15:10.193533 np0000002687 nova-compute[98431]: {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:15:10.201044 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe1623e9-3353-4681-bc87-42f4f797c4b6 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-084b8049-147b-4db4-87aa-de243dbb50fb] added Jun 11 23:15:10.201044 np0000002687 nova-compute[98431]: stderr=iscsiadm: Config file line 363 does not have value Jun 11 23:15:10.201044 np0000002687 nova-compute[98431]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 11 23:15:10.201044 np0000002687 nova-compute[98431]: iscsiadm: Config file line 363 does not have value Jun 11 23:15:10.201044 np0000002687 nova-compute[98431]: iscsiadm: Config file line 363 does not have value Jun 11 23:15:10.201044 np0000002687 nova-compute[98431]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 11 23:15:10.201044 np0000002687 nova-compute[98431]: {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:15:10.201409 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe1623e9-3353-4681-bc87-42f4f797c4b6 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98431) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 11 23:15:10.201506 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-fe1623e9-3353-4681-bc87-42f4f797c4b6 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.03(s), this was the 1st time calling it. {{(pid=98431) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 11 23:15:10.201691 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-fe1623e9-3353-4681-bc87-42f4f797c4b6 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98431) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 11 23:15:10.207628 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe1623e9-3353-4681-bc87-42f4f797c4b6 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-084b8049-147b-4db4-87aa-de243dbb50fb] added Jun 11 23:15:10.207628 np0000002687 nova-compute[98431]: stderr=iscsiadm: Config file line 363 does not have value Jun 11 23:15:10.207628 np0000002687 nova-compute[98431]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 11 23:15:10.207628 np0000002687 nova-compute[98431]: iscsiadm: Config file line 363 does not have value Jun 11 23:15:10.207628 np0000002687 nova-compute[98431]: iscsiadm: Config file line 363 does not have value Jun 11 23:15:10.207628 np0000002687 nova-compute[98431]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 11 23:15:10.207628 np0000002687 nova-compute[98431]: {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:15:10.207997 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe1623e9-3353-4681-bc87-42f4f797c4b6 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98431) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 11 23:15:10.207997 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-fe1623e9-3353-4681-bc87-42f4f797c4b6 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0372(s), this was the 1st time calling it. {{(pid=98431) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 11 23:15:10.208308 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-fe1623e9-3353-4681-bc87-42f4f797c4b6 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98431) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 11 23:15:10.209942 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-bbeb090b-c86d-49f0-b619-a7dd989b10bf tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: cab1cc43-b433-4772-9f01-0197502c8b57] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:15:10.277532 np0000002687 nova-compute[98431]: DEBUG nova.utils [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Queued Task(fn=>, remaining_delay=14.999704616999907 future=) {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:15:10.278072 np0000002687 nova-compute[98431]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=14.999174103000087 future=) {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:15:10.278196 np0000002687 nova-compute[98431]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=14.999010061000035 future=) {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:15:10.342826 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-de917596-6da7-4867-88d0-9e80471c5217 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:15:10.421974 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-de917596-6da7-4867-88d0-9e80471c5217 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:15:10.422435 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-de917596-6da7-4867-88d0-9e80471c5217 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Acquiring lock "refresh_cache-8a45e04f-3516-4c39-bea1-820104411f17" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 11 23:15:10.422679 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-de917596-6da7-4867-88d0-9e80471c5217 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Acquired lock "refresh_cache-8a45e04f-3516-4c39-bea1-820104411f17" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 11 23:15:10.423463 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-de917596-6da7-4867-88d0-9e80471c5217 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] Building network info cache for instance {{(pid=98431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 11 23:15:10.423463 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-de917596-6da7-4867-88d0-9e80471c5217 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lazy-loading 'info_cache' on Instance uuid 8a45e04f-3516-4c39-bea1-820104411f17 {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:15:10.787817 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [-] [instance: f4f629ca-bf55-4dc5-ad80-9136da020657] Updating instance_info_cache with network_info: [] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:15:10.832106 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-94ce8879-3290-4988-a728-1f671906e74c req-4b187cb6-ffa4-4a44-bf7d-c62dfdc6c46b service nova] [instance: f4f629ca-bf55-4dc5-ad80-9136da020657] Received event network-vif-unplugged-ed253e02-f0d4-4a82-a7bc-4d4558e9d645 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:15:10.832229 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-94ce8879-3290-4988-a728-1f671906e74c req-4b187cb6-ffa4-4a44-bf7d-c62dfdc6c46b service nova] Acquiring lock "f4f629ca-bf55-4dc5-ad80-9136da020657-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:15:10.835715 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-94ce8879-3290-4988-a728-1f671906e74c req-4b187cb6-ffa4-4a44-bf7d-c62dfdc6c46b service nova] Lock "f4f629ca-bf55-4dc5-ad80-9136da020657-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:15:10.835715 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-94ce8879-3290-4988-a728-1f671906e74c req-4b187cb6-ffa4-4a44-bf7d-c62dfdc6c46b service nova] Lock "f4f629ca-bf55-4dc5-ad80-9136da020657-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:15:10.835715 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-94ce8879-3290-4988-a728-1f671906e74c req-4b187cb6-ffa4-4a44-bf7d-c62dfdc6c46b service nova] [instance: f4f629ca-bf55-4dc5-ad80-9136da020657] No waiting events found dispatching network-vif-unplugged-ed253e02-f0d4-4a82-a7bc-4d4558e9d645 {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:15:10.835715 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-94ce8879-3290-4988-a728-1f671906e74c req-4b187cb6-ffa4-4a44-bf7d-c62dfdc6c46b service nova] [instance: f4f629ca-bf55-4dc5-ad80-9136da020657] Received event network-vif-unplugged-ed253e02-f0d4-4a82-a7bc-4d4558e9d645 for instance with task_state deleting. {{(pid=98431) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 11 23:15:10.921228 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ffa4bbe-7ead-4029-aba5-28f031f6e784/disk --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:15:11.008504 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ffa4bbe-7ead-4029-aba5-28f031f6e784/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:15:11.008984 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ffa4bbe-7ead-4029-aba5-28f031f6e784/disk --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:15:11.117866 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ffa4bbe-7ead-4029-aba5-28f031f6e784/disk --force-share --output=json" returned: 0 in 0.108s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:15:11.121949 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd1dd46c-2231-40b4-aa61-0121733a932d/disk --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:15:11.203431 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.iscsi [None req-fe1623e9-3353-4681-bc87-42f4f797c4b6 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 11 23:15:11.211430 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.iscsi [None req-fe1623e9-3353-4681-bc87-42f4f797c4b6 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 11 23:15:11.220042 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe1623e9-3353-4681-bc87-42f4f797c4b6 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 11 23:15:11.220042 np0000002687 nova-compute[98431]: node.name = iqn.2023-03.storpool.com:os--volume-084b8049-147b-4db4-87aa-de243dbb50fb Jun 11 23:15:11.220042 np0000002687 nova-compute[98431]: node.tpgt = -1 Jun 11 23:15:11.220042 np0000002687 nova-compute[98431]: node.startup = manual Jun 11 23:15:11.220042 np0000002687 nova-compute[98431]: node.leading_login = No Jun 11 23:15:11.220042 np0000002687 nova-compute[98431]: iface.iscsi_ifacename = default Jun 11 23:15:11.220042 np0000002687 nova-compute[98431]: iface.net_ifacename = Jun 11 23:15:11.220042 np0000002687 nova-compute[98431]: iface.ipaddress = Jun 11 23:15:11.220042 np0000002687 nova-compute[98431]: iface.prefix_len = 0 Jun 11 23:15:11.220042 np0000002687 nova-compute[98431]: iface.hwaddress = Jun 11 23:15:11.220042 np0000002687 nova-compute[98431]: iface.transport_name = tcp Jun 11 23:15:11.220042 np0000002687 nova-compute[98431]: iface.initiatorname = Jun 11 23:15:11.220042 np0000002687 nova-compute[98431]: iface.state = Jun 11 23:15:11.220042 np0000002687 nova-compute[98431]: iface.vlan_id = 0 Jun 11 23:15:11.220042 np0000002687 nova-compute[98431]: iface.vlan_priority = 0 Jun 11 23:15:11.220042 np0000002687 nova-compute[98431]: iface.vlan_state = Jun 11 23:15:11.220042 np0000002687 nova-compute[98431]: iface.iface_num = 0 Jun 11 23:15:11.220042 np0000002687 nova-compute[98431]: iface.mtu = 0 Jun 11 23:15:11.220042 np0000002687 nova-compute[98431]: iface.port = 0 Jun 11 23:15:11.220042 np0000002687 nova-compute[98431]: iface.bootproto = Jun 11 23:15:11.220042 np0000002687 nova-compute[98431]: iface.subnet_mask = Jun 11 23:15:11.220042 np0000002687 nova-compute[98431]: iface.gateway = Jun 11 23:15:11.220042 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id_state = Jun 11 23:15:11.220042 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id = Jun 11 23:15:11.220042 np0000002687 nova-compute[98431]: iface.dhcp_dns = Jun 11 23:15:11.220042 np0000002687 nova-compute[98431]: iface.dhcp_learn_iqn = Jun 11 23:15:11.220042 np0000002687 nova-compute[98431]: iface.dhcp_req_vendor_id_state = Jun 11 23:15:11.220042 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id_state = Jun 11 23:15:11.220042 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id = Jun 11 23:15:11.220042 np0000002687 nova-compute[98431]: iface.dhcp_slp_da = Jun 11 23:15:11.220042 np0000002687 nova-compute[98431]: iface.fragmentation = Jun 11 23:15:11.220042 np0000002687 nova-compute[98431]: iface.gratuitous_arp = Jun 11 23:15:11.220042 np0000002687 nova-compute[98431]: iface.incoming_forwarding = Jun 11 23:15:11.220042 np0000002687 nova-compute[98431]: iface.tos_state = Jun 11 23:15:11.220042 np0000002687 nova-compute[98431]: iface.tos = 0 Jun 11 23:15:11.220042 np0000002687 nova-compute[98431]: iface.ttl = 0 Jun 11 23:15:11.220042 np0000002687 nova-compute[98431]: iface.delayed_ack = Jun 11 23:15:11.220042 np0000002687 nova-compute[98431]: iface.tcp_nagle = Jun 11 23:15:11.220042 np0000002687 nova-compute[98431]: iface.tcp_wsf_state = Jun 11 23:15:11.220042 np0000002687 nova-compute[98431]: iface.tcp_wsf = 0 Jun 11 23:15:11.220042 np0000002687 nova-compute[98431]: iface.tcp_timer_scale = 0 Jun 11 23:15:11.220042 np0000002687 nova-compute[98431]: iface.tcp_timestamp = Jun 11 23:15:11.220042 np0000002687 nova-compute[98431]: iface.redirect = Jun 11 23:15:11.220042 np0000002687 nova-compute[98431]: iface.def_task_mgmt_timeout = 0 Jun 11 23:15:11.220042 np0000002687 nova-compute[98431]: iface.header_digest = Jun 11 23:15:11.220042 np0000002687 nova-compute[98431]: iface.data_digest = Jun 11 23:15:11.220042 np0000002687 nova-compute[98431]: iface.immediate_data = Jun 11 23:15:11.220042 np0000002687 nova-compute[98431]: iface.initial_r2t = Jun 11 23:15:11.220042 np0000002687 nova-compute[98431]: iface.data_seq_inorder = Jun 11 23:15:11.220042 np0000002687 nova-compute[98431]: iface.data_pdu_inorder = Jun 11 23:15:11.220042 np0000002687 nova-compute[98431]: iface.erl = 0 Jun 11 23:15:11.220042 np0000002687 nova-compute[98431]: iface.max_receive_data_len = 0 Jun 11 23:15:11.220042 np0000002687 nova-compute[98431]: iface.first_burst_len = 0 Jun 11 23:15:11.220042 np0000002687 nova-compute[98431]: iface.max_outstanding_r2t = 0 Jun 11 23:15:11.220042 np0000002687 nova-compute[98431]: iface.max_burst_len = 0 Jun 11 23:15:11.220042 np0000002687 nova-compute[98431]: iface.chap_auth = Jun 11 23:15:11.220042 np0000002687 nova-compute[98431]: iface.bidi_chap = Jun 11 23:15:11.220042 np0000002687 nova-compute[98431]: iface.strict_login_compliance = Jun 11 23:15:11.220042 np0000002687 nova-compute[98431]: iface.discovery_auth = Jun 11 23:15:11.220042 np0000002687 nova-compute[98431]: iface.discovery_logout = Jun 11 23:15:11.220042 np0000002687 nova-compute[98431]: node.discovery_address = Jun 11 23:15:11.220042 np0000002687 nova-compute[98431]: node.discovery_port = 0 Jun 11 23:15:11.220042 np0000002687 nova-compute[98431]: node.discovery_type = fw Jun 11 23:15:11.220042 np0000002687 nova-compute[98431]: node.session.initial_cmdsn = 0 Jun 11 23:15:11.220042 np0000002687 nova-compute[98431]: node.session.initial_login_retry_max = 8 Jun 11 23:15:11.220042 np0000002687 nova-compute[98431]: node.session.xmit_thread_priority = 0 Jun 11 23:15:11.220042 np0000002687 nova-compute[98431]: node.session.cmds_max = 128 Jun 11 23:15:11.220042 np0000002687 nova-compute[98431]: node.session.queue_depth = 32 Jun 11 23:15:11.220042 np0000002687 nova-compute[98431]: node.session.nr_sessions = 1 Jun 11 23:15:11.220042 np0000002687 nova-compute[98431]: node.session.auth.authmethod = None Jun 11 23:15:11.220042 np0000002687 nova-compute[98431]: node.session.auth.username = Jun 11 23:15:11.220042 np0000002687 nova-compute[98431]: node.session.auth.password = *** Jun 11 23:15:11.220042 np0000002687 nova-compute[98431]: node.session.auth.username_in = Jun 11 23:15:11.220042 np0000002687 nova-compute[98431]: node.session.auth.password_in = Jun 11 23:15:11.220042 np0000002687 nova-compute[98431]: node.session.auth.chap_algs = SHA256 Jun 11 23:15:11.220042 np0000002687 nova-compute[98431]: node.session.timeo.replacement_timeout = 120 Jun 11 23:15:11.220042 np0000002687 nova-compute[98431]: node.session.err_timeo.abort_timeout = 15 Jun 11 23:15:11.220042 np0000002687 nova-compute[98431]: node.session.err_timeo.lu_reset_timeout = 30 Jun 11 23:15:11.220042 np0000002687 nova-compute[98431]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 11 23:15:11.220042 np0000002687 nova-compute[98431]: node.session.err_timeo.host_reset_timeout = 60 Jun 11 23:15:11.220042 np0000002687 nova-compute[98431]: node.session.iscsi.FastAbort = Yes Jun 11 23:15:11.220042 np0000002687 nova-compute[98431]: node.session.iscsi.InitialR2T = No Jun 11 23:15:11.220042 np0000002687 nova-compute[98431]: node.session.iscsi.ImmediateData = Yes Jun 11 23:15:11.220042 np0000002687 nova-compute[98431]: node.session.iscsi.FirstBurstLength = 262144 Jun 11 23:15:11.220042 np0000002687 nova-compute[98431]: node.session.iscsi.MaxBurstLength = 16776192 Jun 11 23:15:11.220042 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Retain = 0 Jun 11 23:15:11.220042 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Wait = 2 Jun 11 23:15:11.220042 np0000002687 nova-compute[98431]: node.session.iscsi.MaxConnections = 1 Jun 11 23:15:11.220042 np0000002687 nova-compute[98431]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 11 23:15:11.220042 np0000002687 nova-compute[98431]: node.session.iscsi.ERL = 0 Jun 11 23:15:11.220042 np0000002687 nova-compute[98431]: node.session.scan = auto Jun 11 23:15:11.220042 np0000002687 nova-compute[98431]: node.session.reopen_max = 0 Jun 11 23:15:11.220042 np0000002687 nova-compute[98431]: node.conn[0].address = 192.168.50.100 Jun 11 23:15:11.220042 np0000002687 nova-compute[98431]: node.conn[0].port = 3260 Jun 11 23:15:11.220042 np0000002687 nova-compute[98431]: node.conn[0].startup = manual Jun 11 23:15:11.220042 np0000002687 nova-compute[98431]: node.conn[0].tcp.window_size = 524288 Jun 11 23:15:11.220042 np0000002687 nova-compute[98431]: node.conn[0].tcp.type_of_service = 0 Jun 11 23:15:11.220042 np0000002687 nova-compute[98431]: node.conn[0].timeo.logout_timeout = 15 Jun 11 23:15:11.220042 np0000002687 nova-compute[98431]: node.conn[0].timeo.login_timeout = 15 Jun 11 23:15:11.220042 np0000002687 nova-compute[98431]: node.conn[0].timeo.auth_timeout = 45 Jun 11 23:15:11.220042 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_interval = 5 Jun 11 23:15:11.220042 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_timeout = 5 Jun 11 23:15:11.220042 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 11 23:15:11.220042 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 11 23:15:11.220042 np0000002687 nova-compute[98431]: node.conn[0].iscsi.HeaderDigest = None Jun 11 23:15:11.220042 np0000002687 nova-compute[98431]: node.conn[0].iscsi.DataDigest = None Jun 11 23:15:11.220042 np0000002687 nova-compute[98431]: node.conn[0].iscsi.IFMarker = No Jun 11 23:15:11.220042 np0000002687 nova-compute[98431]: node.conn[0].iscsi.OFMarker = No Jun 11 23:15:11.220042 np0000002687 nova-compute[98431]: # END RECORD Jun 11 23:15:11.220042 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:15:11.223121 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd1dd46c-2231-40b4-aa61-0121733a932d/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:15:11.223121 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd1dd46c-2231-40b4-aa61-0121733a932d/disk --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:15:11.239826 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe1623e9-3353-4681-bc87-42f4f797c4b6 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:15:11.240077 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe1623e9-3353-4681-bc87-42f4f797c4b6 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 11 23:15:11.240077 np0000002687 nova-compute[98431]: node.name = iqn.2023-03.storpool.com:os--volume-084b8049-147b-4db4-87aa-de243dbb50fb Jun 11 23:15:11.240077 np0000002687 nova-compute[98431]: node.tpgt = -1 Jun 11 23:15:11.240077 np0000002687 nova-compute[98431]: node.startup = manual Jun 11 23:15:11.240077 np0000002687 nova-compute[98431]: node.leading_login = No Jun 11 23:15:11.240077 np0000002687 nova-compute[98431]: iface.iscsi_ifacename = default Jun 11 23:15:11.240077 np0000002687 nova-compute[98431]: iface.net_ifacename = Jun 11 23:15:11.240077 np0000002687 nova-compute[98431]: iface.ipaddress = Jun 11 23:15:11.240077 np0000002687 nova-compute[98431]: iface.prefix_len = 0 Jun 11 23:15:11.240077 np0000002687 nova-compute[98431]: iface.hwaddress = Jun 11 23:15:11.240077 np0000002687 nova-compute[98431]: iface.transport_name = tcp Jun 11 23:15:11.240077 np0000002687 nova-compute[98431]: iface.initiatorname = Jun 11 23:15:11.240077 np0000002687 nova-compute[98431]: iface.state = Jun 11 23:15:11.240077 np0000002687 nova-compute[98431]: iface.vlan_id = 0 Jun 11 23:15:11.240077 np0000002687 nova-compute[98431]: iface.vlan_priority = 0 Jun 11 23:15:11.240077 np0000002687 nova-compute[98431]: iface.vlan_state = Jun 11 23:15:11.240077 np0000002687 nova-compute[98431]: iface.iface_num = 0 Jun 11 23:15:11.240077 np0000002687 nova-compute[98431]: iface.mtu = 0 Jun 11 23:15:11.240077 np0000002687 nova-compute[98431]: iface.port = 0 Jun 11 23:15:11.240077 np0000002687 nova-compute[98431]: iface.bootproto = Jun 11 23:15:11.240077 np0000002687 nova-compute[98431]: iface.subnet_mask = Jun 11 23:15:11.240077 np0000002687 nova-compute[98431]: iface.gateway = Jun 11 23:15:11.240077 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id_state = Jun 11 23:15:11.240077 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id = Jun 11 23:15:11.240077 np0000002687 nova-compute[98431]: iface.dhcp_dns = Jun 11 23:15:11.240077 np0000002687 nova-compute[98431]: iface.dhcp_learn_iqn = Jun 11 23:15:11.240077 np0000002687 nova-compute[98431]: iface.dhcp_req_vendor_id_state = Jun 11 23:15:11.240077 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id_state = Jun 11 23:15:11.240077 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id = Jun 11 23:15:11.240077 np0000002687 nova-compute[98431]: iface.dhcp_slp_da = Jun 11 23:15:11.240077 np0000002687 nova-compute[98431]: iface.fragmentation = Jun 11 23:15:11.240077 np0000002687 nova-compute[98431]: iface.gratuitous_arp = Jun 11 23:15:11.240077 np0000002687 nova-compute[98431]: iface.incoming_forwarding = Jun 11 23:15:11.240077 np0000002687 nova-compute[98431]: iface.tos_state = Jun 11 23:15:11.240077 np0000002687 nova-compute[98431]: iface.tos = 0 Jun 11 23:15:11.240077 np0000002687 nova-compute[98431]: iface.ttl = 0 Jun 11 23:15:11.240077 np0000002687 nova-compute[98431]: iface.delayed_ack = Jun 11 23:15:11.240077 np0000002687 nova-compute[98431]: iface.tcp_nagle = Jun 11 23:15:11.240077 np0000002687 nova-compute[98431]: iface.tcp_wsf_state = Jun 11 23:15:11.240077 np0000002687 nova-compute[98431]: iface.tcp_wsf = 0 Jun 11 23:15:11.240077 np0000002687 nova-compute[98431]: iface.tcp_timer_scale = 0 Jun 11 23:15:11.240077 np0000002687 nova-compute[98431]: iface.tcp_timestamp = Jun 11 23:15:11.240077 np0000002687 nova-compute[98431]: iface.redirect = Jun 11 23:15:11.240077 np0000002687 nova-compute[98431]: iface.def_task_mgmt_timeout = 0 Jun 11 23:15:11.240077 np0000002687 nova-compute[98431]: iface.header_digest = Jun 11 23:15:11.240077 np0000002687 nova-compute[98431]: iface.data_digest = Jun 11 23:15:11.240077 np0000002687 nova-compute[98431]: iface.immediate_data = Jun 11 23:15:11.240077 np0000002687 nova-compute[98431]: iface.initial_r2t = Jun 11 23:15:11.240077 np0000002687 nova-compute[98431]: iface.data_seq_inorder = Jun 11 23:15:11.240077 np0000002687 nova-compute[98431]: iface.data_pdu_inorder = Jun 11 23:15:11.240077 np0000002687 nova-compute[98431]: iface.erl = 0 Jun 11 23:15:11.240077 np0000002687 nova-compute[98431]: iface.max_receive_data_len = 0 Jun 11 23:15:11.240077 np0000002687 nova-compute[98431]: iface.first_burst_len = 0 Jun 11 23:15:11.240077 np0000002687 nova-compute[98431]: iface.max_outstanding_r2t = 0 Jun 11 23:15:11.240077 np0000002687 nova-compute[98431]: iface.max_burst_len = 0 Jun 11 23:15:11.240077 np0000002687 nova-compute[98431]: iface.chap_auth = Jun 11 23:15:11.240077 np0000002687 nova-compute[98431]: iface.bidi_chap = Jun 11 23:15:11.240077 np0000002687 nova-compute[98431]: iface.strict_login_compliance = Jun 11 23:15:11.240077 np0000002687 nova-compute[98431]: iface.discovery_auth = Jun 11 23:15:11.240077 np0000002687 nova-compute[98431]: iface.discovery_logout = Jun 11 23:15:11.240077 np0000002687 nova-compute[98431]: node.discovery_address = Jun 11 23:15:11.240077 np0000002687 nova-compute[98431]: node.discovery_port = 0 Jun 11 23:15:11.240077 np0000002687 nova-compute[98431]: node.discovery_type = fw Jun 11 23:15:11.240077 np0000002687 nova-compute[98431]: node.session.initial_cmdsn = 0 Jun 11 23:15:11.240077 np0000002687 nova-compute[98431]: node.session.initial_login_retry_max = 8 Jun 11 23:15:11.240077 np0000002687 nova-compute[98431]: node.session.xmit_thread_priority = 0 Jun 11 23:15:11.240077 np0000002687 nova-compute[98431]: node.session.cmds_max = 128 Jun 11 23:15:11.240077 np0000002687 nova-compute[98431]: node.session.queue_depth = 32 Jun 11 23:15:11.240077 np0000002687 nova-compute[98431]: node.session.nr_sessions = 1 Jun 11 23:15:11.240077 np0000002687 nova-compute[98431]: node.session.auth.authmethod = None Jun 11 23:15:11.240077 np0000002687 nova-compute[98431]: node.session.auth.username = Jun 11 23:15:11.240077 np0000002687 nova-compute[98431]: node.session.auth.password = *** Jun 11 23:15:11.240077 np0000002687 nova-compute[98431]: node.session.auth.username_in = Jun 11 23:15:11.240077 np0000002687 nova-compute[98431]: node.session.auth.password_in = Jun 11 23:15:11.240077 np0000002687 nova-compute[98431]: node.session.auth.chap_algs = SHA256 Jun 11 23:15:11.240077 np0000002687 nova-compute[98431]: node.session.timeo.replacement_timeout = 120 Jun 11 23:15:11.240077 np0000002687 nova-compute[98431]: node.session.err_timeo.abort_timeout = 15 Jun 11 23:15:11.240077 np0000002687 nova-compute[98431]: node.session.err_timeo.lu_reset_timeout = 30 Jun 11 23:15:11.240077 np0000002687 nova-compute[98431]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 11 23:15:11.240077 np0000002687 nova-compute[98431]: node.session.err_timeo.host_reset_timeout = 60 Jun 11 23:15:11.240077 np0000002687 nova-compute[98431]: node.session.iscsi.FastAbort = Yes Jun 11 23:15:11.240077 np0000002687 nova-compute[98431]: node.session.iscsi.InitialR2T = No Jun 11 23:15:11.240077 np0000002687 nova-compute[98431]: node.session.iscsi.ImmediateData = Yes Jun 11 23:15:11.240077 np0000002687 nova-compute[98431]: node.session.iscsi.FirstBurstLength = 262144 Jun 11 23:15:11.240077 np0000002687 nova-compute[98431]: node.session.iscsi.MaxBurstLength = 16776192 Jun 11 23:15:11.240077 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Retain = 0 Jun 11 23:15:11.240077 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Wait = 2 Jun 11 23:15:11.240077 np0000002687 nova-compute[98431]: node.session.iscsi.MaxConnections = 1 Jun 11 23:15:11.240077 np0000002687 nova-compute[98431]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 11 23:15:11.240077 np0000002687 nova-compute[98431]: node.session.iscsi.ERL = 0 Jun 11 23:15:11.240077 np0000002687 nova-compute[98431]: node.session.scan = auto Jun 11 23:15:11.240077 np0000002687 nova-compute[98431]: node.session.reopen_max = 0 Jun 11 23:15:11.240077 np0000002687 nova-compute[98431]: node.conn[0].address = 192.168.40.100 Jun 11 23:15:11.240077 np0000002687 nova-compute[98431]: node.conn[0].port = 3260 Jun 11 23:15:11.240077 np0000002687 nova-compute[98431]: node.conn[0].startup = manual Jun 11 23:15:11.240077 np0000002687 nova-compute[98431]: node.conn[0].tcp.window_size = 524288 Jun 11 23:15:11.240077 np0000002687 nova-compute[98431]: node.conn[0].tcp.type_of_service = 0 Jun 11 23:15:11.240077 np0000002687 nova-compute[98431]: node.conn[0].timeo.logout_timeout = 15 Jun 11 23:15:11.240077 np0000002687 nova-compute[98431]: node.conn[0].timeo.login_timeout = 15 Jun 11 23:15:11.240077 np0000002687 nova-compute[98431]: node.conn[0].timeo.auth_timeout = 45 Jun 11 23:15:11.240077 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_interval = 5 Jun 11 23:15:11.240077 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_timeout = 5 Jun 11 23:15:11.240077 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 11 23:15:11.240077 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 11 23:15:11.240077 np0000002687 nova-compute[98431]: node.conn[0].iscsi.HeaderDigest = None Jun 11 23:15:11.240077 np0000002687 nova-compute[98431]: node.conn[0].iscsi.DataDigest = None Jun 11 23:15:11.240077 np0000002687 nova-compute[98431]: node.conn[0].iscsi.IFMarker = No Jun 11 23:15:11.240077 np0000002687 nova-compute[98431]: node.conn[0].iscsi.OFMarker = No Jun 11 23:15:11.240077 np0000002687 nova-compute[98431]: # END RECORD Jun 11 23:15:11.240077 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:15:11.257482 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe1623e9-3353-4681-bc87-42f4f797c4b6 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:15:11.264700 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe1623e9-3353-4681-bc87-42f4f797c4b6 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:15:11.264700 np0000002687 nova-compute[98431]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:15:11.264700 np0000002687 nova-compute[98431]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:15:11.264700 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:15:11.264700 np0000002687 nova-compute[98431]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1 (non-flash) Jun 11 23:15:11.264700 np0000002687 nova-compute[98431]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1 (non-flash) Jun 11 23:15:11.264700 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:15:11.265084 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe1623e9-3353-4681-bc87-42f4f797c4b6 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:15:11.265084 np0000002687 nova-compute[98431]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:15:11.265084 np0000002687 nova-compute[98431]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:15:11.265084 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:15:11.265084 np0000002687 nova-compute[98431]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1 (non-flash) Jun 11 23:15:11.265084 np0000002687 nova-compute[98431]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1 (non-flash) Jun 11 23:15:11.265084 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:15:11.275431 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe1623e9-3353-4681-bc87-42f4f797c4b6 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:15:11.275431 np0000002687 nova-compute[98431]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:15:11.275431 np0000002687 nova-compute[98431]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:15:11.275431 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:15:11.275431 np0000002687 nova-compute[98431]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1 (non-flash) Jun 11 23:15:11.275431 np0000002687 nova-compute[98431]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1 (non-flash) Jun 11 23:15:11.275431 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:15:11.275431 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe1623e9-3353-4681-bc87-42f4f797c4b6 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:15:11.275431 np0000002687 nova-compute[98431]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:15:11.275431 np0000002687 nova-compute[98431]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:15:11.275431 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:15:11.275431 np0000002687 nova-compute[98431]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1 (non-flash) Jun 11 23:15:11.275431 np0000002687 nova-compute[98431]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1 (non-flash) Jun 11 23:15:11.275431 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:15:11.291325 np0000002687 nova-compute[98431]: INFO nova.compute.manager [-] [instance: f4f629ca-bf55-4dc5-ad80-9136da020657] Took 1.37 seconds to deallocate network for instance. Jun 11 23:15:11.308244 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe1623e9-3353-4681-bc87-42f4f797c4b6 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-084b8049-147b-4db4-87aa-de243dbb50fb, portal: 192.168.50.100,3260] Jun 11 23:15:11.308244 np0000002687 nova-compute[98431]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-084b8049-147b-4db4-87aa-de243dbb50fb, portal: 192.168.50.100,3260] successful. Jun 11 23:15:11.308244 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:15:11.314130 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe1623e9-3353-4681-bc87-42f4f797c4b6 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-084b8049-147b-4db4-87aa-de243dbb50fb, portal: 192.168.40.100,3260] Jun 11 23:15:11.314130 np0000002687 nova-compute[98431]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-084b8049-147b-4db4-87aa-de243dbb50fb, portal: 192.168.40.100,3260] successful. Jun 11 23:15:11.314130 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:15:11.328157 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe1623e9-3353-4681-bc87-42f4f797c4b6 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:15:11.340025 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd1dd46c-2231-40b4-aa61-0121733a932d/disk --force-share --output=json" returned: 0 in 0.119s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:15:11.341014 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe1623e9-3353-4681-bc87-42f4f797c4b6 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:15:11.348402 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98431) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12344}} Jun 11 23:15:11.354309 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae596459-1e34-4a2a-9a33-69a02f50fd1c/disk --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:15:11.373845 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe1623e9-3353-4681-bc87-42f4f797c4b6 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:15:11.373845 np0000002687 nova-compute[98431]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:15:11.373845 np0000002687 nova-compute[98431]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:15:11.373845 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:15:11.373845 np0000002687 nova-compute[98431]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1 (non-flash) Jun 11 23:15:11.373845 np0000002687 nova-compute[98431]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1 (non-flash) Jun 11 23:15:11.373845 np0000002687 nova-compute[98431]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-084b8049-147b-4db4-87aa-de243dbb50fb (non-flash) Jun 11 23:15:11.373845 np0000002687 nova-compute[98431]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-084b8049-147b-4db4-87aa-de243dbb50fb (non-flash) Jun 11 23:15:11.373845 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:15:11.374207 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe1623e9-3353-4681-bc87-42f4f797c4b6 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:15:11.374207 np0000002687 nova-compute[98431]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:15:11.374207 np0000002687 nova-compute[98431]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:15:11.374207 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:15:11.374207 np0000002687 nova-compute[98431]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1 (non-flash) Jun 11 23:15:11.374207 np0000002687 nova-compute[98431]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1 (non-flash) Jun 11 23:15:11.374207 np0000002687 nova-compute[98431]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-084b8049-147b-4db4-87aa-de243dbb50fb (non-flash) Jun 11 23:15:11.374207 np0000002687 nova-compute[98431]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-084b8049-147b-4db4-87aa-de243dbb50fb (non-flash) Jun 11 23:15:11.374207 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:15:11.375537 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe1623e9-3353-4681-bc87-42f4f797c4b6 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:15:11.375537 np0000002687 nova-compute[98431]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:15:11.375537 np0000002687 nova-compute[98431]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:15:11.375537 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:15:11.375537 np0000002687 nova-compute[98431]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1 (non-flash) Jun 11 23:15:11.375537 np0000002687 nova-compute[98431]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1 (non-flash) Jun 11 23:15:11.375537 np0000002687 nova-compute[98431]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-084b8049-147b-4db4-87aa-de243dbb50fb (non-flash) Jun 11 23:15:11.375537 np0000002687 nova-compute[98431]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-084b8049-147b-4db4-87aa-de243dbb50fb (non-flash) Jun 11 23:15:11.375537 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:15:11.375711 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe1623e9-3353-4681-bc87-42f4f797c4b6 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:15:11.375711 np0000002687 nova-compute[98431]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:15:11.375711 np0000002687 nova-compute[98431]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:15:11.375711 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:15:11.375711 np0000002687 nova-compute[98431]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1 (non-flash) Jun 11 23:15:11.375711 np0000002687 nova-compute[98431]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1 (non-flash) Jun 11 23:15:11.375711 np0000002687 nova-compute[98431]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-084b8049-147b-4db4-87aa-de243dbb50fb (non-flash) Jun 11 23:15:11.375711 np0000002687 nova-compute[98431]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-084b8049-147b-4db4-87aa-de243dbb50fb (non-flash) Jun 11 23:15:11.375711 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:15:11.376219 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-fe1623e9-3353-4681-bc87-42f4f797c4b6 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-084b8049-147b-4db4-87aa-de243dbb50fb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.205s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 11 23:15:11.376453 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe1623e9-3353-4681-bc87-42f4f797c4b6 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Connected to 192.168.50.100:3260 {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 11 23:15:11.378082 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-fe1623e9-3353-4681-bc87-42f4f797c4b6 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] HCTL ('9', '-', '-', 0) found on session 48 with lun 0 {{(pid=98431) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 11 23:15:11.378554 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-fe1623e9-3353-4681-bc87-42f4f797c4b6 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98431) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 11 23:15:11.378682 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-fe1623e9-3353-4681-bc87-42f4f797c4b6 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-084b8049-147b-4db4-87aa-de243dbb50fb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.208s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 11 23:15:11.378931 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe1623e9-3353-4681-bc87-42f4f797c4b6 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Connected to 192.168.40.100:3260 {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 11 23:15:11.380562 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-fe1623e9-3353-4681-bc87-42f4f797c4b6 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] HCTL ('10', '-', '-', 0) found on session 49 with lun 0 {{(pid=98431) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 11 23:15:11.380562 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-fe1623e9-3353-4681-bc87-42f4f797c4b6 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98431) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 11 23:15:11.426264 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-fe1623e9-3353-4681-bc87-42f4f797c4b6 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Searching for a device in session 48 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98431) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 11 23:15:11.426264 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe1623e9-3353-4681-bc87-42f4f797c4b6 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-084b8049-147b-4db4-87aa-de243dbb50fb', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '084b8049-147b-4db4-87aa-de243dbb50fb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 11 23:15:11.426264 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-fe1623e9-3353-4681-bc87-42f4f797c4b6 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Searching for a device in session 49 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98431) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 11 23:15:11.426264 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe1623e9-3353-4681-bc87-42f4f797c4b6 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-084b8049-147b-4db4-87aa-de243dbb50fb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '084b8049-147b-4db4-87aa-de243dbb50fb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 11 23:15:11.438960 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-de917596-6da7-4867-88d0-9e80471c5217 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:15:11.456740 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae596459-1e34-4a2a-9a33-69a02f50fd1c/disk --force-share --output=json" returned: 0 in 0.098s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:15:11.456740 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae596459-1e34-4a2a-9a33-69a02f50fd1c/disk --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:15:11.586134 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-f9714b9a-8570-418f-8c2b-4fc128dae8e7 req-792fbeef-5ade-4da5-98ab-b17e183e5196 service nova] [instance: f4f629ca-bf55-4dc5-ad80-9136da020657] Received event network-vif-deleted-ed253e02-f0d4-4a82-a7bc-4d4558e9d645 {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:15:11.595784 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae596459-1e34-4a2a-9a33-69a02f50fd1c/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:15:11.600825 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a45e04f-3516-4c39-bea1-820104411f17/disk --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:15:11.709729 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a45e04f-3516-4c39-bea1-820104411f17/disk --force-share --output=json" returned: 0 in 0.109s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:15:11.710570 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a45e04f-3516-4c39-bea1-820104411f17/disk --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:15:11.797437 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a45e04f-3516-4c39-bea1-820104411f17/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:15:11.797929 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] skipping disk /dev/dm-7 (vdb) as it is a volume {{(pid=98431) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12344}} Jun 11 23:15:11.801052 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9271160-14ef-4a59-8ac8-89efbe36c607/disk --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:15:11.829352 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-7b53294f-4e73-4abb-988d-cfd2f172e425 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:15:11.829939 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-7b53294f-4e73-4abb-988d-cfd2f172e425 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:15:11.920437 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9271160-14ef-4a59-8ac8-89efbe36c607/disk --force-share --output=json" returned: 0 in 0.119s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:15:11.920675 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9271160-14ef-4a59-8ac8-89efbe36c607/disk --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:15:12.009687 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9271160-14ef-4a59-8ac8-89efbe36c607/disk --force-share --output=json" returned: 0 in 0.088s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:15:12.014662 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64d7833a-82e8-43e9-83ed-2507197b69bf/disk --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:15:12.054318 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-de917596-6da7-4867-88d0-9e80471c5217 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:15:12.106941 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64d7833a-82e8-43e9-83ed-2507197b69bf/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:15:12.107838 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64d7833a-82e8-43e9-83ed-2507197b69bf/disk --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:15:12.171030 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe1623e9-3353-4681-bc87-42f4f797c4b6 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98431) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 11 23:15:12.218725 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64d7833a-82e8-43e9-83ed-2507197b69bf/disk --force-share --output=json" returned: 0 in 0.110s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:15:12.219454 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] skipping disk /dev/dm-7 (vdb) as it is a volume {{(pid=98431) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12344}} Jun 11 23:15:12.225433 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] skipping disk /dev/dm-4 (vda) as it is a volume {{(pid=98431) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12344}} Jun 11 23:15:12.228201 np0000002687 nova-compute[98431]: WARNING nova.virt.libvirt.driver [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Error from libvirt while getting description of instance-0000001b: [Error Code 42] Domain not found: no domain with matching uuid 'f4f629ca-bf55-4dc5-ad80-9136da020657' (instance-0000001b): libvirt.libvirtError: Domain not found: no domain with matching uuid 'f4f629ca-bf55-4dc5-ad80-9136da020657' (instance-0000001b) Jun 11 23:15:12.232376 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f/disk.rescue --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:15:12.266142 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-de917596-6da7-4867-88d0-9e80471c5217 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] Updating instance_info_cache with network_info: [{"id": "3c04202e-5ce6-4249-ba31-be06996ca75d", "address": "fa:16:3e:6f:42:42", "network": {"id": "17593db3-c22d-4354-ab29-933b1c6a5c3a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1094286565-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "81fd45f475a04e5c8e9bd9deb7ad4c1e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c04202e-5c", "ovs_interfaceid": "3c04202e-5ce6-4249-ba31-be06996ca75d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:15:12.337147 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f/disk.rescue --force-share --output=json" returned: 0 in 0.105s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:15:12.337775 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f/disk.rescue --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:15:12.461295 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-45ff2f84-23d6-444d-811b-4d57be7a22c4 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Acquiring lock "c9271160-14ef-4a59-8ac8-89efbe36c607" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:15:12.462294 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-45ff2f84-23d6-444d-811b-4d57be7a22c4 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Lock "c9271160-14ef-4a59-8ac8-89efbe36c607" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.002s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:15:12.469630 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f/disk.rescue --force-share --output=json" returned: 0 in 0.132s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:15:12.470989 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f/disk --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:15:12.592551 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f/disk --force-share --output=json" returned: 0 in 0.122s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:15:12.593353 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f/disk --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:15:12.697758 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f/disk --force-share --output=json" returned: 0 in 0.104s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:15:12.705832 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/206476b7-d805-4c6c-b7fb-db8b5c2a94a6/disk --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:15:12.772248 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-de917596-6da7-4867-88d0-9e80471c5217 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Releasing lock "refresh_cache-8a45e04f-3516-4c39-bea1-820104411f17" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 11 23:15:12.772708 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-de917596-6da7-4867-88d0-9e80471c5217 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lazy-loading 'migration_context' on Instance uuid 8a45e04f-3516-4c39-bea1-820104411f17 {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:15:12.800017 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/206476b7-d805-4c6c-b7fb-db8b5c2a94a6/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:15:12.800675 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/206476b7-d805-4c6c-b7fb-db8b5c2a94a6/disk --force-share --output=json {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:15:12.849583 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-7b53294f-4e73-4abb-988d-cfd2f172e425 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98431) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 11 23:15:12.850085 np0000002687 nova-compute[98431]: DEBUG nova.compute.provider_tree [None req-7b53294f-4e73-4abb-988d-cfd2f172e425 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Inventory has not changed in ProviderTree for provider: e3e65fe2-9de9-4821-8b4a-ccae37c66e25 {{(pid=98431) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 11 23:15:12.894630 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/206476b7-d805-4c6c-b7fb-db8b5c2a94a6/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:15:12.896933 np0000002687 nova-compute[98431]: WARNING nova.virt.libvirt.driver [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 11 23:15:12.898272 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:15:12.950975 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] CMD "env LANG=C uptime" returned: 0 in 0.042s {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 23:15:12.950975 np0000002687 nova-compute[98431]: DEBUG nova.compute.resource_tracker [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Hypervisor/Node resource view: name=np0000002687 free_ram=11274MB free_disk=74.05176544189453GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}] {{(pid=98431) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}} Jun 11 23:15:12.950975 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:15:12.972875 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-45ff2f84-23d6-444d-811b-4d57be7a22c4 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Lazy-loading 'flavor' on Instance uuid c9271160-14ef-4a59-8ac8-89efbe36c607 {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:15:13.091751 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:15:13.186689 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe1623e9-3353-4681-bc87-42f4f797c4b6 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Found WWN 330000000197fdab1 for multipath device dm-3 {{(pid=98431) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 11 23:15:13.187268 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-fe1623e9-3353-4681-bc87-42f4f797c4b6 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.034s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 11 23:15:13.187526 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe1623e9-3353-4681-bc87-42f4f797c4b6 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] <== connect_volume: return (3034ms) {'type': 'block', 'scsi_wwn': '330000000197fdab1', 'path': '/dev/dm-3', 'multipath_id': '330000000197fdab1'} {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 11 23:15:13.187727 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe1623e9-3353-4681-bc87-42f4f797c4b6 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] [instance: ae596459-1e34-4a2a-9a33-69a02f50fd1c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000197fdab1', 'path': '/dev/dm-3', 'multipath_id': '330000000197fdab1'} {{(pid=98431) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 11 23:15:13.191132 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-fe1623e9-3353-4681-bc87-42f4f797c4b6 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Lazy-loading 'flavor' on Instance uuid ae596459-1e34-4a2a-9a33-69a02f50fd1c {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:15:13.276242 np0000002687 nova-compute[98431]: DEBUG nova.objects.base [None req-de917596-6da7-4867-88d0-9e80471c5217 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Object Instance<8a45e04f-3516-4c39-bea1-820104411f17> lazy-loaded attributes: info_cache,migration_context {{(pid=98431) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 11 23:15:13.287472 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-de917596-6da7-4867-88d0-9e80471c5217 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:15:13.295677 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:15:13.354522 np0000002687 nova-compute[98431]: DEBUG nova.scheduler.client.report [None req-7b53294f-4e73-4abb-988d-cfd2f172e425 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Inventory has not changed for provider e3e65fe2-9de9-4821-8b4a-ccae37c66e25 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98431) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 11 23:15:13.698828 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-fe1623e9-3353-4681-bc87-42f4f797c4b6 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] [instance: ae596459-1e34-4a2a-9a33-69a02f50fd1c] Attempting to attach volume 084b8049-147b-4db4-87aa-de243dbb50fb with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98431) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}} Jun 11 23:15:13.701681 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.guest [None req-fe1623e9-3353-4681-bc87-42f4f797c4b6 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] attach device xml: Jun 11 23:15:13.701681 np0000002687 nova-compute[98431]: Jun 11 23:15:13.701681 np0000002687 nova-compute[98431]: Jun 11 23:15:13.701681 np0000002687 nova-compute[98431]: Jun 11 23:15:13.701681 np0000002687 nova-compute[98431]: Jun 11 23:15:13.701681 np0000002687 nova-compute[98431]: 084b8049-147b-4db4-87aa-de243dbb50fb Jun 11 23:15:13.701681 np0000002687 nova-compute[98431]: Jun 11 23:15:13.701681 np0000002687 nova-compute[98431]: {{(pid=98431) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} Jun 11 23:15:13.866044 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-7b53294f-4e73-4abb-988d-cfd2f172e425 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 2.036s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:15:13.869559 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.924s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:15:13.957055 np0000002687 nova-compute[98431]: INFO nova.scheduler.client.report [None req-7b53294f-4e73-4abb-988d-cfd2f172e425 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Deleted allocations for instance f4f629ca-bf55-4dc5-ad80-9136da020657 Jun 11 23:15:13.986143 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-45ff2f84-23d6-444d-811b-4d57be7a22c4 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Lock "c9271160-14ef-4a59-8ac8-89efbe36c607" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.524s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:15:14.408958 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:15:14.893904 np0000002687 nova-compute[98431]: DEBUG nova.compute.resource_tracker [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Applying migration context for instance 8a45e04f-3516-4c39-bea1-820104411f17 as it has an incoming, in-progress migration 58e91fdb-feef-45c5-9524-61c903923259. Migration status is confirming {{(pid=98431) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1046}} Jun 11 23:15:14.893904 np0000002687 nova-compute[98431]: INFO nova.compute.resource_tracker [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] Updating resource usage from migration 58e91fdb-feef-45c5-9524-61c903923259 Jun 11 23:15:14.968034 np0000002687 nova-compute[98431]: DEBUG nova.compute.resource_tracker [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Instance de4372a4-a0cc-4541-a5a2-87be3152c50e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98431) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 11 23:15:14.968531 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-7b53294f-4e73-4abb-988d-cfd2f172e425 tempest-VolumesActionsTest-1703782237 tempest-VolumesActionsTest-1703782237-project-member] Lock "f4f629ca-bf55-4dc5-ad80-9136da020657" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 6.938s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:15:14.971886 np0000002687 nova-compute[98431]: DEBUG nova.compute.resource_tracker [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Instance 206476b7-d805-4c6c-b7fb-db8b5c2a94a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98431) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 11 23:15:14.971886 np0000002687 nova-compute[98431]: DEBUG nova.compute.resource_tracker [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Instance 8ffa4bbe-7ead-4029-aba5-28f031f6e784 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98431) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 11 23:15:14.971886 np0000002687 nova-compute[98431]: DEBUG nova.compute.resource_tracker [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Instance dd1dd46c-2231-40b4-aa61-0121733a932d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98431) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 11 23:15:14.971886 np0000002687 nova-compute[98431]: DEBUG nova.compute.resource_tracker [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Instance 67b0f75d-ef0a-400e-a39b-bcd6f0c41a9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98431) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 11 23:15:14.971886 np0000002687 nova-compute[98431]: DEBUG nova.compute.resource_tracker [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Instance 64d7833a-82e8-43e9-83ed-2507197b69bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=98431) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 11 23:15:14.971886 np0000002687 nova-compute[98431]: DEBUG nova.compute.resource_tracker [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Instance ae596459-1e34-4a2a-9a33-69a02f50fd1c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98431) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 11 23:15:14.971886 np0000002687 nova-compute[98431]: DEBUG nova.compute.resource_tracker [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Instance 010aa26e-fb15-47ee-a9b7-089dbfdfd1c7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98431) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 11 23:15:14.971886 np0000002687 nova-compute[98431]: DEBUG nova.compute.resource_tracker [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Instance c9271160-14ef-4a59-8ac8-89efbe36c607 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98431) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 11 23:15:14.971886 np0000002687 nova-compute[98431]: DEBUG nova.compute.resource_tracker [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Migration 58e91fdb-feef-45c5-9524-61c903923259 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98431) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1745}} Jun 11 23:15:14.971886 np0000002687 nova-compute[98431]: DEBUG nova.compute.resource_tracker [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Instance 8a45e04f-3516-4c39-bea1-820104411f17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=98431) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 11 23:15:14.971886 np0000002687 nova-compute[98431]: DEBUG nova.compute.resource_tracker [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=98431) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}} Jun 11 23:15:14.971886 np0000002687 nova-compute[98431]: DEBUG nova.compute.resource_tracker [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Final resource view: name=np0000002687 phys_ram=24030MB used_ram=2752MB phys_disk=95GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 23:15:12 up 30 min, 2 users, load average: 9.52, 7.02, 3.45\n', 'num_instances': '10', 'num_vm_active': '8', 'num_task_None': '10', 'num_os_type_None': '10', 'num_proj_81fd45f475a04e5c8e9bd9deb7ad4c1e': '5', 'io_workload': '0', 'num_vm_resized': '1', 'num_proj_b2b9f55b231c455ca1a4579d7ed54888': '3', 'num_vm_rescued': '1', 'num_proj_03be033a975c41efba46c4d480df190f': '1', 'num_proj_dbca65bf08474994b1c22f42047c7cbc': '1'} {{(pid=98431) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}} Jun 11 23:15:15.094320 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-45ff2f84-23d6-444d-811b-4d57be7a22c4 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Acquiring lock "c9271160-14ef-4a59-8ac8-89efbe36c607" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:15:15.094502 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-45ff2f84-23d6-444d-811b-4d57be7a22c4 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Lock "c9271160-14ef-4a59-8ac8-89efbe36c607" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:15:15.094791 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-45ff2f84-23d6-444d-811b-4d57be7a22c4 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: c9271160-14ef-4a59-8ac8-89efbe36c607] Attaching volume 1926104c-1d9a-4111-ab37-77c31acf8a06 to /dev/vdb Jun 11 23:15:15.160001 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-45ff2f84-23d6-444d-811b-4d57be7a22c4 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.209', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000002687', 'execute': None}" {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 11 23:15:15.174459 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.scaleio [None req-45ff2f84-23d6-444d-811b-4d57be7a22c4 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98431) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 11 23:15:15.208054 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-45ff2f84-23d6-444d-811b-4d57be7a22c4 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Running cmd (subprocess): nvme version {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 23:15:15.248109 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.processutils [None req-45ff2f84-23d6-444d-811b-4d57be7a22c4 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] 'nvme version' failed. Not Retrying. {{(pid=98431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 11 23:15:15.249329 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.nvmeof [None req-45ff2f84-23d6-444d-811b-4d57be7a22c4 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] nvme not present on system {{(pid=98431) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 11 23:15:15.258104 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.lightos [None req-45ff2f84-23d6-444d-811b-4d57be7a22c4 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98431) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 11 23:15:15.260047 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.lightos [None req-45ff2f84-23d6-444d-811b-4d57be7a22c4 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Current host hostNQN and IP(s) are ['10.4.3.209', 'fe80::f816:3eff:fea3:3707', '192.168.40.6', 'fe80::f816:3eff:fe06:bdab', '192.168.50.6', 'fe80::f816:3eff:fe7a:46f2', '192.168.10.6', 'fe80::f816:3eff:fe13:793b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::38fa:21ff:fe6c:3746', 'fe80::fc16:3eff:fe77:488d', 'fe80::9469:f2ff:feae:5824', 'fe80::fc16:3eff:fec7:336a', 'fe80::fc16:3eff:fe61:b7fd', 'fe80::38dc:c1ff:fee9:4731', 'fe80::fc16:3eff:fec2:8da4', 'fe80::fc16:3eff:fe4b:2695', 'fe80::fc16:3eff:fe2b:91a7', 'fe80::fc16:3eff:fe6c:78be', 'fe80::d82a:87ff:fe65:391e', 'fe80::fc16:3eff:fef6:b5ae', 'fe80::fc16:3eff:fe03:1c0a', 'fe80::f090:d9ff:fe35:5216', 'fe80::fc16:3eff:feae:c283', 'fe80::e4:9eff:fed3:41d', 'fe80::fc16:3eff:fe6f:4242'] Jun 11 23:15:15.260203 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.lightos [None req-45ff2f84-23d6-444d-811b-4d57be7a22c4 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98431) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 11 23:15:15.260298 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.lightos [None req-45ff2f84-23d6-444d-811b-4d57be7a22c4 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] LIGHTOS: no hostnqn found. {{(pid=98431) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 11 23:15:15.261381 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-45ff2f84-23d6-444d-811b-4d57be7a22c4 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] <== get_connector_properties: return (99ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.209', 'host': 'np0000002687', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:798b370f1cc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad465dfe-0ed1-4637-98c3-ddaebebd61a4', 'nvme_native_multipath': False} {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 11 23:15:15.261381 np0000002687 nova-compute[98431]: DEBUG nova.virt.block_device [None req-45ff2f84-23d6-444d-811b-4d57be7a22c4 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: c9271160-14ef-4a59-8ac8-89efbe36c607] Updating existing volume attachment record: d3f558bb-6e66-4d4c-8bb2-956500436142 {{(pid=98431) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 11 23:15:15.398355 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-fe1623e9-3353-4681-bc87-42f4f797c4b6 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] No BDM found with device name vda, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:15:15.399913 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-fe1623e9-3353-4681-bc87-42f4f797c4b6 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] No BDM found with device name hda, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:15:15.399913 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-fe1623e9-3353-4681-bc87-42f4f797c4b6 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] No VIF found with MAC fa:16:3e:6c:78:be, not building metadata {{(pid=98431) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13199}} Jun 11 23:15:15.509011 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:15:15.782622 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98431) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 11 23:15:15.782964 np0000002687 nova-compute[98431]: DEBUG nova.compute.provider_tree [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Inventory has not changed in ProviderTree for provider: e3e65fe2-9de9-4821-8b4a-ccae37c66e25 {{(pid=98431) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 11 23:15:15.837020 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45ff2f84-23d6-444d-811b-4d57be7a22c4 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: c9271160-14ef-4a59-8ac8-89efbe36c607] Calling os-brick to attach iSCSI Volume {{(pid=98431) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 11 23:15:15.837435 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ff2f84-23d6-444d-811b-4d57be7a22c4 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1926104c-1d9a-4111-ab37-77c31acf8a06', 'iqn.2023-03.storpool.com:os--volume-1926104c-1d9a-4111-ab37-77c31acf8a06'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1926104c-1d9a-4111-ab37-77c31acf8a06', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1926104c-1d9a-4111-ab37-77c31acf8a06', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 11 23:15:15.837610 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-45ff2f84-23d6-444d-811b-4d57be7a22c4 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 11 23:15:15.839737 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-45ff2f84-23d6-444d-811b-4d57be7a22c4 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 11 23:15:15.840060 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-45ff2f84-23d6-444d-811b-4d57be7a22c4 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1926104c-1d9a-4111-ab37-77c31acf8a06', 'iqn.2023-03.storpool.com:os--volume-1926104c-1d9a-4111-ab37-77c31acf8a06'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1926104c-1d9a-4111-ab37-77c31acf8a06', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1926104c-1d9a-4111-ab37-77c31acf8a06', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98431) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 11 23:15:15.858202 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-45ff2f84-23d6-444d-811b-4d57be7a22c4 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1926104c-1d9a-4111-ab37-77c31acf8a06" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 11 23:15:15.858202 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-45ff2f84-23d6-444d-811b-4d57be7a22c4 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-1926104c-1d9a-4111-ab37-77c31acf8a06" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 11 23:15:15.858202 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-45ff2f84-23d6-444d-811b-4d57be7a22c4 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-1926104c-1d9a-4111-ab37-77c31acf8a06" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 11 23:15:15.858202 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.iscsi [None req-45ff2f84-23d6-444d-811b-4d57be7a22c4 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 11 23:15:15.859680 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-45ff2f84-23d6-444d-811b-4d57be7a22c4 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1926104c-1d9a-4111-ab37-77c31acf8a06" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.005s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 11 23:15:15.859680 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.iscsi [None req-45ff2f84-23d6-444d-811b-4d57be7a22c4 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 11 23:15:15.871663 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ff2f84-23d6-444d-811b-4d57be7a22c4 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 11 23:15:15.871663 np0000002687 nova-compute[98431]: {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:15:15.884186 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ff2f84-23d6-444d-811b-4d57be7a22c4 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 11 23:15:15.884186 np0000002687 nova-compute[98431]: {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:15:15.888260 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ff2f84-23d6-444d-811b-4d57be7a22c4 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-1926104c-1d9a-4111-ab37-77c31acf8a06] added Jun 11 23:15:15.888260 np0000002687 nova-compute[98431]: stderr=iscsiadm: Config file line 363 does not have value Jun 11 23:15:15.888260 np0000002687 nova-compute[98431]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 11 23:15:15.888260 np0000002687 nova-compute[98431]: iscsiadm: Config file line 363 does not have value Jun 11 23:15:15.888260 np0000002687 nova-compute[98431]: iscsiadm: Config file line 363 does not have value Jun 11 23:15:15.888260 np0000002687 nova-compute[98431]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 11 23:15:15.888260 np0000002687 nova-compute[98431]: {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:15:15.888581 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ff2f84-23d6-444d-811b-4d57be7a22c4 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98431) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 11 23:15:15.888655 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-45ff2f84-23d6-444d-811b-4d57be7a22c4 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.033(s), this was the 1st time calling it. {{(pid=98431) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 11 23:15:15.889109 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-45ff2f84-23d6-444d-811b-4d57be7a22c4 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98431) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 11 23:15:15.896995 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ff2f84-23d6-444d-811b-4d57be7a22c4 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-1926104c-1d9a-4111-ab37-77c31acf8a06] added Jun 11 23:15:15.896995 np0000002687 nova-compute[98431]: stderr=iscsiadm: Config file line 363 does not have value Jun 11 23:15:15.896995 np0000002687 nova-compute[98431]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 11 23:15:15.896995 np0000002687 nova-compute[98431]: iscsiadm: Config file line 363 does not have value Jun 11 23:15:15.896995 np0000002687 nova-compute[98431]: iscsiadm: Config file line 363 does not have value Jun 11 23:15:15.896995 np0000002687 nova-compute[98431]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 11 23:15:15.896995 np0000002687 nova-compute[98431]: {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:15:15.896995 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ff2f84-23d6-444d-811b-4d57be7a22c4 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98431) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 11 23:15:15.896995 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-45ff2f84-23d6-444d-811b-4d57be7a22c4 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0376(s), this was the 1st time calling it. {{(pid=98431) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 11 23:15:15.896995 np0000002687 nova-compute[98431]: DEBUG os_brick.utils [None req-45ff2f84-23d6-444d-811b-4d57be7a22c4 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98431) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 11 23:15:16.288606 np0000002687 nova-compute[98431]: DEBUG nova.scheduler.client.report [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Inventory has not changed for provider e3e65fe2-9de9-4821-8b4a-ccae37c66e25 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98431) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 11 23:15:16.796397 np0000002687 nova-compute[98431]: DEBUG nova.compute.resource_tracker [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Compute_service record updated for np0000002687:np0000002687 {{(pid=98431) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}} Jun 11 23:15:16.796397 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.930s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:15:16.796397 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-de917596-6da7-4867-88d0-9e80471c5217 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 3.512s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:15:16.797535 np0000002687 nova-compute[98431]: DEBUG oslo.service.backend._threading.loopingcall [None req-99e4690d-e1c2-492c-8046-bdec7a2a810e None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 49.64 seconds {{(pid=98431) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jun 11 23:15:16.889984 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.iscsi [None req-45ff2f84-23d6-444d-811b-4d57be7a22c4 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 11 23:15:16.897422 np0000002687 nova-compute[98431]: INFO os_brick.initiator.connectors.iscsi [None req-45ff2f84-23d6-444d-811b-4d57be7a22c4 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 11 23:15:16.909383 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ff2f84-23d6-444d-811b-4d57be7a22c4 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 11 23:15:16.909383 np0000002687 nova-compute[98431]: node.name = iqn.2023-03.storpool.com:os--volume-1926104c-1d9a-4111-ab37-77c31acf8a06 Jun 11 23:15:16.909383 np0000002687 nova-compute[98431]: node.tpgt = -1 Jun 11 23:15:16.909383 np0000002687 nova-compute[98431]: node.startup = manual Jun 11 23:15:16.909383 np0000002687 nova-compute[98431]: node.leading_login = No Jun 11 23:15:16.909383 np0000002687 nova-compute[98431]: iface.iscsi_ifacename = default Jun 11 23:15:16.909383 np0000002687 nova-compute[98431]: iface.net_ifacename = Jun 11 23:15:16.909383 np0000002687 nova-compute[98431]: iface.ipaddress = Jun 11 23:15:16.909383 np0000002687 nova-compute[98431]: iface.prefix_len = 0 Jun 11 23:15:16.909383 np0000002687 nova-compute[98431]: iface.hwaddress = Jun 11 23:15:16.909383 np0000002687 nova-compute[98431]: iface.transport_name = tcp Jun 11 23:15:16.909383 np0000002687 nova-compute[98431]: iface.initiatorname = Jun 11 23:15:16.909383 np0000002687 nova-compute[98431]: iface.state = Jun 11 23:15:16.909383 np0000002687 nova-compute[98431]: iface.vlan_id = 0 Jun 11 23:15:16.909383 np0000002687 nova-compute[98431]: iface.vlan_priority = 0 Jun 11 23:15:16.909383 np0000002687 nova-compute[98431]: iface.vlan_state = Jun 11 23:15:16.909383 np0000002687 nova-compute[98431]: iface.iface_num = 0 Jun 11 23:15:16.909383 np0000002687 nova-compute[98431]: iface.mtu = 0 Jun 11 23:15:16.909383 np0000002687 nova-compute[98431]: iface.port = 0 Jun 11 23:15:16.909383 np0000002687 nova-compute[98431]: iface.bootproto = Jun 11 23:15:16.909383 np0000002687 nova-compute[98431]: iface.subnet_mask = Jun 11 23:15:16.909383 np0000002687 nova-compute[98431]: iface.gateway = Jun 11 23:15:16.909383 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id_state = Jun 11 23:15:16.909383 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id = Jun 11 23:15:16.909383 np0000002687 nova-compute[98431]: iface.dhcp_dns = Jun 11 23:15:16.909383 np0000002687 nova-compute[98431]: iface.dhcp_learn_iqn = Jun 11 23:15:16.909383 np0000002687 nova-compute[98431]: iface.dhcp_req_vendor_id_state = Jun 11 23:15:16.909383 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id_state = Jun 11 23:15:16.909383 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id = Jun 11 23:15:16.909383 np0000002687 nova-compute[98431]: iface.dhcp_slp_da = Jun 11 23:15:16.909383 np0000002687 nova-compute[98431]: iface.fragmentation = Jun 11 23:15:16.909383 np0000002687 nova-compute[98431]: iface.gratuitous_arp = Jun 11 23:15:16.909383 np0000002687 nova-compute[98431]: iface.incoming_forwarding = Jun 11 23:15:16.909383 np0000002687 nova-compute[98431]: iface.tos_state = Jun 11 23:15:16.909383 np0000002687 nova-compute[98431]: iface.tos = 0 Jun 11 23:15:16.909383 np0000002687 nova-compute[98431]: iface.ttl = 0 Jun 11 23:15:16.909383 np0000002687 nova-compute[98431]: iface.delayed_ack = Jun 11 23:15:16.909383 np0000002687 nova-compute[98431]: iface.tcp_nagle = Jun 11 23:15:16.909383 np0000002687 nova-compute[98431]: iface.tcp_wsf_state = Jun 11 23:15:16.909383 np0000002687 nova-compute[98431]: iface.tcp_wsf = 0 Jun 11 23:15:16.909383 np0000002687 nova-compute[98431]: iface.tcp_timer_scale = 0 Jun 11 23:15:16.909383 np0000002687 nova-compute[98431]: iface.tcp_timestamp = Jun 11 23:15:16.909383 np0000002687 nova-compute[98431]: iface.redirect = Jun 11 23:15:16.909383 np0000002687 nova-compute[98431]: iface.def_task_mgmt_timeout = 0 Jun 11 23:15:16.909383 np0000002687 nova-compute[98431]: iface.header_digest = Jun 11 23:15:16.909383 np0000002687 nova-compute[98431]: iface.data_digest = Jun 11 23:15:16.909383 np0000002687 nova-compute[98431]: iface.immediate_data = Jun 11 23:15:16.909383 np0000002687 nova-compute[98431]: iface.initial_r2t = Jun 11 23:15:16.909383 np0000002687 nova-compute[98431]: iface.data_seq_inorder = Jun 11 23:15:16.909383 np0000002687 nova-compute[98431]: iface.data_pdu_inorder = Jun 11 23:15:16.909383 np0000002687 nova-compute[98431]: iface.erl = 0 Jun 11 23:15:16.909383 np0000002687 nova-compute[98431]: iface.max_receive_data_len = 0 Jun 11 23:15:16.909383 np0000002687 nova-compute[98431]: iface.first_burst_len = 0 Jun 11 23:15:16.909383 np0000002687 nova-compute[98431]: iface.max_outstanding_r2t = 0 Jun 11 23:15:16.909383 np0000002687 nova-compute[98431]: iface.max_burst_len = 0 Jun 11 23:15:16.909383 np0000002687 nova-compute[98431]: iface.chap_auth = Jun 11 23:15:16.909383 np0000002687 nova-compute[98431]: iface.bidi_chap = Jun 11 23:15:16.909383 np0000002687 nova-compute[98431]: iface.strict_login_compliance = Jun 11 23:15:16.909383 np0000002687 nova-compute[98431]: iface.discovery_auth = Jun 11 23:15:16.909383 np0000002687 nova-compute[98431]: iface.discovery_logout = Jun 11 23:15:16.909383 np0000002687 nova-compute[98431]: node.discovery_address = Jun 11 23:15:16.909383 np0000002687 nova-compute[98431]: node.discovery_port = 0 Jun 11 23:15:16.909383 np0000002687 nova-compute[98431]: node.discovery_type = fw Jun 11 23:15:16.909383 np0000002687 nova-compute[98431]: node.session.initial_cmdsn = 0 Jun 11 23:15:16.909383 np0000002687 nova-compute[98431]: node.session.initial_login_retry_max = 8 Jun 11 23:15:16.909383 np0000002687 nova-compute[98431]: node.session.xmit_thread_priority = 0 Jun 11 23:15:16.909383 np0000002687 nova-compute[98431]: node.session.cmds_max = 128 Jun 11 23:15:16.909383 np0000002687 nova-compute[98431]: node.session.queue_depth = 32 Jun 11 23:15:16.909383 np0000002687 nova-compute[98431]: node.session.nr_sessions = 1 Jun 11 23:15:16.909383 np0000002687 nova-compute[98431]: node.session.auth.authmethod = None Jun 11 23:15:16.909383 np0000002687 nova-compute[98431]: node.session.auth.username = Jun 11 23:15:16.909383 np0000002687 nova-compute[98431]: node.session.auth.password = *** Jun 11 23:15:16.909383 np0000002687 nova-compute[98431]: node.session.auth.username_in = Jun 11 23:15:16.909383 np0000002687 nova-compute[98431]: node.session.auth.password_in = Jun 11 23:15:16.909383 np0000002687 nova-compute[98431]: node.session.auth.chap_algs = SHA256 Jun 11 23:15:16.909383 np0000002687 nova-compute[98431]: node.session.timeo.replacement_timeout = 120 Jun 11 23:15:16.909383 np0000002687 nova-compute[98431]: node.session.err_timeo.abort_timeout = 15 Jun 11 23:15:16.909383 np0000002687 nova-compute[98431]: node.session.err_timeo.lu_reset_timeout = 30 Jun 11 23:15:16.909383 np0000002687 nova-compute[98431]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 11 23:15:16.909383 np0000002687 nova-compute[98431]: node.session.err_timeo.host_reset_timeout = 60 Jun 11 23:15:16.909383 np0000002687 nova-compute[98431]: node.session.iscsi.FastAbort = Yes Jun 11 23:15:16.909383 np0000002687 nova-compute[98431]: node.session.iscsi.InitialR2T = No Jun 11 23:15:16.909383 np0000002687 nova-compute[98431]: node.session.iscsi.ImmediateData = Yes Jun 11 23:15:16.909383 np0000002687 nova-compute[98431]: node.session.iscsi.FirstBurstLength = 262144 Jun 11 23:15:16.909383 np0000002687 nova-compute[98431]: node.session.iscsi.MaxBurstLength = 16776192 Jun 11 23:15:16.909383 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Retain = 0 Jun 11 23:15:16.909383 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Wait = 2 Jun 11 23:15:16.909383 np0000002687 nova-compute[98431]: node.session.iscsi.MaxConnections = 1 Jun 11 23:15:16.909383 np0000002687 nova-compute[98431]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 11 23:15:16.909383 np0000002687 nova-compute[98431]: node.session.iscsi.ERL = 0 Jun 11 23:15:16.909383 np0000002687 nova-compute[98431]: node.session.scan = auto Jun 11 23:15:16.909383 np0000002687 nova-compute[98431]: node.session.reopen_max = 0 Jun 11 23:15:16.909383 np0000002687 nova-compute[98431]: node.conn[0].address = 192.168.50.100 Jun 11 23:15:16.909383 np0000002687 nova-compute[98431]: node.conn[0].port = 3260 Jun 11 23:15:16.909383 np0000002687 nova-compute[98431]: node.conn[0].startup = manual Jun 11 23:15:16.909383 np0000002687 nova-compute[98431]: node.conn[0].tcp.window_size = 524288 Jun 11 23:15:16.909383 np0000002687 nova-compute[98431]: node.conn[0].tcp.type_of_service = 0 Jun 11 23:15:16.909383 np0000002687 nova-compute[98431]: node.conn[0].timeo.logout_timeout = 15 Jun 11 23:15:16.909383 np0000002687 nova-compute[98431]: node.conn[0].timeo.login_timeout = 15 Jun 11 23:15:16.909383 np0000002687 nova-compute[98431]: node.conn[0].timeo.auth_timeout = 45 Jun 11 23:15:16.909383 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_interval = 5 Jun 11 23:15:16.909383 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_timeout = 5 Jun 11 23:15:16.909383 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 11 23:15:16.909383 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 11 23:15:16.909383 np0000002687 nova-compute[98431]: node.conn[0].iscsi.HeaderDigest = None Jun 11 23:15:16.909383 np0000002687 nova-compute[98431]: node.conn[0].iscsi.DataDigest = None Jun 11 23:15:16.909383 np0000002687 nova-compute[98431]: node.conn[0].iscsi.IFMarker = No Jun 11 23:15:16.909383 np0000002687 nova-compute[98431]: node.conn[0].iscsi.OFMarker = No Jun 11 23:15:16.909383 np0000002687 nova-compute[98431]: # END RECORD Jun 11 23:15:16.909383 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:15:16.922625 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ff2f84-23d6-444d-811b-4d57be7a22c4 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 11 23:15:16.922625 np0000002687 nova-compute[98431]: node.name = iqn.2023-03.storpool.com:os--volume-1926104c-1d9a-4111-ab37-77c31acf8a06 Jun 11 23:15:16.922625 np0000002687 nova-compute[98431]: node.tpgt = -1 Jun 11 23:15:16.922625 np0000002687 nova-compute[98431]: node.startup = manual Jun 11 23:15:16.922625 np0000002687 nova-compute[98431]: node.leading_login = No Jun 11 23:15:16.922625 np0000002687 nova-compute[98431]: iface.iscsi_ifacename = default Jun 11 23:15:16.922625 np0000002687 nova-compute[98431]: iface.net_ifacename = Jun 11 23:15:16.922625 np0000002687 nova-compute[98431]: iface.ipaddress = Jun 11 23:15:16.922625 np0000002687 nova-compute[98431]: iface.prefix_len = 0 Jun 11 23:15:16.922625 np0000002687 nova-compute[98431]: iface.hwaddress = Jun 11 23:15:16.922625 np0000002687 nova-compute[98431]: iface.transport_name = tcp Jun 11 23:15:16.922625 np0000002687 nova-compute[98431]: iface.initiatorname = Jun 11 23:15:16.922625 np0000002687 nova-compute[98431]: iface.state = Jun 11 23:15:16.922625 np0000002687 nova-compute[98431]: iface.vlan_id = 0 Jun 11 23:15:16.922625 np0000002687 nova-compute[98431]: iface.vlan_priority = 0 Jun 11 23:15:16.922625 np0000002687 nova-compute[98431]: iface.vlan_state = Jun 11 23:15:16.922625 np0000002687 nova-compute[98431]: iface.iface_num = 0 Jun 11 23:15:16.922625 np0000002687 nova-compute[98431]: iface.mtu = 0 Jun 11 23:15:16.922625 np0000002687 nova-compute[98431]: iface.port = 0 Jun 11 23:15:16.922625 np0000002687 nova-compute[98431]: iface.bootproto = Jun 11 23:15:16.922625 np0000002687 nova-compute[98431]: iface.subnet_mask = Jun 11 23:15:16.922625 np0000002687 nova-compute[98431]: iface.gateway = Jun 11 23:15:16.922625 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id_state = Jun 11 23:15:16.922625 np0000002687 nova-compute[98431]: iface.dhcp_alt_client_id = Jun 11 23:15:16.922625 np0000002687 nova-compute[98431]: iface.dhcp_dns = Jun 11 23:15:16.922625 np0000002687 nova-compute[98431]: iface.dhcp_learn_iqn = Jun 11 23:15:16.922625 np0000002687 nova-compute[98431]: iface.dhcp_req_vendor_id_state = Jun 11 23:15:16.922625 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id_state = Jun 11 23:15:16.922625 np0000002687 nova-compute[98431]: iface.dhcp_vendor_id = Jun 11 23:15:16.922625 np0000002687 nova-compute[98431]: iface.dhcp_slp_da = Jun 11 23:15:16.922625 np0000002687 nova-compute[98431]: iface.fragmentation = Jun 11 23:15:16.922625 np0000002687 nova-compute[98431]: iface.gratuitous_arp = Jun 11 23:15:16.922625 np0000002687 nova-compute[98431]: iface.incoming_forwarding = Jun 11 23:15:16.922625 np0000002687 nova-compute[98431]: iface.tos_state = Jun 11 23:15:16.922625 np0000002687 nova-compute[98431]: iface.tos = 0 Jun 11 23:15:16.922625 np0000002687 nova-compute[98431]: iface.ttl = 0 Jun 11 23:15:16.922625 np0000002687 nova-compute[98431]: iface.delayed_ack = Jun 11 23:15:16.922625 np0000002687 nova-compute[98431]: iface.tcp_nagle = Jun 11 23:15:16.922625 np0000002687 nova-compute[98431]: iface.tcp_wsf_state = Jun 11 23:15:16.922625 np0000002687 nova-compute[98431]: iface.tcp_wsf = 0 Jun 11 23:15:16.922625 np0000002687 nova-compute[98431]: iface.tcp_timer_scale = 0 Jun 11 23:15:16.922625 np0000002687 nova-compute[98431]: iface.tcp_timestamp = Jun 11 23:15:16.922625 np0000002687 nova-compute[98431]: iface.redirect = Jun 11 23:15:16.922625 np0000002687 nova-compute[98431]: iface.def_task_mgmt_timeout = 0 Jun 11 23:15:16.922625 np0000002687 nova-compute[98431]: iface.header_digest = Jun 11 23:15:16.922625 np0000002687 nova-compute[98431]: iface.data_digest = Jun 11 23:15:16.922625 np0000002687 nova-compute[98431]: iface.immediate_data = Jun 11 23:15:16.922625 np0000002687 nova-compute[98431]: iface.initial_r2t = Jun 11 23:15:16.922625 np0000002687 nova-compute[98431]: iface.data_seq_inorder = Jun 11 23:15:16.922625 np0000002687 nova-compute[98431]: iface.data_pdu_inorder = Jun 11 23:15:16.922625 np0000002687 nova-compute[98431]: iface.erl = 0 Jun 11 23:15:16.922625 np0000002687 nova-compute[98431]: iface.max_receive_data_len = 0 Jun 11 23:15:16.922625 np0000002687 nova-compute[98431]: iface.first_burst_len = 0 Jun 11 23:15:16.922625 np0000002687 nova-compute[98431]: iface.max_outstanding_r2t = 0 Jun 11 23:15:16.922625 np0000002687 nova-compute[98431]: iface.max_burst_len = 0 Jun 11 23:15:16.922625 np0000002687 nova-compute[98431]: iface.chap_auth = Jun 11 23:15:16.922625 np0000002687 nova-compute[98431]: iface.bidi_chap = Jun 11 23:15:16.922625 np0000002687 nova-compute[98431]: iface.strict_login_compliance = Jun 11 23:15:16.922625 np0000002687 nova-compute[98431]: iface.discovery_auth = Jun 11 23:15:16.922625 np0000002687 nova-compute[98431]: iface.discovery_logout = Jun 11 23:15:16.922625 np0000002687 nova-compute[98431]: node.discovery_address = Jun 11 23:15:16.922625 np0000002687 nova-compute[98431]: node.discovery_port = 0 Jun 11 23:15:16.922625 np0000002687 nova-compute[98431]: node.discovery_type = fw Jun 11 23:15:16.922625 np0000002687 nova-compute[98431]: node.session.initial_cmdsn = 0 Jun 11 23:15:16.922625 np0000002687 nova-compute[98431]: node.session.initial_login_retry_max = 8 Jun 11 23:15:16.922625 np0000002687 nova-compute[98431]: node.session.xmit_thread_priority = 0 Jun 11 23:15:16.922625 np0000002687 nova-compute[98431]: node.session.cmds_max = 128 Jun 11 23:15:16.922625 np0000002687 nova-compute[98431]: node.session.queue_depth = 32 Jun 11 23:15:16.922625 np0000002687 nova-compute[98431]: node.session.nr_sessions = 1 Jun 11 23:15:16.922625 np0000002687 nova-compute[98431]: node.session.auth.authmethod = None Jun 11 23:15:16.922625 np0000002687 nova-compute[98431]: node.session.auth.username = Jun 11 23:15:16.922625 np0000002687 nova-compute[98431]: node.session.auth.password = *** Jun 11 23:15:16.922625 np0000002687 nova-compute[98431]: node.session.auth.username_in = Jun 11 23:15:16.922625 np0000002687 nova-compute[98431]: node.session.auth.password_in = Jun 11 23:15:16.922625 np0000002687 nova-compute[98431]: node.session.auth.chap_algs = SHA256 Jun 11 23:15:16.922625 np0000002687 nova-compute[98431]: node.session.timeo.replacement_timeout = 120 Jun 11 23:15:16.922625 np0000002687 nova-compute[98431]: node.session.err_timeo.abort_timeout = 15 Jun 11 23:15:16.922625 np0000002687 nova-compute[98431]: node.session.err_timeo.lu_reset_timeout = 30 Jun 11 23:15:16.922625 np0000002687 nova-compute[98431]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 11 23:15:16.922625 np0000002687 nova-compute[98431]: node.session.err_timeo.host_reset_timeout = 60 Jun 11 23:15:16.922625 np0000002687 nova-compute[98431]: node.session.iscsi.FastAbort = Yes Jun 11 23:15:16.922625 np0000002687 nova-compute[98431]: node.session.iscsi.InitialR2T = No Jun 11 23:15:16.922625 np0000002687 nova-compute[98431]: node.session.iscsi.ImmediateData = Yes Jun 11 23:15:16.922625 np0000002687 nova-compute[98431]: node.session.iscsi.FirstBurstLength = 262144 Jun 11 23:15:16.922625 np0000002687 nova-compute[98431]: node.session.iscsi.MaxBurstLength = 16776192 Jun 11 23:15:16.922625 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Retain = 0 Jun 11 23:15:16.922625 np0000002687 nova-compute[98431]: node.session.iscsi.DefaultTime2Wait = 2 Jun 11 23:15:16.922625 np0000002687 nova-compute[98431]: node.session.iscsi.MaxConnections = 1 Jun 11 23:15:16.922625 np0000002687 nova-compute[98431]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 11 23:15:16.922625 np0000002687 nova-compute[98431]: node.session.iscsi.ERL = 0 Jun 11 23:15:16.922625 np0000002687 nova-compute[98431]: node.session.scan = auto Jun 11 23:15:16.922625 np0000002687 nova-compute[98431]: node.session.reopen_max = 0 Jun 11 23:15:16.922625 np0000002687 nova-compute[98431]: node.conn[0].address = 192.168.40.100 Jun 11 23:15:16.922625 np0000002687 nova-compute[98431]: node.conn[0].port = 3260 Jun 11 23:15:16.922625 np0000002687 nova-compute[98431]: node.conn[0].startup = manual Jun 11 23:15:16.922625 np0000002687 nova-compute[98431]: node.conn[0].tcp.window_size = 524288 Jun 11 23:15:16.922625 np0000002687 nova-compute[98431]: node.conn[0].tcp.type_of_service = 0 Jun 11 23:15:16.922625 np0000002687 nova-compute[98431]: node.conn[0].timeo.logout_timeout = 15 Jun 11 23:15:16.922625 np0000002687 nova-compute[98431]: node.conn[0].timeo.login_timeout = 15 Jun 11 23:15:16.922625 np0000002687 nova-compute[98431]: node.conn[0].timeo.auth_timeout = 45 Jun 11 23:15:16.922625 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_interval = 5 Jun 11 23:15:16.922625 np0000002687 nova-compute[98431]: node.conn[0].timeo.noop_out_timeout = 5 Jun 11 23:15:16.922625 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 11 23:15:16.922625 np0000002687 nova-compute[98431]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 11 23:15:16.922625 np0000002687 nova-compute[98431]: node.conn[0].iscsi.HeaderDigest = None Jun 11 23:15:16.922625 np0000002687 nova-compute[98431]: node.conn[0].iscsi.DataDigest = None Jun 11 23:15:16.922625 np0000002687 nova-compute[98431]: node.conn[0].iscsi.IFMarker = No Jun 11 23:15:16.922625 np0000002687 nova-compute[98431]: node.conn[0].iscsi.OFMarker = No Jun 11 23:15:16.922625 np0000002687 nova-compute[98431]: # END RECORD Jun 11 23:15:16.922625 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:15:16.930633 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ff2f84-23d6-444d-811b-4d57be7a22c4 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:15:16.941359 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ff2f84-23d6-444d-811b-4d57be7a22c4 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:15:16.960648 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ff2f84-23d6-444d-811b-4d57be7a22c4 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:15:16.960648 np0000002687 nova-compute[98431]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:15:16.960648 np0000002687 nova-compute[98431]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:15:16.960648 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:15:16.960648 np0000002687 nova-compute[98431]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1 (non-flash) Jun 11 23:15:16.960648 np0000002687 nova-compute[98431]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1 (non-flash) Jun 11 23:15:16.960648 np0000002687 nova-compute[98431]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-084b8049-147b-4db4-87aa-de243dbb50fb (non-flash) Jun 11 23:15:16.960648 np0000002687 nova-compute[98431]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-084b8049-147b-4db4-87aa-de243dbb50fb (non-flash) Jun 11 23:15:16.960648 np0000002687 nova-compute[98431]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a725cde0-4eec-48e6-a636-98bd40a9488b (non-flash) Jun 11 23:15:16.960648 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:15:16.961180 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ff2f84-23d6-444d-811b-4d57be7a22c4 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:15:16.961180 np0000002687 nova-compute[98431]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:15:16.961180 np0000002687 nova-compute[98431]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:15:16.961180 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:15:16.961180 np0000002687 nova-compute[98431]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1 (non-flash) Jun 11 23:15:16.961180 np0000002687 nova-compute[98431]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1 (non-flash) Jun 11 23:15:16.961180 np0000002687 nova-compute[98431]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-084b8049-147b-4db4-87aa-de243dbb50fb (non-flash) Jun 11 23:15:16.961180 np0000002687 nova-compute[98431]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-084b8049-147b-4db4-87aa-de243dbb50fb (non-flash) Jun 11 23:15:16.961180 np0000002687 nova-compute[98431]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a725cde0-4eec-48e6-a636-98bd40a9488b (non-flash) Jun 11 23:15:16.961180 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:15:16.967182 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ff2f84-23d6-444d-811b-4d57be7a22c4 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:15:16.967182 np0000002687 nova-compute[98431]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:15:16.967182 np0000002687 nova-compute[98431]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:15:16.967182 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:15:16.967182 np0000002687 nova-compute[98431]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1 (non-flash) Jun 11 23:15:16.967182 np0000002687 nova-compute[98431]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1 (non-flash) Jun 11 23:15:16.967182 np0000002687 nova-compute[98431]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-084b8049-147b-4db4-87aa-de243dbb50fb (non-flash) Jun 11 23:15:16.967182 np0000002687 nova-compute[98431]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-084b8049-147b-4db4-87aa-de243dbb50fb (non-flash) Jun 11 23:15:16.967182 np0000002687 nova-compute[98431]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a725cde0-4eec-48e6-a636-98bd40a9488b (non-flash) Jun 11 23:15:16.967182 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:15:16.967558 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ff2f84-23d6-444d-811b-4d57be7a22c4 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:15:16.967558 np0000002687 nova-compute[98431]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:15:16.967558 np0000002687 nova-compute[98431]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:15:16.967558 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:15:16.967558 np0000002687 nova-compute[98431]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1 (non-flash) Jun 11 23:15:16.967558 np0000002687 nova-compute[98431]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1 (non-flash) Jun 11 23:15:16.967558 np0000002687 nova-compute[98431]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-084b8049-147b-4db4-87aa-de243dbb50fb (non-flash) Jun 11 23:15:16.967558 np0000002687 nova-compute[98431]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-084b8049-147b-4db4-87aa-de243dbb50fb (non-flash) Jun 11 23:15:16.967558 np0000002687 nova-compute[98431]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a725cde0-4eec-48e6-a636-98bd40a9488b (non-flash) Jun 11 23:15:16.967558 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:15:16.968245 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-fe1623e9-3353-4681-bc87-42f4f797c4b6 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Lock "ae596459-1e34-4a2a-9a33-69a02f50fd1c" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 7.557s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:15:17.014270 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ff2f84-23d6-444d-811b-4d57be7a22c4 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1926104c-1d9a-4111-ab37-77c31acf8a06, portal: 192.168.50.100,3260] Jun 11 23:15:17.014270 np0000002687 nova-compute[98431]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1926104c-1d9a-4111-ab37-77c31acf8a06, portal: 192.168.50.100,3260] successful. Jun 11 23:15:17.014270 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:15:17.020546 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ff2f84-23d6-444d-811b-4d57be7a22c4 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1926104c-1d9a-4111-ab37-77c31acf8a06, portal: 192.168.40.100,3260] Jun 11 23:15:17.020546 np0000002687 nova-compute[98431]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1926104c-1d9a-4111-ab37-77c31acf8a06, portal: 192.168.40.100,3260] successful. Jun 11 23:15:17.020546 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:15:17.037868 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ff2f84-23d6-444d-811b-4d57be7a22c4 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:15:17.044326 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ff2f84-23d6-444d-811b-4d57be7a22c4 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:15:17.054168 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ff2f84-23d6-444d-811b-4d57be7a22c4 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:15:17.054168 np0000002687 nova-compute[98431]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:15:17.054168 np0000002687 nova-compute[98431]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:15:17.054168 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:15:17.054168 np0000002687 nova-compute[98431]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1 (non-flash) Jun 11 23:15:17.054168 np0000002687 nova-compute[98431]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1 (non-flash) Jun 11 23:15:17.054168 np0000002687 nova-compute[98431]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-084b8049-147b-4db4-87aa-de243dbb50fb (non-flash) Jun 11 23:15:17.054168 np0000002687 nova-compute[98431]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-084b8049-147b-4db4-87aa-de243dbb50fb (non-flash) Jun 11 23:15:17.054168 np0000002687 nova-compute[98431]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a725cde0-4eec-48e6-a636-98bd40a9488b (non-flash) Jun 11 23:15:17.054168 np0000002687 nova-compute[98431]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1926104c-1d9a-4111-ab37-77c31acf8a06 (non-flash) Jun 11 23:15:17.054168 np0000002687 nova-compute[98431]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1926104c-1d9a-4111-ab37-77c31acf8a06 (non-flash) Jun 11 23:15:17.054168 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:15:17.054168 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ff2f84-23d6-444d-811b-4d57be7a22c4 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:15:17.054168 np0000002687 nova-compute[98431]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:15:17.054168 np0000002687 nova-compute[98431]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:15:17.054168 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:15:17.054168 np0000002687 nova-compute[98431]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1 (non-flash) Jun 11 23:15:17.054168 np0000002687 nova-compute[98431]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1 (non-flash) Jun 11 23:15:17.054168 np0000002687 nova-compute[98431]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-084b8049-147b-4db4-87aa-de243dbb50fb (non-flash) Jun 11 23:15:17.054168 np0000002687 nova-compute[98431]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-084b8049-147b-4db4-87aa-de243dbb50fb (non-flash) Jun 11 23:15:17.054168 np0000002687 nova-compute[98431]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a725cde0-4eec-48e6-a636-98bd40a9488b (non-flash) Jun 11 23:15:17.054168 np0000002687 nova-compute[98431]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1926104c-1d9a-4111-ab37-77c31acf8a06 (non-flash) Jun 11 23:15:17.054168 np0000002687 nova-compute[98431]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1926104c-1d9a-4111-ab37-77c31acf8a06 (non-flash) Jun 11 23:15:17.054168 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:15:17.054992 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-45ff2f84-23d6-444d-811b-4d57be7a22c4 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-1926104c-1d9a-4111-ab37-77c31acf8a06" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.199s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 11 23:15:17.054992 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ff2f84-23d6-444d-811b-4d57be7a22c4 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Connected to 192.168.50.100:3260 {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 11 23:15:17.057227 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-45ff2f84-23d6-444d-811b-4d57be7a22c4 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] HCTL ('16', '-', '-', 0) found on session 51 with lun 0 {{(pid=98431) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 11 23:15:17.057521 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-45ff2f84-23d6-444d-811b-4d57be7a22c4 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98431) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 11 23:15:17.069658 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ff2f84-23d6-444d-811b-4d57be7a22c4 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:15:17.069658 np0000002687 nova-compute[98431]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:15:17.069658 np0000002687 nova-compute[98431]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:15:17.069658 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:15:17.069658 np0000002687 nova-compute[98431]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1 (non-flash) Jun 11 23:15:17.069658 np0000002687 nova-compute[98431]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1 (non-flash) Jun 11 23:15:17.069658 np0000002687 nova-compute[98431]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-084b8049-147b-4db4-87aa-de243dbb50fb (non-flash) Jun 11 23:15:17.069658 np0000002687 nova-compute[98431]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-084b8049-147b-4db4-87aa-de243dbb50fb (non-flash) Jun 11 23:15:17.069658 np0000002687 nova-compute[98431]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a725cde0-4eec-48e6-a636-98bd40a9488b (non-flash) Jun 11 23:15:17.069658 np0000002687 nova-compute[98431]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1926104c-1d9a-4111-ab37-77c31acf8a06 (non-flash) Jun 11 23:15:17.069658 np0000002687 nova-compute[98431]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1926104c-1d9a-4111-ab37-77c31acf8a06 (non-flash) Jun 11 23:15:17.069658 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:15:17.069982 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ff2f84-23d6-444d-811b-4d57be7a22c4 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:15:17.069982 np0000002687 nova-compute[98431]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:15:17.069982 np0000002687 nova-compute[98431]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:15:17.069982 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:15:17.069982 np0000002687 nova-compute[98431]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1 (non-flash) Jun 11 23:15:17.069982 np0000002687 nova-compute[98431]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1 (non-flash) Jun 11 23:15:17.069982 np0000002687 nova-compute[98431]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-084b8049-147b-4db4-87aa-de243dbb50fb (non-flash) Jun 11 23:15:17.069982 np0000002687 nova-compute[98431]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-084b8049-147b-4db4-87aa-de243dbb50fb (non-flash) Jun 11 23:15:17.069982 np0000002687 nova-compute[98431]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a725cde0-4eec-48e6-a636-98bd40a9488b (non-flash) Jun 11 23:15:17.069982 np0000002687 nova-compute[98431]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1926104c-1d9a-4111-ab37-77c31acf8a06 (non-flash) Jun 11 23:15:17.069982 np0000002687 nova-compute[98431]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1926104c-1d9a-4111-ab37-77c31acf8a06 (non-flash) Jun 11 23:15:17.069982 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:15:17.077630 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-45ff2f84-23d6-444d-811b-4d57be7a22c4 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1926104c-1d9a-4111-ab37-77c31acf8a06" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.211s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 11 23:15:17.077630 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ff2f84-23d6-444d-811b-4d57be7a22c4 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Connected to 192.168.40.100:3260 {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 11 23:15:17.077630 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-45ff2f84-23d6-444d-811b-4d57be7a22c4 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] HCTL ('17', '-', '-', 0) found on session 52 with lun 0 {{(pid=98431) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 11 23:15:17.077630 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-45ff2f84-23d6-444d-811b-4d57be7a22c4 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Scanning host 17 c: -, t: -, l: 0) {{(pid=98431) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 11 23:15:17.085875 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-45ff2f84-23d6-444d-811b-4d57be7a22c4 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Searching for a device in session 51 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98431) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 11 23:15:17.086208 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ff2f84-23d6-444d-811b-4d57be7a22c4 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1926104c-1d9a-4111-ab37-77c31acf8a06', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '1926104c-1d9a-4111-ab37-77c31acf8a06', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 11 23:15:17.098597 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-45ff2f84-23d6-444d-811b-4d57be7a22c4 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Searching for a device in session 52 and hctl ['17', '*', '*', 0] yield: sdl {{(pid=98431) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 11 23:15:17.098597 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ff2f84-23d6-444d-811b-4d57be7a22c4 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1926104c-1d9a-4111-ab37-77c31acf8a06', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1926104c-1d9a-4111-ab37-77c31acf8a06', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98431) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 11 23:15:17.856145 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ff2f84-23d6-444d-811b-4d57be7a22c4 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98431) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 11 23:15:17.974363 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-de917596-6da7-4867-88d0-9e80471c5217 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98431) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 11 23:15:17.974858 np0000002687 nova-compute[98431]: DEBUG nova.compute.provider_tree [None req-de917596-6da7-4867-88d0-9e80471c5217 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Inventory has not changed in ProviderTree for provider: e3e65fe2-9de9-4821-8b4a-ccae37c66e25 {{(pid=98431) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 11 23:15:18.090721 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:15:18.478269 np0000002687 nova-compute[98431]: DEBUG nova.scheduler.client.report [None req-de917596-6da7-4867-88d0-9e80471c5217 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Inventory has not changed for provider e3e65fe2-9de9-4821-8b4a-ccae37c66e25 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98431) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 11 23:15:18.758617 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-0926df6b-3ea5-49ec-ae04-e77e7060bfd3 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Acquiring lock "ae596459-1e34-4a2a-9a33-69a02f50fd1c" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:15:18.758835 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-0926df6b-3ea5-49ec-ae04-e77e7060bfd3 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Lock "ae596459-1e34-4a2a-9a33-69a02f50fd1c" acquired by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:15:18.872597 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ff2f84-23d6-444d-811b-4d57be7a22c4 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Found WWN 3300000004204bd6a for multipath device dm-8 {{(pid=98431) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 11 23:15:18.872973 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-45ff2f84-23d6-444d-811b-4d57be7a22c4 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.033s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 11 23:15:18.873186 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ff2f84-23d6-444d-811b-4d57be7a22c4 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] <== connect_volume: return (3035ms) {'type': 'block', 'scsi_wwn': '3300000004204bd6a', 'path': '/dev/dm-8', 'multipath_id': '3300000004204bd6a'} {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 11 23:15:18.873579 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45ff2f84-23d6-444d-811b-4d57be7a22c4 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: c9271160-14ef-4a59-8ac8-89efbe36c607] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000004204bd6a', 'path': '/dev/dm-8', 'multipath_id': '3300000004204bd6a'} {{(pid=98431) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 11 23:15:18.875952 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-45ff2f84-23d6-444d-811b-4d57be7a22c4 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Lazy-loading 'flavor' on Instance uuid c9271160-14ef-4a59-8ac8-89efbe36c607 {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:15:19.261786 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-0926df6b-3ea5-49ec-ae04-e77e7060bfd3 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] [instance: ae596459-1e34-4a2a-9a33-69a02f50fd1c] Detaching volume 084b8049-147b-4db4-87aa-de243dbb50fb Jun 11 23:15:19.312046 np0000002687 nova-compute[98431]: INFO nova.virt.block_device [None req-0926df6b-3ea5-49ec-ae04-e77e7060bfd3 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] [instance: ae596459-1e34-4a2a-9a33-69a02f50fd1c] Attempting to driver detach volume 084b8049-147b-4db4-87aa-de243dbb50fb from mountpoint /dev/vdb Jun 11 23:15:19.319769 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-0926df6b-3ea5-49ec-ae04-e77e7060bfd3 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Found disk vdb by alias ua-084b8049-147b-4db4-87aa-de243dbb50fb {{(pid=98431) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}} Jun 11 23:15:19.319769 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-0926df6b-3ea5-49ec-ae04-e77e7060bfd3 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Found disk vdb by alias ua-084b8049-147b-4db4-87aa-de243dbb50fb {{(pid=98431) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}} Jun 11 23:15:19.319769 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-0926df6b-3ea5-49ec-ae04-e77e7060bfd3 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Attempting to detach device vdb from instance ae596459-1e34-4a2a-9a33-69a02f50fd1c from the persistent domain config. {{(pid=98431) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}} Jun 11 23:15:19.319769 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.guest [None req-0926df6b-3ea5-49ec-ae04-e77e7060bfd3 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] detach device xml: Jun 11 23:15:19.319769 np0000002687 nova-compute[98431]: Jun 11 23:15:19.319769 np0000002687 nova-compute[98431]: Jun 11 23:15:19.319769 np0000002687 nova-compute[98431]: Jun 11 23:15:19.319769 np0000002687 nova-compute[98431]: Jun 11 23:15:19.319769 np0000002687 nova-compute[98431]: 084b8049-147b-4db4-87aa-de243dbb50fb Jun 11 23:15:19.319769 np0000002687 nova-compute[98431]:
Jun 11 23:15:19.319769 np0000002687 nova-compute[98431]: Jun 11 23:15:19.319769 np0000002687 nova-compute[98431]: {{(pid=98431) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jun 11 23:15:19.327951 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-0926df6b-3ea5-49ec-ae04-e77e7060bfd3 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Successfully detached device vdb from instance ae596459-1e34-4a2a-9a33-69a02f50fd1c from the persistent domain config. Jun 11 23:15:19.328135 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-0926df6b-3ea5-49ec-ae04-e77e7060bfd3 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] (1/8): Attempting to detach device vdb with device alias ua-084b8049-147b-4db4-87aa-de243dbb50fb from instance ae596459-1e34-4a2a-9a33-69a02f50fd1c from the live domain config. {{(pid=98431) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}} Jun 11 23:15:19.328278 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.guest [None req-0926df6b-3ea5-49ec-ae04-e77e7060bfd3 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] detach device xml: Jun 11 23:15:19.328278 np0000002687 nova-compute[98431]: Jun 11 23:15:19.328278 np0000002687 nova-compute[98431]: Jun 11 23:15:19.328278 np0000002687 nova-compute[98431]: Jun 11 23:15:19.328278 np0000002687 nova-compute[98431]: Jun 11 23:15:19.328278 np0000002687 nova-compute[98431]: 084b8049-147b-4db4-87aa-de243dbb50fb Jun 11 23:15:19.328278 np0000002687 nova-compute[98431]:
Jun 11 23:15:19.328278 np0000002687 nova-compute[98431]: Jun 11 23:15:19.328278 np0000002687 nova-compute[98431]: {{(pid=98431) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jun 11 23:15:19.380236 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-45ff2f84-23d6-444d-811b-4d57be7a22c4 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: c9271160-14ef-4a59-8ac8-89efbe36c607] Attempting to attach volume 1926104c-1d9a-4111-ab37-77c31acf8a06 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98431) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}} Jun 11 23:15:19.385847 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.guest [None req-45ff2f84-23d6-444d-811b-4d57be7a22c4 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] attach device xml: Jun 11 23:15:19.385847 np0000002687 nova-compute[98431]: Jun 11 23:15:19.385847 np0000002687 nova-compute[98431]: Jun 11 23:15:19.385847 np0000002687 nova-compute[98431]: Jun 11 23:15:19.385847 np0000002687 nova-compute[98431]: Jun 11 23:15:19.385847 np0000002687 nova-compute[98431]: 1926104c-1d9a-4111-ab37-77c31acf8a06 Jun 11 23:15:19.385847 np0000002687 nova-compute[98431]: Jun 11 23:15:19.385847 np0000002687 nova-compute[98431]: {{(pid=98431) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} Jun 11 23:15:19.410612 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:15:19.480772 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:15:19.489669 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-de917596-6da7-4867-88d0-9e80471c5217 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 2.693s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:15:19.718775 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-541c3c20-d2d5-43fe-a481-35b48f515040 tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] [instance: 010aa26e-fb15-47ee-a9b7-089dbfdfd1c7] Rebuilding instance Jun 11 23:15:19.901893 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-541c3c20-d2d5-43fe-a481-35b48f515040 tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] [instance: 010aa26e-fb15-47ee-a9b7-089dbfdfd1c7] Checking state {{(pid=98431) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 11 23:15:20.031674 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Received event ua-084b8049-147b-4db4-87aa-de243dbb50fb> from libvirt while the driver is waiting for it; dispatched. {{(pid=98431) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}} Jun 11 23:15:20.038217 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-0926df6b-3ea5-49ec-ae04-e77e7060bfd3 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-084b8049-147b-4db4-87aa-de243dbb50fb for instance ae596459-1e34-4a2a-9a33-69a02f50fd1c {{(pid=98431) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}} Jun 11 23:15:20.042269 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-0926df6b-3ea5-49ec-ae04-e77e7060bfd3 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Successfully detached device vdb from instance ae596459-1e34-4a2a-9a33-69a02f50fd1c from the live domain config. Jun 11 23:15:20.043930 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0926df6b-3ea5-49ec-ae04-e77e7060bfd3 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] [instance: ae596459-1e34-4a2a-9a33-69a02f50fd1c] calling os-brick to detach iSCSI Volume {{(pid=98431) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jun 11 23:15:20.044786 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-0926df6b-3ea5-49ec-ae04-e77e7060bfd3 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-084b8049-147b-4db4-87aa-de243dbb50fb', 'iqn.2023-03.storpool.com:os--volume-084b8049-147b-4db4-87aa-de243dbb50fb'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-084b8049-147b-4db4-87aa-de243dbb50fb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '084b8049-147b-4db4-87aa-de243dbb50fb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': False}}" {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 11 23:15:20.044786 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-0926df6b-3ea5-49ec-ae04-e77e7060bfd3 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 11 23:15:20.150090 np0000002687 nova-compute[98431]: INFO nova.scheduler.client.report [None req-de917596-6da7-4867-88d0-9e80471c5217 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Deleted allocation for migration 58e91fdb-feef-45c5-9524-61c903923259 Jun 11 23:15:20.654401 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-de917596-6da7-4867-88d0-9e80471c5217 tempest-AttachVolumeMultiAttachTest-1514006700 tempest-AttachVolumeMultiAttachTest-1514006700-project-member] Lock "8a45e04f-3516-4c39-bea1-820104411f17" "released" by "nova.compute.manager.ComputeManager.confirm_resize..do_confirm_resize" :: held 10.820s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:15:20.944157 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:15:20.945054 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:15:20.974733 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:15:20.979371 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:15:21.011499 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:15:21.097512 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-45ff2f84-23d6-444d-811b-4d57be7a22c4 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] No BDM found with device name vda, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:15:21.097681 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-45ff2f84-23d6-444d-811b-4d57be7a22c4 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:15:21.097810 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-45ff2f84-23d6-444d-811b-4d57be7a22c4 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] No BDM found with device name hda, not building metadata. {{(pid=98431) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13223}} Jun 11 23:15:21.098035 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-45ff2f84-23d6-444d-811b-4d57be7a22c4 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] No VIF found with MAC fa:16:3e:f6:b5:ae, not building metadata {{(pid=98431) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13199}} Jun 11 23:15:21.151731 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-2790aafa-e05a-4be5-93cf-9ebbd5218499 req-6b64acc7-ed2c-40a4-9ca0-82ade022b0d8 service nova] [instance: 010aa26e-fb15-47ee-a9b7-089dbfdfd1c7] Received event network-vif-unplugged-75b6f9f6-6287-4fd3-ae85-5f0145c9ecca {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:15:21.151731 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-2790aafa-e05a-4be5-93cf-9ebbd5218499 req-6b64acc7-ed2c-40a4-9ca0-82ade022b0d8 service nova] Acquiring lock "010aa26e-fb15-47ee-a9b7-089dbfdfd1c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:15:21.151731 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-2790aafa-e05a-4be5-93cf-9ebbd5218499 req-6b64acc7-ed2c-40a4-9ca0-82ade022b0d8 service nova] Lock "010aa26e-fb15-47ee-a9b7-089dbfdfd1c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:15:21.151941 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-2790aafa-e05a-4be5-93cf-9ebbd5218499 req-6b64acc7-ed2c-40a4-9ca0-82ade022b0d8 service nova] Lock "010aa26e-fb15-47ee-a9b7-089dbfdfd1c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:15:21.151941 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-2790aafa-e05a-4be5-93cf-9ebbd5218499 req-6b64acc7-ed2c-40a4-9ca0-82ade022b0d8 service nova] [instance: 010aa26e-fb15-47ee-a9b7-089dbfdfd1c7] No waiting events found dispatching network-vif-unplugged-75b6f9f6-6287-4fd3-ae85-5f0145c9ecca {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:15:21.152159 np0000002687 nova-compute[98431]: WARNING nova.compute.manager [req-2790aafa-e05a-4be5-93cf-9ebbd5218499 req-6b64acc7-ed2c-40a4-9ca0-82ade022b0d8 service nova] [instance: 010aa26e-fb15-47ee-a9b7-089dbfdfd1c7] Received unexpected event network-vif-unplugged-75b6f9f6-6287-4fd3-ae85-5f0145c9ecca for instance with vm_state active and task_state rebuilding. Jun 11 23:15:21.238228 np0000002687 nova-compute[98431]: DEBUG nova.utils [None req-cf82e4d9-c762-4965-abaa-6c7900ea78a9 None None] Queued Task(fn=>, remaining_delay=14.999694789999921 future=) {{(pid=98431) _log /opt/stack/nova/nova/utils.py:1508}} Jun 11 23:15:21.242338 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [-] [instance: 010aa26e-fb15-47ee-a9b7-089dbfdfd1c7] Instance destroyed successfully. Jun 11 23:15:21.251069 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [-] [instance: 010aa26e-fb15-47ee-a9b7-089dbfdfd1c7] Instance destroyed successfully. Jun 11 23:15:21.252226 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-541c3c20-d2d5-43fe-a481-35b48f515040 tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-11T23:14:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-873365265',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='tempest-serveractionsv293testjson-server-1471414698',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKdUGoO9cuTXJZHu2h25q6vrckGgOLiWeRbl1vP84Rc3f1lHWmXgff8p6BaYIh4+tSsnr7LRQTn7Zdhe47kpCDz5cfnYlNWR8SMBDDSyTc1K7cQyl9CNKh4PSTwXCJAaHw==',key_name='tempest-keypair-1991391740',keypairs=,launch_index=0,launched_at=2026-06-11T23:14:36Z,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0000002687',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='dbca65bf08474994b1c22f42047c7cbc',ramdisk_id='',reservation_id='r-wck7um1h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fb40a064-a524-4011-beb1-2c5fe9ded5a0',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-748885515',owner_user_name='tempest-ServerActionsV293TestJSON-748885515-project-member'},tags=,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2026-06-11T23:15:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6fa2c504358c4aa3bb219d75150b1bdf',uuid=010aa26e-fb15-47ee-a9b7-089dbfdfd1c7,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "75b6f9f6-6287-4fd3-ae85-5f0145c9ecca", "address": "fa:16:3e:03:1c:0a", "network": {"id": "05459848-a1d6-43f2-934a-5abedf048534", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-501623705-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dbca65bf08474994b1c22f42047c7cbc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap75b6f9f6-62", "ovs_interfaceid": "75b6f9f6-6287-4fd3-ae85-5f0145c9ecca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 11 23:15:21.252432 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-541c3c20-d2d5-43fe-a481-35b48f515040 tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] Converting VIF {"id": "75b6f9f6-6287-4fd3-ae85-5f0145c9ecca", "address": "fa:16:3e:03:1c:0a", "network": {"id": "05459848-a1d6-43f2-934a-5abedf048534", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-501623705-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dbca65bf08474994b1c22f42047c7cbc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap75b6f9f6-62", "ovs_interfaceid": "75b6f9f6-6287-4fd3-ae85-5f0145c9ecca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:15:21.253202 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-541c3c20-d2d5-43fe-a481-35b48f515040 tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:03:1c:0a,bridge_name='br-int',has_traffic_filtering=True,id=75b6f9f6-6287-4fd3-ae85-5f0145c9ecca,network=Network(05459848-a1d6-43f2-934a-5abedf048534),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75b6f9f6-62') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:15:21.253491 np0000002687 nova-compute[98431]: DEBUG os_vif [None req-541c3c20-d2d5-43fe-a481-35b48f515040 tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:1c:0a,bridge_name='br-int',has_traffic_filtering=True,id=75b6f9f6-6287-4fd3-ae85-5f0145c9ecca,network=Network(05459848-a1d6-43f2-934a-5abedf048534),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75b6f9f6-62') {{(pid=98431) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 11 23:15:21.258310 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:15:21.258310 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap75b6f9f6-62, bridge=br-int, if_exists=True) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:15:21.262499 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:15:21.264587 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:15:21.265550 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:15:21.265784 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f87dcfd9-9dee-4b8d-9a1f-a33c5a0433ef) {{(pid=98431) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 11 23:15:21.266294 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:15:21.267825 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 11 23:15:21.269926 np0000002687 nova-compute[98431]: INFO os_vif [None req-541c3c20-d2d5-43fe-a481-35b48f515040 tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:1c:0a,bridge_name='br-int',has_traffic_filtering=True,id=75b6f9f6-6287-4fd3-ae85-5f0145c9ecca,network=Network(05459848-a1d6-43f2-934a-5abedf048534),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75b6f9f6-62') Jun 11 23:15:21.271311 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.volume.iscsi [None req-541c3c20-d2d5-43fe-a481-35b48f515040 tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] [instance: 010aa26e-fb15-47ee-a9b7-089dbfdfd1c7] calling os-brick to detach iSCSI Volume {{(pid=98431) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jun 11 23:15:21.271591 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-541c3c20-d2d5-43fe-a481-35b48f515040 tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1', 'iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '97bc8780-33f3-43fc-8005-01d53ccb1cd1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': True}}" {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 11 23:15:21.271732 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-541c3c20-d2d5-43fe-a481-35b48f515040 tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 11 23:15:21.409178 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-135a2879-64ba-4b50-b614-ac58e735d3d4 req-73b71689-dbc3-459f-b674-d3b7a8ae6c27 service nova] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] Received event network-changed-283962f2-faaf-4d85-8eda-9b77b55a5b0c {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:15:21.409178 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-135a2879-64ba-4b50-b614-ac58e735d3d4 req-73b71689-dbc3-459f-b674-d3b7a8ae6c27 service nova] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] Refreshing instance network info cache due to event network-changed-283962f2-faaf-4d85-8eda-9b77b55a5b0c. {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 11 23:15:21.409178 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-135a2879-64ba-4b50-b614-ac58e735d3d4 req-73b71689-dbc3-459f-b674-d3b7a8ae6c27 service nova] Acquiring lock "refresh_cache-64d7833a-82e8-43e9-83ed-2507197b69bf" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 11 23:15:21.409178 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-135a2879-64ba-4b50-b614-ac58e735d3d4 req-73b71689-dbc3-459f-b674-d3b7a8ae6c27 service nova] Acquired lock "refresh_cache-64d7833a-82e8-43e9-83ed-2507197b69bf" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 11 23:15:21.409178 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-135a2879-64ba-4b50-b614-ac58e735d3d4 req-73b71689-dbc3-459f-b674-d3b7a8ae6c27 service nova] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] Refreshing network info cache for port 283962f2-faaf-4d85-8eda-9b77b55a5b0c {{(pid=98431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 11 23:15:21.915192 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [req-135a2879-64ba-4b50-b614-ac58e735d3d4 req-73b71689-dbc3-459f-b674-d3b7a8ae6c27 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:15:22.007180 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-0926df6b-3ea5-49ec-ae04-e77e7060bfd3 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.963s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 11 23:15:22.007741 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-0926df6b-3ea5-49ec-ae04-e77e7060bfd3 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-084b8049-147b-4db4-87aa-de243dbb50fb', 'iqn.2023-03.storpool.com:os--volume-084b8049-147b-4db4-87aa-de243dbb50fb'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-084b8049-147b-4db4-87aa-de243dbb50fb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '084b8049-147b-4db4-87aa-de243dbb50fb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 11 23:15:22.007986 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-0926df6b-3ea5-49ec-ae04-e77e7060bfd3 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-084b8049-147b-4db4-87aa-de243dbb50fb', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-084b8049-147b-4db4-87aa-de243dbb50fb', 0)] {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 11 23:15:22.045752 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-0926df6b-3ea5-49ec-ae04-e77e7060bfd3 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:15:22.045752 np0000002687 nova-compute[98431]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:15:22.045752 np0000002687 nova-compute[98431]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:15:22.045752 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:15:22.045752 np0000002687 nova-compute[98431]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1 (non-flash) Jun 11 23:15:22.045752 np0000002687 nova-compute[98431]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1 (non-flash) Jun 11 23:15:22.045752 np0000002687 nova-compute[98431]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-084b8049-147b-4db4-87aa-de243dbb50fb (non-flash) Jun 11 23:15:22.045752 np0000002687 nova-compute[98431]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-084b8049-147b-4db4-87aa-de243dbb50fb (non-flash) Jun 11 23:15:22.045752 np0000002687 nova-compute[98431]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a725cde0-4eec-48e6-a636-98bd40a9488b (non-flash) Jun 11 23:15:22.045752 np0000002687 nova-compute[98431]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1926104c-1d9a-4111-ab37-77c31acf8a06 (non-flash) Jun 11 23:15:22.045752 np0000002687 nova-compute[98431]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1926104c-1d9a-4111-ab37-77c31acf8a06 (non-flash) Jun 11 23:15:22.045752 np0000002687 nova-compute[98431]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b07fe085-0489-4090-bd59-9f31a72dc789 (non-flash) Jun 11 23:15:22.045752 np0000002687 nova-compute[98431]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b07fe085-0489-4090-bd59-9f31a72dc789 (non-flash) Jun 11 23:15:22.045752 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:15:22.046243 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-0926df6b-3ea5-49ec-ae04-e77e7060bfd3 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:15:22.046243 np0000002687 nova-compute[98431]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:15:22.046243 np0000002687 nova-compute[98431]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:15:22.046243 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:15:22.046243 np0000002687 nova-compute[98431]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1 (non-flash) Jun 11 23:15:22.046243 np0000002687 nova-compute[98431]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1 (non-flash) Jun 11 23:15:22.046243 np0000002687 nova-compute[98431]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-084b8049-147b-4db4-87aa-de243dbb50fb (non-flash) Jun 11 23:15:22.046243 np0000002687 nova-compute[98431]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-084b8049-147b-4db4-87aa-de243dbb50fb (non-flash) Jun 11 23:15:22.046243 np0000002687 nova-compute[98431]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a725cde0-4eec-48e6-a636-98bd40a9488b (non-flash) Jun 11 23:15:22.046243 np0000002687 nova-compute[98431]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1926104c-1d9a-4111-ab37-77c31acf8a06 (non-flash) Jun 11 23:15:22.046243 np0000002687 nova-compute[98431]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1926104c-1d9a-4111-ab37-77c31acf8a06 (non-flash) Jun 11 23:15:22.046243 np0000002687 nova-compute[98431]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b07fe085-0489-4090-bd59-9f31a72dc789 (non-flash) Jun 11 23:15:22.046243 np0000002687 nova-compute[98431]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b07fe085-0489-4090-bd59-9f31a72dc789 (non-flash) Jun 11 23:15:22.046243 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:15:22.046243 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-0926df6b-3ea5-49ec-ae04-e77e7060bfd3 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9', '3'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff', '31'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff', '32'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9', '4'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1', '43'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1', '44'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-084b8049-147b-4db4-87aa-de243dbb50fb', '48'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-084b8049-147b-4db4-87aa-de243dbb50fb', '49'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a725cde0-4eec-48e6-a636-98bd40a9488b', '50'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1926104c-1d9a-4111-ab37-77c31acf8a06', '51'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1926104c-1d9a-4111-ab37-77c31acf8a06', '52'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b07fe085-0489-4090-bd59-9f31a72dc789', '53'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b07fe085-0489-4090-bd59-9f31a72dc789', '54')] {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 11 23:15:22.046243 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-0926df6b-3ea5-49ec-ae04-e77e7060bfd3 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-084b8049-147b-4db4-87aa-de243dbb50fb, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-084b8049-147b-4db4-87aa-de243dbb50fb', '49')] {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 11 23:15:22.047721 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-0926df6b-3ea5-49ec-ae04-e77e7060bfd3 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-084b8049-147b-4db4-87aa-de243dbb50fb, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-084b8049-147b-4db4-87aa-de243dbb50fb', '48')] {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 11 23:15:22.049104 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-0926df6b-3ea5-49ec-ae04-e77e7060bfd3 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Resulting device map defaultdict(. at 0x7e1ea0290900>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-084b8049-147b-4db4-87aa-de243dbb50fb'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-084b8049-147b-4db4-87aa-de243dbb50fb'): ({'sdd'}, set())}) {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 11 23:15:22.049348 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-0926df6b-3ea5-49ec-ae04-e77e7060bfd3 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Removing multipathed devices sdd, sde {{(pid=98431) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 11 23:15:22.049779 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-0926df6b-3ea5-49ec-ae04-e77e7060bfd3 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Flush multipath device 330000000197fdab1 {{(pid=98431) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jun 11 23:15:22.093420 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-0926df6b-3ea5-49ec-ae04-e77e7060bfd3 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98431) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 11 23:15:22.140984 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-0926df6b-3ea5-49ec-ae04-e77e7060bfd3 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98431) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 11 23:15:22.190813 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-0926df6b-3ea5-49ec-ae04-e77e7060bfd3 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Checking to see if SCSI volumes sdd, sde have been removed. {{(pid=98431) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 11 23:15:22.190813 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-0926df6b-3ea5-49ec-ae04-e77e7060bfd3 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] SCSI volumes sdd, sde have been removed. {{(pid=98431) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 11 23:15:22.192551 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-0926df6b-3ea5-49ec-ae04-e77e7060bfd3 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Checking to see if device paths {'sdd', 'sde'} are still under multipathd monitoring {{(pid=98431) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 11 23:15:22.205446 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-0926df6b-3ea5-49ec-ae04-e77e7060bfd3 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Device paths {'sdd', 'sde'} have been removed from multipathd monitoring. {{(pid=98431) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 11 23:15:22.205621 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-0926df6b-3ea5-49ec-ae04-e77e7060bfd3 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-084b8049-147b-4db4-87aa-de243dbb50fb'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-084b8049-147b-4db4-87aa-de243dbb50fb')] {{(pid=98431) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 11 23:15:22.225472 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-0926df6b-3ea5-49ec-ae04-e77e7060bfd3 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:15:22.278767 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-0926df6b-3ea5-49ec-ae04-e77e7060bfd3 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2023-03.storpool.com:os--volume-084b8049-147b-4db4-87aa-de243dbb50fb, portal: 192.168.40.100,3260] Jun 11 23:15:22.278767 np0000002687 nova-compute[98431]: Logout of [sid: 49, target: iqn.2023-03.storpool.com:os--volume-084b8049-147b-4db4-87aa-de243dbb50fb, portal: 192.168.40.100,3260] successful. Jun 11 23:15:22.278767 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:15:22.303467 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-0926df6b-3ea5-49ec-ae04-e77e7060bfd3 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:15:22.324480 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-0926df6b-3ea5-49ec-ae04-e77e7060bfd3 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:15:22.329345 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [req-135a2879-64ba-4b50-b614-ac58e735d3d4 req-73b71689-dbc3-459f-b674-d3b7a8ae6c27 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:15:22.368748 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-0926df6b-3ea5-49ec-ae04-e77e7060bfd3 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2023-03.storpool.com:os--volume-084b8049-147b-4db4-87aa-de243dbb50fb, portal: 192.168.50.100,3260] Jun 11 23:15:22.368748 np0000002687 nova-compute[98431]: Logout of [sid: 48, target: iqn.2023-03.storpool.com:os--volume-084b8049-147b-4db4-87aa-de243dbb50fb, portal: 192.168.50.100,3260] successful. Jun 11 23:15:22.368748 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:15:22.401485 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-0926df6b-3ea5-49ec-ae04-e77e7060bfd3 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:15:22.402196 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-0926df6b-3ea5-49ec-ae04-e77e7060bfd3 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.395s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 11 23:15:22.402463 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-0926df6b-3ea5-49ec-ae04-e77e7060bfd3 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] <== disconnect_volume: return (2357ms) None {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 11 23:15:22.403731 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0926df6b-3ea5-49ec-ae04-e77e7060bfd3 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] [instance: ae596459-1e34-4a2a-9a33-69a02f50fd1c] Disconnected iSCSI Volume {{(pid=98431) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jun 11 23:15:22.403731 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-541c3c20-d2d5-43fe-a481-35b48f515040 tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.131s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 11 23:15:22.403731 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-541c3c20-d2d5-43fe-a481-35b48f515040 tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1', 'iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '97bc8780-33f3-43fc-8005-01d53ccb1cd1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 11 23:15:22.403731 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-541c3c20-d2d5-43fe-a481-35b48f515040 tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1', 0)] {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 11 23:15:22.463849 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-541c3c20-d2d5-43fe-a481-35b48f515040 tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:15:22.463849 np0000002687 nova-compute[98431]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:15:22.463849 np0000002687 nova-compute[98431]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:15:22.463849 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:15:22.463849 np0000002687 nova-compute[98431]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1 (non-flash) Jun 11 23:15:22.463849 np0000002687 nova-compute[98431]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1 (non-flash) Jun 11 23:15:22.463849 np0000002687 nova-compute[98431]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a725cde0-4eec-48e6-a636-98bd40a9488b (non-flash) Jun 11 23:15:22.463849 np0000002687 nova-compute[98431]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1926104c-1d9a-4111-ab37-77c31acf8a06 (non-flash) Jun 11 23:15:22.463849 np0000002687 nova-compute[98431]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1926104c-1d9a-4111-ab37-77c31acf8a06 (non-flash) Jun 11 23:15:22.463849 np0000002687 nova-compute[98431]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b07fe085-0489-4090-bd59-9f31a72dc789 (non-flash) Jun 11 23:15:22.463849 np0000002687 nova-compute[98431]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b07fe085-0489-4090-bd59-9f31a72dc789 (non-flash) Jun 11 23:15:22.463849 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:15:22.463849 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-541c3c20-d2d5-43fe-a481-35b48f515040 tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:15:22.463849 np0000002687 nova-compute[98431]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:15:22.463849 np0000002687 nova-compute[98431]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:15:22.463849 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:15:22.463849 np0000002687 nova-compute[98431]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1 (non-flash) Jun 11 23:15:22.463849 np0000002687 nova-compute[98431]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1 (non-flash) Jun 11 23:15:22.463849 np0000002687 nova-compute[98431]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a725cde0-4eec-48e6-a636-98bd40a9488b (non-flash) Jun 11 23:15:22.463849 np0000002687 nova-compute[98431]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1926104c-1d9a-4111-ab37-77c31acf8a06 (non-flash) Jun 11 23:15:22.463849 np0000002687 nova-compute[98431]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1926104c-1d9a-4111-ab37-77c31acf8a06 (non-flash) Jun 11 23:15:22.463849 np0000002687 nova-compute[98431]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b07fe085-0489-4090-bd59-9f31a72dc789 (non-flash) Jun 11 23:15:22.463849 np0000002687 nova-compute[98431]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b07fe085-0489-4090-bd59-9f31a72dc789 (non-flash) Jun 11 23:15:22.463849 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:15:22.467891 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-541c3c20-d2d5-43fe-a481-35b48f515040 tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9', '3'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff', '31'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff', '32'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9', '4'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1', '43'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1', '44'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a725cde0-4eec-48e6-a636-98bd40a9488b', '50'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1926104c-1d9a-4111-ab37-77c31acf8a06', '51'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1926104c-1d9a-4111-ab37-77c31acf8a06', '52'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b07fe085-0489-4090-bd59-9f31a72dc789', '53'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b07fe085-0489-4090-bd59-9f31a72dc789', '54')] {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 11 23:15:22.468257 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-541c3c20-d2d5-43fe-a481-35b48f515040 tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1', '44')] {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 11 23:15:22.470458 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-541c3c20-d2d5-43fe-a481-35b48f515040 tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1', '43')] {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 11 23:15:22.474467 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-541c3c20-d2d5-43fe-a481-35b48f515040 tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] Resulting device map defaultdict(. at 0x7e1ea047c9a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1'): ({'sdf'}, set())}) {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 11 23:15:22.474744 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-541c3c20-d2d5-43fe-a481-35b48f515040 tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] Removing multipathed devices sdf, sdg {{(pid=98431) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 11 23:15:22.475060 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-541c3c20-d2d5-43fe-a481-35b48f515040 tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] Flush multipath device 3300000008c957fc3 {{(pid=98431) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jun 11 23:15:22.542313 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-541c3c20-d2d5-43fe-a481-35b48f515040 tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98431) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 11 23:15:22.560852 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-135a2879-64ba-4b50-b614-ac58e735d3d4 req-73b71689-dbc3-459f-b674-d3b7a8ae6c27 service nova] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] Updated VIF entry in instance network info cache for port 283962f2-faaf-4d85-8eda-9b77b55a5b0c. {{(pid=98431) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 11 23:15:22.564667 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-135a2879-64ba-4b50-b614-ac58e735d3d4 req-73b71689-dbc3-459f-b674-d3b7a8ae6c27 service nova] [instance: 64d7833a-82e8-43e9-83ed-2507197b69bf] Updating instance_info_cache with network_info: [{"id": "283962f2-faaf-4d85-8eda-9b77b55a5b0c", "address": "fa:16:3e:4b:26:95", "network": {"id": "17593db3-c22d-4354-ab29-933b1c6a5c3a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1094286565-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "81fd45f475a04e5c8e9bd9deb7ad4c1e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap283962f2-fa", "ovs_interfaceid": "283962f2-faaf-4d85-8eda-9b77b55a5b0c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:15:22.585751 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-541c3c20-d2d5-43fe-a481-35b48f515040 tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98431) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 11 23:15:22.644934 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-541c3c20-d2d5-43fe-a481-35b48f515040 tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98431) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 11 23:15:22.647392 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-541c3c20-d2d5-43fe-a481-35b48f515040 tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98431) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 11 23:15:22.649204 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-541c3c20-d2d5-43fe-a481-35b48f515040 tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98431) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 11 23:15:22.666551 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.linuxscsi [None req-541c3c20-d2d5-43fe-a481-35b48f515040 tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98431) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 11 23:15:22.666551 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-541c3c20-d2d5-43fe-a481-35b48f515040 tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1')] {{(pid=98431) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 11 23:15:22.681519 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-541c3c20-d2d5-43fe-a481-35b48f515040 tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:15:22.682897 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-45ff2f84-23d6-444d-811b-4d57be7a22c4 tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Lock "c9271160-14ef-4a59-8ac8-89efbe36c607" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 7.588s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:15:22.715075 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-541c3c20-d2d5-43fe-a481-35b48f515040 tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1, portal: 192.168.40.100,3260] Jun 11 23:15:22.715075 np0000002687 nova-compute[98431]: Logout of [sid: 44, target: iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1, portal: 192.168.40.100,3260] successful. Jun 11 23:15:22.715075 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:15:22.741234 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-541c3c20-d2d5-43fe-a481-35b48f515040 tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:15:22.756065 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-541c3c20-d2d5-43fe-a481-35b48f515040 tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:15:22.797828 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-541c3c20-d2d5-43fe-a481-35b48f515040 tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1, portal: 192.168.50.100,3260] Jun 11 23:15:22.797828 np0000002687 nova-compute[98431]: Logout of [sid: 43, target: iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1, portal: 192.168.50.100,3260] successful. Jun 11 23:15:22.797828 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:15:22.821531 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-541c3c20-d2d5-43fe-a481-35b48f515040 tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98431) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 11 23:15:22.821531 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-541c3c20-d2d5-43fe-a481-35b48f515040 tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.418s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 11 23:15:22.821531 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-541c3c20-d2d5-43fe-a481-35b48f515040 tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] <== disconnect_volume: return (1549ms) None {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 11 23:15:22.821531 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.volume.iscsi [None req-541c3c20-d2d5-43fe-a481-35b48f515040 tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] [instance: 010aa26e-fb15-47ee-a9b7-089dbfdfd1c7] Disconnected iSCSI Volume {{(pid=98431) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jun 11 23:15:22.821531 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-541c3c20-d2d5-43fe-a481-35b48f515040 tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] [instance: 010aa26e-fb15-47ee-a9b7-089dbfdfd1c7] Deleting instance files /opt/stack/data/nova/instances/010aa26e-fb15-47ee-a9b7-089dbfdfd1c7_del Jun 11 23:15:22.825319 np0000002687 nova-compute[98431]: INFO nova.virt.libvirt.driver [None req-541c3c20-d2d5-43fe-a481-35b48f515040 tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] [instance: 010aa26e-fb15-47ee-a9b7-089dbfdfd1c7] Deletion of /opt/stack/data/nova/instances/010aa26e-fb15-47ee-a9b7-089dbfdfd1c7_del complete Jun 11 23:15:22.992897 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-0926df6b-3ea5-49ec-ae04-e77e7060bfd3 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Lazy-loading 'flavor' on Instance uuid ae596459-1e34-4a2a-9a33-69a02f50fd1c {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:15:23.066979 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-135a2879-64ba-4b50-b614-ac58e735d3d4 req-73b71689-dbc3-459f-b674-d3b7a8ae6c27 service nova] Releasing lock "refresh_cache-64d7833a-82e8-43e9-83ed-2507197b69bf" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 11 23:15:23.104871 np0000002687 nova-compute[98431]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98431) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 11 23:15:23.117303 np0000002687 nova-compute[98431]: INFO nova.compute.manager [None req-2f60724f-a0b4-4030-be51-e66c6b34ea3e tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: c9271160-14ef-4a59-8ac8-89efbe36c607] Rescuing Jun 11 23:15:23.117474 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-2f60724f-a0b4-4030-be51-e66c6b34ea3e tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Acquiring lock "refresh_cache-c9271160-14ef-4a59-8ac8-89efbe36c607" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 11 23:15:23.117534 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-2f60724f-a0b4-4030-be51-e66c6b34ea3e tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Acquired lock "refresh_cache-c9271160-14ef-4a59-8ac8-89efbe36c607" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 11 23:15:23.117672 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-2f60724f-a0b4-4030-be51-e66c6b34ea3e tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: c9271160-14ef-4a59-8ac8-89efbe36c607] Building network info cache for instance {{(pid=98431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 11 23:15:23.218001 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-ca3dc557-1da9-4e23-8ed3-0caeef0ef030 req-b23f96ec-abd9-4a88-9b94-f28415d37f33 service nova] [instance: 010aa26e-fb15-47ee-a9b7-089dbfdfd1c7] Received event network-vif-unplugged-75b6f9f6-6287-4fd3-ae85-5f0145c9ecca {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:15:23.218224 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-ca3dc557-1da9-4e23-8ed3-0caeef0ef030 req-b23f96ec-abd9-4a88-9b94-f28415d37f33 service nova] Acquiring lock "010aa26e-fb15-47ee-a9b7-089dbfdfd1c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:15:23.218394 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-ca3dc557-1da9-4e23-8ed3-0caeef0ef030 req-b23f96ec-abd9-4a88-9b94-f28415d37f33 service nova] Lock "010aa26e-fb15-47ee-a9b7-089dbfdfd1c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:15:23.218492 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-ca3dc557-1da9-4e23-8ed3-0caeef0ef030 req-b23f96ec-abd9-4a88-9b94-f28415d37f33 service nova] Lock "010aa26e-fb15-47ee-a9b7-089dbfdfd1c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:15:23.218669 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-ca3dc557-1da9-4e23-8ed3-0caeef0ef030 req-b23f96ec-abd9-4a88-9b94-f28415d37f33 service nova] [instance: 010aa26e-fb15-47ee-a9b7-089dbfdfd1c7] No waiting events found dispatching network-vif-unplugged-75b6f9f6-6287-4fd3-ae85-5f0145c9ecca {{(pid=98431) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 11 23:15:23.218777 np0000002687 nova-compute[98431]: WARNING nova.compute.manager [req-ca3dc557-1da9-4e23-8ed3-0caeef0ef030 req-b23f96ec-abd9-4a88-9b94-f28415d37f33 service nova] [instance: 010aa26e-fb15-47ee-a9b7-089dbfdfd1c7] Received unexpected event network-vif-unplugged-75b6f9f6-6287-4fd3-ae85-5f0145c9ecca for instance with vm_state active and task_state rebuilding. Jun 11 23:15:23.409958 np0000002687 nova-compute[98431]: WARNING nova.virt.libvirt.driver [None req-541c3c20-d2d5-43fe-a481-35b48f515040 tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] [instance: 010aa26e-fb15-47ee-a9b7-089dbfdfd1c7] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 010aa26e-fb15-47ee-a9b7-089dbfdfd1c7 could not be found. Jun 11 23:15:23.410953 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.volume.iscsi [None req-541c3c20-d2d5-43fe-a481-35b48f515040 tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] [instance: 010aa26e-fb15-47ee-a9b7-089dbfdfd1c7] calling os-brick to detach iSCSI Volume {{(pid=98431) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jun 11 23:15:23.412250 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-541c3c20-d2d5-43fe-a481-35b48f515040 tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1', 'iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '97bc8780-33f3-43fc-8005-01d53ccb1cd1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': False}}" {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 11 23:15:23.412250 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-541c3c20-d2d5-43fe-a481-35b48f515040 tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 11 23:15:23.412250 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-541c3c20-d2d5-43fe-a481-35b48f515040 tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 11 23:15:23.412250 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-541c3c20-d2d5-43fe-a481-35b48f515040 tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1', 'iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '97bc8780-33f3-43fc-8005-01d53ccb1cd1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 11 23:15:23.412250 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-541c3c20-d2d5-43fe-a481-35b48f515040 tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1', 0)] {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 11 23:15:23.450218 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-541c3c20-d2d5-43fe-a481-35b48f515040 tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:15:23.450218 np0000002687 nova-compute[98431]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:15:23.450218 np0000002687 nova-compute[98431]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:15:23.450218 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:15:23.450218 np0000002687 nova-compute[98431]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a725cde0-4eec-48e6-a636-98bd40a9488b (non-flash) Jun 11 23:15:23.450218 np0000002687 nova-compute[98431]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1926104c-1d9a-4111-ab37-77c31acf8a06 (non-flash) Jun 11 23:15:23.450218 np0000002687 nova-compute[98431]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1926104c-1d9a-4111-ab37-77c31acf8a06 (non-flash) Jun 11 23:15:23.450218 np0000002687 nova-compute[98431]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b07fe085-0489-4090-bd59-9f31a72dc789 (non-flash) Jun 11 23:15:23.450218 np0000002687 nova-compute[98431]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b07fe085-0489-4090-bd59-9f31a72dc789 (non-flash) Jun 11 23:15:23.450218 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 11 23:15:23.450499 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-541c3c20-d2d5-43fe-a481-35b48f515040 tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:15:23.450499 np0000002687 nova-compute[98431]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:15:23.450499 np0000002687 nova-compute[98431]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff (non-flash) Jun 11 23:15:23.450499 np0000002687 nova-compute[98431]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9 (non-flash) Jun 11 23:15:23.450499 np0000002687 nova-compute[98431]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a725cde0-4eec-48e6-a636-98bd40a9488b (non-flash) Jun 11 23:15:23.450499 np0000002687 nova-compute[98431]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1926104c-1d9a-4111-ab37-77c31acf8a06 (non-flash) Jun 11 23:15:23.450499 np0000002687 nova-compute[98431]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1926104c-1d9a-4111-ab37-77c31acf8a06 (non-flash) Jun 11 23:15:23.450499 np0000002687 nova-compute[98431]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b07fe085-0489-4090-bd59-9f31a72dc789 (non-flash) Jun 11 23:15:23.450499 np0000002687 nova-compute[98431]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b07fe085-0489-4090-bd59-9f31a72dc789 (non-flash) Jun 11 23:15:23.450499 np0000002687 nova-compute[98431]: stderr= {{(pid=98431) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 11 23:15:23.450499 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-541c3c20-d2d5-43fe-a481-35b48f515040 tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9', '3'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff', '31'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f535b91b-3bff-46ad-905e-644bd012b9ff', '32'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-51510c5e-80aa-4db3-9246-3becbd15cde9', '4'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a725cde0-4eec-48e6-a636-98bd40a9488b', '50'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1926104c-1d9a-4111-ab37-77c31acf8a06', '51'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1926104c-1d9a-4111-ab37-77c31acf8a06', '52'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b07fe085-0489-4090-bd59-9f31a72dc789', '53'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b07fe085-0489-4090-bd59-9f31a72dc789', '54')] {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 11 23:15:23.450746 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-541c3c20-d2d5-43fe-a481-35b48f515040 tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1, 0): [] {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 11 23:15:23.451166 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-541c3c20-d2d5-43fe-a481-35b48f515040 tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] No session or node found for (ip, iqn)=('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1') {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}} Jun 11 23:15:23.451259 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-541c3c20-d2d5-43fe-a481-35b48f515040 tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1, 0): [] {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 11 23:15:23.451352 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-541c3c20-d2d5-43fe-a481-35b48f515040 tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] No session or node found for (ip, iqn)=('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-97bc8780-33f3-43fc-8005-01d53ccb1cd1') {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}} Jun 11 23:15:23.451474 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-541c3c20-d2d5-43fe-a481-35b48f515040 tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] Resulting device map defaultdict(. at 0x7e1e947036a0>, {}) {{(pid=98431) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 11 23:15:23.451598 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-541c3c20-d2d5-43fe-a481-35b48f515040 tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] Disconnecting from: [] {{(pid=98431) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 11 23:15:23.451786 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.base [None req-541c3c20-d2d5-43fe-a481-35b48f515040 tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.040s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 11 23:15:23.451990 np0000002687 nova-compute[98431]: DEBUG os_brick.initiator.connectors.iscsi [None req-541c3c20-d2d5-43fe-a481-35b48f515040 tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] <== disconnect_volume: return (40ms) None {{(pid=98431) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 11 23:15:23.452119 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.volume.iscsi [None req-541c3c20-d2d5-43fe-a481-35b48f515040 tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] [instance: 010aa26e-fb15-47ee-a9b7-089dbfdfd1c7] Disconnected iSCSI Volume {{(pid=98431) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jun 11 23:15:23.484365 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-749583c0-fe57-4d1a-9999-d5bc04e5964d req-e6593954-4252-41ad-80cf-366d6b73b314 service nova] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] Received event network-changed-3c04202e-5ce6-4249-ba31-be06996ca75d {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 11 23:15:23.487187 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [req-749583c0-fe57-4d1a-9999-d5bc04e5964d req-e6593954-4252-41ad-80cf-366d6b73b314 service nova] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] Refreshing instance network info cache due to event network-changed-3c04202e-5ce6-4249-ba31-be06996ca75d. {{(pid=98431) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 11 23:15:23.487187 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-749583c0-fe57-4d1a-9999-d5bc04e5964d req-e6593954-4252-41ad-80cf-366d6b73b314 service nova] Acquiring lock "refresh_cache-8a45e04f-3516-4c39-bea1-820104411f17" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 11 23:15:23.487187 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [req-749583c0-fe57-4d1a-9999-d5bc04e5964d req-e6593954-4252-41ad-80cf-366d6b73b314 service nova] Acquired lock "refresh_cache-8a45e04f-3516-4c39-bea1-820104411f17" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 11 23:15:23.487187 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-749583c0-fe57-4d1a-9999-d5bc04e5964d req-e6593954-4252-41ad-80cf-366d6b73b314 service nova] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] Refreshing network info cache for port 3c04202e-5ce6-4249-ba31-be06996ca75d {{(pid=98431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 11 23:15:23.619537 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-2f60724f-a0b4-4030-be51-e66c6b34ea3e tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:15:23.988893 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [req-749583c0-fe57-4d1a-9999-d5bc04e5964d req-e6593954-4252-41ad-80cf-366d6b73b314 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:15:24.023386 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [None req-2f60724f-a0b4-4030-be51-e66c6b34ea3e tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:15:24.095114 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-87fa1ed2-cf13-40ad-8bf6-728f8273c1a2 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Acquiring lock "interface-ae596459-1e34-4a2a-9a33-69a02f50fd1c-3bee781d-e603-4cbb-9d42-63fb3e55dcd6" by "nova.compute.manager.ComputeManager.detach_interface..do_detach_interface" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:15:24.095298 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-87fa1ed2-cf13-40ad-8bf6-728f8273c1a2 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Lock "interface-ae596459-1e34-4a2a-9a33-69a02f50fd1c-3bee781d-e603-4cbb-9d42-63fb3e55dcd6" acquired by "nova.compute.manager.ComputeManager.detach_interface..do_detach_interface" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:15:24.260472 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [None req-2f60724f-a0b4-4030-be51-e66c6b34ea3e tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] [instance: c9271160-14ef-4a59-8ac8-89efbe36c607] Updating instance_info_cache with network_info: [{"id": "189a71e3-b1fd-4769-a6a6-4a9be0352962", "address": "fa:16:3e:f6:b5:ae", "network": {"id": "77fc4e10-1fed-4963-86b4-1fbb3a9c6f7f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1105404274-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b2b9f55b231c455ca1a4579d7ed54888", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap189a71e3-b1", "ovs_interfaceid": "189a71e3-b1fd-4769-a6a6-4a9be0352962", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:15:24.495572 np0000002687 nova-compute[98431]: WARNING neutronclient.v2_0.client [req-749583c0-fe57-4d1a-9999-d5bc04e5964d req-e6593954-4252-41ad-80cf-366d6b73b314 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 11 23:15:24.509561 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-0926df6b-3ea5-49ec-ae04-e77e7060bfd3 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Lock "ae596459-1e34-4a2a-9a33-69a02f50fd1c" "released" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: held 5.751s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:15:24.602970 np0000002687 nova-compute[98431]: DEBUG nova.objects.instance [None req-87fa1ed2-cf13-40ad-8bf6-728f8273c1a2 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Lazy-loading 'flavor' on Instance uuid ae596459-1e34-4a2a-9a33-69a02f50fd1c {{(pid=98431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 11 23:15:24.715455 np0000002687 nova-compute[98431]: DEBUG nova.compute.manager [None req-541c3c20-d2d5-43fe-a481-35b48f515040 tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] [instance: 010aa26e-fb15-47ee-a9b7-089dbfdfd1c7] Preparing to wait for external event volume-reimaged-97bc8780-33f3-43fc-8005-01d53ccb1cd1 {{(pid=98431) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 11 23:15:24.715655 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-541c3c20-d2d5-43fe-a481-35b48f515040 tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] Acquiring lock "010aa26e-fb15-47ee-a9b7-089dbfdfd1c7-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 11 23:15:24.715757 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-541c3c20-d2d5-43fe-a481-35b48f515040 tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] Lock "010aa26e-fb15-47ee-a9b7-089dbfdfd1c7-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 11 23:15:24.715925 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-541c3c20-d2d5-43fe-a481-35b48f515040 tempest-ServerActionsV293TestJSON-748885515 tempest-ServerActionsV293TestJSON-748885515-project-member] Lock "010aa26e-fb15-47ee-a9b7-089dbfdfd1c7-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 11 23:15:24.753826 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-749583c0-fe57-4d1a-9999-d5bc04e5964d req-e6593954-4252-41ad-80cf-366d6b73b314 service nova] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] Updated VIF entry in instance network info cache for port 3c04202e-5ce6-4249-ba31-be06996ca75d. {{(pid=98431) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 11 23:15:24.753826 np0000002687 nova-compute[98431]: DEBUG nova.network.neutron [req-749583c0-fe57-4d1a-9999-d5bc04e5964d req-e6593954-4252-41ad-80cf-366d6b73b314 service nova] [instance: 8a45e04f-3516-4c39-bea1-820104411f17] Updating instance_info_cache with network_info: [{"id": "3c04202e-5ce6-4249-ba31-be06996ca75d", "address": "fa:16:3e:6f:42:42", "network": {"id": "17593db3-c22d-4354-ab29-933b1c6a5c3a", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1094286565-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "81fd45f475a04e5c8e9bd9deb7ad4c1e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c04202e-5c", "ovs_interfaceid": "3c04202e-5ce6-4249-ba31-be06996ca75d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 11 23:15:24.768859 np0000002687 nova-compute[98431]: DEBUG oslo_concurrency.lockutils [None req-2f60724f-a0b4-4030-be51-e66c6b34ea3e tempest-ServerRescueNegativeTestJSON-2027875711 tempest-ServerRescueNegativeTestJSON-2027875711-project-member] Releasing lock "refresh_cache-c9271160-14ef-4a59-8ac8-89efbe36c607" {{(pid=98431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 11 23:15:25.110250 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.vif [None req-87fa1ed2-cf13-40ad-8bf6-728f8273c1a2 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-11T23:14:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1094546666',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002687',hostname='tempest-device-tagging-server-1094546666',id=22,image_ref='f30640f8-7aca-4300-a085-4706a5209a79',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBL2B+Qi+I3pgfpGsUuP1N6pjhXiP01lrt0dza1VGJ8kct4NaxOPSJEfUBZOLcAcvGFp3NUiLtr1bJ6t1i7htNBE4tCeF5rEUWrutMgZ/N9MVsridCRaWUxTp0gQnqFN3A==',key_name='tempest-keypair-1726377568',keypairs=,launch_index=0,launched_at=2026-06-11T23:14:17Z,launched_on='np0000002687',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000002687',numa_topology=,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='03be033a975c41efba46c4d480df190f',ramdisk_id='',reservation_id='r-irju1qds',resources=,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f30640f8-7aca-4300-a085-4706a5209a79',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1378608456',owner_user_name='tempest-TaggedAttachmentsTest-1378608456-project-member'},tags=,task_state=None,terminated_at=None,trusted_certs=,updated_at=2026-06-11T23:14:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='56116a7118a54aa6b259414512446b40',uuid=ae596459-1e34-4a2a-9a33-69a02f50fd1c,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3bee781d-e603-4cbb-9d42-63fb3e55dcd6", "address": "fa:16:3e:ae:c2:83", "network": {"id": "18029db1-b49f-4422-8aa6-a6432a3c4135", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1440361664", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.94", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "03be033a975c41efba46c4d480df190f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bee781d-e6", "ovs_interfaceid": "3bee781d-e603-4cbb-9d42-63fb3e55dcd6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98431) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 11 23:15:25.110789 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-87fa1ed2-cf13-40ad-8bf6-728f8273c1a2 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Converting VIF {"id": "3bee781d-e603-4cbb-9d42-63fb3e55dcd6", "address": "fa:16:3e:ae:c2:83", "network": {"id": "18029db1-b49f-4422-8aa6-a6432a3c4135", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1440361664", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.94", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "03be033a975c41efba46c4d480df190f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bee781d-e6", "ovs_interfaceid": "3bee781d-e603-4cbb-9d42-63fb3e55dcd6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 11 23:15:25.111563 np0000002687 nova-compute[98431]: DEBUG nova.network.os_vif_util [None req-87fa1ed2-cf13-40ad-8bf6-728f8273c1a2 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ae:c2:83,bridge_name='br-int',has_traffic_filtering=True,id=3bee781d-e603-4cbb-9d42-63fb3e55dcd6,network=Network(18029db1-b49f-4422-8aa6-a6432a3c4135),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bee781d-e6') {{(pid=98431) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 11 23:15:25.113707 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.guest [None req-87fa1ed2-cf13-40ad-8bf6-728f8273c1a2 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] looking for interface given config: {{(pid=98431) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}} Jun 11 23:15:25.115328 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.guest [None req-87fa1ed2-cf13-40ad-8bf6-728f8273c1a2 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] looking for interface given config: {{(pid=98431) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}} Jun 11 23:15:25.116980 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.driver [None req-87fa1ed2-cf13-40ad-8bf6-728f8273c1a2 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] Attempting to detach device tap3bee781d-e6 from instance ae596459-1e34-4a2a-9a33-69a02f50fd1c from the persistent domain config. {{(pid=98431) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}} Jun 11 23:15:25.117080 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.guest [None req-87fa1ed2-cf13-40ad-8bf6-728f8273c1a2 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] detach device xml: Jun 11 23:15:25.117080 np0000002687 nova-compute[98431]: Jun 11 23:15:25.117080 np0000002687 nova-compute[98431]: Jun 11 23:15:25.117080 np0000002687 nova-compute[98431]: Jun 11 23:15:25.117080 np0000002687 nova-compute[98431]: Jun 11 23:15:25.117080 np0000002687 nova-compute[98431]: Jun 11 23:15:25.117080 np0000002687 nova-compute[98431]: Jun 11 23:15:25.117080 np0000002687 nova-compute[98431]: {{(pid=98431) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jun 11 23:15:25.124032 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.guest [None req-87fa1ed2-cf13-40ad-8bf6-728f8273c1a2 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] looking for interface given config: {{(pid=98431) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}} Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: DEBUG nova.virt.libvirt.guest [None req-87fa1ed2-cf13-40ad-8bf6-728f8273c1a2 tempest-TaggedAttachmentsTest-1378608456 tempest-TaggedAttachmentsTest-1378608456-project-member] interface for config: not found in domain: Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: instance-00000016 Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: ae596459-1e34-4a2a-9a33-69a02f50fd1c Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: tempest-device-tagging-server-1094546666 Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: 2026-06-11 23:15:05 Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: 192 Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: 1 Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: 0 Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: 0 Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: 1 Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: True Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: bare Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: qcow2 Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: 1 Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: 0 Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: ide Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: virtio Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: pc Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: virtio Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: virtio Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: virtio Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: tempest-TaggedAttachmentsTest-1378608456-project-member Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: tempest-TaggedAttachmentsTest-1378608456 Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: 196608 Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: 196608 Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: 1 Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: 1 Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: /machine Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: OpenStack Foundation Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: OpenStack Nova Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: 33.1.0 Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: ae596459-1e34-4a2a-9a33-69a02f50fd1c Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: ae596459-1e34-4a2a-9a33-69a02f50fd1c Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: Virtual Machine Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: hvm Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: 131072 Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: Nehalem Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: destroy Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: restart Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: destroy Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: /usr/bin/qemu-system-x86_64 Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]:
Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]:
Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]:
Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]:
Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]:
Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: Jun 11 23:15:25.129820 np0000002687 nova-compute[98431]: